From report at bugs.python.org  Fri Jan  1 00:16:27 2021
From: report at bugs.python.org (Steven D'Aprano)
Date: Fri, 01 Jan 2021 05:16:27 +0000
Subject: [issue42801] Exception catching function crashes on recursive list
Message-ID: <1609478187.83.0.886724654093.issue42801@roundup.psfhosted.org>


New submission from Steven D'Aprano <steve+python at pearwood.info>:

This function crashes on the following recursive list:


def length(x):
    try:
        return sum(length(i) for i in x)
    except Exception:
        return 1


a = [[1, 2, 3], [4, 5, 6]]
a.append(a)
length(a)


Crashes:


Fatal Python error: _Py_CheckRecursiveCall: Cannot recover from stack overflow.
Python runtime state: initialized

Current thread 0x00007eff18d77740 (most recent call first):
  File "<stdin>", line 3 in length
  File "<stdin>", line 3 in <genexpr>
  File "<stdin>", line 3 in length
  File "<stdin>", line 3 in <genexpr>
  ...
Aborted (core dumped)




For brevity I've cut some of the output. There are about fifty pairs of "line 3 in length"/line 3 in <genexpr>" lines, all identical.

----------
components: Interpreter Core
messages: 384150
nosy: steven.daprano
priority: normal
severity: normal
status: open
title: Exception catching function crashes on recursive list
type: crash
versions: Python 3.7, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42801>
_______________________________________

From report at bugs.python.org  Fri Jan  1 01:23:58 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 01 Jan 2021 06:23:58 +0000
Subject: [issue42756] smtplib.LMTP.connect() raises TypeError if `timeout` is
 not specified
In-Reply-To: <1609074713.39.0.771360640486.issue42756@roundup.psfhosted.org>
Message-ID: <1609482238.96.0.776699906154.issue42756@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na at python.org>:


----------
nosy: +corona10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42756>
_______________________________________

From report at bugs.python.org  Fri Jan  1 01:26:51 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 01 Jan 2021 06:26:51 +0000
Subject: [issue42756] smtplib.LMTP.connect() raises TypeError if `timeout` is
 not specified
In-Reply-To: <1609074713.39.0.771360640486.issue42756@roundup.psfhosted.org>
Message-ID: <1609482411.71.0.589936782924.issue42756@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na at python.org>:


----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42756>
_______________________________________

From report at bugs.python.org  Fri Jan  1 01:35:59 2021
From: report at bugs.python.org (mattip)
Date: Fri, 01 Jan 2021 06:35:59 +0000
Subject: [issue42752] multiprocessing Queue leaks a file descriptor associated
 with the pipe writer (#33081 still a problem)
In-Reply-To: <1609023821.09.0.189504509221.issue42752@roundup.psfhosted.org>
Message-ID: <1609482959.01.0.808915030002.issue42752@roundup.psfhosted.org>


mattip <matti.picus at gmail.com> added the comment:

Just to be clear, here is the code from the test (how do you format a code block here?) that demonstrates the writer is not closed when nothing is put into the queue

```
$ python3
Python 3.8.6 | packaged by conda-forge | (default, Oct  7 2020, 19:08:05) 
[GCC 7.5.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import multiprocessing
>>> q = multiprocessing.Queue()
>>> q.close()
>>> q.join_thread()
>>> q._reader.closed
True
>>> q._writer.closed
False
>>> 

```
And the changed behaviour to close the writer if the queue is used

```
>>> q = multiprocessing.Queue()
>>> q.put(1)
>>> q.get()
1
>>> q.close()
>>> q.join_thread()
>>> q._reader.closed
True
>>> q._writer.closed
True

```

----------
nosy: +mattip

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42752>
_______________________________________

From report at bugs.python.org  Fri Jan  1 01:38:21 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 01 Jan 2021 06:38:21 +0000
Subject: [issue42756] smtplib.LMTP.connect() raises TypeError if `timeout` is
 not specified
In-Reply-To: <1609074713.39.0.771360640486.issue42756@roundup.psfhosted.org>
Message-ID: <1609483101.71.0.491666030651.issue42756@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

This

----------
versions: +Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42756>
_______________________________________

From report at bugs.python.org  Fri Jan  1 01:38:38 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 01 Jan 2021 06:38:38 +0000
Subject: [issue42756] smtplib.LMTP.connect() raises TypeError if `timeout` is
 not specified
In-Reply-To: <1609074713.39.0.771360640486.issue42756@roundup.psfhosted.org>
Message-ID: <1609483118.73.0.118964496937.issue42756@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

This is a regression bug that should be fixed.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42756>
_______________________________________

From report at bugs.python.org  Fri Jan  1 01:38:58 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 01 Jan 2021 06:38:58 +0000
Subject: [issue42756] smtplib.LMTP.connect() raises TypeError if `timeout` is
 not specified
In-Reply-To: <1609074713.39.0.771360640486.issue42756@roundup.psfhosted.org>
Message-ID: <1609483138.35.0.734338762132.issue42756@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na at python.org>:


----------
type: crash -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42756>
_______________________________________

From report at bugs.python.org  Fri Jan  1 02:49:53 2021
From: report at bugs.python.org (hai shi)
Date: Fri, 01 Jan 2021 07:49:53 +0000
Subject: [issue30963] xxlimited.c XxoObject_Check should be
 XxoObject_CheckExact
In-Reply-To: <1500412678.84.0.816991478409.issue30963@psf.upfronthosting.co.za>
Message-ID: <1609487393.39.0.260135918702.issue30963@roundup.psfhosted.org>


hai shi <shihai1991 at 126.com> added the comment:

>The Check code is now commented out, and the issue of type checking is mentioned in PEP 630.

Got it, thanks for your supplement :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30963>
_______________________________________

From report at bugs.python.org  Fri Jan  1 03:36:12 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 01 Jan 2021 08:36:12 +0000
Subject: [issue42794] test_nntplib fails on CI
In-Reply-To: <1609407398.52.0.195663540983.issue42794@roundup.psfhosted.org>
Message-ID: <1609490172.93.0.358190877962.issue42794@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na at python.org>:


----------
nosy: +corona10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42794>
_______________________________________

From report at bugs.python.org  Fri Jan  1 03:46:06 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 01 Jan 2021 08:46:06 +0000
Subject: [issue42794] test_nntplib fails on CI
In-Reply-To: <1609407398.52.0.195663540983.issue42794@roundup.psfhosted.org>
Message-ID: <1609490766.26.0.566040187237.issue42794@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

== CPython 3.10.0a3+ (heads/master:c8a7b8fa1b, Jan 1 2021, 08:28:41) [GCC 7.5.0]
== Linux-5.4.0-1031-azure-x86_64-with-glibc2.27 little-endian
== cwd: /home/corona10/cpython/build/test_python_66899?
== CPU count: 2
== encodings: locale=UTF-8, FS=utf-8
0:00:00 load avg: 0.00 Run tests sequentially
0:00:00 load avg: 0.00 [1/1] test_nntplib
test_descriptions (test.test_nntplib.NNTPv1Tests) ... ok
test_descriptions (test.test_nntplib.NNTPv2Tests) ... ok
test_descriptions (test.test_nntplib.NetworkedNNTPTests) ... ok
test_descriptions (test.test_nntplib.NetworkedNNTP_SSLTests) ... ERROR

======================================================================
ERROR: test_descriptions (test.test_nntplib.NetworkedNNTP_SSLTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/corona10/cpython/Lib/test/test_nntplib.py", line 250, in wrapped
    meth(self)
  File "/home/corona10/cpython/Lib/test/test_nntplib.py", line 99, in test_descriptions
    desc = descs[self.GROUP_NAME]
KeyError: 'comp.lang.python'

----------------------------------------------------------------------

Ran 4 tests in 4.734s

FAILED (errors=1)
test test_nntplib failed
test_nntplib failed

== Tests result: FAILURE ==

1 test failed:
    test_nntplib

Total duration: 4.8 sec
Tests result: FAILURE


My test machine success to reproduce this issue.

(Pdb) descs
{}

There might be 4 ways to solve this issue.

1. Re-create group and skip test while descs is empty
2. Update test to use other NNTP server which supports SSL

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42794>
_______________________________________

From report at bugs.python.org  Fri Jan  1 03:46:20 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 01 Jan 2021 08:46:20 +0000
Subject: [issue42794] test_nntplib fails on CI
In-Reply-To: <1609407398.52.0.195663540983.issue42794@roundup.psfhosted.org>
Message-ID: <1609490780.62.0.476335292593.issue42794@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

4 ways / 2 ways

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42794>
_______________________________________

From report at bugs.python.org  Fri Jan  1 03:54:30 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 01 Jan 2021 08:54:30 +0000
Subject: [issue42794] test_nntplib fails on CI
In-Reply-To: <1609407398.52.0.195663540983.issue42794@roundup.psfhosted.org>
Message-ID: <1609491270.41.0.244247951677.issue42794@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na at python.org>:


----------
keywords: +patch
pull_requests: +22877
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24037

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42794>
_______________________________________

From report at bugs.python.org  Fri Jan  1 03:56:43 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 01 Jan 2021 08:56:43 +0000
Subject: [issue42794] test_nntplib fails on CI
In-Reply-To: <1609407398.52.0.195663540983.issue42794@roundup.psfhosted.org>
Message-ID: <1609491403.09.0.304078056613.issue42794@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

I submit the patch to use group_name which is mentioned from https://news.aioe.org/manual/aioe-hierarchy/

IMHO, it will be not changed frequently than what we used before.

----------
stage: patch review -> 

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42794>
_______________________________________

From report at bugs.python.org  Fri Jan  1 04:40:34 2021
From: report at bugs.python.org (Costas Basdekis)
Date: Fri, 01 Jan 2021 09:40:34 +0000
Subject: [issue42797] Allow doctest to select tests via -m/--match option
In-Reply-To: <1609442293.63.0.396324558319.issue42797@roundup.psfhosted.org>
Message-ID: <1609494034.49.0.04464209676.issue42797@roundup.psfhosted.org>


Costas Basdekis <costas.basdekis at gmail.com> added the comment:

Thanks for the thorough feedback Steven (and happy new year).

About -m flag: we could use -k as other testing frameworks use (pytest), or even -t.

About selecting multiple indexes: what you described is my exact use case, as I have a lot of failing examples in one method with verbose output, and also the examples depend on previous examples to be able to run, I'm currently debugging with `-m Ground.step:3,4,6,7`.

So I think you have very valid points, and I'd like to find a way to make the extra overhead be worth it:
* Currently the failing case output is f'File "{path}", line {line}, in {name}': we can add the index as f'File "{path}", line {line}, in {name}, example {index}', so it would be easy to know the indexes
* I think globs in the pattern have been very useful to me in the past (with frameworks that allowed it), because sometimes similarly named functions can have the same types of errors you try to focus on. In any case, it looks like less effort to allow arbitrary globs rather than matching on module name parts

I understand I'm adding complexity, and if we could support the same behaviour in a simpler way I'd be glad to attempt that. In the very least I think allowing a `finder=None` argument in `testmod` would allow more complex solutions, even if they are not accepted in `doctest`.

In the end I'd welcome even a small improvement (for my personal usecase).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42797>
_______________________________________

From report at bugs.python.org  Fri Jan  1 05:31:02 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 01 Jan 2021 10:31:02 +0000
Subject: [issue42794] test_nntplib fails on CI
In-Reply-To: <1609407398.52.0.195663540983.issue42794@roundup.psfhosted.org>
Message-ID: <1609497062.48.0.139789950541.issue42794@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

The test was passed on my computer because test.test_nntplib.NetworkedNNTP_SSLTests was skipped because of the configuration of SSL on Ubuntu 20.04 (see issue41561).

After using custom openssl.cnf I get the same errors.

$ OPENSSL_CONF=~/py/openssl.cnf ./python -m test -vuall test_nntplib -m 'test_description*'

The NNTP server nntp.aioe.org is used instead of snews.gmane.org since 2010 (45ca9874955b1eaf3d941b7a278b594fad50d4ee). Sadly there is no reference to any discussion, maybe Antoine remember some details. What other alternatives were considered? How to handle similar breakage of external servers?

----------
nosy: +pitrou
Added file: https://bugs.python.org/file49714/openssl.cnf

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42794>
_______________________________________

From report at bugs.python.org  Fri Jan  1 06:01:01 2021
From: report at bugs.python.org (Zackery Spytz)
Date: Fri, 01 Jan 2021 11:01:01 +0000
Subject: [issue34752] warnings.warn fails silently with unicode input
In-Reply-To: <1537452937.66.0.956365154283.issue34752@psf.upfronthosting.co.za>
Message-ID: <1609498861.86.0.512092085422.issue34752@roundup.psfhosted.org>


Zackery Spytz <zspytz at gmail.com> added the comment:

Python 2.7 is no longer supported, so I think this issue should be closed.

----------
nosy: +ZackerySpytz

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34752>
_______________________________________

From report at bugs.python.org  Fri Jan  1 06:31:46 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 01 Jan 2021 11:31:46 +0000
Subject: [issue42794] test_nntplib fails on CI
In-Reply-To: <1609407398.52.0.195663540983.issue42794@roundup.psfhosted.org>
Message-ID: <1609500706.47.0.375885148787.issue42794@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

> How to handle similar breakage of external servers?

For tests with the external environment,
How about skipping tests if servers are not available?
It is assumed that if there is a change related to NNTP, it is well checked in the CI and review.
This is because, at this point, reviewers and patch submitters check whether tests with external servers are passed.

The reason for testing with the outside is to confirm that the whole operation works well.
If external servers are not available, we can emit warning messages so that we can recognize when an issue occurs.

Other than that, I can think of local server testing or mocking testing, but I am not sure if it is easy way for the SSL environment.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42794>
_______________________________________

From report at bugs.python.org  Fri Jan  1 06:37:21 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 01 Jan 2021 11:37:21 +0000
Subject: [issue42801] Exception catching function crashes on recursive list
In-Reply-To: <1609478187.83.0.886724654093.issue42801@roundup.psfhosted.org>
Message-ID: <1609501041.97.0.611949388074.issue42801@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

FYI,I am able to reproduce on Python 3.9
The master version is not able to reproduce.

----------
nosy: +corona10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42801>
_______________________________________

From report at bugs.python.org  Fri Jan  1 07:07:48 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 01 Jan 2021 12:07:48 +0000
Subject: [issue42794] test_nntplib fails on CI
In-Reply-To: <1609407398.52.0.195663540983.issue42794@roundup.psfhosted.org>
Message-ID: <1609502868.47.0.2955950893.issue42794@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

> For tests with the external environment,
How about skipping tests if servers are not available?

Hmm, I change my mind this is not a good idea :(

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42794>
_______________________________________

From report at bugs.python.org  Fri Jan  1 07:27:40 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 01 Jan 2021 12:27:40 +0000
Subject: [issue34752] warnings.warn fails silently with unicode input
In-Reply-To: <1537452937.66.0.956365154283.issue34752@psf.upfronthosting.co.za>
Message-ID: <1609504060.05.0.290713352965.issue34752@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na at python.org>:


----------
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34752>
_______________________________________

From report at bugs.python.org  Fri Jan  1 07:57:44 2021
From: report at bugs.python.org (Christian Heimes)
Date: Fri, 01 Jan 2021 12:57:44 +0000
Subject: [issue42794] test_nntplib fails on CI
In-Reply-To: <1609407398.52.0.195663540983.issue42794@roundup.psfhosted.org>
Message-ID: <1609505864.33.0.935382054752.issue42794@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

Does this issue mean that I should include nntplib in PEP 594 again?

----------
nosy: +christian.heimes

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42794>
_______________________________________

From report at bugs.python.org  Fri Jan  1 08:01:52 2021
From: report at bugs.python.org (Christian Heimes)
Date: Fri, 01 Jan 2021 13:01:52 +0000
Subject: [issue42796] tempfile doesn't seem to play nicely with os.chdir on
 Windows
In-Reply-To: <1609429462.99.0.549073524259.issue42796@roundup.psfhosted.org>
Message-ID: <1609506112.79.0.649444809148.issue42796@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

The code fails because TemporaryDirectory.__exit__() is unable to remove the directory. Windows doesn't let you remove files and directories that are used by a process. On POSIX-like operating systems like Linux support removing of opened files. For example anonymous temporary files use the trick.

----------
nosy: +christian.heimes

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42796>
_______________________________________

From report at bugs.python.org  Fri Jan  1 08:34:49 2021
From: report at bugs.python.org (Gabriele Tornetta)
Date: Fri, 01 Jan 2021 13:34:49 +0000
Subject: [issue42796] tempfile doesn't seem to play nicely with os.chdir on
 Windows
In-Reply-To: <1609429462.99.0.549073524259.issue42796@roundup.psfhosted.org>
Message-ID: <1609508089.79.0.236161571076.issue42796@roundup.psfhosted.org>


Gabriele Tornetta <phoenix1987 at gmail.com> added the comment:

That makes sense, but I wonder what the "right" behaviour should be in this case. Surely the infinite recursion should be fixed at the very minimum. Perhaps the code on Windows could be enhanced to catch the case whereby one is trying to delete the cwd and do something like chdir('..') and then delete the temp folder. However, I suspect that something like this still wouldn't be enough. For example, this works fine

~~~ python
def test_chdir():
    with tempfile.TemporaryDirectory() as tempdir:
        old = os.getcwd()
        os.chdir(tempdir)
        os.chdir(old)
~~~

whereas this doesn't (same stacktrace as the original case)

~~~ python
def test_chdir():
    with tempfile.TemporaryDirectory() as tempdir:
        old = os.getcwd()
        os.chdir(tempdir)
        with open(os.path.join(tempdir, "delme")) as fout:
            fout.write("Hello")
        os.chdir(old)
~~~

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42796>
_______________________________________

From report at bugs.python.org  Fri Jan  1 08:40:19 2021
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 01 Jan 2021 13:40:19 +0000
Subject: [issue25479] Increase unit test coverage for abc.py
In-Reply-To: <1445829241.77.0.00855893760535.issue25479@psf.upfronthosting.co.za>
Message-ID: <1609508419.45.0.105924789561.issue25479@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This PR probably doesn't improve test coverage because the feature is tested indirectly (and directly from test_typing). But I think this test should be added nevertheless for completeness and to demonstrate how the feature works. 

That said, this test shows that the documentation of issubclass is not quite accurate when it states that "a class is considered a subclass of itself" 
 (https://docs.python.org/3/library/functions.html#issubclass).  

That should probably be a separate bpo.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue25479>
_______________________________________

From report at bugs.python.org  Fri Jan  1 08:40:26 2021
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 01 Jan 2021 13:40:26 +0000
Subject: [issue25479] Increase unit test coverage for abc.py
In-Reply-To: <1445829241.77.0.00855893760535.issue25479@psf.upfronthosting.co.za>
Message-ID: <1609508426.55.0.0174970434566.issue25479@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
versions:  -Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue25479>
_______________________________________

From report at bugs.python.org  Fri Jan  1 08:52:53 2021
From: report at bugs.python.org (Eryk Sun)
Date: Fri, 01 Jan 2021 13:52:53 +0000
Subject: [issue42796] tempfile doesn't seem to play nicely with os.chdir on
 Windows
In-Reply-To: <1609429462.99.0.549073524259.issue42796@roundup.psfhosted.org>
Message-ID: <1609509173.66.0.453854599803.issue42796@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> Windows doesn't let you remove files and directories that are used 
> by a process. 

Windows does allow deleting open files/directories, but read/execute, write/append, and delete/rename access have to be explicitly shared when opening a file or directory. WinAPI SetCurrentDirectoryW (called by os.chdir) does not share delete access when opening a directory as the new working directory, and the handle is kept open to use as the NTAPI RootDirectory handle when opening relative paths. So the directory can only be deleted after either the working directory changes or the process exits.

See bpo-35144 for the source of the recursion error. An onerror handler was added that retries rmtree() after attempting to reset permissions. I proposed a workaround in the linked issue, but I don't think it's enough. Maybe there should be a separate onerror function for Windows.

The two common PermissionError cases to handle in Windows are readonly files and sharing violations. If the readonly attribute is set, we can remove it and retry the unlink() or rmdir() call. I don't think there's no need for a recursive call since rmtree() only removes empty directories. 

For a sharing violation (winerror 32), all that can be done is to set an atexit function that retries deleting the directory. If rmtree() still fails, emit a resource warning and give up.

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42796>
_______________________________________

From report at bugs.python.org  Fri Jan  1 08:58:19 2021
From: report at bugs.python.org (Marc-Andre Lemburg)
Date: Fri, 01 Jan 2021 13:58:19 +0000
Subject: [issue42794] test_nntplib fails on CI
In-Reply-To: <1609505864.33.0.935382054752.issue42794@roundup.psfhosted.org>
Message-ID: <f80f645e-4b2a-ba79-eedb-ff51d438bba9@egenix.com>


Marc-Andre Lemburg <mal at egenix.com> added the comment:

On 01.01.2021 13:57, Christian Heimes wrote:
> 
> Does this issue mean that I should include nntplib in PEP 594 again?

The test fails because it was relying on an external news server's
configuratoin. This doesn't mean the code itself is broken, just the
test, so clearly: no.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42794>
_______________________________________

From report at bugs.python.org  Fri Jan  1 09:14:09 2021
From: report at bugs.python.org (karl)
Date: Fri, 01 Jan 2021 14:14:09 +0000
Subject: [issue4643] cgitb.html fails if getattr call raises exception
In-Reply-To: <1229093313.68.0.275889144486.issue4643@psf.upfronthosting.co.za>
Message-ID: <1609510449.53.0.992739877802.issue4643@roundup.psfhosted.org>


Change by karl <karl+pythonbugs at la-grange.net>:


----------
nosy: +karlcow
nosy_count: 4.0 -> 5.0
pull_requests: +22878
stage: test needed -> patch review
pull_request: https://github.com/python/cpython/pull/24038

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4643>
_______________________________________

From report at bugs.python.org  Fri Jan  1 09:20:03 2021
From: report at bugs.python.org (karl)
Date: Fri, 01 Jan 2021 14:20:03 +0000
Subject: [issue4643] cgitb.html fails if getattr call raises exception
In-Reply-To: <1229093313.68.0.275889144486.issue4643@psf.upfronthosting.co.za>
Message-ID: <1609510803.05.0.5824548293.issue4643@roundup.psfhosted.org>


karl <karl+pythonbugs at la-grange.net> added the comment:

Converted into GitHub PR https://github.com/python/cpython/pull/24038

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4643>
_______________________________________

From report at bugs.python.org  Fri Jan  1 09:20:45 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 01 Jan 2021 14:20:45 +0000
Subject: [issue42794] test_nntplib fails on CI
In-Reply-To: <1609407398.52.0.195663540983.issue42794@roundup.psfhosted.org>
Message-ID: <1609510845.53.0.483111122853.issue42794@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:


New changeset ec3165320e81ac87edcb85c86c452528ddbaec1c by Dong-hee Na in branch 'master':
bpo-42794: Update test_nntplib to use offical group name for testing (GH-24037)
https://github.com/python/cpython/commit/ec3165320e81ac87edcb85c86c452528ddbaec1c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42794>
_______________________________________

From report at bugs.python.org  Fri Jan  1 09:20:47 2021
From: report at bugs.python.org (miss-islington)
Date: Fri, 01 Jan 2021 14:20:47 +0000
Subject: [issue42794] test_nntplib fails on CI
In-Reply-To: <1609407398.52.0.195663540983.issue42794@roundup.psfhosted.org>
Message-ID: <1609510847.89.0.596633821411.issue42794@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 7.0 -> 8.0
pull_requests: +22880
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24039

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42794>
_______________________________________

From report at bugs.python.org  Fri Jan  1 09:20:55 2021
From: report at bugs.python.org (miss-islington)
Date: Fri, 01 Jan 2021 14:20:55 +0000
Subject: [issue42794] test_nntplib fails on CI
In-Reply-To: <1609407398.52.0.195663540983.issue42794@roundup.psfhosted.org>
Message-ID: <1609510855.09.0.331527005216.issue42794@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +22881
pull_request: https://github.com/python/cpython/pull/24040

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42794>
_______________________________________

From report at bugs.python.org  Fri Jan  1 09:21:01 2021
From: report at bugs.python.org (miss-islington)
Date: Fri, 01 Jan 2021 14:21:01 +0000
Subject: [issue42794] test_nntplib fails on CI
In-Reply-To: <1609407398.52.0.195663540983.issue42794@roundup.psfhosted.org>
Message-ID: <1609510861.89.0.255976128493.issue42794@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +22882
pull_request: https://github.com/python/cpython/pull/24041

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42794>
_______________________________________

From report at bugs.python.org  Fri Jan  1 09:21:09 2021
From: report at bugs.python.org (miss-islington)
Date: Fri, 01 Jan 2021 14:21:09 +0000
Subject: [issue42794] test_nntplib fails on CI
In-Reply-To: <1609407398.52.0.195663540983.issue42794@roundup.psfhosted.org>
Message-ID: <1609510869.11.0.0962007107692.issue42794@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +22883
pull_request: https://github.com/python/cpython/pull/24042

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42794>
_______________________________________

From report at bugs.python.org  Fri Jan  1 09:27:04 2021
From: report at bugs.python.org (Eryk Sun)
Date: Fri, 01 Jan 2021 14:27:04 +0000
Subject: [issue42796] tempfile doesn't seem to play nicely with os.chdir on
 Windows
In-Reply-To: <1609429462.99.0.549073524259.issue42796@roundup.psfhosted.org>
Message-ID: <1609511224.2.0.133035718092.issue42796@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> def test_chdir():
>     with tempfile.TemporaryDirectory() as tempdir:
>         old = os.getcwd()
>         os.chdir(tempdir)
>         with open(os.path.join(tempdir, "delme")) as fout:
>             fout.write("Hello")
>         os.chdir(old)

The open() call in test_chdir() fails before os.chdir(old) executes. You would need to call os.chdir(old) in a `finally` block.

But the cleanup routine could still fail due to a sharing violation from some other process (likely a child process) setting the directory or a child directory as the working directory. Also, a sharing violation when trying to delete a regular file in the tree causes the cleanup routine to fail with NotADirectoryError because the onerror function calls rmtree() if unlink() fails with a PermissionError.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42796>
_______________________________________

From report at bugs.python.org  Fri Jan  1 09:28:27 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 01 Jan 2021 14:28:27 +0000
Subject: [issue42802] distutils: Remove bdist_wininst command
Message-ID: <1609511307.58.0.913169413627.issue42802@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at python.org>:

Attached PR removes it.

The bdist_wininst command was deprecated in Python 3.8:

commit 1da4462765b084dfa8d869b6cb5855e8f6014a11
Author: Victor Stinner <vstinner at redhat.com>
Date:   Fri Jul 5 10:44:12 2019 +0200

    bpo-37481: Deprecate distutils bdist_wininst command (GH-14553)
    
    The distutils bdist_wininst command is now deprecated, use
    bdist_wheel (wheel packages) instead.


"What?s New In Python 3.9: Build Changes" also announced:

* On non-Windows platforms, creating ``bdist_wininst`` installers is now
  officially unsupported.  (See :issue:`10945` for more details.)

https://docs.python.org/dev/whatsnew/3.9.html#build-changes


See bpo-37481 and:
https://discuss.python.org/t/deprecate-bdist-wininst/1929

----------
components: Distutils
messages: 384173
nosy: dstufft, eric.araujo, vstinner
priority: normal
severity: normal
status: open
title: distutils: Remove bdist_wininst command
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42802>
_______________________________________

From report at bugs.python.org  Fri Jan  1 09:30:26 2021
From: report at bugs.python.org (Steve Stagg)
Date: Fri, 01 Jan 2021 14:30:26 +0000
Subject: [issue42801] Exception catching function crashes on recursive list
In-Reply-To: <1609478187.83.0.886724654093.issue42801@roundup.psfhosted.org>
Message-ID: <1609511426.33.0.73445085619.issue42801@roundup.psfhosted.org>


Steve Stagg <stestagg at gmail.com> added the comment:

This is fixed by https://github.com/python/cpython/pull/23744

----------
nosy: +stestagg

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42801>
_______________________________________

From report at bugs.python.org  Fri Jan  1 09:32:41 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 01 Jan 2021 14:32:41 +0000
Subject: [issue42802] distutils: Remove bdist_wininst command
In-Reply-To: <1609511307.58.0.913169413627.issue42802@roundup.psfhosted.org>
Message-ID: <1609511561.98.0.547894505514.issue42802@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

There are 19 issues (+ this one) on bdist_wininst. Once distutils bdist_wininst command will be removed, I propose to all these issues.

Search for open issues with "bdist_wininst" in the title.

Only bpo-41771 was active recently (3 months ago). The 18 other issues are inactive for between 18 months and 121 months (10 years!).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42802>
_______________________________________

From report at bugs.python.org  Fri Jan  1 09:40:21 2021
From: report at bugs.python.org (miss-islington)
Date: Fri, 01 Jan 2021 14:40:21 +0000
Subject: [issue42794] test_nntplib fails on CI
In-Reply-To: <1609407398.52.0.195663540983.issue42794@roundup.psfhosted.org>
Message-ID: <1609512021.85.0.105752511939.issue42794@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 381f3e4bfd4b1c440f7cb3025972fe0acd0406fc by Miss Islington (bot) in branch '3.8':
bpo-42794: Update test_nntplib to use offical group name for testing (GH-24037)
https://github.com/python/cpython/commit/381f3e4bfd4b1c440f7cb3025972fe0acd0406fc


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42794>
_______________________________________

From report at bugs.python.org  Fri Jan  1 09:42:46 2021
From: report at bugs.python.org (miss-islington)
Date: Fri, 01 Jan 2021 14:42:46 +0000
Subject: [issue42794] test_nntplib fails on CI
In-Reply-To: <1609407398.52.0.195663540983.issue42794@roundup.psfhosted.org>
Message-ID: <1609512166.42.0.762612700749.issue42794@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset b20d5e5ce95248e0fa77c5d7bf8f6f5b1231fa53 by Miss Islington (bot) in branch '3.9':
bpo-42794: Update test_nntplib to use offical group name for testing (GH-24037)
https://github.com/python/cpython/commit/b20d5e5ce95248e0fa77c5d7bf8f6f5b1231fa53


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42794>
_______________________________________

From report at bugs.python.org  Fri Jan  1 09:43:03 2021
From: report at bugs.python.org (Ned Batchelder)
Date: Fri, 01 Jan 2021 14:43:03 +0000
Subject: [issue42803] Traced line number is wrong for "if not __debug__"
Message-ID: <1609512183.17.0.454209386156.issue42803@roundup.psfhosted.org>


New submission from Ned Batchelder <ned at nedbatchelder.com>:

(Using CPython commit 6b1ac809b9)

This program never executes line 4, but the "if not __debug__" is partly attributed to line 4, giving an incorrect trace:

    for value in [True, False]:
        if value:
            if not __debug__:
                1/0 # line 4
        else:
            x = 6

Using a simple trace program (https://github.com/nedbat/coveragepy/blob/master/lab/run_trace.py), it produces this output:

    call <string> 1 @-1
        line <string> 1 @0
        line <string> 2 @8
        line <string> 3 @12
        line <string> 4 @14
        line <string> 1 @4
        line <string> 2 @8
        line <string> 6 @16
        line <string> 1 @4
        return <string> 1 @24

Various simplifications of the program make the problem go away.

----------
components: Interpreter Core
messages: 384178
nosy: Mark.Shannon, nedbat
priority: normal
severity: normal
status: open
title: Traced line number is wrong for "if not __debug__"
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42803>
_______________________________________

From report at bugs.python.org  Fri Jan  1 09:44:30 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 01 Jan 2021 14:44:30 +0000
Subject: [issue42802] distutils: Remove bdist_wininst command
In-Reply-To: <1609511307.58.0.913169413627.issue42802@roundup.psfhosted.org>
Message-ID: <1609512270.92.0.0174157121748.issue42802@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
keywords: +patch
pull_requests: +22884
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24043

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42802>
_______________________________________

From report at bugs.python.org  Fri Jan  1 10:02:51 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 01 Jan 2021 15:02:51 +0000
Subject: [issue42802] distutils: Remove bdist_wininst command
In-Reply-To: <1609511307.58.0.913169413627.issue42802@roundup.psfhosted.org>
Message-ID: <1609513371.14.0.0156126239515.issue42802@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

FYI last year, I fixed setuptools v45.2 (released in February 2020) when bdist_wininst is missing:
https://github.com/pypa/setuptools/commit/5d17586a56077dfa3109a5861cf0ff579095a42e

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42802>
_______________________________________

From report at bugs.python.org  Fri Jan  1 10:05:12 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 01 Jan 2021 15:05:12 +0000
Subject: [issue42802] distutils: Remove bdist_wininst command
In-Reply-To: <1609511307.58.0.913169413627.issue42802@roundup.psfhosted.org>
Message-ID: <1609513512.98.0.168727870465.issue42802@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Note: bdist_msi is deprecated since Python 3.9 (bpo-39586). I prefer to wait for Python 3.11 to remove it:

commit 29b3fc0a18f105de666fdd586b537f34e349766d
Author: Hugo van Kemenade <hugovk at users.noreply.github.com>
Date:   Mon Feb 10 15:26:40 2020 +0200

    bpo-39586: Deprecate distutils bdist_msi command (GH-18415)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42802>
_______________________________________

From report at bugs.python.org  Fri Jan  1 10:10:07 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 01 Jan 2021 15:10:07 +0000
Subject: [issue42802] distutils: Remove bdist_wininst command
In-Reply-To: <1609511307.58.0.913169413627.issue42802@roundup.psfhosted.org>
Message-ID: <1609513807.55.0.65283379452.issue42802@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I created a https://discuss.python.org/t/remove-bdist-wininst-command/6434 topic to check if anyone wants to keep the command, or if it's ok to remove it right now.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42802>
_______________________________________

From report at bugs.python.org  Fri Jan  1 10:16:10 2021
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 01 Jan 2021 15:16:10 +0000
Subject: [issue4643] cgitb.html fails if getattr call raises exception
In-Reply-To: <1229093313.68.0.275889144486.issue4643@psf.upfronthosting.co.za>
Message-ID: <1609514170.08.0.00103800015921.issue4643@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

On closer scrutiny I'm not sure this patch should not be merged. 

The getattr call here has a default value, so it should not raise AttributeError. It should also not raise any other exception because a valid implementation of __getattr__ should raise only AttributeError:

https://docs.python.org/3/reference/datamodel.html#object.__getattr__

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4643>
_______________________________________

From report at bugs.python.org  Fri Jan  1 10:16:50 2021
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 01 Jan 2021 15:16:50 +0000
Subject: [issue4643] cgitb.html fails if getattr call raises exception
In-Reply-To: <1229093313.68.0.275889144486.issue4643@psf.upfronthosting.co.za>
Message-ID: <1609514210.19.0.00210890984531.issue4643@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
Removed message: https://bugs.python.org/msg384182

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4643>
_______________________________________

From report at bugs.python.org  Fri Jan  1 10:17:00 2021
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 01 Jan 2021 15:17:00 +0000
Subject: [issue4643] cgitb.html fails if getattr call raises exception
In-Reply-To: <1229093313.68.0.275889144486.issue4643@psf.upfronthosting.co.za>
Message-ID: <1609514220.83.0.876949122193.issue4643@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

On closer scrutiny I'm not sure this patch should be merged. 

The getattr call here has a default value, so it should not raise AttributeError. It should also not raise any other exception because a valid implementation of __getattr__ should raise only AttributeError:

https://docs.python.org/3/reference/datamodel.html#object.__getattr__

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4643>
_______________________________________

From report at bugs.python.org  Fri Jan  1 10:20:49 2021
From: report at bugs.python.org (Christian Heimes)
Date: Fri, 01 Jan 2021 15:20:49 +0000
Subject: [issue42794] test_nntplib fails on CI
In-Reply-To: <1609407398.52.0.195663540983.issue42794@roundup.psfhosted.org>
Message-ID: <1609514449.63.0.974857878445.issue42794@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

> The test fails because it was relying on an external news server's
> configuratoin. This doesn't mean the code itself is broken, just the
> test, so clearly: no.

Broken and unstable tests are one of two reasons why I listed nntplib in my PEP, https://www.python.org/dev/peps/pep-0594/#nntplib .

Q.E.D.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42794>
_______________________________________

From report at bugs.python.org  Fri Jan  1 11:43:04 2021
From: report at bugs.python.org (Marc-Andre Lemburg)
Date: Fri, 01 Jan 2021 16:43:04 +0000
Subject: [issue42794] test_nntplib fails on CI
In-Reply-To: <1609407398.52.0.195663540983.issue42794@roundup.psfhosted.org>
Message-ID: <1609519384.88.0.643969284001.issue42794@roundup.psfhosted.org>


Marc-Andre Lemburg <mal at egenix.com> added the comment:

Thanks for the patch, Dong-hee Na.

Christian: Tests relying on external resources will always have such issues. This doesn't mean that the code which is being tested is outdated or broken. It's just an issue with the tests. Perhaps we ought to disable external tests for NNTP on CI or ask the PSF to setup a news server for testing purposes (just like we have for SSL tests), e.g. news.pythontest.net mirroring comp.lang.python.

----------
stage: patch review -> 

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42794>
_______________________________________

From report at bugs.python.org  Fri Jan  1 12:03:26 2021
From: report at bugs.python.org (Jeremy Kloth)
Date: Fri, 01 Jan 2021 17:03:26 +0000
Subject: [issue42802] distutils: Remove bdist_wininst command
In-Reply-To: <1609511307.58.0.913169413627.issue42802@roundup.psfhosted.org>
Message-ID: <1609520606.69.0.115630301092.issue42802@roundup.psfhosted.org>


Change by Jeremy Kloth <jeremy.kloth+python-tracker at gmail.com>:


----------
nosy: +jkloth

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42802>
_______________________________________

From report at bugs.python.org  Fri Jan  1 12:20:33 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 01 Jan 2021 17:20:33 +0000
Subject: [issue42756] smtplib.LMTP.connect() raises TypeError if `timeout` is
 not specified
In-Reply-To: <1609074713.39.0.771360640486.issue42756@roundup.psfhosted.org>
Message-ID: <1609521633.16.0.846094394518.issue42756@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:


New changeset 3bf05327c2b25d42b92795d9d280288c22a0963d by Ross in branch 'master':
bpo-42756: Configure LMTP Unix-domain socket to use global default timeout when timeout not provided (GH-23969)
https://github.com/python/cpython/commit/3bf05327c2b25d42b92795d9d280288c22a0963d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42756>
_______________________________________

From report at bugs.python.org  Fri Jan  1 12:23:15 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 01 Jan 2021 17:23:15 +0000
Subject: [issue42756] smtplib.LMTP.connect() raises TypeError if `timeout` is
 not specified
In-Reply-To: <1609074713.39.0.771360640486.issue42756@roundup.psfhosted.org>
Message-ID: <1609521795.69.0.62237772436.issue42756@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na at python.org>:


----------
pull_requests: +22885
pull_request: https://github.com/python/cpython/pull/24049

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42756>
_______________________________________

From report at bugs.python.org  Fri Jan  1 12:24:55 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Fri, 01 Jan 2021 17:24:55 +0000
Subject: [issue42756] smtplib.LMTP.connect() raises TypeError if `timeout` is
 not specified
In-Reply-To: <1609074713.39.0.771360640486.issue42756@roundup.psfhosted.org>
Message-ID: <1609521895.82.0.110640298452.issue42756@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na at python.org>:


----------
pull_requests:  -22885

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42756>
_______________________________________

From report at bugs.python.org  Fri Jan  1 12:30:55 2021
From: report at bugs.python.org (Ross Rhodes)
Date: Fri, 01 Jan 2021 17:30:55 +0000
Subject: [issue42756] smtplib.LMTP.connect() raises TypeError if `timeout` is
 not specified
In-Reply-To: <1609074713.39.0.771360640486.issue42756@roundup.psfhosted.org>
Message-ID: <1609522255.91.0.119522393021.issue42756@roundup.psfhosted.org>


Change by Ross Rhodes <ross.rhodes at hotmail.co.uk>:


----------
pull_requests: +22886
pull_request: https://github.com/python/cpython/pull/24050

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42756>
_______________________________________

From report at bugs.python.org  Fri Jan  1 12:39:44 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 01 Jan 2021 17:39:44 +0000
Subject: [issue42759] Take into acount a Tcl interpreter when compare
 variables and fonts
In-Reply-To: <1609100219.29.0.633808020235.issue42759@roundup.psfhosted.org>
Message-ID: <1609522784.87.0.537929335954.issue42759@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset e3a9adba329681b1b73b7223515e71e94fc35e12 by Serhiy Storchaka in branch '3.8':
[3.8] bpo-42759: Fix equality comparison of Variable and Font in Tkinter (GH-23968) (GH-24026)
https://github.com/python/cpython/commit/e3a9adba329681b1b73b7223515e71e94fc35e12


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42759>
_______________________________________

From report at bugs.python.org  Fri Jan  1 12:40:14 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 01 Jan 2021 17:40:14 +0000
Subject: [issue42425] Possible leak in initialization of errmap for OSError
In-Reply-To: <1605970873.69.0.937757784906.issue42425@roundup.psfhosted.org>
Message-ID: <1609522814.61.0.727565022855.issue42425@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 1a544e1dcf8e0880ee35ce78a7f90fc4e5c98c4f by Serhiy Storchaka in branch '3.8':
[3.8] bpo-42425: Fix possible leak in initialization of errmap for OSError (GH-23446). (GH-24025)
https://github.com/python/cpython/commit/1a544e1dcf8e0880ee35ce78a7f90fc4e5c98c4f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42425>
_______________________________________

From report at bugs.python.org  Fri Jan  1 12:40:41 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 01 Jan 2021 17:40:41 +0000
Subject: [issue36589] Incorrect error handling in curses.update_lines_cols()
In-Reply-To: <1554923035.79.0.592038232821.issue36589@roundup.psfhosted.org>
Message-ID: <1609522841.78.0.311005325178.issue36589@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 187785e2fa2050156a6eda93fb2da31db13f07a6 by Serhiy Storchaka in branch '3.8':
[3.8] bpo-36589: Fix the error handling in curses.update_lines_cols(). (GH-12766) (GH-24023)
https://github.com/python/cpython/commit/187785e2fa2050156a6eda93fb2da31db13f07a6


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36589>
_______________________________________

From report at bugs.python.org  Fri Jan  1 12:41:52 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 01 Jan 2021 17:41:52 +0000
Subject: [issue39068] Base 85 encoding initialization race condition
In-Reply-To: <1576518904.56.0.627490233403.issue39068@roundup.psfhosted.org>
Message-ID: <1609522912.31.0.0748837306187.issue39068@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset b863607d303a87e8680149361ac987328b35ca5f by Serhiy Storchaka in branch '3.8':
[3.8] bpo-39068: Fix race condition in base64 (GH-17627) (GH-24022)
https://github.com/python/cpython/commit/b863607d303a87e8680149361ac987328b35ca5f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39068>
_______________________________________

From report at bugs.python.org  Fri Jan  1 12:42:27 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 01 Jan 2021 17:42:27 +0000
Subject: [issue26407] csv.writer.writerows masks exceptions from __iter__
In-Reply-To: <1456144733.82.0.26880413097.issue26407@psf.upfronthosting.co.za>
Message-ID: <1609522947.06.0.928799035112.issue26407@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 6dffa67b98f78ae41b596f84478f3379f55d4d03 by Serhiy Storchaka in branch '3.8':
[3.8] bpo-26407: Do not mask errors in csv. (GH-20536) (GH-24021)
https://github.com/python/cpython/commit/6dffa67b98f78ae41b596f84478f3379f55d4d03


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26407>
_______________________________________

From report at bugs.python.org  Fri Jan  1 12:46:29 2021
From: report at bugs.python.org (miss-islington)
Date: Fri, 01 Jan 2021 17:46:29 +0000
Subject: [issue39068] Base 85 encoding initialization race condition
In-Reply-To: <1576518904.56.0.627490233403.issue39068@roundup.psfhosted.org>
Message-ID: <1609523189.52.0.163479926171.issue39068@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +22887
pull_request: https://github.com/python/cpython/pull/24051

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39068>
_______________________________________

From report at bugs.python.org  Fri Jan  1 12:46:45 2021
From: report at bugs.python.org (Paul "TBBle" Hampson)
Date: Fri, 01 Jan 2021 17:46:45 +0000
Subject: [issue2142] difflib.unified_diff(...) produces invalid patches
In-Reply-To: <1203365817.7.0.0998491412302.issue2142@psf.upfronthosting.co.za>
Message-ID: <1609523205.1.0.423760665564.issue2142@roundup.psfhosted.org>


Paul "TBBle" Hampson <Paul.Hampson at Pobox.com> added the comment:

I just bounced off this issue and proposed a work-around for it in Black (https://github.com/psf/black/pull/1897).

Since it wasn't mentioned here earlier, the `\` marker _is_ documented in the GNU Diffutils documentation, under "Incomplete Lines" (https://www.gnu.org/software/diffutils/manual/html_node/Incomplete-Lines.html#Incomplete-Lines), and applies to both Context and Normal diff output formats.

----------
nosy: +TBBle

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue2142>
_______________________________________

From report at bugs.python.org  Fri Jan  1 12:50:30 2021
From: report at bugs.python.org (Big Stone)
Date: Fri, 01 Jan 2021 17:50:30 +0000
Subject: [issue42686] include built-in Math functions in SQLite to 3.35.0 of
 march 2021
In-Reply-To: <1608391961.58.0.717857253057.issue42686@roundup.psfhosted.org>
Message-ID: <1609523430.02.0.785761976695.issue42686@roundup.psfhosted.org>


Big Stone <stonebig34 at gmail.com> added the comment:

it seems resolved now, at least with VS 2019

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42686>
_______________________________________

From report at bugs.python.org  Fri Jan  1 13:00:07 2021
From: report at bugs.python.org (Bharath Posa)
Date: Fri, 01 Jan 2021 18:00:07 +0000
Subject: [issue42804] Unable to compile the code x86 windows
Message-ID: <1609524007.28.0.23660757957.issue42804@roundup.psfhosted.org>


New submission from Bharath Posa <nmania03 at gmail.com>:

Hi Team,

While I am trying to build the  cpython in windows 10. I am getting tcl.h file not found error.

You can find the screen shot of the error along with the bug.

regards
Sunny

----------
components: Build
files: error_python_compilation.JPG
messages: 384194
nosy: pbharat
priority: normal
severity: normal
status: open
title: Unable to compile the code x86 windows
versions: Python 3.8
Added file: https://bugs.python.org/file49715/error_python_compilation.JPG

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42804>
_______________________________________

From report at bugs.python.org  Fri Jan  1 13:02:08 2021
From: report at bugs.python.org (Bharath Posa)
Date: Fri, 01 Jan 2021 18:02:08 +0000
Subject: [issue42804] Unable to compile the cpython code x86 windows
In-Reply-To: <1609524007.28.0.23660757957.issue42804@roundup.psfhosted.org>
Message-ID: <1609524128.31.0.457952375171.issue42804@roundup.psfhosted.org>


Change by Bharath Posa <nmania03 at gmail.com>:


----------
title: Unable to compile the code x86 windows -> Unable to compile the cpython code x86 windows
type:  -> compile error

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42804>
_______________________________________

From report at bugs.python.org  Fri Jan  1 13:21:41 2021
From: report at bugs.python.org (Dennis Sweeney)
Date: Fri, 01 Jan 2021 18:21:41 +0000
Subject: [issue42804] Unable to compile the cpython code x86 windows
In-Reply-To: <1609524007.28.0.23660757957.issue42804@roundup.psfhosted.org>
Message-ID: <1609525301.37.0.494988568992.issue42804@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

What commands did you enter? Are you following the instructions at https://devguide.python.org/setup/ ?

----------
nosy: +Dennis Sweeney

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42804>
_______________________________________

From report at bugs.python.org  Fri Jan  1 13:31:18 2021
From: report at bugs.python.org (Bharath Posa)
Date: Fri, 01 Jan 2021 18:31:18 +0000
Subject: [issue42804] Unable to compile the cpython code x86 windows
In-Reply-To: <1609524007.28.0.23660757957.issue42804@roundup.psfhosted.org>
Message-ID: <1609525878.8.0.923313142669.issue42804@roundup.psfhosted.org>


Bharath Posa <nmania03 at gmail.com> added the comment:

Followed the instructions as per the link https://devguide.python.org/setup/#setup


While running the command build.bat

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42804>
_______________________________________

From report at bugs.python.org  Fri Jan  1 13:37:42 2021
From: report at bugs.python.org (Ned Deily)
Date: Fri, 01 Jan 2021 18:37:42 +0000
Subject: [issue42794] test_nntplib fails on CI
In-Reply-To: <1609407398.52.0.195663540983.issue42794@roundup.psfhosted.org>
Message-ID: <1609526262.27.0.0152572905538.issue42794@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset 8200ee66697601a8766f234d6eb8e4c8735216fd by Miss Islington (bot) in branch '3.7':
bpo-42794: Update test_nntplib to use offical group name for testing (GH-24037) (GH-24041)
https://github.com/python/cpython/commit/8200ee66697601a8766f234d6eb8e4c8735216fd


----------
nosy: +ned.deily

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42794>
_______________________________________

From report at bugs.python.org  Fri Jan  1 13:42:19 2021
From: report at bugs.python.org (Ned Deily)
Date: Fri, 01 Jan 2021 18:42:19 +0000
Subject: [issue42794] test_nntplib fails on CI
In-Reply-To: <1609407398.52.0.195663540983.issue42794@roundup.psfhosted.org>
Message-ID: <1609526539.3.0.568741562698.issue42794@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset 546baba63a446e261d0248338f9034e56eccfc46 by Miss Islington (bot) in branch '3.6':
bpo-42794: Update test_nntplib to use offical group name for testing (GH-24037) (GH-24042)
https://github.com/python/cpython/commit/546baba63a446e261d0248338f9034e56eccfc46


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42794>
_______________________________________

From report at bugs.python.org  Fri Jan  1 13:48:59 2021
From: report at bugs.python.org (Dennis Sweeney)
Date: Fri, 01 Jan 2021 18:48:59 +0000
Subject: [issue42804] Unable to compile the cpython code x86 windows
In-Reply-To: <1609524007.28.0.23660757957.issue42804@roundup.psfhosted.org>
Message-ID: <1609526939.85.0.452599113002.issue42804@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

Were you able to run PCbuild\get_externals.bat ?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42804>
_______________________________________

From report at bugs.python.org  Fri Jan  1 14:14:13 2021
From: report at bugs.python.org (Bharath Posa)
Date: Fri, 01 Jan 2021 19:14:13 +0000
Subject: [issue42804] Unable to compile the cpython code x86 windows
In-Reply-To: <1609524007.28.0.23660757957.issue42804@roundup.psfhosted.org>
Message-ID: <1609528453.7.0.984704919187.issue42804@roundup.psfhosted.org>


Bharath Posa <nmania03 at gmail.com> added the comment:

I just ran the file but got the below error 
 saying permission denied 

PermissionError: [WinError 5] Access is denied: 'E:\\Libarary\\workspace\\python_dev\\cpython\\PCbuild\\..\\externals\\cpython-bin-deps-tcltk-8.6.9.0' -> 'E:\\Libarary\\workspace\\python_dev\\cpython\\PCbuild\\..\\externals\\tcltk-8.6.9.0'

----------
Added file: https://bugs.python.org/file49716/errors_python.JPG

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42804>
_______________________________________

From report at bugs.python.org  Fri Jan  1 14:21:24 2021
From: report at bugs.python.org (Sunny)
Date: Fri, 01 Jan 2021 19:21:24 +0000
Subject: [issue42804] Unable to compile the cpython code x86 windows
In-Reply-To: <1609524007.28.0.23660757957.issue42804@roundup.psfhosted.org>
Message-ID: <1609528884.96.0.0572717610717.issue42804@roundup.psfhosted.org>


Sunny <nmania03 at gmail.com> added the comment:

I am running using admin rights but still getting the error

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42804>
_______________________________________

From report at bugs.python.org  Fri Jan  1 14:25:55 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 01 Jan 2021 19:25:55 +0000
Subject: [issue42794] test_nntplib fails on CI
In-Reply-To: <1609407398.52.0.195663540983.issue42794@roundup.psfhosted.org>
Message-ID: <1609529155.61.0.0481350277216.issue42794@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Thanks Dong-hee Na for the fix!

We have many tests using external services, like test_ssl that Christian may know ;-)
https://pythondev.readthedocs.io/infra.html#services-used-by-unit-tests

----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42794>
_______________________________________

From report at bugs.python.org  Fri Jan  1 14:39:57 2021
From: report at bugs.python.org (monchy)
Date: Fri, 01 Jan 2021 19:39:57 +0000
Subject: [issue42805] broken pygame integration into wxpython
Message-ID: <1609529997.71.0.350416816551.issue42805@roundup.psfhosted.org>


New submission from monchy <monchytales at gmail.com>:

in previous python verions a pygame window could be embedded into wxpython by assigning the SDL_WINDOWID to the current wx.Panel.GetHandle() and the SDL_VIDEODRIVER to 'windib' before importing python
the same code creates a separate pygame window in the newest python version
a basic implementation can be found here:
https://github.com/Monchytales/Puppet-Theatre/blob/main/pygame_panel.py

----------
messages: 384203
nosy: MonchyTales
priority: normal
severity: normal
status: open
title: broken pygame integration into wxpython
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42805>
_______________________________________

From report at bugs.python.org  Fri Jan  1 14:56:08 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Fri, 01 Jan 2021 19:56:08 +0000
Subject: [issue42686] include built-in Math functions in SQLite to 3.35.0 of
 march 2021
In-Reply-To: <1608391961.58.0.717857253057.issue42686@roundup.psfhosted.org>
Message-ID: <1609530968.5.0.201191621168.issue42686@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

Yes, R. Hipp has fixed this here: https://www2.sqlite.org/cgi/src/info/e5d7209e118a8453
We still need to modify PCbuild in order to build the SQLite library with math functions from 3.35.0 and onwards.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42686>
_______________________________________

From report at bugs.python.org  Fri Jan  1 15:18:48 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Fri, 01 Jan 2021 20:18:48 +0000
Subject: [issue42686] include built-in Math functions in SQLite to 3.35.0 of
 march 2021
In-Reply-To: <1608391961.58.0.717857253057.issue42686@roundup.psfhosted.org>
Message-ID: <1609532328.71.0.624584711472.issue42686@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
keywords: +patch
pull_requests: +22888
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24053

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42686>
_______________________________________

From report at bugs.python.org  Fri Jan  1 15:42:52 2021
From: report at bugs.python.org (miss-islington)
Date: Fri, 01 Jan 2021 20:42:52 +0000
Subject: [issue39068] Base 85 encoding initialization race condition
In-Reply-To: <1576518904.56.0.627490233403.issue39068@roundup.psfhosted.org>
Message-ID: <1609533772.68.0.118598803344.issue39068@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 0d6e40744ae40ff397883ff90ca235efd3b63f18 by Miss Islington (bot) in branch '3.9':
bpo-39068: Fix race condition in base64 (GH-17627)
https://github.com/python/cpython/commit/0d6e40744ae40ff397883ff90ca235efd3b63f18


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39068>
_______________________________________

From report at bugs.python.org  Fri Jan  1 15:46:38 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 01 Jan 2021 20:46:38 +0000
Subject: [issue39068] Base 85 encoding initialization race condition
In-Reply-To: <1576518904.56.0.627490233403.issue39068@roundup.psfhosted.org>
Message-ID: <1609533998.0.0.797105001173.issue39068@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.10, Python 3.8, Python 3.9 -Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39068>
_______________________________________

From report at bugs.python.org  Fri Jan  1 15:47:08 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 01 Jan 2021 20:47:08 +0000
Subject: [issue26407] csv.writer.writerows masks exceptions from __iter__
In-Reply-To: <1456144733.82.0.26880413097.issue26407@psf.upfronthosting.co.za>
Message-ID: <1609534028.37.0.37340010258.issue26407@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: commit review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26407>
_______________________________________

From report at bugs.python.org  Fri Jan  1 15:50:36 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 01 Jan 2021 20:50:36 +0000
Subject: [issue42759] Take into acount a Tcl interpreter when compare
 variables and fonts
In-Reply-To: <1609100219.29.0.633808020235.issue42759@roundup.psfhosted.org>
Message-ID: <1609534236.53.0.298425780428.issue42759@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42759>
_______________________________________

From report at bugs.python.org  Fri Jan  1 15:54:44 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 01 Jan 2021 20:54:44 +0000
Subject: [issue42805] broken pygame integration into wxpython
In-Reply-To: <1609529997.71.0.350416816551.issue42805@roundup.psfhosted.org>
Message-ID: <1609534484.89.0.287992809.issue42805@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Pygame and wxpython are not parts of the stdlib. Please use an appropriate bug tracker.

----------
nosy: +serhiy.storchaka
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42805>
_______________________________________

From report at bugs.python.org  Fri Jan  1 18:30:03 2021
From: report at bugs.python.org (monchy)
Date: Fri, 01 Jan 2021 23:30:03 +0000
Subject: [issue42805] broken pygame integration into wxpython
In-Reply-To: <1609534484.89.0.287992809.issue42805@roundup.psfhosted.org>
Message-ID: <CACz_0ui63A-agvLEnb2Z8OuM5m=sxsTjV_8eaKqZj4fg8XHeLA@mail.gmail.com>


monchy <monchytales at gmail.com> added the comment:

The only thing I changed was the version of python I was using, which means
that whatever caused the problem was python itself
if something was changed in how the interpreter operates the environmental
variables or something then that might do it
PYTHON broke MY software, so this and this alone is the appropriate bug
tracker

On Fri, 1 Jan 2021 at 15:54, Serhiy Storchaka <report at bugs.python.org>
wrote:

>
> Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:
>
> Pygame and wxpython are not parts of the stdlib. Please use an appropriate
> bug tracker.
>
> ----------
> nosy: +serhiy.storchaka
> resolution:  -> third party
> stage:  -> resolved
> status: open -> closed
>
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue42805>
> _______________________________________
>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42805>
_______________________________________

From report at bugs.python.org  Fri Jan  1 19:00:22 2021
From: report at bugs.python.org (Anthony Sottile)
Date: Sat, 02 Jan 2021 00:00:22 +0000
Subject: [issue42806] Incorrect offsets in new parser for f-string
 substitutions
Message-ID: <1609545622.39.0.162230247041.issue42806@roundup.psfhosted.org>


New submission from Anthony Sottile <asottile at umich.edu>:

here's a sample file.  this is distilled down from an example which broke a code formatter here: https://github.com/asottile/add-trailing-comma/issues/106

def f():
    x = (
            'PERL_MM_OPT', (
                f'INSTALL-BASE={shlex.quote(venv)} '
                f'wat'
            ),
    )


A diff from astpretty (https://github.com/asottile/astpretty) between the old and new parser:

```console
$ diff -u <(.tox/py39/bin/python -X oldparser -m astpretty perl.py) <(.tox/py39/bin/python -m astpretty perl.py)
--- /dev/fd/63	2021-01-01 15:58:09.108060968 -0800
+++ /dev/fd/62	2021-01-01 15:58:09.108060968 -0800
@@ -35,19 +35,19 @@
                                         end_col_offset=22,
                                         value=Call(
                                             lineno=4,
-                                            col_offset=32,
+                                            col_offset=16,
                                             end_lineno=4,
-                                            end_col_offset=49,
+                                            end_col_offset=33,
                                             func=Attribute(
                                                 lineno=4,
-                                                col_offset=32,
+                                                col_offset=16,
                                                 end_lineno=4,
-                                                end_col_offset=43,
-                                                value=Name(lineno=4, col_offset=32, end_lineno=4, end_col_offset=37, id='shlex', ctx=Load()),
+                                                end_col_offset=27,
+                                                value=Name(lineno=4, col_offset=16, end_lineno=4, end_col_offset=21, id='shlex', ctx=Load()),
                                                 attr='quote',
                                                 ctx=Load(),
                                             ),
-                                            args=[Name(lineno=4, col_offset=44, end_lineno=4, end_col_offset=48, id='venv', ctx=Load())],
+                                            args=[Name(lineno=4, col_offset=28, end_lineno=4, end_col_offset=32, id='venv', ctx=Load())],
                                             keywords=[],
                                         ),
                                         conversion=-1,
```

the old parser is correct here, and the new parser is wrong

notably it thinks that the call inside the f-string substitution is positioned at column 16 which is the position of the f-string start

this bug is also present in 3.10:

```console
$ venv/bin/python3.10 --version
Python 3.10.0a3
$ diff -u <(.tox/py39/bin/python -X oldparser -m astpretty perl.py) <(venv/bin/python3.10 -m astpretty perl.py)
--- /dev/fd/63	2021-01-01 15:59:54.000059968 -0800
+++ /dev/fd/62	2021-01-01 15:59:54.000059968 -0800
@@ -35,19 +35,19 @@
                                         end_col_offset=22,
                                         value=Call(
                                             lineno=4,
-                                            col_offset=32,
+                                            col_offset=16,
                                             end_lineno=4,
-                                            end_col_offset=49,
+                                            end_col_offset=33,
                                             func=Attribute(
                                                 lineno=4,
-                                                col_offset=32,
+                                                col_offset=16,
                                                 end_lineno=4,
-                                                end_col_offset=43,
-                                                value=Name(lineno=4, col_offset=32, end_lineno=4, end_col_offset=37, id='shlex', ctx=Load()),
+                                                end_col_offset=27,
+                                                value=Name(lineno=4, col_offset=16, end_lineno=4, end_col_offset=21, id='shlex', ctx=Load()),
                                                 attr='quote',
                                                 ctx=Load(),
                                             ),
-                                            args=[Name(lineno=4, col_offset=44, end_lineno=4, end_col_offset=48, id='venv', ctx=Load())],
+                                            args=[Name(lineno=4, col_offset=28, end_lineno=4, end_col_offset=32, id='venv', ctx=Load())],
                                             keywords=[],
                                         ),
                                         conversion=-1,
```

----------
components: Interpreter Core
messages: 384208
nosy: Anthony Sottile
priority: normal
severity: normal
status: open
title: Incorrect offsets in new parser for f-string substitutions
type: behavior
versions: Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42806>
_______________________________________

From report at bugs.python.org  Fri Jan  1 19:11:01 2021
From: report at bugs.python.org (Rahul Jha)
Date: Sat, 02 Jan 2021 00:11:01 +0000
Subject: [issue34451] docs: tutorial/introduction doesn't mention toggle of
 prompts
In-Reply-To: <1534877418.64.0.56676864532.issue34451@psf.upfronthosting.co.za>
Message-ID: <1609546261.37.0.511325408053.issue34451@roundup.psfhosted.org>


Change by Rahul Jha <rahul722j at gmail.com>:


----------
nosy: +RJ722

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34451>
_______________________________________

From report at bugs.python.org  Fri Jan  1 19:23:44 2021
From: report at bugs.python.org (Anthony Sottile)
Date: Sat, 02 Jan 2021 00:23:44 +0000
Subject: [issue42806] Incorrect offsets in new parser for f-string
 substitutions
In-Reply-To: <1609545622.39.0.162230247041.issue42806@roundup.psfhosted.org>
Message-ID: <1609547024.86.0.0692508313058.issue42806@roundup.psfhosted.org>


Anthony Sottile <asottile at umich.edu> added the comment:

+peg parser individuals to nosy

----------
nosy: +gvanrossum, lys.nikolaou, pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42806>
_______________________________________

From report at bugs.python.org  Fri Jan  1 19:25:44 2021
From: report at bugs.python.org (Rahul Jha)
Date: Sat, 02 Jan 2021 00:25:44 +0000
Subject: [issue30044] shutil.copystat should (allow to) copy ownership,
 and other attributes
In-Reply-To: <1491925353.8.0.782070431072.issue30044@psf.upfronthosting.co.za>
Message-ID: <1609547144.42.0.99485147955.issue30044@roundup.psfhosted.org>


Change by Rahul Jha <rahul722j at gmail.com>:


----------
nosy: +RJ722

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30044>
_______________________________________

From report at bugs.python.org  Fri Jan  1 19:34:54 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 02 Jan 2021 00:34:54 +0000
Subject: [issue42806] Incorrect offsets in new parser for f-string
 substitutions
In-Reply-To: <1609545622.39.0.162230247041.issue42806@roundup.psfhosted.org>
Message-ID: <1609547694.62.0.841834646555.issue42806@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Did you check this with master?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42806>
_______________________________________

From report at bugs.python.org  Fri Jan  1 19:43:45 2021
From: report at bugs.python.org (Anthony Sottile)
Date: Sat, 02 Jan 2021 00:43:45 +0000
Subject: [issue42806] Incorrect offsets in new parser for f-string
 substitutions
In-Reply-To: <1609545622.39.0.162230247041.issue42806@roundup.psfhosted.org>
Message-ID: <1609548225.95.0.710589176503.issue42806@roundup.psfhosted.org>


Anthony Sottile <asottile at umich.edu> added the comment:

I didn't initially, but now I have and it has the same bug in the current master: 3bf05327c2b25d42b92795d9d280288c22a0963d

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42806>
_______________________________________

From report at bugs.python.org  Fri Jan  1 19:45:58 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 02 Jan 2021 00:45:58 +0000
Subject: [issue41559] Add support for PEP 612 (Parameter Specification
 Variables) to typing.py
In-Reply-To: <1597516564.62.0.520187732663.issue41559@roundup.psfhosted.org>
Message-ID: <1609548358.77.0.83632795028.issue41559@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:


New changeset 11276cd9c49faea66ce7760f26a238d1edbf6421 by Ken Jin in branch 'master':
bpo-41559: Documentation for PEP 612 (GH-24000)
https://github.com/python/cpython/commit/11276cd9c49faea66ce7760f26a238d1edbf6421


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41559>
_______________________________________

From report at bugs.python.org  Fri Jan  1 19:49:59 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 02 Jan 2021 00:49:59 +0000
Subject: [issue41559] Add support for PEP 612 (Parameter Specification
 Variables) to typing.py
In-Reply-To: <1597516564.62.0.520187732663.issue41559@roundup.psfhosted.org>
Message-ID: <1609548599.47.0.77014975734.issue41559@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Looks like we can close this now, right? You can open a separate issue in the python/typing repo to update typing_extensions.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41559>
_______________________________________

From report at bugs.python.org  Fri Jan  1 21:41:59 2021
From: report at bugs.python.org (David Beazley)
Date: Sat, 02 Jan 2021 02:41:59 +0000
Subject: [issue16132] ctypes incorrectly encodes .format attribute of memory
 views
In-Reply-To: <1349364906.03.0.586114989306.issue16132@psf.upfronthosting.co.za>
Message-ID: <1609555319.44.0.383788925404.issue16132@roundup.psfhosted.org>


Change by David Beazley <dave at dabeaz.com>:


----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue16132>
_______________________________________

From report at bugs.python.org  Fri Jan  1 21:42:12 2021
From: report at bugs.python.org (David Beazley)
Date: Sat, 02 Jan 2021 02:42:12 +0000
Subject: [issue27436] Strange code in selectors.KqueueSelector
In-Reply-To: <1467387207.61.0.938158843585.issue27436@psf.upfronthosting.co.za>
Message-ID: <1609555332.76.0.684930035581.issue27436@roundup.psfhosted.org>


Change by David Beazley <dave at dabeaz.com>:


----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27436>
_______________________________________

From report at bugs.python.org  Fri Jan  1 21:42:25 2021
From: report at bugs.python.org (David Beazley)
Date: Sat, 02 Jan 2021 02:42:25 +0000
Subject: [issue24844] Python 3.5rc1 compilation error with Apple clang 4.2
 included with Xcode 4
In-Reply-To: <1439312804.21.0.961990235071.issue24844@psf.upfronthosting.co.za>
Message-ID: <1609555345.91.0.514675596156.issue24844@roundup.psfhosted.org>


Change by David Beazley <dave at dabeaz.com>:


----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24844>
_______________________________________

From report at bugs.python.org  Fri Jan  1 21:42:35 2021
From: report at bugs.python.org (David Beazley)
Date: Sat, 02 Jan 2021 02:42:35 +0000
Subject: [issue32810] Expose ags_gen and agt_gen in asynchronous generators
In-Reply-To: <1518205773.11.0.467229070634.issue32810@psf.upfronthosting.co.za>
Message-ID: <1609555355.81.0.37247657569.issue32810@roundup.psfhosted.org>


Change by David Beazley <dave at dabeaz.com>:


----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32810>
_______________________________________

From report at bugs.python.org  Fri Jan  1 21:42:47 2021
From: report at bugs.python.org (David Beazley)
Date: Sat, 02 Jan 2021 02:42:47 +0000
Subject: [issue16894] Function attribute access doesn't invoke methods in dict
 subclasses
In-Reply-To: <1357670592.25.0.470525675752.issue16894@psf.upfronthosting.co.za>
Message-ID: <1609555367.4.0.505011727378.issue16894@roundup.psfhosted.org>


Change by David Beazley <dave at dabeaz.com>:


----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue16894>
_______________________________________

From report at bugs.python.org  Fri Jan  1 21:43:00 2021
From: report at bugs.python.org (David Beazley)
Date: Sat, 02 Jan 2021 02:43:00 +0000
Subject: [issue7946] Convoy effect with I/O bound threads and New GIL
In-Reply-To: <1266353325.38.0.278549753357.issue7946@psf.upfronthosting.co.za>
Message-ID: <1609555380.58.0.0562917834059.issue7946@roundup.psfhosted.org>


Change by David Beazley <dave at dabeaz.com>:


----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue7946>
_______________________________________

From report at bugs.python.org  Fri Jan  1 22:44:12 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Sat, 02 Jan 2021 03:44:12 +0000
Subject: [issue42756] smtplib.LMTP.connect() raises TypeError if `timeout` is
 not specified
In-Reply-To: <1609074713.39.0.771360640486.issue42756@roundup.psfhosted.org>
Message-ID: <1609559052.74.0.451612561318.issue42756@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:


New changeset 69120613c071e9327a9dc6e4b1ff21b2e94d885e by Ross in branch '3.9':
[3.9] bpo-42756: Configure LMTP Unix-domain socket to use global default timeout when timeout not provided (GH-23969) (GH-24050)
https://github.com/python/cpython/commit/69120613c071e9327a9dc6e4b1ff21b2e94d885e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42756>
_______________________________________

From report at bugs.python.org  Fri Jan  1 22:48:39 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Sat, 02 Jan 2021 03:48:39 +0000
Subject: [issue42756] smtplib.LMTP.connect() raises TypeError if `timeout` is
 not specified
In-Reply-To: <1609074713.39.0.771360640486.issue42756@roundup.psfhosted.org>
Message-ID: <1609559319.69.0.621759766092.issue42756@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

Thanks, Ross Rhodes for the fix!
And thanks, W?stengecko for the report!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42756>
_______________________________________

From report at bugs.python.org  Fri Jan  1 23:23:16 2021
From: report at bugs.python.org (oon arfiandwi)
Date: Sat, 02 Jan 2021 04:23:16 +0000
Subject: [issue42807] smtplib send_message should gives more clear exception
 if the msg is None
Message-ID: <1609561396.29.0.629926386929.issue42807@roundup.psfhosted.org>


New submission from oon arfiandwi <oon.arfiandwi at gmail.com>:

I want to enhance the error message on the send_message method of class SMTP, in module smtplib.

One of the parameters on send_message is msg which is email.message.Message object, this is a required argument. If the msg is None, currently it will raise "AttributeError: 'NoneType' object has no attribute 'get_all'".
This message is not straight forward and a bit hard to debug.

As the easy fix with additional check if msg is None in send_message method.

I want to add PR on this, also with the additional test(s). This is my first issue, appreciate any feedback. thank you.

----------
components: Library (Lib)
messages: 384216
nosy: oon
priority: normal
severity: normal
status: open
title: smtplib send_message should gives more clear exception if the msg is None
type: behavior
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42807>
_______________________________________

From report at bugs.python.org  Fri Jan  1 23:30:10 2021
From: report at bugs.python.org (Ken Jin)
Date: Sat, 02 Jan 2021 04:30:10 +0000
Subject: [issue41559] Add support for PEP 612 (Parameter Specification
 Variables) to typing.py
In-Reply-To: <1609548599.47.0.77014975734.issue41559@roundup.psfhosted.org>
Message-ID: <CAOMZG7i3eyh==gioPGYzP-sSCmGDB+goWLBk3Sf4HKkFCXSsQQ@mail.gmail.com>


Ken Jin <kenjin4096 at gmail.com> added the comment:

I have just one more PR - one that converts genericalias nested lists to
tuples by default. It'll simplify the code a little bit and prepare 3.9.x
for PEP 612.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41559>
_______________________________________

From report at bugs.python.org  Sat Jan  2 04:02:56 2021
From: report at bugs.python.org (Berry Schoenmakers)
Date: Sat, 02 Jan 2021 09:02:56 +0000
Subject: [issue42557] Make asyncio.__main__ reusable,
 also adding a preamble feature.
In-Reply-To: <1607009685.51.0.588770537577.issue42557@roundup.psfhosted.org>
Message-ID: <1609578176.52.0.96168114671.issue42557@roundup.psfhosted.org>


Change by Berry Schoenmakers <l.a.m.schoenmakers at tue.nl>:


----------
keywords: +patch
pull_requests: +22889
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24055

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42557>
_______________________________________

From report at bugs.python.org  Sat Jan  2 04:45:37 2021
From: report at bugs.python.org (Ken Jin)
Date: Sat, 02 Jan 2021 09:45:37 +0000
Subject: [issue41559] Add support for PEP 612 (Parameter Specification
 Variables) to typing.py
In-Reply-To: <1597516564.62.0.520187732663.issue41559@roundup.psfhosted.org>
Message-ID: <1609580737.72.0.334121834027.issue41559@roundup.psfhosted.org>


Change by Ken Jin <kenjin4096 at gmail.com>:


----------
pull_requests: +22890
pull_request: https://github.com/python/cpython/pull/24056

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41559>
_______________________________________

From report at bugs.python.org  Sat Jan  2 04:54:12 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 02 Jan 2021 09:54:12 +0000
Subject: [issue42425] Possible leak in initialization of errmap for OSError
In-Reply-To: <1605970873.69.0.937757784906.issue42425@roundup.psfhosted.org>
Message-ID: <1609581252.13.0.142656213001.issue42425@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +22891
pull_request: https://github.com/python/cpython/pull/24057

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42425>
_______________________________________

From report at bugs.python.org  Sat Jan  2 05:00:06 2021
From: report at bugs.python.org (Dennis Sweeney)
Date: Sat, 02 Jan 2021 10:00:06 +0000
Subject: [issue42808] Add PyType_Type.tp_vectorcall for type(obj) performance
Message-ID: <1609581606.85.0.894764244692.issue42808@roundup.psfhosted.org>


New submission from Dennis Sweeney <sweeney.dennis650 at gmail.com>:

# common case
.\python.bat -m pyperf timeit "type(17)"
Master: 49.9 ns +- 1.8 ns ---> PR: 33.3 ns +- 1.4 ns

# uncommon case
.\python.bat -m pyperf timeit "type('A', (object, ), {})"
Master: 5.14 us +- 0.04 us ---> PR: 5.43 us +- 0.06 us

----------
components: Interpreter Core
messages: 384218
nosy: Dennis Sweeney
priority: normal
severity: normal
status: open
title: Add PyType_Type.tp_vectorcall for type(obj) performance
type: performance
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42808>
_______________________________________

From report at bugs.python.org  Sat Jan  2 05:04:18 2021
From: report at bugs.python.org (Dennis Sweeney)
Date: Sat, 02 Jan 2021 10:04:18 +0000
Subject: [issue42808] Add PyType_Type.tp_vectorcall for type(obj) performance
In-Reply-To: <1609581606.85.0.894764244692.issue42808@roundup.psfhosted.org>
Message-ID: <1609581858.08.0.882062814361.issue42808@roundup.psfhosted.org>


Change by Dennis Sweeney <sweeney.dennis650 at gmail.com>:


----------
keywords: +patch
pull_requests: +22892
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24058

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42808>
_______________________________________

From report at bugs.python.org  Sat Jan  2 05:19:15 2021
From: report at bugs.python.org (Ken Jin)
Date: Sat, 02 Jan 2021 10:19:15 +0000
Subject: [issue42195] Inconsistent __args__ between typing.Callable and
 collections.abc.Callable
In-Reply-To: <1603974319.88.0.166786801787.issue42195@roundup.psfhosted.org>
Message-ID: <1609582755.15.0.224486316788.issue42195@roundup.psfhosted.org>


Change by Ken Jin <kenjin4096 at gmail.com>:


----------
pull_requests: +22893
pull_request: https://github.com/python/cpython/pull/24059

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42195>
_______________________________________

From report at bugs.python.org  Sat Jan  2 05:24:30 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 02 Jan 2021 10:24:30 +0000
Subject: [issue42425] Possible leak in initialization of errmap for OSError
In-Reply-To: <1605970873.69.0.937757784906.issue42425@roundup.psfhosted.org>
Message-ID: <1609583070.86.0.496885647353.issue42425@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 7695d832565914efcedcc885feb129f5102aec90 by Serhiy Storchaka in branch '3.9':
[3.9] bpo-42425: Fix possible leak in initialization of errmap for OSError (GH-23446). (GH-24057)
https://github.com/python/cpython/commit/7695d832565914efcedcc885feb129f5102aec90


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42425>
_______________________________________

From report at bugs.python.org  Sat Jan  2 05:37:37 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Sat, 02 Jan 2021 10:37:37 +0000
Subject: [issue42808] Add PyType_Type.tp_vectorcall for type(obj) performance
In-Reply-To: <1609581606.85.0.894764244692.issue42808@roundup.psfhosted.org>
Message-ID: <1609583857.54.0.0128983703916.issue42808@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na at python.org>:


----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42808>
_______________________________________

From report at bugs.python.org  Sat Jan  2 05:47:46 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 02 Jan 2021 10:47:46 +0000
Subject: [issue42809] Improve pickle tests for recursive data
In-Reply-To: <1609584428.87.0.716102907179.issue42809@roundup.psfhosted.org>
Message-ID: <1609584466.05.0.345614999487.issue42809@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
versions: +Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42809>
_______________________________________

From report at bugs.python.org  Sat Jan  2 05:47:08 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 02 Jan 2021 10:47:08 +0000
Subject: [issue42809] Improve pickle tests for recursive data
Message-ID: <1609584428.87.0.716102907179.issue42809@roundup.psfhosted.org>


New submission from Serhiy Storchaka <storchaka+cpython at gmail.com>:

The proposed PR extends tests for pickling recursive structures. The code is now more generic and covers more corner cases (found during work on issue36694).

----------
components: Tests
messages: 384220
nosy: alexandre.vassalotti, serhiy.storchaka
priority: normal
severity: normal
status: open
title: Improve pickle tests for recursive data
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42809>
_______________________________________

From report at bugs.python.org  Sat Jan  2 05:59:37 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 02 Jan 2021 10:59:37 +0000
Subject: [issue42809] Improve pickle tests for recursive data
In-Reply-To: <1609584428.87.0.716102907179.issue42809@roundup.psfhosted.org>
Message-ID: <1609585177.14.0.482102173959.issue42809@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
keywords: +patch
pull_requests: +22894
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24060

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42809>
_______________________________________

From report at bugs.python.org  Sat Jan  2 06:05:39 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 02 Jan 2021 11:05:39 +0000
Subject: [issue42425] Possible leak in initialization of errmap for OSError
In-Reply-To: <1605970873.69.0.937757784906.issue42425@roundup.psfhosted.org>
Message-ID: <1609585539.65.0.856896182991.issue42425@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42425>
_______________________________________

From report at bugs.python.org  Sat Jan  2 08:21:57 2021
From: report at bugs.python.org (karl)
Date: Sat, 02 Jan 2021 13:21:57 +0000
Subject: [issue4643] cgitb.html fails if getattr call raises exception
In-Reply-To: <1229093313.68.0.275889144486.issue4643@psf.upfronthosting.co.za>
Message-ID: <1609593717.62.0.433147344984.issue4643@roundup.psfhosted.org>


karl <karl+pythonbugs at la-grange.net> added the comment:

> The getattr call here has a default value, so it should not raise AttributeError. It should also not raise any other exception because a valid implementation of __getattr__ should raise only AttributeError:


but probably the intent of the patch here is to surface a meaningful error with regards to the script, more than an error on the cgitb python lib itself as this is a traceback tool. A bit like an HTML validator which continue to process things to give some kind of meaning.

Diving into previous issues about scanvars
https://bugs.python.org/issue966992

Similar
https://bugs.python.org/issue1047397 The last comment is basically this issue here. 

There is a patch which is lot better for this bug and which addresses the issues here. 
https://github.com/python/cpython/pull/15094

It has not been merged yet. Not sure why or if there is anything missing. 

Probably this bug could be closed as a duplicate of https://bugs.python.org/issue966992


And someone needs to push to push the latest bits for https://github.com/python/cpython/pull/15094


What do you think @iritkatriel ?

I will close my PR.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4643>
_______________________________________

From report at bugs.python.org  Sat Jan  2 09:01:58 2021
From: report at bugs.python.org (Matej Cepl)
Date: Sat, 02 Jan 2021 14:01:58 +0000
Subject: [issue40059] Provide a toml module in the standard library
In-Reply-To: <1585119261.47.0.818238682424.issue40059@roundup.psfhosted.org>
Message-ID: <1609596118.13.0.827953672355.issue40059@roundup.psfhosted.org>


Change by Matej Cepl <mcepl at cepl.eu>:


----------
nosy: +mcepl

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40059>
_______________________________________

From report at bugs.python.org  Sat Jan  2 10:09:25 2021
From: report at bugs.python.org (Ned Batchelder)
Date: Sat, 02 Jan 2021 15:09:25 +0000
Subject: [issue42810] Nested if/else gets phantom else trace (3.10)
Message-ID: <1609600165.12.0.126191975832.issue42810@roundup.psfhosted.org>


New submission from Ned Batchelder <ned at nedbatchelder.com>:

(Using CPython commit 6b1ac809b9)

This program never executes line 6, but tracing it claims that it does:

    a = b = x = y = z = 1
    if a == 1:
        if b == 1:
            x = 4
        else:
            y = 6
    else:
        z = 8
    assert (a, b, x, y, z) == (1, 1, 4, 1, 1)

Using a simple trace program (https://github.com/nedbat/coveragepy/blob/master/lab/run_trace.py), it produces this output:

    call <string> 1 @-1
        line <string> 1 @0
        line <string> 2 @20
        line <string> 3 @28
        line <string> 4 @36
        line <string> 6 @40
        line <string> 9 @52
        return <string> 9 @76

----------
components: Interpreter Core
messages: 384222
nosy: Mark.Shannon, nedbat
priority: normal
severity: normal
status: open
title: Nested if/else gets phantom else trace (3.10)
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42810>
_______________________________________

From report at bugs.python.org  Sat Jan  2 10:19:20 2021
From: report at bugs.python.org (Ned Batchelder)
Date: Sat, 02 Jan 2021 15:19:20 +0000
Subject: [issue42803] Traced line number is wrong for "if not __debug__"
In-Reply-To: <1609512183.17.0.454209386156.issue42803@roundup.psfhosted.org>
Message-ID: <1609600760.97.0.299729368916.issue42803@roundup.psfhosted.org>


Ned Batchelder <ned at nedbatchelder.com> added the comment:

This might be the same problem as #42810.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42803>
_______________________________________

From report at bugs.python.org  Sat Jan  2 10:19:36 2021
From: report at bugs.python.org (Ned Batchelder)
Date: Sat, 02 Jan 2021 15:19:36 +0000
Subject: [issue42810] Nested if/else gets phantom else trace (3.10)
In-Reply-To: <1609600165.12.0.126191975832.issue42810@roundup.psfhosted.org>
Message-ID: <1609600776.57.0.297899247634.issue42810@roundup.psfhosted.org>


Ned Batchelder <ned at nedbatchelder.com> added the comment:

This might be the same problem as #42803.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42810>
_______________________________________

From report at bugs.python.org  Sat Jan  2 10:42:45 2021
From: report at bugs.python.org (hai shi)
Date: Sat, 02 Jan 2021 15:42:45 +0000
Subject: [issue41798] [C API] Revisit usage of the PyCapsule C API with
 multi-phase initialization API
In-Reply-To: <1600265269.2.0.881235166904.issue41798@roundup.psfhosted.org>
Message-ID: <1609602165.12.0.596008780563.issue41798@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
keywords: +patch
pull_requests: +22895
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24061

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41798>
_______________________________________

From report at bugs.python.org  Sat Jan  2 11:08:47 2021
From: report at bugs.python.org (Marc-Andre Lemburg)
Date: Sat, 02 Jan 2021 16:08:47 +0000
Subject: [issue42257] platform.libc_ver() doesn't consider in case of
 executable is empty string
In-Reply-To: <1604469715.55.0.889552705694.issue42257@roundup.psfhosted.org>
Message-ID: <1609603727.38.0.39813010211.issue42257@roundup.psfhosted.org>


Marc-Andre Lemburg <mal at egenix.com> added the comment:

https://github.com/python/cpython/pull/23140 merged. Thanks for the patch, Kurochan.

----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42257>
_______________________________________

From report at bugs.python.org  Sat Jan  2 11:10:14 2021
From: report at bugs.python.org (Marc-Andre Lemburg)
Date: Sat, 02 Jan 2021 16:10:14 +0000
Subject: [issue42257] platform.libc_ver() doesn't consider in case of
 executable is empty string
In-Reply-To: <1604469715.55.0.889552705694.issue42257@roundup.psfhosted.org>
Message-ID: <1609603814.09.0.946859150634.issue42257@roundup.psfhosted.org>


Marc-Andre Lemburg <mal at egenix.com> added the comment:

Note: I did not request a backport, since this really is a new feature.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42257>
_______________________________________

From report at bugs.python.org  Sat Jan  2 11:19:18 2021
From: report at bugs.python.org (miss-islington)
Date: Sat, 02 Jan 2021 16:19:18 +0000
Subject: [issue42195] Inconsistent __args__ between typing.Callable and
 collections.abc.Callable
In-Reply-To: <1603974319.88.0.166786801787.issue42195@roundup.psfhosted.org>
Message-ID: <1609604358.92.0.890282379381.issue42195@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 49cd68fb1ed4cbaf109308c0a7c8c1efcf6f3775 by Ken Jin in branch 'master':
bpo-42195: Disallow isinstance/issubclass for subclasses of genericaliases in Union (GH-24059)
https://github.com/python/cpython/commit/49cd68fb1ed4cbaf109308c0a7c8c1efcf6f3775


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42195>
_______________________________________

From report at bugs.python.org  Sat Jan  2 11:38:59 2021
From: report at bugs.python.org (Petr Viktorin)
Date: Sat, 02 Jan 2021 16:38:59 +0000
Subject: [issue40077] Convert static types to heap types: use PyType_FromSpec()
In-Reply-To: <1585238684.65.0.246012172449.issue40077@roundup.psfhosted.org>
Message-ID: <1609605539.93.0.943757502981.issue40077@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:


New changeset 75bf107c62fbdc00af51ee4f6ab69df4bd201104 by Erlend Egeberg Aasland in branch 'master':
bpo-40077: Convert arraymodule to use heap types and establish module state (GH-23124)
https://github.com/python/cpython/commit/75bf107c62fbdc00af51ee4f6ab69df4bd201104


----------
nosy: +petr.viktorin

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40077>
_______________________________________

From report at bugs.python.org  Sat Jan  2 11:53:03 2021
From: report at bugs.python.org (Anthony Sottile)
Date: Sat, 02 Jan 2021 16:53:03 +0000
Subject: [issue42806] Incorrect offsets in new parser for f-string
 substitutions
In-Reply-To: <1609545622.39.0.162230247041.issue42806@roundup.psfhosted.org>
Message-ID: <1609606383.71.0.942409301396.issue42806@roundup.psfhosted.org>


Anthony Sottile <asottile at umich.edu> added the comment:

by the way, here's a much smaller case which has a similar problem

```
x = (
    f" {test(t)}"
)
```

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42806>
_______________________________________

From report at bugs.python.org  Sat Jan  2 12:32:56 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 02 Jan 2021 17:32:56 +0000
Subject: [issue42809] Improve pickle tests for recursive data
In-Reply-To: <1609584428.87.0.716102907179.issue42809@roundup.psfhosted.org>
Message-ID: <1609608776.91.0.921454033883.issue42809@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset a25011be8c6f62cb3333903befe6295d57f0bd30 by Serhiy Storchaka in branch 'master':
bpo-42809: Improve pickle tests for recursive data. (GH-24060)
https://github.com/python/cpython/commit/a25011be8c6f62cb3333903befe6295d57f0bd30


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42809>
_______________________________________

From report at bugs.python.org  Sat Jan  2 12:33:46 2021
From: report at bugs.python.org (miss-islington)
Date: Sat, 02 Jan 2021 17:33:46 +0000
Subject: [issue42809] Improve pickle tests for recursive data
In-Reply-To: <1609584428.87.0.716102907179.issue42809@roundup.psfhosted.org>
Message-ID: <1609608826.05.0.761638778864.issue42809@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 2.0 -> 3.0
pull_requests: +22896
pull_request: https://github.com/python/cpython/pull/24062

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42809>
_______________________________________

From report at bugs.python.org  Sat Jan  2 12:33:56 2021
From: report at bugs.python.org (miss-islington)
Date: Sat, 02 Jan 2021 17:33:56 +0000
Subject: [issue42809] Improve pickle tests for recursive data
In-Reply-To: <1609584428.87.0.716102907179.issue42809@roundup.psfhosted.org>
Message-ID: <1609608836.5.0.747496188213.issue42809@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +22897
pull_request: https://github.com/python/cpython/pull/24063

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42809>
_______________________________________

From report at bugs.python.org  Sat Jan  2 12:35:18 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 02 Jan 2021 17:35:18 +0000
Subject: [issue42789] Do not skip test_curses on non-tty
In-Reply-To: <1609355195.18.0.84938555409.issue42789@roundup.psfhosted.org>
Message-ID: <1609608918.78.0.385649454466.issue42789@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 607501abb488fb37e33cf9d35260ab7baefa192f by Serhiy Storchaka in branch 'master':
bpo-42789: Don't skip curses tests on non-tty. (GH-24009)
https://github.com/python/cpython/commit/607501abb488fb37e33cf9d35260ab7baefa192f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42789>
_______________________________________

From report at bugs.python.org  Sat Jan  2 12:36:27 2021
From: report at bugs.python.org (Ned Batchelder)
Date: Sat, 02 Jan 2021 17:36:27 +0000
Subject: [issue42803] Traced line number is wrong for "if not __debug__"
In-Reply-To: <1609512183.17.0.454209386156.issue42803@roundup.psfhosted.org>
Message-ID: <1609608987.33.0.949157795007.issue42803@roundup.psfhosted.org>


Ned Batchelder <ned at nedbatchelder.com> added the comment:

I think I am finding more examples of the same problem, so I will just add it here:

    x = "hello"
    try:
        3/0
    except ZeroDivisionError:
        if x == 'raise':
            raise ValueError()   # line 6
    f = 7

This shows a trace for line 6, which is never excecuted:

call <string> 1 @-1
    line <string> 1 @0
    line <string> 2 @4
    line <string> 3 @6
    exception <string> 3 @10
    line <string> 4 @24
    line <string> 5 @36
    line <string> 6 @50
    line <string> 7 @52
    return <string> 7 @58

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42803>
_______________________________________

From report at bugs.python.org  Sat Jan  2 12:50:45 2021
From: report at bugs.python.org (miss-islington)
Date: Sat, 02 Jan 2021 17:50:45 +0000
Subject: [issue42809] Improve pickle tests for recursive data
In-Reply-To: <1609584428.87.0.716102907179.issue42809@roundup.psfhosted.org>
Message-ID: <1609609845.38.0.750836326348.issue42809@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 2e8b1c9e9b2d2e011bf35f77cd611843bac7f3dd by Miss Islington (bot) in branch '3.8':
bpo-42809: Improve pickle tests for recursive data. (GH-24060)
https://github.com/python/cpython/commit/2e8b1c9e9b2d2e011bf35f77cd611843bac7f3dd


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42809>
_______________________________________

From report at bugs.python.org  Sat Jan  2 12:53:55 2021
From: report at bugs.python.org (miss-islington)
Date: Sat, 02 Jan 2021 17:53:55 +0000
Subject: [issue42809] Improve pickle tests for recursive data
In-Reply-To: <1609584428.87.0.716102907179.issue42809@roundup.psfhosted.org>
Message-ID: <1609610035.52.0.517171694786.issue42809@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 39a7578186d2f5eaa112a5854c46f84eae401522 by Miss Islington (bot) in branch '3.9':
bpo-42809: Improve pickle tests for recursive data. (GH-24060)
https://github.com/python/cpython/commit/39a7578186d2f5eaa112a5854c46f84eae401522


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42809>
_______________________________________

From report at bugs.python.org  Sat Jan  2 13:24:58 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 02 Jan 2021 18:24:58 +0000
Subject: [issue42772] randrange() mishandles step when stop is None
In-Reply-To: <1609183417.92.0.845527263557.issue42772@roundup.psfhosted.org>
Message-ID: <1609611898.56.0.16838871535.issue42772@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset 768fa145cfec2a0599802b74fc31d2bc2812ed96 by Raymond Hettinger in branch 'master':
bpo-42772: Step argument ignored when stop is None. (GH-24018)
https://github.com/python/cpython/commit/768fa145cfec2a0599802b74fc31d2bc2812ed96


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42772>
_______________________________________

From report at bugs.python.org  Sat Jan  2 13:25:13 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 02 Jan 2021 18:25:13 +0000
Subject: [issue42772] randrange() mishandles step when stop is None
In-Reply-To: <1609183417.92.0.845527263557.issue42772@roundup.psfhosted.org>
Message-ID: <1609611913.76.0.706743922887.issue42772@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42772>
_______________________________________

From report at bugs.python.org  Sat Jan  2 14:11:56 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Sat, 02 Jan 2021 19:11:56 +0000
Subject: [issue40077] Convert static types to heap types: use PyType_FromSpec()
In-Reply-To: <1585238684.65.0.246012172449.issue40077@roundup.psfhosted.org>
Message-ID: <1609614716.76.0.950961698607.issue40077@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

Should Modules/_testcapimodule.c stay untouched?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40077>
_______________________________________

From report at bugs.python.org  Sat Jan  2 14:28:42 2021
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 02 Jan 2021 19:28:42 +0000
Subject: [issue4643] cgitb.html fails if getattr call raises exception
In-Reply-To: <1229093313.68.0.275889144486.issue4643@psf.upfronthosting.co.za>
Message-ID: <1609615722.57.0.862099064131.issue4643@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

I agree that this can be closed as duplicate. Thanks, Karl, for the research.

----------
resolution:  -> duplicate
stage: patch review -> resolved
status: open -> closed
superseder:  -> cgitb failures

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4643>
_______________________________________

From report at bugs.python.org  Sat Jan  2 15:27:59 2021
From: report at bugs.python.org (Brett Cannon)
Date: Sat, 02 Jan 2021 20:27:59 +0000
Subject: [issue42811] Update docs for importlib.util.resolve_name() to use
 __spec__ instead of __package__
Message-ID: <1609619279.01.0.578638244778.issue42811@roundup.psfhosted.org>


New submission from Brett Cannon <brett at python.org>:

Since importlib now prefers `__spec__` over `__package__`, https://docs.python.org/3/library/importlib.html#importlib.util.resolve_name should be updated to use `__spec__.parent` instead in the. example.

----------
assignee: brett.cannon
components: Documentation
keywords: easy
messages: 384238
nosy: brett.cannon
priority: low
severity: normal
stage: needs patch
status: open
title: Update docs for importlib.util.resolve_name() to use __spec__ instead of __package__
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42811>
_______________________________________

From report at bugs.python.org  Sat Jan  2 15:28:34 2021
From: report at bugs.python.org (Brett Cannon)
Date: Sat, 02 Jan 2021 20:28:34 +0000
Subject: [issue40059] Provide a toml module in the standard library
In-Reply-To: <1585119261.47.0.818238682424.issue40059@roundup.psfhosted.org>
Message-ID: <1609619314.61.0.0436054962517.issue40059@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
versions:  -Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40059>
_______________________________________

From report at bugs.python.org  Sat Jan  2 16:11:43 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 02 Jan 2021 21:11:43 +0000
Subject: [issue40636] Provide a strict form of zip (PEP-618) requiring same
 length inputs
In-Reply-To: <1589570739.4.0.582573486837.issue40636@roundup.psfhosted.org>
Message-ID: <1609621903.72.0.165857942184.issue40636@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Tests test_zip_pickle_stability and test_zip_pickle_strict_stability look excessively strict. Why did we need them if there are other pickle tests? They prevent implementing optimizations like in issue36694.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40636>
_______________________________________

From report at bugs.python.org  Sat Jan  2 16:58:23 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 02 Jan 2021 21:58:23 +0000
Subject: [issue42810] Nested if/else gets phantom else trace (3.10)
In-Reply-To: <1609600165.12.0.126191975832.issue42810@roundup.psfhosted.org>
Message-ID: <1609624703.16.0.75765394861.issue42810@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Confirmed.  This regression happened between 3.10 alpha 2 and today's build:

$ python3.10 --version
Python 3.10.0a2
$ python3.10 -m trace --trace tmp19.py
 --- modulename: tmp19, funcname: <module>
tmp19.py(1): a = b = x = y = z = 1
tmp19.py(2): if a == 1:
tmp19.py(3):     if b == 1:
tmp19.py(4):         x = 4
tmp19.py(9): assert (a, b, x, y, z) == (1, 1, 4, 1, 1)

$ py --version
Python 3.10.0a3+
$ py -m trace --trace tmp19.py
 --- modulename: tmp19, funcname: <module>
tmp19.py(1): a = b = x = y = z = 1
tmp19.py(2): if a == 1:
tmp19.py(3):     if b == 1:
tmp19.py(4):         x = 4
tmp19.py(6):         y = 6
tmp19.py(9): assert (a, b, x, y, z) == (1, 1, 4, 1, 1)

----------
nosy: +pablogsal, rhettinger
priority: normal -> high

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42810>
_______________________________________

From report at bugs.python.org  Sat Jan  2 17:01:11 2021
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 02 Jan 2021 22:01:11 +0000
Subject: [issue42789] Do not skip test_curses on non-tty
In-Reply-To: <1609355195.18.0.84938555409.issue42789@roundup.psfhosted.org>
Message-ID: <1609624871.82.0.507637331238.issue42789@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Buildbot failure: ARM Raspbian 3.x:
https://buildbot.python.org/all/#/builders/424/builds/658

Tests are run with env var TERM=screen.xterm-256color.

======================================================================
ERROR: test_colors_funcs (test.test_curses.TestCurses)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/var/lib/buildbot/workers/3.x.gps-raspbian/build/Lib/test/test_curses.py", line 316, in test_colors_funcs
    curses.pair_content(curses.COLOR_PAIRS - 1)
_curses.error: Argument 1 was out of range. (1..COLOR_PAIRS-1)

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42789>
_______________________________________

From report at bugs.python.org  Sat Jan  2 17:03:55 2021
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 02 Jan 2021 22:03:55 +0000
Subject: [issue42789] Do not skip test_curses on non-tty
In-Reply-To: <1609355195.18.0.84938555409.issue42789@roundup.psfhosted.org>
Message-ID: <1609625035.63.0.564340936489.issue42789@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

s390x RHEL8 3.x:
https://buildbot.python.org/all/#/builders/509/builds/601

Tests run with TERM=xterm-256color.

======================================================================
ERROR: test_colors_funcs (test.test_curses.TestCurses)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/dje/cpython-buildarea/3.x.edelsohn-rhel8-z/build/Lib/test/test_curses.py", line 316, in test_colors_funcs
    curses.pair_content(curses.COLOR_PAIRS - 1)
_curses.error: Argument 1 was out of range. (1..COLOR_PAIRS-1)

--

test.pythoninfo doesn't log anything about curses. I expected to find _curses.ncurses_version there.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42789>
_______________________________________

From report at bugs.python.org  Sat Jan  2 17:04:59 2021
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 02 Jan 2021 22:04:59 +0000
Subject: [issue40636] Provide a strict form of zip (PEP-618) requiring same
 length inputs
In-Reply-To: <1589570739.4.0.582573486837.issue40636@roundup.psfhosted.org>
Message-ID: <1609625099.89.0.740237593067.issue40636@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40636>
_______________________________________

From report at bugs.python.org  Sat Jan  2 17:07:25 2021
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 02 Jan 2021 22:07:25 +0000
Subject: [issue42557] Make asyncio.__main__ reusable,
 also adding a preamble feature.
In-Reply-To: <1607009685.51.0.588770537577.issue42557@roundup.psfhosted.org>
Message-ID: <1609625245.83.0.326272135965.issue42557@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42557>
_______________________________________

From report at bugs.python.org  Sat Jan  2 17:45:50 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 02 Jan 2021 22:45:50 +0000
Subject: [issue40636] Provide a strict form of zip (PEP-618) requiring same
 length inputs
In-Reply-To: <1589570739.4.0.582573486837.issue40636@roundup.psfhosted.org>
Message-ID: <1609627550.8.0.0466169466089.issue40636@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

That's fair.  How do other builtins validate their pickling implementation?

Since the pickling goes through __reduce__/__reduce_ex__ we could instead test that those methods return the expected results, that pickling roundtrips, and that unpickling those exact byte strings produces the expected value?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40636>
_______________________________________

From report at bugs.python.org  Sat Jan  2 18:13:48 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Sat, 02 Jan 2021 23:13:48 +0000
Subject: [issue40077] Convert static types to heap types: use PyType_FromSpec()
In-Reply-To: <1585238684.65.0.246012172449.issue40077@roundup.psfhosted.org>
Message-ID: <1609629228.15.0.368849492107.issue40077@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
pull_requests: +22898
pull_request: https://github.com/python/cpython/pull/24065

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40077>
_______________________________________

From report at bugs.python.org  Sat Jan  2 18:14:28 2021
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Sat, 02 Jan 2021 23:14:28 +0000
Subject: [issue40631] PEG Parser: Cannot used starred expression in
 parenthesised expr
In-Reply-To: <1589544267.84.0.231872596395.issue40631@roundup.psfhosted.org>
Message-ID: <1609629268.11.0.421365127807.issue40631@roundup.psfhosted.org>


Lysandros Nikolaou <lisandrosnik at gmail.com> added the comment:


New changeset 2ea320dddd553298038bb7d6789e50e199332f66 by Lysandros Nikolaou in branch 'master':
bpo-40631: Disallow single parenthesized star target (GH-24027)
https://github.com/python/cpython/commit/2ea320dddd553298038bb7d6789e50e199332f66


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40631>
_______________________________________

From report at bugs.python.org  Sat Jan  2 18:23:21 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Sat, 02 Jan 2021 23:23:21 +0000
Subject: [issue40077] Convert static types to heap types: use PyType_FromSpec()
In-Reply-To: <1585238684.65.0.246012172449.issue40077@roundup.psfhosted.org>
Message-ID: <1609629801.55.0.289914583499.issue40077@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
pull_requests: +22899
pull_request: https://github.com/python/cpython/pull/24066

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40077>
_______________________________________

From report at bugs.python.org  Sat Jan  2 18:24:50 2021
From: report at bugs.python.org (Marco Atzeri)
Date: Sat, 02 Jan 2021 23:24:50 +0000
Subject: [issue41374] socket.TCP_* no longer available with cygwin 3.1.6+
In-Reply-To: <1595490704.07.0.649120374256.issue41374@roundup.psfhosted.org>
Message-ID: <1609629890.48.0.148710780499.issue41374@roundup.psfhosted.org>


Marco Atzeri <marco.atzeri at gmail.com> added the comment:

The Analysis is correct. 
Removing the test for CYGWIN and always include the 
<netinet/tcp.h>

solved the problem building all python (3.6,3.7,3.8) packages

https://sourceware.org/pipermail/cygwin-apps/2020-December/040845.html
https://sourceware.org/pipermail/cygwin-announce/2020-December/009853.html

attached patch used on the build.
Similar one was applied to the rebuild of 2.7.18

----------
nosy: +matzeri
versions: +Python 3.6, Python 3.7
Added file: https://bugs.python.org/file49717/3.6.12-socketmodule.patch

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41374>
_______________________________________

From report at bugs.python.org  Sat Jan  2 19:02:11 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 03 Jan 2021 00:02:11 +0000
Subject: [issue42806] Incorrect offsets in new parser for f-string
 substitutions
In-Reply-To: <1609545622.39.0.162230247041.issue42806@roundup.psfhosted.org>
Message-ID: <1609632131.53.0.216713821107.issue42806@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
keywords: +patch
pull_requests: +22900
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24067

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42806>
_______________________________________

From report at bugs.python.org  Sat Jan  2 19:19:23 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 03 Jan 2021 00:19:23 +0000
Subject: [issue42806] Incorrect offsets in new parser for f-string
 substitutions
In-Reply-To: <1609545622.39.0.162230247041.issue42806@roundup.psfhosted.org>
Message-ID: <1609633163.51.0.552592806521.issue42806@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Seems that I also found this weird behaviour in the old parser:

import ast
code = """\
x = (
        'PERL_MM_OPT', (
            f'wat'
            f'INSTALL-BASE={shlex.quote(venv)} '
            f'wat'
        ),
)
"""
elem = ast.parse(code).body[0].value.elts[1].values[1].value
print(elem)
print(code.split("\n")[elem.lineno-1][elem.col_offset:elem.end_col_offset])

In Python3.8 this prints:

<_ast.Call object at 0x7f7484393a00>
'wat'

which is wrong as the code for that call is certainly not "wat". This happens in the oldparser in 3.9:

? ../3.9/python -Xoldparser lel.py
<ast.Call object at 0x7f78afbc1e10>
'wat'

And something wrong happens in the current master with the new parser:

? ../3.9/python lel.py
<ast.Call object at 0x7f504e9a1eb0>
STALL-BASE={shlex

But with PR24067:

<ast.Call object at 0x7fec78673fa0>
shlex.quote(venv)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42806>
_______________________________________

From report at bugs.python.org  Sat Jan  2 19:38:00 2021
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Sun, 03 Jan 2021 00:38:00 +0000
Subject: [issue40631] PEG Parser: Cannot used starred expression in
 parenthesised expr
In-Reply-To: <1589544267.84.0.231872596395.issue40631@roundup.psfhosted.org>
Message-ID: <1609634280.2.0.682938284333.issue40631@roundup.psfhosted.org>


Change by Lysandros Nikolaou <lisandrosnik at gmail.com>:


----------
pull_requests: +22901
pull_request: https://github.com/python/cpython/pull/24068

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40631>
_______________________________________

From report at bugs.python.org  Sat Jan  2 19:59:56 2021
From: report at bugs.python.org (miss-islington)
Date: Sun, 03 Jan 2021 00:59:56 +0000
Subject: [issue40631] PEG Parser: Cannot used starred expression in
 parenthesised expr
In-Reply-To: <1589544267.84.0.231872596395.issue40631@roundup.psfhosted.org>
Message-ID: <1609635596.09.0.436730151989.issue40631@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 9a608ac17c284008d3c2986a4a8b194f84488e56 by Lysandros Nikolaou in branch '3.9':
[3.9] bpo-40631: Disallow single parenthesized star target (GH-24027) (GH-24068)
https://github.com/python/cpython/commit/9a608ac17c284008d3c2986a4a8b194f84488e56


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40631>
_______________________________________

From report at bugs.python.org  Sat Jan  2 20:06:44 2021
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 03 Jan 2021 01:06:44 +0000
Subject: [issue15106] Potential Bug in errors.c
In-Reply-To: <1340120572.84.0.94173614856.issue15106@psf.upfronthosting.co.za>
Message-ID: <1609636004.29.0.12059357414.issue15106@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

The code is not really cloned - note that PyErr_Restore is operating on tstate->curexc (the exception currently being handled) while PyErr_SetExcInfo is operating on tstate->exc_info (the earliest exception currently on the exception stack).

If there is a bug here, I think it is the silent conversion of traceback to NULL in the case where it is neither NULL nor Py_None. (The case in PyErr_Restore that the comment says should not happen).

Otherwise, the difference is that PyErr_Restore transforms Py_None to NULL for the traceback, and PyErr_SetExcInfo doesn't.  That conversion seems neither necessary nor wrong.

----------
nosy: +iritkatriel
versions: +Python 3.10 -Python 3.4

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue15106>
_______________________________________

From report at bugs.python.org  Sat Jan  2 20:12:11 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 03 Jan 2021 01:12:11 +0000
Subject: [issue42806] Incorrect offsets in new parser for f-string
 substitutions
In-Reply-To: <1609545622.39.0.162230247041.issue42806@roundup.psfhosted.org>
Message-ID: <1609636331.43.0.854741815373.issue42806@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset bd2728b1e8a99ba8f8c2d481f88aeb99b8b8360f by Pablo Galindo in branch 'master':
bpo-42806: Fix ast locations of f-strings inside parentheses (GH-24067)
https://github.com/python/cpython/commit/bd2728b1e8a99ba8f8c2d481f88aeb99b8b8360f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42806>
_______________________________________

From report at bugs.python.org  Sat Jan  2 20:13:04 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 03 Jan 2021 01:13:04 +0000
Subject: [issue42806] Incorrect offsets in new parser for f-string
 substitutions
In-Reply-To: <1609545622.39.0.162230247041.issue42806@roundup.psfhosted.org>
Message-ID: <1609636384.97.0.43160522115.issue42806@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
pull_requests: +22902
pull_request: https://github.com/python/cpython/pull/24069

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42806>
_______________________________________

From report at bugs.python.org  Sat Jan  2 20:32:51 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 03 Jan 2021 01:32:51 +0000
Subject: [issue42806] Incorrect offsets in new parser for f-string
 substitutions
In-Reply-To: <1609545622.39.0.162230247041.issue42806@roundup.psfhosted.org>
Message-ID: <1609637571.57.0.209640928502.issue42806@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42806>
_______________________________________

From report at bugs.python.org  Sat Jan  2 20:33:09 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 03 Jan 2021 01:33:09 +0000
Subject: [issue42806] Incorrect offsets in new parser for f-string
 substitutions
In-Reply-To: <1609545622.39.0.162230247041.issue42806@roundup.psfhosted.org>
Message-ID: <1609637589.17.0.563399702071.issue42806@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset bfc413ce4fa37ccb889757388102c7755e057bf5 by Pablo Galindo in branch '3.9':
[3.9] bpo-42806: Fix ast locations of f-strings inside parentheses (GH-24067) (GH-24069)
https://github.com/python/cpython/commit/bfc413ce4fa37ccb889757388102c7755e057bf5


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42806>
_______________________________________

From report at bugs.python.org  Sat Jan  2 20:57:55 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 03 Jan 2021 01:57:55 +0000
Subject: [issue15106] Potential Bug in errors.c
In-Reply-To: <1340120572.84.0.94173614856.issue15106@psf.upfronthosting.co.za>
Message-ID: <1609639075.48.0.309752656386.issue15106@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Adding extra checks to PyErr_SetExcInfo doesn't have a lot of value because is already out of of contract. If you pass an invalid object (let's say a list) to any of the specific APIs (like PyDict_GetItem) it will crash anyway. We could add some assert, though.

----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue15106>
_______________________________________

From report at bugs.python.org  Sat Jan  2 21:01:34 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 03 Jan 2021 02:01:34 +0000
Subject: [issue40631] PEG Parser: Cannot used starred expression in
 parenthesised expr
In-Reply-To: <1589544267.84.0.231872596395.issue40631@roundup.psfhosted.org>
Message-ID: <1609639294.48.0.252405261907.issue40631@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40631>
_______________________________________

From report at bugs.python.org  Sat Jan  2 21:01:22 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 03 Jan 2021 02:01:22 +0000
Subject: [issue15106] Potential Bug in errors.c
In-Reply-To: <1340120572.84.0.94173614856.issue15106@psf.upfronthosting.co.za>
Message-ID: <1609639282.75.0.616132040655.issue15106@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue15106>
_______________________________________

From report at bugs.python.org  Sat Jan  2 21:15:39 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 03 Jan 2021 02:15:39 +0000
Subject: [issue42810] Nested if/else gets phantom else trace (3.10)
In-Reply-To: <1609600165.12.0.126191975832.issue42810@roundup.psfhosted.org>
Message-ID: <1609640139.47.0.0115401338329.issue42810@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Bisecting points at this commit as the culprit:

28b75c80dcc1e17ed3ac1c69362bf8dc164b760a is the first bad commit
commit 28b75c80dcc1e17ed3ac1c69362bf8dc164b760a
Author: Mark Shannon <mark at hotpy.org>
Date:   Wed Dec 23 11:43:10 2020 +0000

    bpo-42246: Don't eliminate jumps to jumps, if it will break PEP 626. (GH-23896)

 Lib/test/test_dis.py                               |  169 +-
 Lib/test/test_sys_settrace.py                      |   64 +
 .../2020-12-22-20-30-11.bpo-42246.7BrPLg.rst       |    1 +
 Python/compile.c                                   |  135 +-
 Python/importlib.h                                 | 1531 +++---
 Python/importlib_external.h                        | 4884 ++++++++++----------
 Python/importlib_zipimport.h                       | 1796 +++----
 7 files changed, 4341 insertions(+), 4239 deletions(-)
 create mode 100644 Misc/NEWS.d/next/Core and Builtins/2020-12-22-20-30-11.bpo-42246.7BrPLg.rst
bisect run success

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42810>
_______________________________________

From report at bugs.python.org  Sat Jan  2 21:37:42 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 03 Jan 2021 02:37:42 +0000
Subject: [issue42810] Nested if/else gets phantom else trace (3.10)
In-Reply-To: <1609600165.12.0.126191975832.issue42810@roundup.psfhosted.org>
Message-ID: <1609641462.41.0.55872840958.issue42810@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

There is something wrong elsewhere as well because even if reverting that commit fix the problem:

? git reset --hard upstream/master
HEAD is now at bd2728b1e8 bpo-42806: Fix ast locations of f-strings inside parentheses (GH-24067)

~/github/python/master master*
? git revert 28b75c80dcc1e17ed3ac1c69362bf8dc164b760a
Removing Misc/NEWS.d/next/Core and Builtins/2020-12-22-20-30-11.bpo-42246.7BrPLg.rst
mak[master 444e7e11a8] Revert "bpo-42246: Don't eliminate jumps to jumps, if it will break PEP 626. (GH-23896)"
 7 files changed, 4605 insertions(+), 4707 deletions(-)
 delete mode 100644 Misc/NEWS.d/next/Core and Builtins/2020-12-22-20-30-11.bpo-42246.7BrPLg.rst
 rewrite Python/importlib_external.h (87%)
 rewrite Python/importlib_zipimport.h (85%)
e
~/github/python/master master* ?
? make -j -s
 CC='gcc -pthread' LDSHARED='gcc -pthread -shared    ' OPT='-g -Og -Wall'       _TCLTK_INCLUDES='' _TCLTK_LIBS=''       ./python -E ./setup.py -q build

The following modules found by detect_modules() in setup.py, have been
built by the Makefile instead, as configured by the Setup files:
_abc                  pwd                   time


~/github/python/master master* ?
? ./python -m trace --trace ./lel.py
 --- modulename: lel, funcname: <module>
lel.py(1): a = b = x = y = z = 1
lel.py(2): if a == 1:
lel.py(3):     if b == 1:
lel.py(4):         x = 4
lel.py(9): assert (a, b, x, y, z) == (1, 1, 4, 1, 1)

Not running the optimize_basic_block function:

diff --git a/Python/compile.c b/Python/compile.c
index 6698b55000..30a0305ef1 100644
--- a/Python/compile.c
+++ b/Python/compile.c
@@ -6074,6 +6074,7 @@ fold_tuple_on_constants(struct instr *inst,
 static int
 optimize_basic_block(basicblock *bb, PyObject *consts)
 {
+    return 0;
     assert(PyList_CheckExact(consts));
     struct instr nop;
     nop.i_opcode = NOP;

makes the problem appear again:

? make -j -s
 CC='gcc -pthread' LDSHARED='gcc -pthread -shared    ' OPT='-g -Og -Wall'       _TCLTK_INCLUDES='' _TCLTK_LIBS=''       ./python -E ./setup.py -q build

The following modules found by detect_modules() in setup.py, have been
built by the Makefile instead, as configured by the Setup files:
_abc                  pwd                   time


~/github/python/master master* ?
? ./python -m trace --trace ./lel.py
 --- modulename: lel, funcname: <module>
lel.py(1): a = b = x = y = z = 1
lel.py(2): if a == 1:
lel.py(3):     if b == 1:
lel.py(4):         x = 4
lel.py(6):         y = 6
lel.py(9): assert (a, b, x, y, z) == (1, 1, 4, 1, 1)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42810>
_______________________________________

From report at bugs.python.org  Sat Jan  2 21:53:43 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 03 Jan 2021 02:53:43 +0000
Subject: [issue42093] Add opcode cache for LOAD_ATTR
In-Reply-To: <1603163916.18.0.528007796853.issue42093@roundup.psfhosted.org>
Message-ID: <1609642423.78.0.478710689338.issue42093@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
pull_requests: +22903
pull_request: https://github.com/python/cpython/pull/24070

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42093>
_______________________________________

From report at bugs.python.org  Sat Jan  2 23:38:11 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 03 Jan 2021 04:38:11 +0000
Subject: [issue42093] Add opcode cache for LOAD_ATTR
In-Reply-To: <1603163916.18.0.528007796853.issue42093@roundup.psfhosted.org>
Message-ID: <1609648691.62.0.913962483928.issue42093@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset 9e8fe1986cb4205fb9f883c89b9d5d76a9847e0b by Pablo Galindo in branch 'master':
bpo-42093: Tweak the what's new message about the new LOAD_ATTR opcode cache (GH-24070)
https://github.com/python/cpython/commit/9e8fe1986cb4205fb9f883c89b9d5d76a9847e0b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42093>
_______________________________________

From report at bugs.python.org  Sun Jan  3 00:37:51 2021
From: report at bugs.python.org (Gregory P. Smith)
Date: Sun, 03 Jan 2021 05:37:51 +0000
Subject: [issue7946] Convoy effect with I/O bound threads and New GIL
In-Reply-To: <1266353325.38.0.278549753357.issue7946@psf.upfronthosting.co.za>
Message-ID: <1609652271.06.0.263524528058.issue7946@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
resolution:  -> wont fix

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue7946>
_______________________________________

From report at bugs.python.org  Sun Jan  3 00:51:32 2021
From: report at bugs.python.org (Chaim Gewirtz)
Date: Sun, 03 Jan 2021 05:51:32 +0000
Subject: [issue42812] @overload-ing method of parent class without actual
 implementation
Message-ID: <1609653092.18.0.893619520042.issue42812@roundup.psfhosted.org>


New submission from Chaim Gewirtz <chaim422 at gmail.com>:

Why should @overload need to be followed by an implementation when an implementation already exists in the parent class?

Illustrative example:

class Parent:
    def foo(**kwargs):
        """Argument names of foo vary depending on the child class."""

class Child(Parent):
    @overload foo(a, b): ...
    
Raises:

"NotImplementedError: You should not call an overloaded function. A series of @overload-decorated functions outside a stub module should always be followed by an implementation that is not @overload-ed."

----------
messages: 384255
nosy: chaim422
priority: normal
severity: normal
status: open
title: @overload-ing method of parent class without actual implementation
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42812>
_______________________________________

From report at bugs.python.org  Sun Jan  3 03:22:14 2021
From: report at bugs.python.org (karl)
Date: Sun, 03 Jan 2021 08:22:14 +0000
Subject: [issue41748] HTMLParser: parsing error
In-Reply-To: <1599602370.01.0.842812753139.issue41748@roundup.psfhosted.org>
Message-ID: <1609662134.54.0.633908039041.issue41748@roundup.psfhosted.org>


karl <karl+pythonbugs at la-grange.net> added the comment:

Ezio,

TL,DR: Testing in browsers and adding two tests for this issue. 
       Should I create a PR just for the tests?

https://github.com/python/cpython/blame/63298930fb531ba2bb4f23bc3b915dbf1e17e9e1/Lib/test/test_htmlparser.py#L479-L485


A: comma without spaces
-----------------------


Tests for browsers:
data:text/html,<!doctype html><div class=bar,baz=asd>text</div>

Serializations:
* Firefox, Gecko (86.0a1 (2020-12-28) (64-bit)) 
* Edge, Blink (Version 89.0.752.0 (Version officielle) Canary (64 bits))
* Safari, WebKit (Release 117 (Safari 14.1, WebKit 16611.1.7.2))

Same serialization in these 3 rendering engines
<div class="bar,baz=asd">text</div>


Adding:

    def test_comma_between_unquoted_attributes(self):
        # bpo 41748
        self._run_check('<div class=bar,baz=asd>',
                        [('starttag', 'div', [('class', 'bar,baz=asd')])])


? ./python.exe -m test -v test_htmlparser

?
test_comma_between_unquoted_attributes (test.test_htmlparser.HTMLParserTestCase) ... ok
?

Ran 47 tests in 0.168s

OK

== Tests result: SUCCESS ==

1 test OK.

Total duration: 369 ms
Tests result: SUCCESS


So this is working as expected for the first test.


B: comma with spaces
--------------------

Tests for browsers:
data:text/html,<!doctype html><div class=bar, baz=asd>text</div>

Serializations:
* Firefox, Gecko (86.0a1 (2020-12-28) (64-bit)) 
* Edge, Blink (Version 89.0.752.0 (Version officielle) Canary (64 bits))
* Safari, WebKit (Release 117 (Safari 14.1, WebKit 16611.1.7.2))

Same serialization in these 3 rendering engines
<div class="bar" ,baz="asd">text</div>


Adding
    def test_comma_with_space_between_unquoted_attributes(self):
        # bpo 41748
        self._run_check('<div class=bar ,baz=asd>',
                        [('starttag', 'div', [
                            ('class', 'bar'),
                            (',baz', 'asd')])])


? ./python.exe -m test -v test_htmlparser


This is failing.

======================================================================
FAIL: test_comma_with_space_between_unquoted_attributes (test.test_htmlparser.HTMLParserTestCase)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/karl/code/cpython/Lib/test/test_htmlparser.py", line 493, in test_comma_with_space_between_unquoted_attributes
    self._run_check('<div class=bar ,baz=asd>',
  File "/Users/karl/code/cpython/Lib/test/test_htmlparser.py", line 95, in _run_check
    self.fail("received events did not match expected events" +
AssertionError: received events did not match expected events
Source:
'<div class=bar ,baz=asd>'
Expected:
[('starttag', 'div', [('class', 'bar'), (',baz', 'asd')])]
Received:
[('data', '<div class=bar ,baz=asd>')]

----------------------------------------------------------------------


I started to look into the code of parser.py which I'm not familiar (yet) with.

https://github.com/python/cpython/blob/63298930fb531ba2bb4f23bc3b915dbf1e17e9e1/Lib/html/parser.py#L42-L52

Do you have a suggestion to fix it?

----------
nosy: +karlcow

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41748>
_______________________________________

From report at bugs.python.org  Sun Jan  3 03:26:58 2021
From: report at bugs.python.org (karl)
Date: Sun, 03 Jan 2021 08:26:58 +0000
Subject: [issue41748] HTMLParser: comma in attribute values with/without space
In-Reply-To: <1599602370.01.0.842812753139.issue41748@roundup.psfhosted.org>
Message-ID: <1609662418.62.0.772363781542.issue41748@roundup.psfhosted.org>


Change by karl <karl+pythonbugs at la-grange.net>:


----------
title: HTMLParser: parsing error -> HTMLParser: comma in attribute values with/without space

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41748>
_______________________________________

From report at bugs.python.org  Sun Jan  3 03:33:08 2021
From: report at bugs.python.org (Xinmeng Xia)
Date: Sun, 03 Jan 2021 08:33:08 +0000
Subject: [issue42813] Extra spaces cause unexpected EOF error in "compile"
 function with mode "single"
Message-ID: <1609662788.81.0.389452774776.issue42813@roundup.psfhosted.org>


New submission from Xinmeng Xia <xiaxm at smail.nju.edu.cn>:

Running the following program will lead to an unexpected EOF error. If we delete the space before  triple-quotation mark("""), the error will gone. If we replace the content of snippet with "a = 1", the program will work well. However, if we replace the content of snippet with "if a:pass" in a single line, the program cause an error again. This is weird. 

Spaces in the end of a statement should not affect the compilation of program in "single" mode. Besides, the error messages are different in Python2 and Python3. Indentation error are reported in Python 2 for snippet" if a:pass" while SyntaxError are reported in Python 3. 
  
======================================================
import math
def check_stack_size( code):
    # To assert that the alleged stack size is not O(N), we
    # check that it is smaller than log(N).
    if isinstance(code, str):
        code = compile(code, "<foo>", "single")
    max_size = math.ceil(math.log(len(code.co_code)))
    # self.assertLessEqual(code.co_stacksize, max_size)

def test_if_else():
    snippet ="""
if x:
    a
elif y:
    b
else:
    c     
    """
    check_stack_size(snippet)

test_if_else()
=====================================================
Behavior in Python 3.10:
Traceback (most recent call last):
  File "/home/xxm/Desktop/nameChanging/report/temp.py", line 30, in <module>
    test_if_else()
  File "/home/xxm/Desktop/nameChanging/report/temp.py", line 20, in test_if_else
    check_stack_size(snippet)
  File "/home/xxm/Desktop/nameChanging/report/temp.py", line 6, in check_stack_size
    code = compile(code, "<foo>", "single")
  File "<foo>", line 8
    
SyntaxError: unexpected EOF while parsing

Behaviors in Python2: 
Traceback (most recent call last):
  File "/home/xxm/Desktop/nameChanging/report/temp.py", line 30, in <module>
    test_if_else()
  File "/home/xxm/Desktop/nameChanging/report/temp.py", line 27, in test_if_else
    check_stack_size(snippet)
  File "/home/xxm/Desktop/nameChanging/report/temp.py", line 6, in check_stack_size
    code = compile(code, "<foo>", "single")
  File "<foo>", line 3
    
    ^
IndentationError: unexpected indent

----------
components: Interpreter Core
messages: 384257
nosy: xxm
priority: normal
severity: normal
status: open
title: Extra spaces cause unexpected EOF error in "compile" function with mode "single"
type: compile error
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42813>
_______________________________________

From report at bugs.python.org  Sun Jan  3 03:49:01 2021
From: report at bugs.python.org (karl)
Date: Sun, 03 Jan 2021 08:49:01 +0000
Subject: [issue41748] HTMLParser: comma in attribute values with/without space
In-Reply-To: <1599602370.01.0.842812753139.issue41748@roundup.psfhosted.org>
Message-ID: <1609663741.05.0.47042034978.issue41748@roundup.psfhosted.org>


karl <karl+pythonbugs at la-grange.net> added the comment:

Ah!

This is fixing it

diff --git a/Lib/html/parser.py b/Lib/html/parser.py
index 6083077981..ffff790666 100644
--- a/Lib/html/parser.py
+++ b/Lib/html/parser.py
@@ -44,7 +44,7 @@
       (?:\s*=+\s*                    # value indicator
         (?:'[^']*'                   # LITA-enclosed value
           |"[^"]*"                   # LIT-enclosed value
-          |(?!['"])[^>\s]*           # bare value
+          |(?!['"])[^>]*           # bare value
          )
          (?:\s*,)*                   # possibly followed by a comma
        )?(?:\s|/(?!>))*




Ran 48 tests in 0.175s

OK

== Tests result: SUCCESS ==

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41748>
_______________________________________

From report at bugs.python.org  Sun Jan  3 03:49:49 2021
From: report at bugs.python.org (Ezio Melotti)
Date: Sun, 03 Jan 2021 08:49:49 +0000
Subject: [issue41748] HTMLParser: comma in attribute values with/without space
In-Reply-To: <1599602370.01.0.842812753139.issue41748@roundup.psfhosted.org>
Message-ID: <1609663789.45.0.809660769829.issue41748@roundup.psfhosted.org>


Ezio Melotti <ezio.melotti at gmail.com> added the comment:

Writing tests that verify the expected behavior is a great first step. The expected output in the tests should match the behavior described by the HTML 5 specs (which should also correspond to the browsers' behavior), and should initially fail. You can start creating a PR with only the tests, clarifying that it's a work in progress, or wait until you have the fix too.

The next step would be tweaking the regex and the code until both the new tests and all the other ones work (excluding the one with the commas you are fixing).  You can then commit the fix in the same branch and push it -- GitHub will automatically update the PR.


> Do you have a suggestion to fix it?

If you are familiar enough with regexes, you could try to figure out whether it matches the invalid attributes or not, and if not why (I took a quick look and I didn't see anything immediately wrong in the regexes).

Since the output of the failing test is [('data', '<div class=bar ,baz=asd>')], it's likely that the parser doesn't know how to handle it and passes it to one of the handle_data() in the goahead() method.  You can figure out which one is being called and see which are the if-conditions that are leading the interpreter down this path rather than the usual path where the attributes are parsed correctly.

If you have other questions let me know :)

----------
type: crash -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41748>
_______________________________________

From report at bugs.python.org  Sun Jan  3 03:52:13 2021
From: report at bugs.python.org (karl)
Date: Sun, 03 Jan 2021 08:52:13 +0000
Subject: [issue41748] HTMLParser: comma in attribute values with/without space
In-Reply-To: <1599602370.01.0.842812753139.issue41748@roundup.psfhosted.org>
Message-ID: <1609663933.36.0.107337903735.issue41748@roundup.psfhosted.org>


Change by karl <karl+pythonbugs at la-grange.net>:


----------
keywords: +patch
pull_requests: +22904
stage: test needed -> patch review
pull_request: https://github.com/python/cpython/pull/24072

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41748>
_______________________________________

From report at bugs.python.org  Sun Jan  3 05:32:05 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 03 Jan 2021 10:32:05 +0000
Subject: [issue42789] Do not skip test_curses on non-tty
In-Reply-To: <1609355195.18.0.84938555409.issue42789@roundup.psfhosted.org>
Message-ID: <1609669925.03.0.264094923085.issue42789@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

I guess I should merge a PR for issue42681 first.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42789>
_______________________________________

From report at bugs.python.org  Sun Jan  3 06:40:24 2021
From: report at bugs.python.org (Zackery Spytz)
Date: Sun, 03 Jan 2021 11:40:24 +0000
Subject: [issue42814] Undefined behavior in Objects/genericaliasobject.c
Message-ID: <1609674024.61.0.74243567004.issue42814@roundup.psfhosted.org>


New submission from Zackery Spytz <zspytz at gmail.com>:

In is_typing_name(), va_end() is not always called before the function returns.  It is undefined behavior to call va_start() without also calling va_end().

----------
components: Interpreter Core
messages: 384261
nosy: ZackerySpytz
priority: normal
severity: normal
status: open
title: Undefined behavior in Objects/genericaliasobject.c
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42814>
_______________________________________

From report at bugs.python.org  Sun Jan  3 06:42:49 2021
From: report at bugs.python.org (Zackery Spytz)
Date: Sun, 03 Jan 2021 11:42:49 +0000
Subject: [issue42814] Undefined behavior in Objects/genericaliasobject.c
In-Reply-To: <1609674024.61.0.74243567004.issue42814@roundup.psfhosted.org>
Message-ID: <1609674169.44.0.326141097716.issue42814@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
keywords: +patch
pull_requests: +22906
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24073

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42814>
_______________________________________

From report at bugs.python.org  Sun Jan  3 06:43:34 2021
From: report at bugs.python.org (Yurii Karabas)
Date: Sun, 03 Jan 2021 11:43:34 +0000
Subject: [issue42815] new thread doesn't copy context of the parent thread
Message-ID: <1609674214.71.0.941381845328.issue42815@roundup.psfhosted.org>


New submission from Yurii Karabas <1998uriyyo at gmail.com>:

New thread doesn't copy context of the parent thread.

The minimal example to reproduce the issue:
```
from threading import Thread
from contextvars import ContextVar

foo: ContextVar[str] = ContextVar("foo")


def temp():
    print(foo.get())


foo.set("bar")

t = Thread(target=temp)
t.start()
t.join()
```

Is it expected behavior?

PEP 567 I didn't find anything regarding this case.

----------
components: Library (Lib)
messages: 384262
nosy: uriyyo
priority: normal
severity: normal
status: open
title: new thread doesn't copy context of the parent thread
type: behavior
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42815>
_______________________________________

From report at bugs.python.org  Sun Jan  3 06:46:40 2021
From: report at bugs.python.org (Yurii Karabas)
Date: Sun, 03 Jan 2021 11:46:40 +0000
Subject: [issue42815] new thread doesn't copy context of the parent thread
In-Reply-To: <1609674214.71.0.941381845328.issue42815@roundup.psfhosted.org>
Message-ID: <1609674400.18.0.748238578637.issue42815@roundup.psfhosted.org>


Change by Yurii Karabas <1998uriyyo at gmail.com>:


----------
keywords: +patch
pull_requests: +22907
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24074

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42815>
_______________________________________

From report at bugs.python.org  Sun Jan  3 06:48:13 2021
From: report at bugs.python.org (Yurii Karabas)
Date: Sun, 03 Jan 2021 11:48:13 +0000
Subject: [issue42455] Add decorator_factory function to functools module
In-Reply-To: <1606250077.84.0.747907374749.issue42455@roundup.psfhosted.org>
Message-ID: <1609674493.76.0.276113833025.issue42455@roundup.psfhosted.org>


Yurii Karabas <1998uriyyo at gmail.com> added the comment:

What we should do with this issue?

There was no much discussion at python-ideas.

I have received only one -1 opinion.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42455>
_______________________________________

From report at bugs.python.org  Sun Jan  3 06:52:22 2021
From: report at bugs.python.org (Ronald Oussoren)
Date: Sun, 03 Jan 2021 11:52:22 +0000
Subject: [issue38946] IDLE on macOS 10.15 Catalina does not open
 double-clicked files if app already launched
In-Reply-To: <1575141041.2.0.751349559914.issue38946@roundup.psfhosted.org>
Message-ID: <1609674742.81.0.686748880164.issue38946@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

As another datapoint: This works for me on macOS 11.1 with the universal2 installer for Python 3.9.1 (which includes Tk 8.6.10).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38946>
_______________________________________

From report at bugs.python.org  Sun Jan  3 06:53:09 2021
From: report at bugs.python.org (Yurii Karabas)
Date: Sun, 03 Jan 2021 11:53:09 +0000
Subject: [issue42812] @overload-ing method of parent class without actual
 implementation
In-Reply-To: <1609653092.18.0.893619520042.issue42812@roundup.psfhosted.org>
Message-ID: <1609674789.93.0.0707728209379.issue42812@roundup.psfhosted.org>


Yurii Karabas <1998uriyyo at gmail.com> added the comment:

The purpose of `@overload` is quite different. I believe you thought that this is smth like `@override` in Java world but it different.

Basically, the correct usage of `@overaload` is:
```
@overload
def process(response: None) -> None:
    ...
@overload
def process(response: int) -> tuple[int, str]:
    ...
@overload
def process(response: bytes) -> str:
    ...
def process(response):
    <actual implementation>
```

Please, follow this link for more information https://docs.python.org/3/library/typing.html#typing.overload

----------
nosy: +uriyyo

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42812>
_______________________________________

From report at bugs.python.org  Sun Jan  3 07:16:30 2021
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 03 Jan 2021 12:16:30 +0000
Subject: [issue42815] new thread doesn't copy context of the parent thread
In-Reply-To: <1609674214.71.0.941381845328.issue42815@roundup.psfhosted.org>
Message-ID: <1609676190.39.0.892703007861.issue42815@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy: +yselivanov

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42815>
_______________________________________

From report at bugs.python.org  Sun Jan  3 07:18:30 2021
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 03 Jan 2021 12:18:30 +0000
Subject: [issue42814] Undefined behavior in Objects/genericaliasobject.c
In-Reply-To: <1609674024.61.0.74243567004.issue42814@roundup.psfhosted.org>
Message-ID: <1609676310.79.0.137539417149.issue42814@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 5d3553b0a8959e7505bbec4de03077dbf135ee4b by Zackery Spytz in branch 'master':
bpo-42814: Fix undefined behavior in Objects/genericaliasobject.c (GH-24073)
https://github.com/python/cpython/commit/5d3553b0a8959e7505bbec4de03077dbf135ee4b


----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42814>
_______________________________________

From report at bugs.python.org  Sun Jan  3 07:22:16 2021
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 03 Jan 2021 12:22:16 +0000
Subject: [issue42814] Undefined behavior in Objects/genericaliasobject.c
In-Reply-To: <1609674024.61.0.74243567004.issue42814@roundup.psfhosted.org>
Message-ID: <1609676536.03.0.341041457642.issue42814@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Thanks for the fix!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42814>
_______________________________________

From report at bugs.python.org  Sun Jan  3 07:35:30 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 03 Jan 2021 12:35:30 +0000
Subject: [issue38308] Add optional weighting to statistics.harmonic_mean()
In-Reply-To: <1569695295.83.0.838130885601.issue38308@roundup.psfhosted.org>
Message-ID: <1609677330.0.0.579231286061.issue38308@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 66136768615472a8d1a18b5018095b9737dbab8c by Zackery Spytz in branch 'master':
bpo-38308: Fix the "versionchanged" for the *weights* of harmonic_mean() (GH-23919)
https://github.com/python/cpython/commit/66136768615472a8d1a18b5018095b9737dbab8c


----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38308>
_______________________________________

From report at bugs.python.org  Sun Jan  3 08:09:40 2021
From: report at bugs.python.org (Batuhan Taskaya)
Date: Sun, 03 Jan 2021 13:09:40 +0000
Subject: [issue42455] Add decorator_factory function to functools module
In-Reply-To: <1606250077.84.0.747907374749.issue42455@roundup.psfhosted.org>
Message-ID: <1609679380.66.0.471292767864.issue42455@roundup.psfhosted.org>


Batuhan Taskaya <isidentical at gmail.com> added the comment:

I also agree with Raymond's opinion, and from the point that it didn't get much attention I'd assume not many people need it. So count me as -1

----------
nosy: +BTaskaya

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42455>
_______________________________________

From report at bugs.python.org  Sun Jan  3 08:09:42 2021
From: report at bugs.python.org (Martin Winks)
Date: Sun, 03 Jan 2021 13:09:42 +0000
Subject: [issue42816] Add str.split_iter function
Message-ID: <1609679382.47.0.0845431201313.issue42816@roundup.psfhosted.org>


New submission from Martin Winks <cat at snejugal.ru>:

Split string by given separator and return iterator as a result.

The naive and not very efficient solution would be using current str.split:

def split_iter(self: str, sep: str) -> 'Iterator[str]':
    return iter(self.split(sep))

Probably, need we'll some better solution without allocating new list.

----------
components: Unicode
messages: 384270
nosy: ezio.melotti, uwinx, vstinner
priority: normal
severity: normal
status: open
title: Add str.split_iter function
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42816>
_______________________________________

From report at bugs.python.org  Sun Jan  3 08:11:33 2021
From: report at bugs.python.org (Petr Viktorin)
Date: Sun, 03 Jan 2021 13:11:33 +0000
Subject: [issue40077] Convert static types to heap types: use PyType_FromSpec()
In-Reply-To: <1585238684.65.0.246012172449.issue40077@roundup.psfhosted.org>
Message-ID: <1609679493.33.0.831271629173.issue40077@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:


New changeset b8eb3765908c0063f0739595ba4b296cc8863d19 by Erlend Egeberg Aasland in branch 'master':
bpo-40077: Add traverse/clear/free to arraymodule (GH-24066)
https://github.com/python/cpython/commit/b8eb3765908c0063f0739595ba4b296cc8863d19


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40077>
_______________________________________

From report at bugs.python.org  Sun Jan  3 08:18:17 2021
From: report at bugs.python.org (Petr Viktorin)
Date: Sun, 03 Jan 2021 13:18:17 +0000
Subject: [issue40077] Convert static types to heap types: use PyType_FromSpec()
In-Reply-To: <1585238684.65.0.246012172449.issue40077@roundup.psfhosted.org>
Message-ID: <1609679897.36.0.134805142171.issue40077@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

Yes, please keep _testcapimodule.c as it is. Static types are still supported and need to be tested.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40077>
_______________________________________

From report at bugs.python.org  Sun Jan  3 08:19:56 2021
From: report at bugs.python.org (Kevin Rasmussen)
Date: Sun, 03 Jan 2021 13:19:56 +0000
Subject: [issue42817] timedelta zeropadding hh
Message-ID: <1609679996.96.0.581038745817.issue42817@roundup.psfhosted.org>


New submission from Kevin Rasmussen <kj_529 at hotmail.com>:

It looks like hh should be zeropadded to 2 and isn't for timedelta.

----------
messages: 384273
nosy: krasmussen
priority: normal
severity: normal
status: open
title: timedelta zeropadding hh
type: behavior
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42817>
_______________________________________

From report at bugs.python.org  Sun Jan  3 08:23:48 2021
From: report at bugs.python.org (Kevin Rasmussen)
Date: Sun, 03 Jan 2021 13:23:48 +0000
Subject: [issue42817] timedelta zeropadding hh
In-Reply-To: <1609679996.96.0.581038745817.issue42817@roundup.psfhosted.org>
Message-ID: <1609680228.39.0.3136623058.issue42817@roundup.psfhosted.org>


Change by Kevin Rasmussen <kj_529 at hotmail.com>:


----------
keywords: +patch
pull_requests: +22908
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24075

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42817>
_______________________________________

From report at bugs.python.org  Sun Jan  3 08:40:58 2021
From: report at bugs.python.org (Steven D'Aprano)
Date: Sun, 03 Jan 2021 13:40:58 +0000
Subject: [issue42816] Add str.split_iter function
In-Reply-To: <1609679382.47.0.0845431201313.issue42816@roundup.psfhosted.org>
Message-ID: <1609681258.66.0.62269398911.issue42816@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

I am pretty sure this has been discussed and rejected on the Python-Ideas mailing list before.

If not rejected, the idea didn't go very far. You may wish to search the mailing list archives for previous discussions.

Either way, I think this should be discussed on Python-Ideas, to see if there is a consensus on this, and whether or not this is a large enough change that it needs a PEP.

----------
nosy: +steven.daprano

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42816>
_______________________________________

From report at bugs.python.org  Sun Jan  3 08:43:14 2021
From: report at bugs.python.org (Steven D'Aprano)
Date: Sun, 03 Jan 2021 13:43:14 +0000
Subject: [issue42816] Add str.split_iter function
In-Reply-To: <1609679382.47.0.0845431201313.issue42816@roundup.psfhosted.org>
Message-ID: <1609681394.55.0.422489340401.issue42816@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

See also discussion here: #17343

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42816>
_______________________________________

From report at bugs.python.org  Sun Jan  3 08:58:27 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 03 Jan 2021 13:58:27 +0000
Subject: [issue42816] Add str.split_iter function
In-Reply-To: <1609679382.47.0.0845431201313.issue42816@roundup.psfhosted.org>
Message-ID: <1609682307.81.0.0799805733074.issue42816@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Issue17343 mentions also a separate method str.itersplit, so I close this issue as a duplicate.

----------
nosy: +serhiy.storchaka
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> Add a version of str.split which returns an iterator

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42816>
_______________________________________

From report at bugs.python.org  Sun Jan  3 08:58:55 2021
From: report at bugs.python.org (Kevin Rasmussen)
Date: Sun, 03 Jan 2021 13:58:55 +0000
Subject: [issue42817] timedelta zeropadding hh
In-Reply-To: <1609679996.96.0.581038745817.issue42817@roundup.psfhosted.org>
Message-ID: <1609682335.25.0.08544907835.issue42817@roundup.psfhosted.org>


Kevin Rasmussen <kj_529 at hotmail.com> added the comment:

Current behaviour:

```
# python
Python 3.9.1 (default, Dec 18 2020, 05:16:04) 
[GCC 8.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import datetime
>>> td = datetime.timedelta(hours=3)
>>> str(td)
'3:00:00'
>>> dt = datetime.datetime.strptime(str(td), "%H:%M:%S")
>>> dt.strftime("%H:%M:%S")
'03:00:00'
>>> 
```

Expected behaviour:

```
# python
Python 3.9.1 (default, Dec 18 2020, 05:16:04) 
[GCC 8.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import datetime
>>> td = datetime.timedelta(hours=3)
>>> str(td)
'03:00:00'
>>> dt = datetime.datetime.strptime(str(td), "%H:%M:%S")
>>> dt.strftime("%H:%M:%S")
'03:00:00'
>>> 
```

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42817>
_______________________________________

From report at bugs.python.org  Sun Jan  3 09:00:57 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 03 Jan 2021 14:00:57 +0000
Subject: [issue42817] timedelta zeropadding hh
In-Reply-To: <1609679996.96.0.581038745817.issue42817@roundup.psfhosted.org>
Message-ID: <1609682457.73.0.575896754351.issue42817@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Why should it be zeropadded to 2?

It is likely this option was considered when that code was added, and rejected.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42817>
_______________________________________

From report at bugs.python.org  Sun Jan  3 09:09:35 2021
From: report at bugs.python.org (Klaus Ethgen)
Date: Sun, 03 Jan 2021 14:09:35 +0000
Subject: [issue42818] AttributeError: 'zipimporter' object has no attribute
 'find_spec'
Message-ID: <1609682975.59.0.559934544299.issue42818@roundup.psfhosted.org>


New submission from Klaus Ethgen <Klaus at Ethgen.de>:

I encountered the bug when installing a package with `python3 setup.py install --user`. After that, a second installation failed with this stack trace:
```
Traceback (most recent call last):                                                                                                                            
  File "/usr/lib/python3/dist-packages/pkg_resources/__init__.py", line 2191, in _handle_ns                                                                   
    loader = importer.find_spec(packageName).loader                                                                                                           
AttributeError: 'zipimporter' object has no attribute 'find_spec'                                                                                             

During handling of the above exception, another exception occurred:                                                                                           

Traceback (most recent call last):                                                                                                                            
  File "/home/klaus/devel/upstream/pass-git-helper/setup.py", line 1, in <module>                                                                             
    from setuptools import setup                                                                                                                              
  File "/usr/lib/python3/dist-packages/setuptools/__init__.py", line 16, in <module>                                                                          
    import setuptools.version                                                                                                                                 
  File "/usr/lib/python3/dist-packages/setuptools/version.py", line 1, in <module>                                                                            
    import pkg_resources                                                                                                                                      
  File "/usr/lib/python3/dist-packages/pkg_resources/__init__.py", line 3239, in <module>                                                                     
    def _initialize_master_working_set():                                                                                                                     
  File "/usr/lib/python3/dist-packages/pkg_resources/__init__.py", line 3222, in _call_aside                                                                  
    f(*args, **kwargs)                                                                                                                                        
  File "/usr/lib/python3/dist-packages/pkg_resources/__init__.py", line 3264, in _initialize_master_working_set                                               
    tuple(                                                                                                                                              
  File "/usr/lib/python3/dist-packages/pkg_resources/__init__.py", line 3265, in <genexpr>                                                                    
    dist.activate(replace=False)                                                                                                                              
  File "/usr/lib/python3/dist-packages/pkg_resources/__init__.py", line 2780, in activate                                                                     
    declare_namespace(pkg)                                                                                                                                    
  File "/usr/lib/python3/dist-packages/pkg_resources/__init__.py", line 2279, in declare_namespace                                                            
    _handle_ns(packageName, path_item)                                                                                                                        
  File "/usr/lib/python3/dist-packages/pkg_resources/__init__.py", line 2196, in _handle_ns                                                                   
    loader = importer.find_spec(packageName)                                                                                                                  
AttributeError: 'zipimporter' object has no attribute 'find_spec'
```

This error happens now also with different tools.

Solution is to `rm -fr ~/.local/lib`. But the next installation triggers the bug again.

The only solution is to install via `python3 setup.py install --user --old-and-unmanageable`.

When I look into the code of zipimport(er), I do not see any find_spec only the old find_loader.

Despite it is a core library, this must be fixed! And with that the name should match the name of the py file to make it able to find the relevant file.

----------
components: Library (Lib)
messages: 384279
nosy: mowgli
priority: normal
severity: normal
status: open
title: AttributeError: 'zipimporter' object has no attribute 'find_spec'
type: crash
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42818>
_______________________________________

From report at bugs.python.org  Sun Jan  3 09:15:06 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 03 Jan 2021 14:15:06 +0000
Subject: [issue42789] Do not skip test_curses on non-tty
In-Reply-To: <1609355195.18.0.84938555409.issue42789@roundup.psfhosted.org>
Message-ID: <1609683306.45.0.485116456546.issue42789@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +22910
pull_request: https://github.com/python/cpython/pull/24076

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42789>
_______________________________________

From report at bugs.python.org  Sun Jan  3 09:23:20 2021
From: report at bugs.python.org (Martin Winks)
Date: Sun, 03 Jan 2021 14:23:20 +0000
Subject: [issue17343] Add a version of str.split which returns an iterator
In-Reply-To: <1362359066.58.0.311917237277.issue17343@psf.upfronthosting.co.za>
Message-ID: <1609683800.95.0.352498603587.issue17343@roundup.psfhosted.org>


Martin Winks <cat at snejugal.ru> added the comment:

> Perhaps the use case is already served by re.finditer()

def split_whitespace_ascii(s: str):
    return (pt.group(0) for pt in re.finditer(r"[A-Za-z']+", s))

solution above does not cover all possible data and is incorrect for bytes-like objects.

writing regular expressions for different separators/data would be a quite overheadish, so the idea of one-case solution doesn't seem to go very far and requires a bigger change in code for different separators.

let's try to revive this one :)

----------
nosy: +uwinx

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17343>
_______________________________________

From report at bugs.python.org  Sun Jan  3 10:48:06 2021
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 03 Jan 2021 15:48:06 +0000
Subject: [issue41798] [C API] Revisit usage of the PyCapsule C API with
 multi-phase initialization API
In-Reply-To: <1600265269.2.0.881235166904.issue41798@roundup.psfhosted.org>
Message-ID: <1609688886.71.0.342304658844.issue41798@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 7c83eaa536d2f436ae46211ca48692f576c732f0 by Hai Shi in branch 'master':
bpo-41798: pyexpat: Allocate the expat_CAPI on the heap memory (GH-24061)
https://github.com/python/cpython/commit/7c83eaa536d2f436ae46211ca48692f576c732f0


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41798>
_______________________________________

From report at bugs.python.org  Sun Jan  3 11:22:35 2021
From: report at bugs.python.org (Kevin Rasmussen)
Date: Sun, 03 Jan 2021 16:22:35 +0000
Subject: [issue42817] timedelta zeropadding hh
In-Reply-To: <1609679996.96.0.581038745817.issue42817@roundup.psfhosted.org>
Message-ID: <1609690955.6.0.704010811981.issue42817@roundup.psfhosted.org>


Kevin Rasmussen <kj_529 at hotmail.com> added the comment:

Question:
Why should it be zeropadded to 2?

Answer:
Why wouldn't it be zeropadded to match the rest of the library?

Honestly it just seemed like an inconsistency with the rest of the datetime module.

It caught me off guard when I went I tried to pull __str__ of a timedelta and the padding was different than what I saw elsewhere.

I figured it could potentially be a quick fix if the current behaviour is not desired.

I'm curious why that would have been rejected if it was even considered/noticed before.

Do you know of any good way to figure out if this was discussed before? So far all I have done for searching was a search of issues that were already brought up and I didn't find anything at first glance.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42817>
_______________________________________

From report at bugs.python.org  Sun Jan  3 11:33:16 2021
From: report at bugs.python.org (Chaim Gewirtz)
Date: Sun, 03 Jan 2021 16:33:16 +0000
Subject: [issue42812] @overload-ing method of parent class without actual
 implementation
In-Reply-To: <1609653092.18.0.893619520042.issue42812@roundup.psfhosted.org>
Message-ID: <1609691596.39.0.86490176656.issue42812@roundup.psfhosted.org>


Chaim Gewirtz <chaim422 at gmail.com> added the comment:

"The purpose of `@overload` is quite different." So, this would overload the @overload decorator. Hmmm...

Is there a better way to accomplish this goal? What would you suggest, a new decorator?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42812>
_______________________________________

From report at bugs.python.org  Sun Jan  3 11:40:47 2021
From: report at bugs.python.org (Chaim Gewirtz)
Date: Sun, 03 Jan 2021 16:40:47 +0000
Subject: [issue42812] @overload-ing method of parent class without actual
 implementation
In-Reply-To: <1609653092.18.0.893619520042.issue42812@roundup.psfhosted.org>
Message-ID: <1609692047.56.0.674000366147.issue42812@roundup.psfhosted.org>


Chaim Gewirtz <chaim422 at gmail.com> added the comment:

To clarify, this is how it's being done now a dozen times in actual production code:

class Child(Parent):
    @overload foo(a, b): ...
    def overload(**kwargs):
        return super().foo(**kwargs)

The goal of this proposed enhancement is to remove two extra lines of code per Child class.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42812>
_______________________________________

From report at bugs.python.org  Sun Jan  3 12:18:04 2021
From: report at bugs.python.org (Yurii Karabas)
Date: Sun, 03 Jan 2021 17:18:04 +0000
Subject: [issue42812] @overload-ing method of parent class without actual
 implementation
In-Reply-To: <1609653092.18.0.893619520042.issue42812@roundup.psfhosted.org>
Message-ID: <1609694284.85.0.734642051513.issue42812@roundup.psfhosted.org>


Yurii Karabas <1998uriyyo at gmail.com> added the comment:

`mypy` will produce an error on such code:

```
class Parent:
    def foo(self, **kwargs):
        """Argument names of foo vary depending on the child class."""


class Child(Parent):
    @overload
    def foo(self, a, b):
        pass

    def foo(self, **kwargs):
        return super().foo(**kwargs)
```

Result
```
temp.py:10: error: Single overload definition, multiple required
temp.py:10: error: Signature of "foo" incompatible with supertype "Parent"
Found 2 errors in 1 file (checked 1 source file)
```

In case if you want to add an overload for method I would recommend to use such pattern:
```
class Parent:
    def foo(self, **kwargs):
        """Argument names of foo vary depending on the child class."""


class Child(Parent):
    @overload
    def foo(self, a, b):
        pass

    @overload
    def foo(self, **kwargs):
        pass

    def foo(self, **kwargs):
        return super().foo(**kwargs)
```

So signature of `foo` will still match to parent class signature, but it will also have an overloaded variant.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42812>
_______________________________________

From report at bugs.python.org  Sun Jan  3 12:25:06 2021
From: report at bugs.python.org (Chaim Gewirtz)
Date: Sun, 03 Jan 2021 17:25:06 +0000
Subject: [issue42812] @overload-ing method of parent class without actual
 implementation
In-Reply-To: <1609653092.18.0.893619520042.issue42812@roundup.psfhosted.org>
Message-ID: <1609694706.2.0.24560227029.issue42812@roundup.psfhosted.org>


Chaim Gewirtz <chaim422 at gmail.com> added the comment:

Interesting. PyCharm has no problem with this code. It also autocompletes the argument names for me, which is very useful, especially since there a dozen different Child classes.

Isn't "Simple is better than complex", and doesn't "...practicality beat purity"?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42812>
_______________________________________

From report at bugs.python.org  Sun Jan  3 12:31:20 2021
From: report at bugs.python.org (Yurii Karabas)
Date: Sun, 03 Jan 2021 17:31:20 +0000
Subject: [issue42812] @overload-ing method of parent class without actual
 implementation
In-Reply-To: <1609653092.18.0.893619520042.issue42812@roundup.psfhosted.org>
Message-ID: <1609695080.71.0.60842479793.issue42812@roundup.psfhosted.org>


Yurii Karabas <1998uriyyo at gmail.com> added the comment:

I think the simplest solution in your case is not to use `@overload`, as far as I understand you want to override the signature of base method.

This code won't produce any error when used with `mypy`:
```
class Parent:
    def foo(**kwargs):
        """Argument names of foo vary depending on the child class."""

class Child(Parent):
    def foo(self, a, b):
        pass
``

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42812>
_______________________________________

From report at bugs.python.org  Sun Jan  3 12:43:20 2021
From: report at bugs.python.org (Chaim Gewirtz)
Date: Sun, 03 Jan 2021 17:43:20 +0000
Subject: [issue42812] @overload-ing method of parent class without actual
 implementation
In-Reply-To: <1609653092.18.0.893619520042.issue42812@roundup.psfhosted.org>
Message-ID: <1609695800.5.0.915222075343.issue42812@roundup.psfhosted.org>


Chaim Gewirtz <chaim422 at gmail.com> added the comment:

What is better?

A. Keeping Python as is, with four separate signature declarations (1x Parent, 2x @overload Child, and 1x actual signature in Child), and a second method call overhead at runtime (to satisfy mypy as it exists now).

--or--

B. Simplify Python to allow just two signature declarations and no extra overhead? 

--or--

C. Something else? Please specify.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42812>
_______________________________________

From report at bugs.python.org  Sun Jan  3 12:47:35 2021
From: report at bugs.python.org (Chaim Gewirtz)
Date: Sun, 03 Jan 2021 17:47:35 +0000
Subject: [issue42812] @overload-ing method of parent class without actual
 implementation
In-Reply-To: <1609653092.18.0.893619520042.issue42812@roundup.psfhosted.org>
Message-ID: <1609696055.95.0.267838284993.issue42812@roundup.psfhosted.org>


Chaim Gewirtz <chaim422 at gmail.com> added the comment:

In your example, does Child foo call Parent foo? Because the intent is to use the parent's foo method.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42812>
_______________________________________

From report at bugs.python.org  Sun Jan  3 12:55:40 2021
From: report at bugs.python.org (Yurii Karabas)
Date: Sun, 03 Jan 2021 17:55:40 +0000
Subject: [issue42812] @overload-ing method of parent class without actual
 implementation
In-Reply-To: <1609653092.18.0.893619520042.issue42812@roundup.psfhosted.org>
Message-ID: <1609696540.65.0.855863567187.issue42812@roundup.psfhosted.org>


Yurii Karabas <1998uriyyo at gmail.com> added the comment:

> What is better?

Sorry, I can't answer this question.

I am a regular python user and I just tried to help with your issue.

I believe we should wait for someone from core team to answer this question.


> In your example, does Child foo call Parent foo? Because the intent is to use the parent's foo method.

Sorry, I made a mistake, it definitely should call a parent method. A correct example will look like this:
```
class Parent:
    def foo(self, **kwargs):
        """Argument names of foo vary depending on the child class."""


class Child(Parent):
    def foo(self, a, b):
        super().foo(a=a, b=b)
```

But, the example above require more code to write, so a better option will be:
```
class Parent:
    def foo(self, **kwargs):
        """Argument names of foo vary depending on the child class."""


class Child(Parent):
    @overload
    def foo(self, a, b):
        pass

    @overload
    def foo(self, **kwargs):
        pass

    def foo(self, **kwargs):
        return super().foo(**kwargs)
```

I am not sure is it the perfect solution to solve your issue.

Let's wait for someone from core team, so we can hear their opinion.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42812>
_______________________________________

From report at bugs.python.org  Sun Jan  3 13:11:18 2021
From: report at bugs.python.org (Eric V. Smith)
Date: Sun, 03 Jan 2021 18:11:18 +0000
Subject: [issue42817] timedelta zeropadding hh
In-Reply-To: <1609679996.96.0.581038745817.issue42817@roundup.psfhosted.org>
Message-ID: <1609697478.9.0.428587049046.issue42817@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

I don't think zero padding makes sense. For example:

>>> td = datetime.timedelta(hours=100)
>>> str(td)
'4 days, 4:00:00'

I think '4 days, 04:00:00' would not be very user friendly.

In any event, backward compatibility would prevent us from changing this.

----------
nosy: +eric.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42817>
_______________________________________

From report at bugs.python.org  Sun Jan  3 13:26:27 2021
From: report at bugs.python.org (Chaim Gewirtz)
Date: Sun, 03 Jan 2021 18:26:27 +0000
Subject: [issue42812] @overload-ing method of parent class without actual
 implementation
In-Reply-To: <1609653092.18.0.893619520042.issue42812@roundup.psfhosted.org>
Message-ID: <1609698387.19.0.750228321522.issue42812@roundup.psfhosted.org>


Chaim Gewirtz <chaim422 at gmail.com> added the comment:

Thanks for your perspective.

To summarize here is how my proposed enhancement might look in practice:

class Parent:
    def foo(self, **kwargs):
        """Argument names of foo vary depending on the child class."""


class Child(Parent):
    @overload
    def foo(self, a, b):
        pass

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42812>
_______________________________________

From report at bugs.python.org  Sun Jan  3 14:00:39 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Sun, 03 Jan 2021 19:00:39 +0000
Subject: [issue40077] Convert static types to heap types: use PyType_FromSpec()
In-Reply-To: <1585238684.65.0.246012172449.issue40077@roundup.psfhosted.org>
Message-ID: <1609700439.66.0.296712949519.issue40077@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

Ok, perhaps we should leave a comment about that? It already has a comment about multi-phase init.

What about Modules/_testbuffer.c and the xx-modules?

$ grep -E 'static PyTypeObject .* =' $(find . -name "*.c"|grep -vE '(Doc/|Modules/_testcapimodule)') | wc -l
94

$ grep -E 'PyType_Spec .* =' $(find . -name "*.c")|wc -l                                                                                                                            (master)cpython.git
95

We're almost halfway there.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40077>
_______________________________________

From report at bugs.python.org  Sun Jan  3 14:28:21 2021
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 03 Jan 2021 19:28:21 +0000
Subject: [issue41463] Avoid duplicating jump information from opcode.py in
 compile.c
In-Reply-To: <1596452415.91.0.969194719265.issue41463@roundup.psfhosted.org>
Message-ID: <1609702101.48.0.430062029394.issue41463@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems complete, unless you still want to backport?

----------
nosy: +iritkatriel
resolution:  -> fixed
status: open -> pending

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41463>
_______________________________________

From report at bugs.python.org  Sun Jan  3 14:57:41 2021
From: report at bugs.python.org (Andrei Kulakov)
Date: Sun, 03 Jan 2021 19:57:41 +0000
Subject: [issue42817] timedelta zeropadding hh
In-Reply-To: <1609679996.96.0.581038745817.issue42817@roundup.psfhosted.org>
Message-ID: <1609703861.46.0.134020840201.issue42817@roundup.psfhosted.org>


Andrei Kulakov <andrei.avk at gmail.com> added the comment:

In a date, hours are zero-padded probably because that's a common standard for military time dates. But there is no such standard for time periods, therefore timedelta don't have to match date display in respect to zero-padding, in my opinion.

----------
nosy: +andrei.avk

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42817>
_______________________________________

From report at bugs.python.org  Sun Jan  3 15:51:18 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 03 Jan 2021 20:51:18 +0000
Subject: [issue42681] mistake in curses documentation
In-Reply-To: <1608339537.48.0.496910027234.issue42681@roundup.psfhosted.org>
Message-ID: <1609707078.81.0.334132371568.issue42681@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 1470edd6131c29b8a09ce012cdfee3afa269d553 by Serhiy Storchaka in branch 'master':
bpo-42681: Fix range checks for color and pair numbers in curses (GH-23874)
https://github.com/python/cpython/commit/1470edd6131c29b8a09ce012cdfee3afa269d553


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42681>
_______________________________________

From report at bugs.python.org  Sun Jan  3 15:52:35 2021
From: report at bugs.python.org (Dustin Rodrigues)
Date: Sun, 03 Jan 2021 20:52:35 +0000
Subject: [issue42819] readline 8.1 bracketed paste
Message-ID: <1609707155.89.0.22999518491.issue42819@roundup.psfhosted.org>


New submission from Dustin Rodrigues <dust.rod at gmail.com>:

Readline 8.1 enables bracketed paste by default. Package managers like Homebrew for macOS and distributions like Arch Linux which use the latest version of readline (released December 2020) now have new behavior when pasting multiline strings into the python REPL. Disabling bracketed paste on 8.1 reverts to the expected behavior, and enabling bracketed paste on 8.0 also reproduces the behavior. Further information in https://github.com/Homebrew/homebrew-core/issues/68193

Example with bracketed paste on:
$ cat in
1+2
3+4
5+6

$ pbcopy < in
$ /usr/local/Cellar/python\@3.9/3.9.1_3/bin/python3
Python 3.9.1 (default, Dec 28 2020, 11:22:14) 
[Clang 11.0.0 (clang-1100.0.33.17)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> 1+2
3+4
5+6

  File "<stdin>", line 1
    1+2
3+4
5+6


       ^
SyntaxError: multiple statements found while compiling a single statement
>>> 



Example with it off:
$ /usr/local/bin/python3
Python 3.9.1 (v3.9.1:1e5d33e9b9, Dec  7 2020, 12:10:52) 
[Clang 6.0 (clang-600.0.57)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> 1+2
3
>>> 3+4
7
>>> 5+6
11
>>>

----------
messages: 384297
nosy: dtrodrigues
priority: normal
severity: normal
status: open
title: readline 8.1 bracketed paste
type: behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42819>
_______________________________________

From report at bugs.python.org  Sun Jan  3 15:54:49 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 03 Jan 2021 20:54:49 +0000
Subject: [issue42789] Do not skip test_curses on non-tty
In-Reply-To: <1609355195.18.0.84938555409.issue42789@roundup.psfhosted.org>
Message-ID: <1609707289.58.0.784454648738.issue42789@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 0303008ebceb6ac6035cd9722d1393267304171d by Serhiy Storchaka in branch '3.9':
[3.9] bpo-42789: Don't skip curses tests on non-tty. (GH-24009) (GH-24076)
https://github.com/python/cpython/commit/0303008ebceb6ac6035cd9722d1393267304171d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42789>
_______________________________________

From report at bugs.python.org  Sun Jan  3 16:33:50 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 03 Jan 2021 21:33:50 +0000
Subject: [issue42681] mistake in curses documentation
In-Reply-To: <1608339537.48.0.496910027234.issue42681@roundup.psfhosted.org>
Message-ID: <1609709630.69.0.450650243927.issue42681@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +22911
pull_request: https://github.com/python/cpython/pull/24077

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42681>
_______________________________________

From report at bugs.python.org  Sun Jan  3 16:43:00 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 03 Jan 2021 21:43:00 +0000
Subject: [issue42789] Do not skip test_curses on non-tty
In-Reply-To: <1609355195.18.0.84938555409.issue42789@roundup.psfhosted.org>
Message-ID: <1609710180.57.0.980938413243.issue42789@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +22912
pull_request: https://github.com/python/cpython/pull/24078

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42789>
_______________________________________

From report at bugs.python.org  Sun Jan  3 16:46:49 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 03 Jan 2021 21:46:49 +0000
Subject: [issue42681] Incorrect range checks/documentation in curses
In-Reply-To: <1608339537.48.0.496910027234.issue42681@roundup.psfhosted.org>
Message-ID: <1609710409.29.0.836880242335.issue42681@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
title: mistake in curses documentation -> Incorrect range checks/documentation in curses

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42681>
_______________________________________

From report at bugs.python.org  Sun Jan  3 17:48:02 2021
From: report at bugs.python.org (Kevin Rasmussen)
Date: Sun, 03 Jan 2021 22:48:02 +0000
Subject: [issue42817] timedelta zeropadding hh
In-Reply-To: <1609679996.96.0.581038745817.issue42817@roundup.psfhosted.org>
Message-ID: <1609714082.91.0.445217739966.issue42817@roundup.psfhosted.org>


Kevin Rasmussen <kj_529 at hotmail.com> added the comment:

Eric makes a pretty good point about how that ends up looking with days included and backward compatibility.

Thanks everyone for humouring me and talking me through this one I'm going to close the issue as "not a bug".

----------
resolution:  -> not a bug
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42817>
_______________________________________

From report at bugs.python.org  Sun Jan  3 17:54:27 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 03 Jan 2021 22:54:27 +0000
Subject: [issue42789] Do not skip test_curses on non-tty
In-Reply-To: <1609355195.18.0.84938555409.issue42789@roundup.psfhosted.org>
Message-ID: <1609714467.07.0.171007782357.issue42789@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 645174abe0d13cce2cb339cc80b095ad484428ea by Serhiy Storchaka in branch '3.8':
[3.8] [3.9] bpo-42789: Don't skip curses tests on non-tty. (GH-24009) (GH-24076) (GH-24078)
https://github.com/python/cpython/commit/645174abe0d13cce2cb339cc80b095ad484428ea


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42789>
_______________________________________

From report at bugs.python.org  Sun Jan  3 17:55:26 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 03 Jan 2021 22:55:26 +0000
Subject: [issue42681] Incorrect range checks/documentation in curses
In-Reply-To: <1608339537.48.0.496910027234.issue42681@roundup.psfhosted.org>
Message-ID: <1609714526.29.0.302854685949.issue42681@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset b0ee2b492dbf550fbd2a63b82de0a4dc9d67f32e by Serhiy Storchaka in branch '3.9':
[3.9] bpo-42681: Fix range checks for color and pair numbers in curses (GH-23874). (GH-24077)
https://github.com/python/cpython/commit/b0ee2b492dbf550fbd2a63b82de0a4dc9d67f32e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42681>
_______________________________________

From report at bugs.python.org  Sun Jan  3 17:58:10 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 03 Jan 2021 22:58:10 +0000
Subject: [issue42681] Incorrect range checks/documentation in curses
In-Reply-To: <1608339537.48.0.496910027234.issue42681@roundup.psfhosted.org>
Message-ID: <1609714690.96.0.115304474966.issue42681@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +22913
pull_request: https://github.com/python/cpython/pull/24079

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42681>
_______________________________________

From report at bugs.python.org  Sun Jan  3 18:51:07 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 03 Jan 2021 23:51:07 +0000
Subject: [issue42681] Incorrect range checks/documentation in curses
In-Reply-To: <1608339537.48.0.496910027234.issue42681@roundup.psfhosted.org>
Message-ID: <1609717867.29.0.496843941879.issue42681@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

This change seems to broke some buildbots. For instance:

https://buildbot.python.org/all/#/builders/119/builds/153


======================================================================
ERROR: test_colors_funcs (test.test_curses.TestCurses)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/dje/cpython-buildarea/3.8.edelsohn-rhel8-z/build/Lib/test/test_curses.py", line 310, in test_colors_funcs
    curses.pair_content(min(curses.COLOR_PAIRS - 1, 0x7fff))
_curses.error: Argument 1 was out of range. (1..COLOR_PAIRS-1)
----------------------------------------------------------------------
Ran 28 tests in 0.337s
FAILED (errors=1)
1 test failed again:
    test_curses
== Tests result: FAILURE then FAILURE ==

----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42681>
_______________________________________

From report at bugs.python.org  Sun Jan  3 18:55:10 2021
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 03 Jan 2021 23:55:10 +0000
Subject: [issue42789] Do not skip test_curses on non-tty
In-Reply-To: <1609355195.18.0.84938555409.issue42789@roundup.psfhosted.org>
Message-ID: <1609718110.8.0.559916626346.issue42789@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> Buildbot failure: ARM Raspbian 3.x: (...)

As expected, the 3.8 and 3.9 change also broke 11 buildbots (3.8 and 3.8) ;-) I understand that bpo-42681 will fix buildbots.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42789>
_______________________________________

From report at bugs.python.org  Sun Jan  3 18:57:30 2021
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 03 Jan 2021 23:57:30 +0000
Subject: [issue42681] Incorrect range checks/documentation in curses
In-Reply-To: <1608339537.48.0.496910027234.issue42681@roundup.psfhosted.org>
Message-ID: <1609718250.68.0.91151940104.issue42681@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> This change seems to broke some buildbots.

Yep, see also bpo-42789.

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42681>
_______________________________________

From report at bugs.python.org  Sun Jan  3 20:28:14 2021
From: report at bugs.python.org (Tim Hoffmann)
Date: Mon, 04 Jan 2021 01:28:14 +0000
Subject: [issue42820] Sphinx conf.py needs_version entry is outdated
Message-ID: <1609723694.82.0.961390909546.issue42820@roundup.psfhosted.org>


New submission from Tim Hoffmann <tim.hoffmann at posteo.de>:

The sphinx conf.py entry `needs_version=1.8` (https://github.com/python/cpython/blob/1470edd6131c29b8a09ce012cdfee3afa269d553/Doc/conf.py#L48)

is not in sync with the doc build requirements (https://github.com/python/cpython/blob/1470edd6131c29b8a09ce012cdfee3afa269d553/Doc/requirements.txt#L6)

Possible solutions:
a) Drop the `needs_version` config value. It's optional.
b) Make sure to update both places.
c) Or at minimum add a comment that `needs_version` is only a safeguard against very old sphinx versions but is not necessarily sufficient to build.

----------
assignee: docs at python
components: Documentation
messages: 384305
nosy: docs at python, timhoffm
priority: normal
severity: normal
status: open
title: Sphinx conf.py needs_version entry is outdated

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42820>
_______________________________________

From report at bugs.python.org  Sun Jan  3 21:06:27 2021
From: report at bugs.python.org (karl)
Date: Mon, 04 Jan 2021 02:06:27 +0000
Subject: [issue28937] str.split(): allow removing empty strings (when sep is
 not None)
In-Reply-To: <1481469102.15.0.255147638686.issue28937@psf.upfronthosting.co.za>
Message-ID: <1609725987.69.0.709856572783.issue28937@roundup.psfhosted.org>


Change by karl <karl+pythonbugs at la-grange.net>:


----------
nosy: +karlcow

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28937>
_______________________________________

From report at bugs.python.org  Sun Jan  3 21:21:42 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Mon, 04 Jan 2021 02:21:42 +0000
Subject: [issue28937] str.split(): allow removing empty strings (when sep is
 not None)
In-Reply-To: <1609725987.73.0.335617121775.issue28937@roundup.psfhosted.org>
Message-ID: <CAP7+vJJ5fTSDpGrV+dzkp0EfkYuByipbEPSWXAc8svCHBJ=RNQ@mail.gmail.com>


Guido van Rossum <guido at python.org> added the comment:

This issue probably needs a new champion. There is broad agreement but some
bike shedding, so a PEP isn?t needed.--
--Guido (mobile)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28937>
_______________________________________

From report at bugs.python.org  Sun Jan  3 22:37:27 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 04 Jan 2021 03:37:27 +0000
Subject: [issue28937] str.split(): allow removing empty strings (when sep is
 not None)
In-Reply-To: <1481469102.15.0.255147638686.issue28937@psf.upfronthosting.co.za>
Message-ID: <1609731447.04.0.244521924677.issue28937@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
nosy:  -rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28937>
_______________________________________

From report at bugs.python.org  Sun Jan  3 23:48:30 2021
From: report at bugs.python.org (Ned Deily)
Date: Mon, 04 Jan 2021 04:48:30 +0000
Subject: [issue42584] Upgrade macOS and Windows installers to use SQLite 3.34.0
In-Reply-To: <1607337382.55.0.591359272905.issue42584@roundup.psfhosted.org>
Message-ID: <1609735710.83.0.791376738106.issue42584@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset c94ee13ad596d26d1859078bc09806aa59bb0000 by Erlend Egeberg Aasland in branch 'master':
bpo-42584: Update macOS installer to use SQLite 3.34.0 (GH-23674)
https://github.com/python/cpython/commit/c94ee13ad596d26d1859078bc09806aa59bb0000


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42584>
_______________________________________

From report at bugs.python.org  Mon Jan  4 03:00:54 2021
From: report at bugs.python.org (karl)
Date: Mon, 04 Jan 2021 08:00:54 +0000
Subject: [issue42821] HTMLParser: subsequent duplicate attributes should be
 ignored
Message-ID: <1609747254.8.0.505282394857.issue42821@roundup.psfhosted.org>


New submission from karl <karl+pythonbugs at la-grange.net>:

This comes up while working on issue 41748


browser input 
data:text/html,<!doctype html><div class="bar" class="foo">text</div>

browser output
<div class="bar">text</div>

Actual HTMLParser output

see https://github.com/python/cpython/pull/24072#discussion_r551158342
('starttag', 'div', [('class', 'bar'), ('class', 'foo')])]

Expected HTMLParser output
('starttag', 'div', [('class', 'bar')])]

----------
components: Library (Lib)
messages: 384308
nosy: karlcow
priority: normal
severity: normal
status: open
title: HTMLParser: subsequent duplicate attributes should be ignored
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42821>
_______________________________________

From report at bugs.python.org  Mon Jan  4 03:58:29 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 04 Jan 2021 08:58:29 +0000
Subject: [issue42681] Incorrect range checks/documentation in curses
In-Reply-To: <1608339537.48.0.496910027234.issue42681@roundup.psfhosted.org>
Message-ID: <1609750709.35.0.158064018831.issue42681@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 82794cacc6073af9bc2b792a5ee21397f4c9037f by Serhiy Storchaka in branch '3.8':
[3.8] [3.9] bpo-42681: Fix range checks for color and pair numbers in curses (GH-23874). (GH-24077) (GH-24079)
https://github.com/python/cpython/commit/82794cacc6073af9bc2b792a5ee21397f4c9037f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42681>
_______________________________________

From report at bugs.python.org  Mon Jan  4 04:18:10 2021
From: report at bugs.python.org (Ned Deily)
Date: Mon, 04 Jan 2021 09:18:10 +0000
Subject: [issue41837] Upgrade installers to OpenSSL 1.1.1h
In-Reply-To: <1600822748.89.0.850484234677.issue41837@roundup.psfhosted.org>
Message-ID: <1609751890.46.0.654278181779.issue41837@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
keywords: +patch
pull_requests: +22914
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24080

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41837>
_______________________________________

From report at bugs.python.org  Mon Jan  4 04:20:28 2021
From: report at bugs.python.org (Ned Deily)
Date: Mon, 04 Jan 2021 09:20:28 +0000
Subject: [issue42361] Use Tcl/Tk 8.6.10 in build-installer.py when building on
 recent macOS
In-Reply-To: <1605443356.85.0.637246166587.issue42361@roundup.psfhosted.org>
Message-ID: <1609752028.51.0.376963804614.issue42361@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
pull_requests: +22915
pull_request: https://github.com/python/cpython/pull/24081

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42361>
_______________________________________

From report at bugs.python.org  Mon Jan  4 04:38:14 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 04 Jan 2021 09:38:14 +0000
Subject: [issue40636] Provide a strict form of zip (PEP-618) requiring same
 length inputs
In-Reply-To: <1589570739.4.0.582573486837.issue40636@roundup.psfhosted.org>
Message-ID: <1609753094.16.0.975831791952.issue40636@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

For other types we do not have such strict tests. We just test that pickling roundtrips (it is already tested for zip() in other tests). There are few tests that unpickling some exact byte strings produces the expected value, but these tests are in pickletester.py, because they test the unpickling machinery. If unpickling of some type depends on some private constructor (like re._compile), that constructor can be tested separately.

So I think that these tests can be removed.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40636>
_______________________________________

From report at bugs.python.org  Mon Jan  4 04:39:50 2021
From: report at bugs.python.org (Ned Deily)
Date: Mon, 04 Jan 2021 09:39:50 +0000
Subject: [issue41837] Upgrade installers to OpenSSL 1.1.1h
In-Reply-To: <1600822748.89.0.850484234677.issue41837@roundup.psfhosted.org>
Message-ID: <1609753190.25.0.708363081763.issue41837@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset 14097a2785414c728d41d8d730a469a8c46ecdb9 by Ned Deily in branch 'master':
bpo-41837: Update macOS installer build to use OpenSSL 1.1.1i. (GH-24080)
https://github.com/python/cpython/commit/14097a2785414c728d41d8d730a469a8c46ecdb9


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41837>
_______________________________________

From report at bugs.python.org  Mon Jan  4 04:40:06 2021
From: report at bugs.python.org (miss-islington)
Date: Mon, 04 Jan 2021 09:40:06 +0000
Subject: [issue41837] Upgrade installers to OpenSSL 1.1.1h
In-Reply-To: <1600822748.89.0.850484234677.issue41837@roundup.psfhosted.org>
Message-ID: <1609753206.38.0.0132534567308.issue41837@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 7.0 -> 8.0
pull_requests: +22916
pull_request: https://github.com/python/cpython/pull/24083

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41837>
_______________________________________

From report at bugs.python.org  Mon Jan  4 04:40:18 2021
From: report at bugs.python.org (miss-islington)
Date: Mon, 04 Jan 2021 09:40:18 +0000
Subject: [issue41837] Upgrade installers to OpenSSL 1.1.1h
In-Reply-To: <1600822748.89.0.850484234677.issue41837@roundup.psfhosted.org>
Message-ID: <1609753218.0.0.902389079549.issue41837@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +22917
pull_request: https://github.com/python/cpython/pull/24084

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41837>
_______________________________________

From report at bugs.python.org  Mon Jan  4 04:41:11 2021
From: report at bugs.python.org (Ned Deily)
Date: Mon, 04 Jan 2021 09:41:11 +0000
Subject: [issue41837] Upgrade installers to OpenSSL 1.1.1i
In-Reply-To: <1600822748.89.0.850484234677.issue41837@roundup.psfhosted.org>
Message-ID: <1609753271.33.0.765035503357.issue41837@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
title: Upgrade installers to OpenSSL 1.1.1h -> Upgrade installers to OpenSSL 1.1.1i

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41837>
_______________________________________

From report at bugs.python.org  Mon Jan  4 04:41:21 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 04 Jan 2021 09:41:21 +0000
Subject: [issue42789] Do not skip test_curses on non-tty
In-Reply-To: <1609355195.18.0.84938555409.issue42789@roundup.psfhosted.org>
Message-ID: <1609753281.93.0.630024160824.issue42789@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +22918
pull_request: https://github.com/python/cpython/pull/24085

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42789>
_______________________________________

From report at bugs.python.org  Mon Jan  4 04:43:19 2021
From: report at bugs.python.org (Ned Deily)
Date: Mon, 04 Jan 2021 09:43:19 +0000
Subject: [issue42361] Use Tcl/Tk 8.6.10 in build-installer.py when building on
 recent macOS
In-Reply-To: <1605443356.85.0.637246166587.issue42361@roundup.psfhosted.org>
Message-ID: <1609753399.93.0.408547546381.issue42361@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset a38e04b566879a5040ea97428d7ee4331d76513f by Ned Deily in branch 'master':
bpo-42361: Update macOS installer build to use Tcl/Tk 8.6.11 (GH-24081)
https://github.com/python/cpython/commit/a38e04b566879a5040ea97428d7ee4331d76513f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42361>
_______________________________________

From report at bugs.python.org  Mon Jan  4 04:43:25 2021
From: report at bugs.python.org (miss-islington)
Date: Mon, 04 Jan 2021 09:43:25 +0000
Subject: [issue42361] Use Tcl/Tk 8.6.10 in build-installer.py when building on
 recent macOS
In-Reply-To: <1605443356.85.0.637246166587.issue42361@roundup.psfhosted.org>
Message-ID: <1609753405.13.0.610083071281.issue42361@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +22919
pull_request: https://github.com/python/cpython/pull/24086

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42361>
_______________________________________

From report at bugs.python.org  Mon Jan  4 04:47:09 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 04 Jan 2021 09:47:09 +0000
Subject: [issue42789] Do not skip test_curses on non-tty
In-Reply-To: <1609355195.18.0.84938555409.issue42789@roundup.psfhosted.org>
Message-ID: <1609753629.77.0.156556628706.issue42789@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

On other hand, it was impossible to write correct tests for issue42681 while tests were skipped on buildbots. I spent the whole day yesterday debugging and backporting that changes (some tests failed only on one particular builtbot). So it was right to enable tests first.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42789>
_______________________________________

From report at bugs.python.org  Mon Jan  4 04:54:12 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Mon, 04 Jan 2021 09:54:12 +0000
Subject: [issue42584] Upgrade macOS and Windows installers to use SQLite 3.34.0
In-Reply-To: <1607337382.55.0.591359272905.issue42584@roundup.psfhosted.org>
Message-ID: <1609754052.84.0.766670012356.issue42584@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


Removed file: https://bugs.python.org/file49694/0001-Add-simple-validation-CI.patch

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42584>
_______________________________________

From report at bugs.python.org  Mon Jan  4 04:54:24 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Mon, 04 Jan 2021 09:54:24 +0000
Subject: [issue42584] Upgrade macOS and Windows installers to use SQLite 3.34.0
In-Reply-To: <1607337382.55.0.591359272905.issue42584@roundup.psfhosted.org>
Message-ID: <1609754064.7.0.856938243898.issue42584@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


Added file: https://bugs.python.org/file49718/0001-Add-simple-validation-CI.patch

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42584>
_______________________________________

From report at bugs.python.org  Mon Jan  4 05:17:38 2021
From: report at bugs.python.org (miss-islington)
Date: Mon, 04 Jan 2021 10:17:38 +0000
Subject: [issue42361] Use Tcl/Tk 8.6.10 in build-installer.py when building on
 recent macOS
In-Reply-To: <1605443356.85.0.637246166587.issue42361@roundup.psfhosted.org>
Message-ID: <1609755458.47.0.239667677821.issue42361@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset cb882f97bc142380460ea519829dc4baf0eb01f2 by Miss Islington (bot) in branch '3.9':
bpo-42361: Update macOS installer build to use Tcl/Tk 8.6.11 (GH-24081)
https://github.com/python/cpython/commit/cb882f97bc142380460ea519829dc4baf0eb01f2


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42361>
_______________________________________

From report at bugs.python.org  Mon Jan  4 05:27:26 2021
From: report at bugs.python.org (Ned Deily)
Date: Mon, 04 Jan 2021 10:27:26 +0000
Subject: [issue41837] Upgrade installers to OpenSSL 1.1.1i
In-Reply-To: <1600822748.89.0.850484234677.issue41837@roundup.psfhosted.org>
Message-ID: <1609756046.81.0.784319482421.issue41837@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset f24ac455521e46bf9f6c7971aec0e4abec4451c4 by Miss Islington (bot) in branch '3.8':
bpo-41837: Update macOS installer build to use OpenSSL 1.1.1i. (GH-24080) (#24084)
https://github.com/python/cpython/commit/f24ac455521e46bf9f6c7971aec0e4abec4451c4


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41837>
_______________________________________

From report at bugs.python.org  Mon Jan  4 05:28:36 2021
From: report at bugs.python.org (Ned Deily)
Date: Mon, 04 Jan 2021 10:28:36 +0000
Subject: [issue41837] Upgrade installers to OpenSSL 1.1.1i
In-Reply-To: <1600822748.89.0.850484234677.issue41837@roundup.psfhosted.org>
Message-ID: <1609756116.48.0.936809121964.issue41837@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset 76489dd2998ac70ffb300d612792a7238c03438c by Miss Islington (bot) in branch '3.9':
bpo-41837: Update macOS installer build to use OpenSSL 1.1.1i. (GH-24080) (GH-24083)
https://github.com/python/cpython/commit/76489dd2998ac70ffb300d612792a7238c03438c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41837>
_______________________________________

From report at bugs.python.org  Mon Jan  4 05:30:24 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 04 Jan 2021 10:30:24 +0000
Subject: [issue42789] Do not skip test_curses on non-tty
In-Reply-To: <1609355195.18.0.84938555409.issue42789@roundup.psfhosted.org>
Message-ID: <1609756224.13.0.776429481775.issue42789@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset b6fc0c406e6b4b86f59b1390142f35da0e364927 by Serhiy Storchaka in branch 'master':
bpo-42789: Enable using /dev/tty in test_curses. (GH-24085)
https://github.com/python/cpython/commit/b6fc0c406e6b4b86f59b1390142f35da0e364927


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42789>
_______________________________________

From report at bugs.python.org  Mon Jan  4 05:30:55 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 04 Jan 2021 10:30:55 +0000
Subject: [issue42789] Do not skip test_curses on non-tty
In-Reply-To: <1609355195.18.0.84938555409.issue42789@roundup.psfhosted.org>
Message-ID: <1609756255.33.0.636134787036.issue42789@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42789>
_______________________________________

From report at bugs.python.org  Mon Jan  4 05:34:54 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 04 Jan 2021 10:34:54 +0000
Subject: [issue42681] Incorrect range checks/documentation in curses
In-Reply-To: <1608339537.48.0.496910027234.issue42681@roundup.psfhosted.org>
Message-ID: <1609756494.87.0.624100686217.issue42681@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +22920
pull_request: https://github.com/python/cpython/pull/24089

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42681>
_______________________________________

From report at bugs.python.org  Mon Jan  4 05:37:05 2021
From: report at bugs.python.org (miss-islington)
Date: Mon, 04 Jan 2021 10:37:05 +0000
Subject: [issue42692] Build fails on macOS when compiler doesn't define
 __has_builtin
In-Reply-To: <1608488860.71.0.844167332987.issue42692@roundup.psfhosted.org>
Message-ID: <1609756625.41.0.373349092118.issue42692@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset df21f502fdccec234282bf0a211af979fd23def4 by Joshua Root in branch 'master':
bpo-42692: fix __builtin_available check on older compilers (GH-23873)
https://github.com/python/cpython/commit/df21f502fdccec234282bf0a211af979fd23def4


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42692>
_______________________________________

From report at bugs.python.org  Mon Jan  4 05:37:14 2021
From: report at bugs.python.org (miss-islington)
Date: Mon, 04 Jan 2021 10:37:14 +0000
Subject: [issue42692] Build fails on macOS when compiler doesn't define
 __has_builtin
In-Reply-To: <1608488860.71.0.844167332987.issue42692@roundup.psfhosted.org>
Message-ID: <1609756634.72.0.522848932071.issue42692@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +22921
pull_request: https://github.com/python/cpython/pull/24090

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42692>
_______________________________________

From report at bugs.python.org  Mon Jan  4 06:00:49 2021
From: report at bugs.python.org (Ned Deily)
Date: Mon, 04 Jan 2021 11:00:49 +0000
Subject: [issue42692] Build fails on macOS when compiler doesn't define
 __has_builtin
In-Reply-To: <1608488860.71.0.844167332987.issue42692@roundup.psfhosted.org>
Message-ID: <1609758049.79.0.375556222774.issue42692@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset eedeaef1f22d27264ce9b031da80fe2485e85e69 by Miss Islington (bot) in branch '3.9':
bpo-42692: fix __builtin_available check on older compilers (GH-23873) (GH-24090)
https://github.com/python/cpython/commit/eedeaef1f22d27264ce9b031da80fe2485e85e69


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42692>
_______________________________________

From report at bugs.python.org  Mon Jan  4 06:01:55 2021
From: report at bugs.python.org (Ned Deily)
Date: Mon, 04 Jan 2021 11:01:55 +0000
Subject: [issue42692] Build fails on macOS when compiler doesn't define
 __has_builtin
In-Reply-To: <1608488860.71.0.844167332987.issue42692@roundup.psfhosted.org>
Message-ID: <1609758115.93.0.192007952792.issue42692@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Thanks for the PR!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42692>
_______________________________________

From report at bugs.python.org  Mon Jan  4 06:15:53 2021
From: report at bugs.python.org (Zackery Spytz)
Date: Mon, 04 Jan 2021 11:15:53 +0000
Subject: [issue28937] str.split(): allow removing empty strings (when sep is
 not None)
In-Reply-To: <1481469102.15.0.255147638686.issue28937@psf.upfronthosting.co.za>
Message-ID: <1609758953.83.0.998298203003.issue28937@roundup.psfhosted.org>


Zackery Spytz <zspytz at gmail.com> added the comment:

I am working on this issue.

----------
assignee:  -> ZackerySpytz
nosy: +ZackerySpytz
versions: +Python 3.10 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28937>
_______________________________________

From report at bugs.python.org  Mon Jan  4 06:52:05 2021
From: report at bugs.python.org (Mark Shannon)
Date: Mon, 04 Jan 2021 11:52:05 +0000
Subject: [issue42810] Nested if/else gets phantom else trace (3.10)
In-Reply-To: <1609600165.12.0.126191975832.issue42810@roundup.psfhosted.org>
Message-ID: <1609761125.63.0.122904067211.issue42810@roundup.psfhosted.org>


Change by Mark Shannon <mark at hotpy.org>:


----------
keywords: +patch
pull_requests: +22922
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24091

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42810>
_______________________________________

From report at bugs.python.org  Mon Jan  4 06:55:51 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 04 Jan 2021 11:55:51 +0000
Subject: [issue42587] memoryview rely on _Bool undefined behavior (test_buffer
 fails on Python built with GCC 11)
In-Reply-To: <1607353221.74.0.500162368406.issue42587@roundup.psfhosted.org>
Message-ID: <1609761351.59.0.49708629426.issue42587@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The Fedora package gcc-11.0.0-0.11 includes https://gcc.gnu.org/git/gitweb.cgi?p=gcc.git;h=3e60ddeb8220ed388819bb3f14e8caa9309fd3c2 fix for the https://gcc.gnu.org/bugzilla/show_bug.cgi?id=98190 bug.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42587>
_______________________________________

From report at bugs.python.org  Mon Jan  4 06:58:06 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 04 Jan 2021 11:58:06 +0000
Subject: [issue42587] memoryview rely on _Bool undefined behavior (test_buffer
 fails on Python built with GCC 11)
In-Reply-To: <1607353221.74.0.500162368406.issue42587@roundup.psfhosted.org>
Message-ID: <1609761486.91.0.13723659574.issue42587@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

"PPC64LE Fedora Rawhide LTO 3.x" buildbot is back to green. test.pythoninfo now says:

CC.version: gcc (GCC) 11.0.0 20201223 (Red Hat 11.0.0-0)

----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42587>
_______________________________________

From report at bugs.python.org  Mon Jan  4 08:01:07 2021
From: report at bugs.python.org (Mark Shannon)
Date: Mon, 04 Jan 2021 13:01:07 +0000
Subject: [issue42246] Implement PEP 626 -- Precise line numbers for debugging
In-Reply-To: <1604331162.26.0.596873070589.issue42246@roundup.psfhosted.org>
Message-ID: <1609765267.67.0.910783571076.issue42246@roundup.psfhosted.org>


Change by Mark Shannon <mark at hotpy.org>:


----------
pull_requests: +22923
pull_request: https://github.com/python/cpython/pull/24094

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42246>
_______________________________________

From report at bugs.python.org  Mon Jan  4 08:03:56 2021
From: report at bugs.python.org (Julien Palard)
Date: Mon, 04 Jan 2021 13:03:56 +0000
Subject: [issue42822] Missing backslashes in documentation for 3.8 and 3.9
In-Reply-To: <1609765422.49.0.483236804978.issue42822@roundup.psfhosted.org>
Message-ID: <1609765436.31.0.631622232538.issue42822@roundup.psfhosted.org>


Change by Julien Palard <julien+python at palard.fr>:


----------
keywords: +patch
pull_requests: +22924
stage: commit review -> patch review
pull_request: https://github.com/python/cpython/pull/24093

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42822>
_______________________________________

From report at bugs.python.org  Mon Jan  4 08:03:42 2021
From: report at bugs.python.org (Julien Palard)
Date: Mon, 04 Jan 2021 13:03:42 +0000
Subject: [issue42822] Missing backslashes in documentation for 3.8 and 3.9
Message-ID: <1609765422.49.0.483236804978.issue42822@roundup.psfhosted.org>


New submission from Julien Palard <julien+python at palard.fr>:

This is just to track the issue, initially reported here:

https://github.com/python/python-docs-theme/issues/63

Then discussed here:

https://github.com/python/cpython/pull/23827#issuecomment-753598860

Then reverted:

- in 3.8 https://github.com/python/cpython/pull/24093
- in 3.9 https://github.com/python/cpython/pull/24092

I edited the revert to keep only relevant parts, as only a few bits of the commit were causing troubles.

Issue is: Sphinx 2 and Sphinx 3 have incompatible handling of backslahes, fixing them for Sphinx 3 in Python 3.10, then backporting to 3.8 and 3.9 which use Sphinx 2 caused an issue: `\n` for example are rendered as `n`, easy to notice in the documentaion of print:

    print(*objects, sep=' ', end='n', file=sys.stdout, flush=False)?

As migration to Sphinx 3 was hard (done for Python 3.10 documentation), it won't be backported to 3.8 and 3.9, which will still be built using Sphinx 2, so some bits had to be reverted for the doc to display the backslash of `\n`.

----------
assignee: mdk
components: Documentation
messages: 384324
nosy: adelfino, mdk
priority: normal
severity: normal
stage: commit review
status: open
title: Missing backslashes in documentation for 3.8 and 3.9
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42822>
_______________________________________

From report at bugs.python.org  Mon Jan  4 08:04:22 2021
From: report at bugs.python.org (Julien Palard)
Date: Mon, 04 Jan 2021 13:04:22 +0000
Subject: [issue42822] Missing backslashes in documentation for 3.8 and 3.9
In-Reply-To: <1609765422.49.0.483236804978.issue42822@roundup.psfhosted.org>
Message-ID: <1609765462.33.0.219243649416.issue42822@roundup.psfhosted.org>


Change by Julien Palard <julien+python at palard.fr>:


----------
pull_requests: +22925
pull_request: https://github.com/python/cpython/pull/24092

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42822>
_______________________________________

From report at bugs.python.org  Mon Jan  4 09:29:42 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Mon, 04 Jan 2021 14:29:42 +0000
Subject: [issue1635741] Py_Finalize() doesn't clear all Python objects at exit
Message-ID: <1609770582.87.0.843001893092.issue1635741@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
pull_requests: +22926
pull_request: https://github.com/python/cpython/pull/24095

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1635741>
_______________________________________

From report at bugs.python.org  Mon Jan  4 09:31:20 2021
From: report at bugs.python.org (Mark Shannon)
Date: Mon, 04 Jan 2021 14:31:20 +0000
Subject: [issue42739] Crash when try to disassemble bogus code object
In-Reply-To: <1608897358.97.0.834158885511.issue42739@roundup.psfhosted.org>
Message-ID: <1609770680.79.0.959405453476.issue42739@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

dis is able to handle code with no line numbers.

>>> def f(): pass
... 
>>> co = f.__code__.replace(co_linetable=b'\xff')
>>> list(co.co_lines())
[]
>>> import dis
>>> dis.dis(co)
          0 LOAD_CONST               0 (None)
          2 RETURN_VALUE

The problem with the example Serhiy gives is that the line number table does not end in a sentinel value.

You shouldn't be creating code objects unless you really know what you are doing. I.e. never.

For manually created code objects that don't respect the invariants, any behavior is acceptable IMO.

----------
assignee:  -> Mark.Shannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42739>
_______________________________________

From report at bugs.python.org  Mon Jan  4 09:34:37 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 04 Jan 2021 14:34:37 +0000
Subject: [issue1635741] Py_Finalize() doesn't clear all Python objects at exit
Message-ID: <1609770877.01.0.718057327319.issue1635741@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset c8a87addb1fa35dec79ed8f227eba3694fc36234 by Mohamed Koubaa in branch 'master':
bpo-1635741: Port pyexpat to multi-phase init (PEP 489) (GH-22222)
https://github.com/python/cpython/commit/c8a87addb1fa35dec79ed8f227eba3694fc36234


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1635741>
_______________________________________

From report at bugs.python.org  Mon Jan  4 10:14:25 2021
From: report at bugs.python.org (David Steele)
Date: Mon, 04 Jan 2021 15:14:25 +0000
Subject: [issue12806] argparse: Hybrid help text formatter
In-Reply-To: <1313973978.37.0.422477813424.issue12806@psf.upfronthosting.co.za>
Message-ID: <1609773265.58.0.988054217179.issue12806@roundup.psfhosted.org>


David Steele <dsteele at gmail.com> added the comment:

For those looking for a solution now, see https://pypi.org/project/argparse-formatter/

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue12806>
_______________________________________

From report at bugs.python.org  Mon Jan  4 10:24:37 2021
From: report at bugs.python.org (hai shi)
Date: Mon, 04 Jan 2021 15:24:37 +0000
Subject: [issue41798] [C API] Revisit usage of the PyCapsule C API with
 multi-phase initialization API
In-Reply-To: <1600265269.2.0.881235166904.issue41798@roundup.psfhosted.org>
Message-ID: <1609773877.45.0.186452065328.issue41798@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
pull_requests: +22927
pull_request: https://github.com/python/cpython/pull/24096

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41798>
_______________________________________

From report at bugs.python.org  Mon Jan  4 10:27:57 2021
From: report at bugs.python.org (E. Paine)
Date: Mon, 04 Jan 2021 15:27:57 +0000
Subject: [issue42541] Tkinter colours wrong on MacOS universal2
In-Reply-To: <1606920595.63.0.665509072103.issue42541@roundup.psfhosted.org>
Message-ID: <1609774077.19.0.765537711109.issue42541@roundup.psfhosted.org>


E. Paine <paineelisha at gmail.com> added the comment:

Note: Tcl/Tk 8.6.11 was released a few days ago (thanks Kevin/Marc!).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42541>
_______________________________________

From report at bugs.python.org  Mon Jan  4 10:31:07 2021
From: report at bugs.python.org (Steve Dower)
Date: Mon, 04 Jan 2021 15:31:07 +0000
Subject: [issue42584] Upgrade macOS and Windows installers to use SQLite 3.34.0
In-Reply-To: <1607337382.55.0.591359272905.issue42584@roundup.psfhosted.org>
Message-ID: <1609774267.71.0.779705181257.issue42584@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Honestly, keeping a CI run alive is more work than just doing the extract and push myself. I know this means it feels like you can't do as much yourself to speed up the integration, but it really isn't going to slow it down that much.

FWIW, any core dev can merge SQLite updates for Windows (if they're satisfied there are no issues). It's only OpenSSL that relies on running a signed build.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42584>
_______________________________________

From report at bugs.python.org  Mon Jan  4 10:34:30 2021
From: report at bugs.python.org (FX Coudert)
Date: Mon, 04 Jan 2021 15:34:30 +0000
Subject: [issue42819] readline 8.1 bracketed paste
In-Reply-To: <1609707155.89.0.22999518491.issue42819@roundup.psfhosted.org>
Message-ID: <1609774470.67.0.533688444092.issue42819@roundup.psfhosted.org>


FX Coudert <fxcoudert at gmail.com> added the comment:

This bug is present in all versions since the 3.6 branch at least, but was only triggered when users' readline settings explicitly enabled bracketed-paste. Previous reports: https://bugs.python.org/issue32019 and https://bugs.python.org/issue39820 Longer discussion (on a more extensive feature request) at https://bugs.python.org/issue38747

The new factor is that readline 8.1 now enables bracketed-paste by default. So the broken behaviour is seen for Python built with the latest readline, with no specific setting.

Python should probably in the long term be improved to handle bracketed-paste, which will make a nicer user experience. But in the short term, it should communication with readline to disable bracketed-paste at runtime, and restore the previous behaviour.

----------
nosy: +fxcoudert

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42819>
_______________________________________

From report at bugs.python.org  Mon Jan  4 11:32:45 2021
From: report at bugs.python.org (Mark Shannon)
Date: Mon, 04 Jan 2021 16:32:45 +0000
Subject: [issue42823] Incorrect frame.f_lineno when frame.f_trace is set
Message-ID: <1609777965.06.0.667792191004.issue42823@roundup.psfhosted.org>


New submission from Mark Shannon <mark at hotpy.org>:

The logic for frame.f_lineno assumes that the internal C field will be updated when f_trace is set, but that is incorrect.
Consequently, the following code

import sys

def print_line():
    print(sys._getframe(1).f_lineno)

def test():
    print_line()
    sys._getframe(0).f_trace = True
    print_line()
    print_line()

test()

prints
7
8
8

it should print
7
9
10


Fixing this is required by PEP 626, but it should be fixed anyway.

----------
assignee: Mark.Shannon
messages: 384331
nosy: Mark.Shannon
priority: normal
severity: normal
status: open
title: Incorrect frame.f_lineno when frame.f_trace is set

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42823>
_______________________________________

From report at bugs.python.org  Mon Jan  4 11:55:18 2021
From: report at bugs.python.org (Fabian.M)
Date: Mon, 04 Jan 2021 16:55:18 +0000
Subject: [issue42824] get_type_hints throws for local class reference
Message-ID: <1609779318.04.0.39059957238.issue42824@roundup.psfhosted.org>


New submission from Fabian.M <f.mehmke at gmail.com>:

The following code throws with "NameError: name 'Nested' is not defined".

For reference, it works well when moving class definitions out of the local scope.


import typing
T = typing.TypeVar('T')

def test():
    class Nested(typing.Generic[T]):
        pass

    class Test(typing.Generic[T]):
      nested: Nested[T]

    typing.get_type_hints(Test) # this throws

test()

----------
components: Library (Lib)
messages: 384332
nosy: Fabian.M
priority: normal
severity: normal
status: open
title: get_type_hints throws for local class reference
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42824>
_______________________________________

From report at bugs.python.org  Mon Jan  4 12:42:40 2021
From: report at bugs.python.org (Austin Lamb)
Date: Mon, 04 Jan 2021 17:42:40 +0000
Subject: [issue42825] Optimization opportunity on Windows
Message-ID: <1609782160.13.0.0224895080942.issue42825@roundup.psfhosted.org>


New submission from Austin Lamb <austin.lamb at microsoft.com>:

I noticed that CPython and the various libraries built out of the repo aren't using the "/OPT:REF" linker optimization on Windows.  This optimization allows the linker to throw away dead/unreachable code, resulting in a substantial decrease in binary size.  That in turn also reduces the amount of Disk I/O that must be done to get these binaries in memory (which can be meaningful on spinning hard drives that are still rather common), and the reference set of applications using Python.

I'll send a PR for this shortly, just filing the issue to be able to reference it in the PR.

----------
components: Windows
messages: 384333
nosy: Austin-Lamb, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: Optimization opportunity on Windows
type: performance
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42825>
_______________________________________

From report at bugs.python.org  Mon Jan  4 12:47:07 2021
From: report at bugs.python.org (=?utf-8?q?Peter_Pavlini=C4=8D?=)
Date: Mon, 04 Jan 2021 17:47:07 +0000
Subject: [issue42826] typing.Iterable does not need__getitem__() method
Message-ID: <1609782427.22.0.495333991832.issue42826@roundup.psfhosted.org>


New submission from Peter Pavlini? <peter.pavlinic at trilogic.si>:

https://docs.python.org/3.10/glossary.html#term-iterable

----------
assignee: docs at python
components: Documentation
messages: 384334
nosy: docs at python, peter.pavlinic
priority: normal
severity: normal
status: open
title: typing.Iterable does not need__getitem__() method
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42826>
_______________________________________

From report at bugs.python.org  Mon Jan  4 12:49:15 2021
From: report at bugs.python.org (=?utf-8?q?Peter_Pavlini=C4=8D?=)
Date: Mon, 04 Jan 2021 17:49:15 +0000
Subject: [issue42826] typing.Iterable does not need __getitem__() method
In-Reply-To: <1609782427.22.0.495333991832.issue42826@roundup.psfhosted.org>
Message-ID: <1609782555.29.0.538092017864.issue42826@roundup.psfhosted.org>


Peter Pavlini? <peter.pavlinic at trilogic.si> added the comment:

In documentation it is written that typing.Iterable can be implemented with __getitem__() method that implements Sequence semantics.

That is not correct. link: 

https://docs.python.org/3.79/glossary.html#term-iterable

----------
title: typing.Iterable does not need__getitem__() method -> typing.Iterable does not need __getitem__() method

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42826>
_______________________________________

From report at bugs.python.org  Mon Jan  4 12:49:40 2021
From: report at bugs.python.org (=?utf-8?q?Peter_Pavlini=C4=8D?=)
Date: Mon, 04 Jan 2021 17:49:40 +0000
Subject: [issue42826] typing.Iterable does not need __getitem__() method
In-Reply-To: <1609782427.22.0.495333991832.issue42826@roundup.psfhosted.org>
Message-ID: <1609782580.26.0.683634883727.issue42826@roundup.psfhosted.org>


Peter Pavlini? <peter.pavlinic at trilogic.si> added the comment:

In documentation it is written that typing.Iterable can be implemented with __getitem__() method that implements Sequence semantics.

That is not correct. link: 

/glossary.html#term-iterable

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42826>
_______________________________________

From report at bugs.python.org  Mon Jan  4 12:50:49 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Mon, 04 Jan 2021 17:50:49 +0000
Subject: [issue28937] str.split(): allow removing empty strings (when sep is
 not None)
In-Reply-To: <1609758953.83.0.998298203003.issue28937@roundup.psfhosted.org>
Message-ID: <CAP7+vJKyaZDk9vEkXVdjYki+VeaiwC237_He-70nzEEOQNCfNA@mail.gmail.com>


Guido van Rossum <guido at python.org> added the comment:

Excellent!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28937>
_______________________________________

From report at bugs.python.org  Mon Jan  4 12:51:37 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Mon, 04 Jan 2021 17:51:37 +0000
Subject: [issue40636] Provide a strict form of zip (PEP-618) requiring same
 length inputs
In-Reply-To: <1609753094.16.0.975831791952.issue40636@roundup.psfhosted.org>
Message-ID: <CAP7+vJKUNrKsVQ2HD8tY8Em+Ub6_G60FegvCzVJyE55M0Uq5ug@mail.gmail.com>


Guido van Rossum <guido at python.org> added the comment:

Sounds good, go for it. I assume @brandtbucher won't mind.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40636>
_______________________________________

From report at bugs.python.org  Mon Jan  4 12:59:34 2021
From: report at bugs.python.org (Austin Lamb)
Date: Mon, 04 Jan 2021 17:59:34 +0000
Subject: [issue42825] Optimization opportunity on Windows
In-Reply-To: <1609782160.13.0.0224895080942.issue42825@roundup.psfhosted.org>
Message-ID: <1609783174.32.0.991472260171.issue42825@roundup.psfhosted.org>


Change by Austin Lamb <austin.lamb at microsoft.com>:


----------
keywords: +patch
pull_requests: +22928
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24098

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42825>
_______________________________________

From report at bugs.python.org  Mon Jan  4 13:04:36 2021
From: report at bugs.python.org (Brandt Bucher)
Date: Mon, 04 Jan 2021 18:04:36 +0000
Subject: [issue40636] Provide a strict form of zip (PEP-618) requiring same
 length inputs
In-Reply-To: <1589570739.4.0.582573486837.issue40636@roundup.psfhosted.org>
Message-ID: <1609783476.41.0.0736236576955.issue40636@roundup.psfhosted.org>


Brandt Bucher <brandtbucher at gmail.com> added the comment:

Yep, fine by me. I can remove them later today (unless Serhiy beats me to it).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40636>
_______________________________________

From report at bugs.python.org  Mon Jan  4 13:07:05 2021
From: report at bugs.python.org (Mark Shannon)
Date: Mon, 04 Jan 2021 18:07:05 +0000
Subject: [issue42810] Nested if/else gets phantom else trace (3.10)
In-Reply-To: <1609600165.12.0.126191975832.issue42810@roundup.psfhosted.org>
Message-ID: <1609783625.65.0.526369512891.issue42810@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:


New changeset 127dde591686816e379d1add015304e6b9fb6954 by Mark Shannon in branch 'master':
bpo-42810: Mark jumps at end of if and try statements as artificial. (GH-24091)
https://github.com/python/cpython/commit/127dde591686816e379d1add015304e6b9fb6954


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42810>
_______________________________________

From report at bugs.python.org  Mon Jan  4 13:20:57 2021
From: report at bugs.python.org (Marc Culler)
Date: Mon, 04 Jan 2021 18:20:57 +0000
Subject: [issue42541] Tkinter colours wrong on MacOS universal2
In-Reply-To: <1606920595.63.0.665509072103.issue42541@roundup.psfhosted.org>
Message-ID: <1609784457.12.0.446196473398.issue42541@roundup.psfhosted.org>


Marc Culler <marc.culler at gmail.com> added the comment:

Well, actually the release was announced today.

There was one bug fix which did not make it into the release but could possibly affect Python, due to the fact that Python is installed as a framework, and frameworks to not have icons.  I can supply a (1-line) patch if needed.  To test, import tkinter, create a tkinter.Tk object and open the "About Python" menu.  If the icon displayed on the About dialog looks like a folder then you need the patch.

Please let me know what happens when switching to dark mode.  My concern
arises from my understanding that python is being built with a macOS 10.9 SDK, which does not understand dark mode.  I don't know what will happen when running that code on a system which does support dark mode.  Since Tk can be build on Big Sur with a minimum target of 10.9 (and I recommend doing so) I think it should be OK. There may be warnings when linking _tkinter.so though.

I do not understand why the 10.9 SDK is needed, since I recently built Python 3.9.0 on Big Sur, with a minimum target of 10.9, and did not see any significant issues.  (Well, maybe A few warnings from the posix module need investigation.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42541>
_______________________________________

From report at bugs.python.org  Mon Jan  4 13:21:30 2021
From: report at bugs.python.org (Mark Shannon)
Date: Mon, 04 Jan 2021 18:21:30 +0000
Subject: [issue42823] Incorrect frame.f_lineno when frame.f_trace is set
In-Reply-To: <1609777965.06.0.667792191004.issue42823@roundup.psfhosted.org>
Message-ID: <1609784490.96.0.305276678962.issue42823@roundup.psfhosted.org>


Change by Mark Shannon <mark at hotpy.org>:


----------
keywords: +patch
pull_requests: +22930
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24099

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42823>
_______________________________________

From report at bugs.python.org  Mon Jan  4 13:25:00 2021
From: report at bugs.python.org (Mark Shannon)
Date: Mon, 04 Jan 2021 18:25:00 +0000
Subject: [issue42803] Traced line number is wrong for "if not __debug__"
In-Reply-To: <1609512183.17.0.454209386156.issue42803@roundup.psfhosted.org>
Message-ID: <1609784700.52.0.0977630575646.issue42803@roundup.psfhosted.org>


Change by Mark Shannon <mark at hotpy.org>:


----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42803>
_______________________________________

From report at bugs.python.org  Mon Jan  4 13:24:50 2021
From: report at bugs.python.org (Mark Shannon)
Date: Mon, 04 Jan 2021 18:24:50 +0000
Subject: [issue42810] Nested if/else gets phantom else trace (3.10)
In-Reply-To: <1609600165.12.0.126191975832.issue42810@roundup.psfhosted.org>
Message-ID: <1609784690.43.0.0452320786269.issue42810@roundup.psfhosted.org>


Change by Mark Shannon <mark at hotpy.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42810>
_______________________________________

From report at bugs.python.org  Mon Jan  4 13:27:08 2021
From: report at bugs.python.org (Mark Shannon)
Date: Mon, 04 Jan 2021 18:27:08 +0000
Subject: [issue41463] Avoid duplicating jump information from opcode.py in
 compile.c
In-Reply-To: <1596452415.91.0.969194719265.issue41463@roundup.psfhosted.org>
Message-ID: <1609784828.48.0.782161818898.issue41463@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

I don't think we want to backport it

----------
stage: patch review -> resolved
status: pending -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41463>
_______________________________________

From report at bugs.python.org  Mon Jan  4 13:41:33 2021
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 04 Jan 2021 18:41:33 +0000
Subject: [issue42541] Tkinter colours wrong on MacOS universal2
In-Reply-To: <1606920595.63.0.665509072103.issue42541@roundup.psfhosted.org>
Message-ID: <1609785693.76.0.987306659254.issue42541@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

W.r.t. building on 10.9: until very recently (trunk and 3.9.1) Python didn?t check for symbol availability at runtime. Building on 10.9 is basically a workaround for that. 

The, for now experimental, ?universal2? installer for 3.9.1 is build on Big Sur and includes Tk 8.6.10 (and we?ll track Tk releases now that we have a more modern build system).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42541>
_______________________________________

From report at bugs.python.org  Mon Jan  4 14:53:19 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 04 Jan 2021 19:53:19 +0000
Subject: [issue42826] typing.Iterable does not need __getitem__() method
In-Reply-To: <1609782427.22.0.495333991832.issue42826@roundup.psfhosted.org>
Message-ID: <1609789999.43.0.645410892685.issue42826@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

I do not know how is it related to typing.Iterable and I have not found any mention of typing.Iterable on the provided link, but an iterable object can be implemented with __getitem__ method.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42826>
_______________________________________

From report at bugs.python.org  Mon Jan  4 14:58:43 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Mon, 04 Jan 2021 19:58:43 +0000
Subject: [issue42824] get_type_hints throws for local class reference
In-Reply-To: <1609779318.04.0.39059957238.issue42824@roundup.psfhosted.org>
Message-ID: <1609790323.17.0.0717513976284.issue42824@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

This is a known limitation. To get this to work you have to pass globals() and locals():

    typing.get_type_hints(Test, globals(), locals())

----------
nosy: +gvanrossum
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42824>
_______________________________________

From report at bugs.python.org  Mon Jan  4 15:10:30 2021
From: report at bugs.python.org (Yair Frid)
Date: Mon, 04 Jan 2021 20:10:30 +0000
Subject: [issue42811] Update docs for importlib.util.resolve_name() to use
 __spec__ instead of __package__
In-Reply-To: <1609619279.01.0.578638244778.issue42811@roundup.psfhosted.org>
Message-ID: <1609791030.35.0.18722974854.issue42811@roundup.psfhosted.org>


Change by Yair Frid <fridyair at gmail.com>:


----------
keywords: +patch
nosy: +Fongeme
nosy_count: 1.0 -> 2.0
pull_requests: +22931
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/24100

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42811>
_______________________________________

From report at bugs.python.org  Mon Jan  4 15:21:06 2021
From: report at bugs.python.org (Florian Bruhin)
Date: Mon, 04 Jan 2021 20:21:06 +0000
Subject: [issue1043134] Add preferred extensions for MIME types
Message-ID: <1609791666.61.0.283313894323.issue1043134@roundup.psfhosted.org>


Florian Bruhin <python.org at the-compiler.org> added the comment:

I think this has been fixed in Python 3.7+ via https://github.com/python/cpython/pull/14375 - at least for a couple of types.

Comparing Python 3.6 with the current state, the following changed (which can be used as an "override" dict before calling mimetypes.guess_extension):

    "application/manifest+json": ".webmanifest",  # not None
    "application/octet-stream": ".bin",  # not .a
    "application/postscript": ".ps",  # not .ai
    "application/vnd.ms-excel": ".xls",  # not .xlb
    "application/vnd.ms-powerpoint": ".ppt",  # not .pot
    "application/wasm": ".wasm",  # not None
    "application/x-hdf5": ".h5",  # not None
    "application/xml": ".xsl",  # not .rdf
    "audio/mpeg": ".mp3",  # not .mp2
    "image/jpeg": ".jpg",  # not .jpe
    "image/tiff": ".tiff",  # not .tif
    "text/html": ".html",  # not .htm
    "text/plain": ".txt",  # not .bat
    "video/mpeg": ".mpeg",  # not .m1v

----------
nosy: +The Compiler

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1043134>
_______________________________________

From report at bugs.python.org  Mon Jan  4 15:33:45 2021
From: report at bugs.python.org (Ned Deily)
Date: Mon, 04 Jan 2021 20:33:45 +0000
Subject: [issue42541] Tkinter colours wrong on MacOS universal2
In-Reply-To: <1606920595.63.0.665509072103.issue42541@roundup.psfhosted.org>
Message-ID: <1609792425.63.0.017417825285.issue42541@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

As Ronald notes, as of 3.9.1, we are for the immediate future providing two macOS installer variants: the traditional 10.9+ Intel-64 variant that is built on 10.9 and includes Tk 8.6.8 and the new "experimental" 10.9+ "universal2" (Apple Silicon and Intel-64) variant built on macOS 11 which included Tk 8.6.10. As the new universal2 variant gains more exposure over the next releases of 3.9.x, we hope to migrate to that being the recommended variant and start to deprecate the traditional 10.9 variant for 3.9.x.  For 3.10 pre-releases, we are now only providing the "universal2" variant; the next alpha release. 3.10.0a4, should be available very shortly and its macOS installer is built with the just released Tk 8.6.11. I have only run some preliminary tests at the moment and there do seem to be some changes and possible regressions in our tests when using 8.6.11 instead of 8.6.10 but I will investigate further over the next day or so and open issues as needed. Feel free to download 3.10.0a4 and test away!

I did not see any issues with missing icons; with a Python framework build, Python and IDLE both run under app bundles with supplied icons amd that still seems to be working. Things may well be different for non-framework builds but they were before, too.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42541>
_______________________________________

From report at bugs.python.org  Mon Jan  4 15:48:09 2021
From: report at bugs.python.org (Julien Palard)
Date: Mon, 04 Jan 2021 20:48:09 +0000
Subject: [issue42827] Multiline eval with assignment to function call segfaults
Message-ID: <1609793289.79.0.762652539307.issue42827@roundup.psfhosted.org>


New submission from Julien Palard <julien+python at palard.fr>:

Tested in 3.9.0 and master (127dde5916):

$ cat test.py
eval(
    """[file for str(file) in []
]
"""
)

$ ./python test.py
python: Parser/pegen.c:149: byte_offset_to_character_offset: Assertion `col_offset >= 0 && (unsigned long)col_offset <= strlen(str)' failed.
Fatal Python error: Aborted

Current thread 0x00007f6454cfe280 (most recent call first):
  File "/home/mdk/clones/python/cpython/test.py", line 1 in <module>
Aborted (core dumped)

(Adding Guido and Pablo to nosy as, IIRC, you're interested in parser things :))

----------
messages: 384348
nosy: gvanrossum, mdk, pablogsal
priority: normal
severity: normal
status: open
title: Multiline eval with assignment to function call segfaults
type: crash
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42827>
_______________________________________

From report at bugs.python.org  Mon Jan  4 15:53:07 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 04 Jan 2021 20:53:07 +0000
Subject: [issue42827] Multiline eval with assignment to function call segfaults
In-Reply-To: <1609793289.79.0.762652539307.issue42827@roundup.psfhosted.org>
Message-ID: <1609793587.9.0.768268944125.issue42827@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Reproducer as a single line:

compile("[file for str(file) in []\n]", "string", "exec")

----------
components: +Interpreter Core
keywords: +3.9regression
nosy: +lys.nikolaou, vstinner
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42827>
_______________________________________

From report at bugs.python.org  Mon Jan  4 15:54:00 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 04 Jan 2021 20:54:00 +0000
Subject: [issue42827] pegen parser: Multiline eval with assignment to function
 call: assertion failed
In-Reply-To: <1609793289.79.0.762652539307.issue42827@roundup.psfhosted.org>
Message-ID: <1609793640.53.0.539072127032.issue42827@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
title: Multiline eval with assignment to function call segfaults -> pegen parser: Multiline eval with assignment to function call:  assertion failed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42827>
_______________________________________

From report at bugs.python.org  Mon Jan  4 16:12:16 2021
From: report at bugs.python.org (Brett Cannon)
Date: Mon, 04 Jan 2021 21:12:16 +0000
Subject: [issue29708] support reproducible Python builds
In-Reply-To: <1488540966.18.0.904677570473.issue29708@psf.upfronthosting.co.za>
Message-ID: <1609794736.74.0.515979211318.issue29708@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
nosy:  -brett.cannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29708>
_______________________________________

From report at bugs.python.org  Mon Jan  4 16:13:16 2021
From: report at bugs.python.org (Brett Cannon)
Date: Mon, 04 Jan 2021 21:13:16 +0000
Subject: [issue17343] Add a version of str.split which returns an iterator
In-Reply-To: <1362359066.58.0.311917237277.issue17343@psf.upfronthosting.co.za>
Message-ID: <1609794796.64.0.495237976701.issue17343@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
nosy:  -brett.cannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17343>
_______________________________________

From report at bugs.python.org  Mon Jan  4 16:19:46 2021
From: report at bugs.python.org (Julien Palard)
Date: Mon, 04 Jan 2021 21:19:46 +0000
Subject: [issue42827] pegen parser: Multiline eval with assignment to function
 call: assertion failed
In-Reply-To: <1609793289.79.0.762652539307.issue42827@roundup.psfhosted.org>
Message-ID: <1609795186.11.0.626969675474.issue42827@roundup.psfhosted.org>


Julien Palard <julien+python at palard.fr> added the comment:

According to git bisect it come from 01ece63d42b830df106948db0aefa6c1ba24416a, thanks Victor for adding Lysandros, you had a good feeling :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42827>
_______________________________________

From report at bugs.python.org  Mon Jan  4 16:26:52 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Mon, 04 Jan 2021 21:26:52 +0000
Subject: [issue42584] Upgrade macOS and Windows installers to use SQLite 3.34.0
In-Reply-To: <1607337382.55.0.591359272905.issue42584@roundup.psfhosted.org>
Message-ID: <1609795612.88.0.479107343764.issue42584@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

> FWIW, any core dev can merge SQLite updates for Windows (if they're satisfied there are no issues).

A CI check would indicate that there are no issues. The PoC CI is just a short bash script wrapped in GitHub's workflow syntax. I'd be happy to maintain it, FWIW. On the other hand, adding a CI check is not super important for me :)

https://sqlite.org/versionnumbers.html:
"[?] the current tarball naming conventions only reserve two digits for the Y and so the naming format for downloads will need to be revised in about 2030."

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42584>
_______________________________________

From report at bugs.python.org  Mon Jan  4 16:33:53 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 04 Jan 2021 21:33:53 +0000
Subject: [issue1635741] Py_Finalize() doesn't clear all Python objects at exit
Message-ID: <1609796033.54.0.0423735146758.issue1635741@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 0b858cdd5d114f0890b11b6c4d6559d0ceb468ab by Erlend Egeberg Aasland in branch 'master':
bpo-1635741: Convert _multibytecodec to multi-phase init (GH-24095)
https://github.com/python/cpython/commit/0b858cdd5d114f0890b11b6c4d6559d0ceb468ab


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1635741>
_______________________________________

From report at bugs.python.org  Mon Jan  4 18:05:30 2021
From: report at bugs.python.org (J.D. Rudie)
Date: Mon, 04 Jan 2021 23:05:30 +0000
Subject: [issue42818] AttributeError: 'zipimporter' object has no attribute
 'find_spec'
In-Reply-To: <1609682975.59.0.559934544299.issue42818@roundup.psfhosted.org>
Message-ID: <1609801530.95.0.357816829381.issue42818@roundup.psfhosted.org>


J.D. Rudie <rudiejd at miamioh.edu> added the comment:

Is this an issue with zipimporter, or an issue with a version of setuptools? On the latest version of setuptools, find_spec reverts to find_module, which should be implemented in the 3.9 version of zipimporter unless I'm misunderstanding the issue.

----------
nosy: +rudiejd

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42818>
_______________________________________

From report at bugs.python.org  Mon Jan  4 18:05:56 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Mon, 04 Jan 2021 23:05:56 +0000
Subject: [issue42093] Add opcode cache for LOAD_ATTR
In-Reply-To: <1603163916.18.0.528007796853.issue42093@roundup.psfhosted.org>
Message-ID: <1609801556.26.0.0575921522692.issue42093@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Thanks! Do you have any plans for further inline caches? I was wondering if we could reverse the situation for slots again by adding slots support to the LOAD_ATTR opcode inline cache...

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42093>
_______________________________________

From report at bugs.python.org  Mon Jan  4 18:16:47 2021
From: report at bugs.python.org (miss-islington)
Date: Mon, 04 Jan 2021 23:16:47 +0000
Subject: [issue40810] sqlite3 test CheckTraceCallbackContent fails for sqlite
 v3.7.3 through 3.7.14.1
In-Reply-To: <1590688058.38.0.22519081316.issue40810@roundup.psfhosted.org>
Message-ID: <1609802207.53.0.209619314554.issue40810@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset f7f0ed59bcc41ed20674d4b2aa443d3b79e725f4 by Erlend Egeberg Aasland in branch 'master':
bpo-40810: Fix CheckTraceCallbackContent for SQLite pre 3.7.15 (GH-20530)
https://github.com/python/cpython/commit/f7f0ed59bcc41ed20674d4b2aa443d3b79e725f4


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40810>
_______________________________________

From report at bugs.python.org  Mon Jan  4 18:17:10 2021
From: report at bugs.python.org (miss-islington)
Date: Mon, 04 Jan 2021 23:17:10 +0000
Subject: [issue40810] sqlite3 test CheckTraceCallbackContent fails for sqlite
 v3.7.3 through 3.7.14.1
In-Reply-To: <1590688058.38.0.22519081316.issue40810@roundup.psfhosted.org>
Message-ID: <1609802230.01.0.779122977587.issue40810@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +22933
pull_request: https://github.com/python/cpython/pull/24104

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40810>
_______________________________________

From report at bugs.python.org  Mon Jan  4 18:17:23 2021
From: report at bugs.python.org (miss-islington)
Date: Mon, 04 Jan 2021 23:17:23 +0000
Subject: [issue40810] sqlite3 test CheckTraceCallbackContent fails for sqlite
 v3.7.3 through 3.7.14.1
In-Reply-To: <1590688058.38.0.22519081316.issue40810@roundup.psfhosted.org>
Message-ID: <1609802243.0.0.21518436679.issue40810@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +22934
pull_request: https://github.com/python/cpython/pull/24105

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40810>
_______________________________________

From report at bugs.python.org  Mon Jan  4 18:18:26 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Mon, 04 Jan 2021 23:18:26 +0000
Subject: [issue40810] sqlite3 test CheckTraceCallbackContent fails for sqlite
 v3.7.3 through 3.7.14.1
In-Reply-To: <1590688058.38.0.22519081316.issue40810@roundup.psfhosted.org>
Message-ID: <1609802306.63.0.40963546912.issue40810@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Please ping this issue if the backports don't auto-merge after the tests pass, or if the tests fail.

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40810>
_______________________________________

From report at bugs.python.org  Mon Jan  4 18:20:18 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Mon, 04 Jan 2021 23:20:18 +0000
Subject: [issue40822] Drop support for SQLite pre 3.7.15
In-Reply-To: <1590829305.32.0.448529686599.issue40822@roundup.psfhosted.org>
Message-ID: <1609802418.41.0.677917672983.issue40822@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40822>
_______________________________________

From report at bugs.python.org  Mon Jan  4 18:31:39 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Mon, 04 Jan 2021 23:31:39 +0000
Subject: [issue40810] sqlite3 test CheckTraceCallbackContent fails for sqlite
 v3.7.3 through 3.7.14.1
In-Reply-To: <1590688058.38.0.22519081316.issue40810@roundup.psfhosted.org>
Message-ID: <1609803099.91.0.43735410998.issue40810@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
pull_requests: +22935
pull_request: https://github.com/python/cpython/pull/24106

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40810>
_______________________________________

From report at bugs.python.org  Mon Jan  4 18:33:39 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Mon, 04 Jan 2021 23:33:39 +0000
Subject: [issue40810] sqlite3 test CheckTraceCallbackContent fails for sqlite
 v3.7.3 through 3.7.14.1
In-Reply-To: <1590688058.38.0.22519081316.issue40810@roundup.psfhosted.org>
Message-ID: <1609803219.93.0.379431555045.issue40810@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

> +1 for dropping support for < 3.7.15 in master. We should fix or skip tests in maintenance branches.

PR's for fixing the tests in 3.9 and 3.8 are now awaiting merge. PR for dropping support for SQLite pre 3.7.15 in master is opened.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40810>
_______________________________________

From report at bugs.python.org  Mon Jan  4 18:36:45 2021
From: report at bugs.python.org (miss-islington)
Date: Mon, 04 Jan 2021 23:36:45 +0000
Subject: [issue40810] sqlite3 test CheckTraceCallbackContent fails for sqlite
 v3.7.3 through 3.7.14.1
In-Reply-To: <1590688058.38.0.22519081316.issue40810@roundup.psfhosted.org>
Message-ID: <1609803405.53.0.118433467636.issue40810@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 0ccac5ff587d7637854e5d3e75f0f9a8f5528e59 by Miss Islington (bot) in branch '3.8':
bpo-40810: Fix CheckTraceCallbackContent for SQLite pre 3.7.15 (GH-20530)
https://github.com/python/cpython/commit/0ccac5ff587d7637854e5d3e75f0f9a8f5528e59


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40810>
_______________________________________

From report at bugs.python.org  Mon Jan  4 18:41:18 2021
From: report at bugs.python.org (miss-islington)
Date: Mon, 04 Jan 2021 23:41:18 +0000
Subject: [issue40810] sqlite3 test CheckTraceCallbackContent fails for sqlite
 v3.7.3 through 3.7.14.1
In-Reply-To: <1590688058.38.0.22519081316.issue40810@roundup.psfhosted.org>
Message-ID: <1609803678.43.0.498693577341.issue40810@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 80e5732d31bb7362c7b647acc618df701b3ae951 by Miss Islington (bot) in branch '3.9':
bpo-40810: Fix CheckTraceCallbackContent for SQLite pre 3.7.15 (GH-20530)
https://github.com/python/cpython/commit/80e5732d31bb7362c7b647acc618df701b3ae951


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40810>
_______________________________________

From report at bugs.python.org  Mon Jan  4 18:42:31 2021
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Mon, 04 Jan 2021 23:42:31 +0000
Subject: [issue42827] pegen parser: Multiline eval with assignment to function
 call: assertion failed
In-Reply-To: <1609793289.79.0.762652539307.issue42827@roundup.psfhosted.org>
Message-ID: <1609803751.69.0.861075960847.issue42827@roundup.psfhosted.org>


Lysandros Nikolaou <lisandrosnik at gmail.com> added the comment:

Thanks for letting us know, Julien! I've identified the bug and where it comes from and I'll probably work on it tomorrow.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42827>
_______________________________________

From report at bugs.python.org  Mon Jan  4 19:10:45 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 05 Jan 2021 00:10:45 +0000
Subject: [issue4714] print opcode stats at the end of pybench runs
In-Reply-To: <1229895457.43.0.758313096043.issue4714@psf.upfronthosting.co.za>
Message-ID: <1609805445.64.0.414037383372.issue4714@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
resolution:  -> out of date
stage: patch review -> resolved
status: languishing -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4714>
_______________________________________

From report at bugs.python.org  Mon Jan  4 19:42:35 2021
From: report at bugs.python.org (Anthony Sottile)
Date: Tue, 05 Jan 2021 00:42:35 +0000
Subject: [issue36675] Doctest directives and comments missing from code samples
In-Reply-To: <1555757030.56.0.8094269644.issue36675@roundup.psfhosted.org>
Message-ID: <1609807355.44.0.833214595396.issue36675@roundup.psfhosted.org>


Anthony Sottile <asottile at umich.edu> added the comment:

should the minimum sphinx version be bumped and/or this reverted: https://github.com/python/cpython/blob/f7f0ed59bcc41ed20674d4b2aa443d3b79e725f4/Doc/conf.py#L48

this change breaks, for example, sphinx 1.8.5 while building for ubuntu 20.04

The directive used here requires sphinx>=3.2.0

I notice some other attempts have been made to make the docs more compatible with sphinx 1.x in this release as well so there might be conflicting directions here: https://github.com/python/cpython/commit/b63a620014b67a6e63d10783149c41baaf59def8

----------
nosy: +Anthony Sottile

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36675>
_______________________________________

From report at bugs.python.org  Mon Jan  4 20:29:11 2021
From: report at bugs.python.org (karl)
Date: Tue, 05 Jan 2021 01:29:11 +0000
Subject: [issue25258] HtmlParser doesn't handle void element tags correctly
In-Reply-To: <1443468394.25.0.617953373069.issue25258@psf.upfronthosting.co.za>
Message-ID: <1609810151.63.0.309866375619.issue25258@roundup.psfhosted.org>


karl <karl+pythonbugs at la-grange.net> added the comment:

The parsing rules for tokenization of html are at 
https://html.spec.whatwg.org/multipage/parsing.html#tokenization

In the stack of open elements, there are specific rules for certain elements. 
https://html.spec.whatwg.org/multipage/parsing.html#special

from a DOM point of view, there is indeed no difference in between 
<img src="somewhere"><img src="somewhere"/>

https://software.hixie.ch/utilities/js/live-dom-viewer/?%3C!DOCTYPE%20html%3E%0A%3Cimg%20src%3D%22somewhere%22%3E%3Cimg%20src%3D%22somewhere%22%2F%3E

----------
nosy: +karlcow

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue25258>
_______________________________________

From report at bugs.python.org  Mon Jan  4 20:32:55 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 05 Jan 2021 01:32:55 +0000
Subject: [issue42827] pegen parser: Multiline eval with assignment to function
 call: assertion failed
In-Reply-To: <1609793289.79.0.762652539307.issue42827@roundup.psfhosted.org>
Message-ID: <1609810375.06.0.0747191760811.issue42827@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
keywords: +patch
pull_requests: +22936
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24107

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42827>
_______________________________________

From report at bugs.python.org  Mon Jan  4 20:34:11 2021
From: report at bugs.python.org (karl)
Date: Tue, 05 Jan 2021 01:34:11 +0000
Subject: [issue25258] HtmlParser doesn't handle void element tags correctly
In-Reply-To: <1443468394.25.0.617953373069.issue25258@psf.upfronthosting.co.za>
Message-ID: <1609810451.87.0.355834457827.issue25258@roundup.psfhosted.org>


karl <karl+pythonbugs at la-grange.net> added the comment:

I wonder if the confusion comes from the name. The HTMLParser is kind of a tokenizer more than a full HTML parser, but that's probably a detail. It doesn't create a DOM Tree which you can access, but could help you to build a DOM Tree (!= DOM Document object)

https://html.spec.whatwg.org/multipage/parsing.html#overview-of-the-parsing-model

> Implementations that do not support scripting do not have to actually create a DOM Document object, but the DOM tree in such cases is still used as the model for the rest of the specification.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue25258>
_______________________________________

From report at bugs.python.org  Mon Jan  4 21:19:54 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 05 Jan 2021 02:19:54 +0000
Subject: [issue42093] Add opcode cache for LOAD_ATTR
In-Reply-To: <1603163916.18.0.528007796853.issue42093@roundup.psfhosted.org>
Message-ID: <1609813194.07.0.457129178836.issue42093@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> Thanks! Do you have any plans for further inline caches?

Yeah, we are experimenting with some ideas here: https://bugs.python.org/issue42115. 

>  I was wondering if we could reverse the situation for slots again by adding slots support to the LOAD_ATTR opcode inline cache...

I think we can do it as long as we can detect easily if a given descriptor is immutable. The problem of mutability is this code:

class Descriptor:
    pass

class C:
    def __init__(self):
        self.x = 1
    x = Descriptor()

def f(o):
    return o.x

o = C()
for i in range(10000):
    assert f(o) == 1

Descriptor.__get__ = lambda self, instance, value: 2
Descriptor.__set__ = lambda *args: None

print(f(o))

In this case, if we do not skip the cache for mutable descriptors, the code will not reflect the new result (2 instead of 1). __slots__ are immutable descriptors so we should be good as long as we can detect them.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42093>
_______________________________________

From report at bugs.python.org  Mon Jan  4 21:45:02 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 05 Jan 2021 02:45:02 +0000
Subject: [issue42115] Caching infrastructure for the evaluation loop:
 specialised opcodes
In-Reply-To: <1603336898.74.0.366564812208.issue42115@roundup.psfhosted.org>
Message-ID: <1609814702.44.0.221439270909.issue42115@roundup.psfhosted.org>


Change by Guido van Rossum <gvanrossum at gmail.com>:


----------
nosy: +Guido.van.Rossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42115>
_______________________________________

From report at bugs.python.org  Mon Jan  4 21:52:40 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 05 Jan 2021 02:52:40 +0000
Subject: [issue42804] Unable to compile the cpython code x86 windows
In-Reply-To: <1609524007.28.0.23660757957.issue42804@roundup.psfhosted.org>
Message-ID: <1609815160.47.0.699516758353.issue42804@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

>From the evidence presented, the problem building 3.8 on Win 10 is not with our build code.  I therefore believe that this should be closed as '3rd-party' and that Sunny should inquire on python-list about the permission problem.  However, I marked this for 'Window' and will give our Windows experts a few days to add something before closing.

----------
components: +Windows
nosy: +paul.moore, steve.dower, terry.reedy, tim.golden, zach.ware

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42804>
_______________________________________

From report at bugs.python.org  Mon Jan  4 22:57:20 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 05 Jan 2021 03:57:20 +0000
Subject: [issue42093] Add opcode cache for LOAD_ATTR
In-Reply-To: <1603163916.18.0.528007796853.issue42093@roundup.psfhosted.org>
Message-ID: <1609819040.53.0.977677271891.issue42093@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Hm, I was thinking to recognize the specific type of descriptor used by slots and cache only that. Though we would still have to consider updates to C.__dict__ (that's handled by looking at the dict version right?).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42093>
_______________________________________

From report at bugs.python.org  Mon Jan  4 23:52:33 2021
From: report at bugs.python.org (Josh Rosenberg)
Date: Tue, 05 Jan 2021 04:52:33 +0000
Subject: [issue42826] typing.Iterable does not need __getitem__() method
In-Reply-To: <1609782427.22.0.495333991832.issue42826@roundup.psfhosted.org>
Message-ID: <1609822353.88.0.362980035256.issue42826@roundup.psfhosted.org>


Josh Rosenberg <shadowranger+python at gmail.com> added the comment:

As Serhiy says, the glossary term for an iterable is not the same as the documentation for typing.Iterable (which at this point is largely defined in terms of collections.abc.Iterable). True, collections.abc.Iterable does not detect classes that iterate via __getitem__, only via __iter__ (the docs are quite clear on this), but such __getitem__ based classes are still iterable in the broad sense of the term used in the glossary.

----------
nosy: +josh.r
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42826>
_______________________________________

From report at bugs.python.org  Tue Jan  5 00:06:20 2021
From: report at bugs.python.org (Dustin Rodrigues)
Date: Tue, 05 Jan 2021 05:06:20 +0000
Subject: [issue42819] readline 8.1 bracketed paste
In-Reply-To: <1609707155.89.0.22999518491.issue42819@roundup.psfhosted.org>
Message-ID: <1609823180.83.0.783110055901.issue42819@roundup.psfhosted.org>


Change by Dustin Rodrigues <dust.rod at gmail.com>:


----------
keywords: +patch
pull_requests: +22937
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24108

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42819>
_______________________________________

From report at bugs.python.org  Tue Jan  5 00:25:32 2021
From: report at bugs.python.org (Brandt Bucher)
Date: Tue, 05 Jan 2021 05:25:32 +0000
Subject: [issue40636] Provide a strict form of zip (PEP-618) requiring same
 length inputs
In-Reply-To: <1589570739.4.0.582573486837.issue40636@roundup.psfhosted.org>
Message-ID: <1609824332.42.0.171180312394.issue40636@roundup.psfhosted.org>


Change by Brandt Bucher <brandtbucher at gmail.com>:


----------
pull_requests: +22938
pull_request: https://github.com/python/cpython/pull/24109

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40636>
_______________________________________

From report at bugs.python.org  Tue Jan  5 01:37:22 2021
From: report at bugs.python.org (Pandu E POLUAN)
Date: Tue, 05 Jan 2021 06:37:22 +0000
Subject: [issue27820] Possible bug in smtplib when initial_response_ok=False
In-Reply-To: <1471739698.94.0.271523306415.issue27820@psf.upfronthosting.co.za>
Message-ID: <1609828642.48.0.0746069230003.issue27820@roundup.psfhosted.org>


Pandu E POLUAN <pepoluan at gmail.com> added the comment:

Okay, I finally figured out what's wrong.

This piece of code in `test_smtplib.py`:

        if self.smtp_state == self.AUTH:
            line = self._emptystring.join(self.received_lines)
            print('Data:', repr(line), file=smtpd.DEBUGSTREAM)
            self.received_lines = []
            try:
                self.auth_object(line)
            except ResponseException as e:
                self.smtp_state = self.COMMAND
                self.push('%s %s' % (e.smtp_code, e.smtp_error))
                return

The last "return" is over-indented.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27820>
_______________________________________

From report at bugs.python.org  Tue Jan  5 01:38:39 2021
From: report at bugs.python.org (Brandt Bucher)
Date: Tue, 05 Jan 2021 06:38:39 +0000
Subject: [issue40810] sqlite3 test CheckTraceCallbackContent fails for sqlite
 v3.7.3 through 3.7.14.1
In-Reply-To: <1590688058.38.0.22519081316.issue40810@roundup.psfhosted.org>
Message-ID: <1609828719.16.0.578433903531.issue40810@roundup.psfhosted.org>


Change by Brandt Bucher <brandtbucher at gmail.com>:


----------
nosy: +brandtbucher
nosy_count: 6.0 -> 7.0
pull_requests: +22939
pull_request: https://github.com/python/cpython/pull/24110

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40810>
_______________________________________

From report at bugs.python.org  Tue Jan  5 01:39:56 2021
From: report at bugs.python.org (Brandt Bucher)
Date: Tue, 05 Jan 2021 06:39:56 +0000
Subject: [issue40810] sqlite3 test CheckTraceCallbackContent fails for sqlite
 v3.7.3 through 3.7.14.1
In-Reply-To: <1590688058.38.0.22519081316.issue40810@roundup.psfhosted.org>
Message-ID: <1609828796.7.0.105468506892.issue40810@roundup.psfhosted.org>


Brandt Bucher <brandtbucher at gmail.com> added the comment:

It looks like the markup in the NEWS entry broke Travis on master. I guess that's one downside of Travis not being a required job anymore.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40810>
_______________________________________

From report at bugs.python.org  Tue Jan  5 01:57:25 2021
From: report at bugs.python.org (miss-islington)
Date: Tue, 05 Jan 2021 06:57:25 +0000
Subject: [issue40810] sqlite3 test CheckTraceCallbackContent fails for sqlite
 v3.7.3 through 3.7.14.1
In-Reply-To: <1590688058.38.0.22519081316.issue40810@roundup.psfhosted.org>
Message-ID: <1609829845.72.0.411432565642.issue40810@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +22940
pull_request: https://github.com/python/cpython/pull/24111

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40810>
_______________________________________

From report at bugs.python.org  Tue Jan  5 01:57:43 2021
From: report at bugs.python.org (miss-islington)
Date: Tue, 05 Jan 2021 06:57:43 +0000
Subject: [issue40810] sqlite3 test CheckTraceCallbackContent fails for sqlite
 v3.7.3 through 3.7.14.1
In-Reply-To: <1590688058.38.0.22519081316.issue40810@roundup.psfhosted.org>
Message-ID: <1609829863.11.0.61897694476.issue40810@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +22941
pull_request: https://github.com/python/cpython/pull/24112

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40810>
_______________________________________

From report at bugs.python.org  Tue Jan  5 02:05:37 2021
From: report at bugs.python.org (Brandt Bucher)
Date: Tue, 05 Jan 2021 07:05:37 +0000
Subject: [issue40636] Provide a strict form of zip (PEP-618) requiring same
 length inputs
In-Reply-To: <1589570739.4.0.582573486837.issue40636@roundup.psfhosted.org>
Message-ID: <1609830337.57.0.294141818119.issue40636@roundup.psfhosted.org>


Brandt Bucher <brandtbucher at gmail.com> added the comment:


New changeset 27f9dafc2ba51864a9bc2fe5d6293eb4fd887bce by Brandt Bucher in branch 'master':
bpo-40636: Remove overly-strict zip pickling tests (GH-24109)
https://github.com/python/cpython/commit/27f9dafc2ba51864a9bc2fe5d6293eb4fd887bce


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40636>
_______________________________________

From report at bugs.python.org  Tue Jan  5 02:13:22 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 05 Jan 2021 07:13:22 +0000
Subject: [issue42681] Incorrect range checks/documentation in curses
In-Reply-To: <1608339537.48.0.496910027234.issue42681@roundup.psfhosted.org>
Message-ID: <1609830802.63.0.106333018822.issue42681@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 59f9b4e4509be67494f3d45489fa55523175ff69 by Serhiy Storchaka in branch 'master':
bpo-42681: Fix test_curses failures related to color pairs (GH-24089)
https://github.com/python/cpython/commit/59f9b4e4509be67494f3d45489fa55523175ff69


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42681>
_______________________________________

From report at bugs.python.org  Tue Jan  5 02:24:40 2021
From: report at bugs.python.org (Cheryl Sabella)
Date: Tue, 05 Jan 2021 07:24:40 +0000
Subject: [issue40810] sqlite3 test CheckTraceCallbackContent fails for sqlite
 v3.7.3 through 3.7.14.1
In-Reply-To: <1590688058.38.0.22519081316.issue40810@roundup.psfhosted.org>
Message-ID: <1609831480.23.0.613496708679.issue40810@roundup.psfhosted.org>


Change by Cheryl Sabella <cheryl.sabella at gmail.com>:


----------
nosy: +cheryl.sabella
nosy_count: 7.0 -> 8.0
pull_requests: +22942
pull_request: https://github.com/python/cpython/pull/14491

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40810>
_______________________________________

From report at bugs.python.org  Tue Jan  5 02:26:50 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 05 Jan 2021 07:26:50 +0000
Subject: [issue32631] IDLE: revise zzdummy.py
In-Reply-To: <1516690644.63.0.467229070634.issue32631@psf.upfronthosting.co.za>
Message-ID: <1609831610.8.0.357150497344.issue32631@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset e40e2a2cc94c554e7e245a8ca5a7432d31a95766 by Cheryl Sabella in branch 'master':
bpo-32631: IDLE: Enable zzdummy example extension module (GH-14491)
https://github.com/python/cpython/commit/e40e2a2cc94c554e7e245a8ca5a7432d31a95766


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32631>
_______________________________________

From report at bugs.python.org  Tue Jan  5 02:43:39 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 05 Jan 2021 07:43:39 +0000
Subject: [issue42681] Incorrect range checks/documentation in curses
In-Reply-To: <1608339537.48.0.496910027234.issue42681@roundup.psfhosted.org>
Message-ID: <1609832619.81.0.598062207326.issue42681@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +22943
pull_request: https://github.com/python/cpython/pull/24113

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42681>
_______________________________________

From report at bugs.python.org  Tue Jan  5 02:46:21 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 05 Jan 2021 07:46:21 +0000
Subject: [issue32631] IDLE: revise zzdummy.py
In-Reply-To: <1516690644.63.0.467229070634.issue32631@psf.upfronthosting.co.za>
Message-ID: <1609832781.2.0.526058583418.issue32631@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
pull_requests: +22944
pull_request: https://github.com/python/cpython/pull/24114

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32631>
_______________________________________

From report at bugs.python.org  Tue Jan  5 03:03:18 2021
From: report at bugs.python.org (Pandu E POLUAN)
Date: Tue, 05 Jan 2021 08:03:18 +0000
Subject: [issue42498] smtplib is glitchy after receive server code 500
In-Reply-To: <1606627835.9.0.185077481862.issue42498@roundup.psfhosted.org>
Message-ID: <1609833798.02.0.70578529849.issue42498@roundup.psfhosted.org>


Pandu E POLUAN <pepoluan at gmail.com> added the comment:

The "problem" is that smtplib.SMTP does the following, in essence:

1. Open connection to server
2. Send EHLO
3. Read server response

The PROXY injection causes a response from the server, but the response gets "cached" in the incoming TCP buffer. The injection script likely does not consume this buffer, resulting in Step 3 above reading this "cached" response. 

So from the point of view of smtplib.SMTP, the "503" message arrives _after_ EHLO is sent, while in actuality the "503" arrives before EHLO is sent.

I suggest rewriting the port forwarding script so that it consumes the response from the server first before transferring to smtplib.SMTP

----------
nosy: +pepoluan

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42498>
_______________________________________

From report at bugs.python.org  Tue Jan  5 03:09:38 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 05 Jan 2021 08:09:38 +0000
Subject: [issue42508] macOS IDLE with Tk 8.6.10 in 3.9.1rc1 universal2
 installer fails smoke test
In-Reply-To: <1606706274.22.0.163331071262.issue42508@roundup.psfhosted.org>
Message-ID: <1609834178.71.0.411712241495.issue42508@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset d05b470d6ad6dfe0d4933ffc3c5c1e2c03b390bd by Miss Islington (bot) in branch '3.8':
bpo-42508: Keep IDLE running on macOS (GH-23577) (#23670)
https://github.com/python/cpython/commit/d05b470d6ad6dfe0d4933ffc3c5c1e2c03b390bd


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42508>
_______________________________________

From report at bugs.python.org  Tue Jan  5 03:10:47 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 05 Jan 2021 08:10:47 +0000
Subject: [issue42508] macOS IDLE with Tk 8.6.10 in 3.9.1rc1 universal2
 installer fails smoke test
In-Reply-To: <1606706274.22.0.163331071262.issue42508@roundup.psfhosted.org>
Message-ID: <1609834247.85.0.0372818678445.issue42508@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

I believe that this issue is done.  Please open a new one if more is needed.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42508>
_______________________________________

From report at bugs.python.org  Tue Jan  5 03:26:05 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 05 Jan 2021 08:26:05 +0000
Subject: [issue32631] IDLE: revise zzdummy.py
In-Reply-To: <1516690644.63.0.467229070634.issue32631@psf.upfronthosting.co.za>
Message-ID: <1609835165.84.0.219999315982.issue32631@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset d82392facefe0564dd55aa2adf04bf21c704858d by Terry Jan Reedy in branch '3.9':
[3.9] bpo-32631: IDLE: Enable zzdummy example extension module (GH-14491)
https://github.com/python/cpython/commit/d82392facefe0564dd55aa2adf04bf21c704858d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32631>
_______________________________________

From report at bugs.python.org  Tue Jan  5 03:35:48 2021
From: report at bugs.python.org (Julien Palard)
Date: Tue, 05 Jan 2021 08:35:48 +0000
Subject: [issue42822] Missing backslashes in documentation for 3.8 and 3.9
In-Reply-To: <1609765422.49.0.483236804978.issue42822@roundup.psfhosted.org>
Message-ID: <1609835748.97.0.250937280764.issue42822@roundup.psfhosted.org>


Change by Julien Palard <julien+python at palard.fr>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42822>
_______________________________________

From report at bugs.python.org  Tue Jan  5 03:36:43 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 05 Jan 2021 08:36:43 +0000
Subject: [issue32631] IDLE: revise zzdummy.py
In-Reply-To: <1516690644.63.0.467229070634.issue32631@psf.upfronthosting.co.za>
Message-ID: <1609835803.01.0.324096082186.issue32631@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
pull_requests: +22945
pull_request: https://github.com/python/cpython/pull/24115

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32631>
_______________________________________

From report at bugs.python.org  Tue Jan  5 03:42:02 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 05 Jan 2021 08:42:02 +0000
Subject: [issue32631] IDLE: revise zzdummy.py
In-Reply-To: <1516690644.63.0.467229070634.issue32631@psf.upfronthosting.co.za>
Message-ID: <1609836122.03.0.508845492115.issue32631@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

https://stackoverflow.com/questions/65567057/how-can-i-get-started-developing-extensions-for-python-idle prompted me to finish this enough to merge it.

My intention was that in the absence of a selection, all lines should be prefixed, not just the current one.  My impression is that some other formatters do this, but maybe not.  In any case, it does not matter exactly what this dummy example does, as long as it works as documented.

----------
versions: +Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32631>
_______________________________________

From report at bugs.python.org  Tue Jan  5 04:18:11 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 05 Jan 2021 09:18:11 +0000
Subject: [issue32631] IDLE: revise zzdummy.py
In-Reply-To: <1516690644.63.0.467229070634.issue32631@psf.upfronthosting.co.za>
Message-ID: <1609838291.71.0.41340704229.issue32631@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset a087a97438e922fcace357ff4c29806ff65838d8 by Terry Jan Reedy in branch '3.8':
[3.8] bpo-32631: IDLE: Enable zzdummy example extension module (GH-14491)
https://github.com/python/cpython/commit/a087a97438e922fcace357ff4c29806ff65838d8


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32631>
_______________________________________

From report at bugs.python.org  Tue Jan  5 04:18:33 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 05 Jan 2021 09:18:33 +0000
Subject: [issue32631] IDLE: revise zzdummy.py
In-Reply-To: <1516690644.63.0.467229070634.issue32631@psf.upfronthosting.co.za>
Message-ID: <1609838313.27.0.781969106683.issue32631@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32631>
_______________________________________

From report at bugs.python.org  Tue Jan  5 05:12:30 2021
From: report at bugs.python.org (=?utf-8?b?TMOhc3psw7MgS2lzcyBLb2xsw6Fy?=)
Date: Tue, 05 Jan 2021 10:12:30 +0000
Subject: [issue33944] Deprecate and remove code execution in pth files
In-Reply-To: <1529688140.44.0.56676864532.issue33944@psf.upfronthosting.co.za>
Message-ID: <1609841550.58.0.275073616062.issue33944@roundup.psfhosted.org>


Change by L?szl? Kiss Koll?r <kiss.kollar.laszlo at gmail.com>:


----------
nosy: +lkollar

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33944>
_______________________________________

From report at bugs.python.org  Tue Jan  5 05:19:01 2021
From: report at bugs.python.org (Marco Franzo)
Date: Tue, 05 Jan 2021 10:19:01 +0000
Subject: [issue42828] Python readline module
Message-ID: <1609841941.92.0.341483279239.issue42828@roundup.psfhosted.org>


New submission from Marco Franzo <frenzisys at gmail.com>:

It would be better to write at the end of the program this:

os.system('stty sane')

because when you import readline, at the end of program, the console remains unusable

----------
assignee: docs at python
components: Documentation
messages: 384379
nosy: docs at python, frenzisys
priority: normal
severity: normal
status: open
title: Python readline module
type: enhancement
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42828>
_______________________________________

From report at bugs.python.org  Tue Jan  5 05:38:02 2021
From: report at bugs.python.org (Steven D'Aprano)
Date: Tue, 05 Jan 2021 10:38:02 +0000
Subject: [issue42828] Python readline module
In-Reply-To: <1609841941.92.0.341483279239.issue42828@roundup.psfhosted.org>
Message-ID: <1609843082.67.0.640359451576.issue42828@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

> when you import readline, at the end of program, the console remains unusable

I cannot replicate that. I've been using readline in versions of Python starting from 2.4 to 3.9 and it has not left the console in an unusual state.

Can you give an example of how to reproduce that? What OS and shell are you using? Which terminal application?

Can you show an example of this bug? Preferably by coping and pasting text, but if necessary a screen shot.

----------
nosy: +steven.daprano

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42828>
_______________________________________

From report at bugs.python.org  Tue Jan  5 06:18:32 2021
From: report at bugs.python.org (Svyatoslav)
Date: Tue, 05 Jan 2021 11:18:32 +0000
Subject: [issue42829] get_type_hints throws for nested class with __future__
 annotations
Message-ID: <1609845512.57.0.0433631135188.issue42829@roundup.psfhosted.org>


New submission from Svyatoslav <prometheus3375 at gmail.com>:

If a class X has nested class Y and class X has annotation Y AFTER the definition of Y, get_type_hints(X) throws NameError if import from future annotations is present.

This is because get_type_hints looks only at mro of the class. Its namespace must be included too as locals.

----------
files: annotations.py
messages: 384381
nosy: Prometheus3375
priority: normal
severity: normal
status: open
title: get_type_hints throws for nested class with __future__ annotations
versions: Python 3.9
Added file: https://bugs.python.org/file49719/annotations.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42829>
_______________________________________

From report at bugs.python.org  Tue Jan  5 06:24:00 2021
From: report at bugs.python.org (Nick Coghlan)
Date: Tue, 05 Jan 2021 11:24:00 +0000
Subject: [issue42455] Add decorator_factory function to functools module
In-Reply-To: <1606250077.84.0.747907374749.issue42455@roundup.psfhosted.org>
Message-ID: <1609845840.55.0.170831240592.issue42455@roundup.psfhosted.org>


Nick Coghlan <ncoghlan at gmail.com> added the comment:

I think the idea is a plausible and well-presented suggestion, but I'm afraid I'm still going to agree with the view that we shouldn't add this.

>From a maintainability point of view, *generically* detecting the difference between "applied without parentheses as a decorator" and "called with parameters to produce a partial function to be used as a decorator" isn't quite as simple as just calling "callable(args[0])", since it's entirely possible for decorator factories to accept callables as parameters. We could try to document our way around that problem, but we wouldn't be able to eliminate it entirely.

Given the relative rarity of the use case, and the potential for subtle issues when the assumptions of the decorator_factory decorator aren't met, I'm happy to leave this task to inline mostly-but-not-completely-boilerplate code rather than trying to abstract it away.

----------
resolution:  -> rejected
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42455>
_______________________________________

From report at bugs.python.org  Tue Jan  5 06:27:54 2021
From: report at bugs.python.org (James Oldfield)
Date: Tue, 05 Jan 2021 11:27:54 +0000
Subject: [issue39457] Add an autocommit property to sqlite3.Connection with a
 PEP 249 compliant manual commit mode and migrate
In-Reply-To: <1580066229.26.0.0229158792904.issue39457@roundup.psfhosted.org>
Message-ID: <1609846074.99.0.876112006766.issue39457@roundup.psfhosted.org>


James Oldfield <james.oldfield at cantab.net> added the comment:

If this ever gets implemented, "autocommit" would be a terrible name for it. That word has a very specific meaning in SQLite, which is essentially the same as "not in a transaction started with BEGIN ...". At the moment, if you want to explicitly control when transactions start (a good idea considering how confusing the current behaviour is) then you would set isolation_mode to None and manually start a transaction with `execute("BEGIN")` - at which point you are NOT in autocommit mode, until you commit or rollback. According to this proposal, if I want manual control over transactions, I would set `conn.autocommit = True`, even though I *don't* want autocommit mode (according to SQLite's definition)!

----------
nosy: +james.oldfield

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39457>
_______________________________________

From report at bugs.python.org  Tue Jan  5 06:28:47 2021
From: report at bugs.python.org (=?utf-8?b?TWllY3p5c8WCYXcgVG9yY2hhxYJh?=)
Date: Tue, 05 Jan 2021 11:28:47 +0000
Subject: [issue42830] tempfile mkstemp() leaks file descriptors if os.close()
 is not called
Message-ID: <1609846127.44.0.860192251042.issue42830@roundup.psfhosted.org>


New submission from Mieczys?aw Torcha?a <mieczyslaw.torchala at gmail.com>:

tempfile mkstemp() documentation says: "Unlike TemporaryFile(), the user of mkstemp() is responsible for deleting the temporary file when done with it."

mkstemp() returns a tuple:

file_descriptor, file_path = mkstemp()

Calling only 

os.unlink(file_path) 

removes the file, but causes leaking file descriptors and when the number of temporary files created is higher than `ulimit -n`, the process crashes (see /proc/$pid/fd in real time until crash).

The solution I found is to also call on descriptor:

os.close(file_descriptor)

but the documentation doesn't mention that (i.e. releasing file descriptor in addition to removing temporary file).

For many users it doesn't matter as they create a few files and when the process finishes, leaking file descriptors are released. 

However, when a lot of files is created during the execution, it will finally crash (unless someone has a huge ulimit -n setting).

If this is not a bug, at least the documentation should mention that both the temp file needs to be removed and the file descriptor released. However, this means calling two commands when only one command was used to create the temporary file. Therefore, maybe adding a function to tempfile library to fully remove a file without a leaking file descriptor is a solution.

----------
components: Library (Lib)
messages: 384384
nosy: mieczyslaw.torchala
priority: normal
severity: normal
status: open
title: tempfile mkstemp() leaks file descriptors if os.close() is not called
type: resource usage
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42830>
_______________________________________

From report at bugs.python.org  Tue Jan  5 06:34:43 2021
From: report at bugs.python.org (Nick Coghlan)
Date: Tue, 05 Jan 2021 11:34:43 +0000
Subject: [issue42455] Add decorator_factory function to functools module
In-Reply-To: <1606250077.84.0.747907374749.issue42455@roundup.psfhosted.org>
Message-ID: <1609846483.03.0.29673297122.issue42455@roundup.psfhosted.org>


Nick Coghlan <ncoghlan at gmail.com> added the comment:

Sorry, I meant to include this comment as well:

The other filter I applied here was "Could someone figure out the boilerplate code themselves in less time than it would take them to find, read, and understand the documentation for the new helper function?"

I'm not sure the answer to that question is "Yes" when writing a decorator factory for the first time, but I am confident it is "Yes" when reading a decorator factory, and for anyone writing their second and subsequent factory (especially if they use the "def factory(decorated=None, /, *, keyword="only", params=True)" idiom the way dataclass and _tp_cache do).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42455>
_______________________________________

From report at bugs.python.org  Tue Jan  5 06:40:50 2021
From: report at bugs.python.org (Svyatoslav)
Date: Tue, 05 Jan 2021 11:40:50 +0000
Subject: [issue42829] get_type_hints throws for nested class with __future__
 annotations
In-Reply-To: <1609845512.57.0.0433631135188.issue42829@roundup.psfhosted.org>
Message-ID: <1609846850.9.0.929067149865.issue42829@roundup.psfhosted.org>


Svyatoslav <prometheus3375 at gmail.com> added the comment:

>
This is because get_type_hints looks only at mro of the class. Its namespace must be included too as locals
<

I'll correct myself. get_type_hints() looks at all entites of mro of a class. If globals are not defined, globals of an entity module are used. But if locals are not defined, then no action is taken. Actually, class namespace must be used as locals in that case.

This is also supported by the case when a class and its module have classes with the same name. See same_classes.py for an example.

----------
Added file: https://bugs.python.org/file49720/same_classes.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42829>
_______________________________________

From report at bugs.python.org  Tue Jan  5 07:04:20 2021
From: report at bugs.python.org (Mark Shannon)
Date: Tue, 05 Jan 2021 12:04:20 +0000
Subject: [issue42823] Incorrect frame.f_lineno when frame.f_trace is set
In-Reply-To: <1609777965.06.0.667792191004.issue42823@roundup.psfhosted.org>
Message-ID: <1609848260.13.0.596826173931.issue42823@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:


New changeset ee9f98d9f4b881ee15868a836a2b99271df1bc0e by Mark Shannon in branch 'master':
bpo-42823: Fix frame lineno when frame.f_trace is set (GH-24099)
https://github.com/python/cpython/commit/ee9f98d9f4b881ee15868a836a2b99271df1bc0e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42823>
_______________________________________

From report at bugs.python.org  Tue Jan  5 07:07:07 2021
From: report at bugs.python.org (Mark Shannon)
Date: Tue, 05 Jan 2021 12:07:07 +0000
Subject: [issue42823] Incorrect frame.f_lineno when frame.f_trace is set
In-Reply-To: <1609777965.06.0.667792191004.issue42823@roundup.psfhosted.org>
Message-ID: <1609848427.27.0.704549522731.issue42823@roundup.psfhosted.org>


Change by Mark Shannon <mark at hotpy.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42823>
_______________________________________

From report at bugs.python.org  Tue Jan  5 07:23:47 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 05 Jan 2021 12:23:47 +0000
Subject: [issue42681] Incorrect range checks/documentation in curses
In-Reply-To: <1608339537.48.0.496910027234.issue42681@roundup.psfhosted.org>
Message-ID: <1609849427.52.0.636941824381.issue42681@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 9b3a53a8264d4c469a3f3d8c037e74c010be3e5c by Serhiy Storchaka in branch '3.9':
[3.9] bpo-42681: Fix test_curses failures related to color pairs (GH-24089) (GH-24113)
https://github.com/python/cpython/commit/9b3a53a8264d4c469a3f3d8c037e74c010be3e5c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42681>
_______________________________________

From report at bugs.python.org  Tue Jan  5 07:38:50 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Tue, 05 Jan 2021 12:38:50 +0000
Subject: [issue41798] [C API] Revisit usage of the PyCapsule C API with
 multi-phase initialization API
In-Reply-To: <1600265269.2.0.881235166904.issue41798@roundup.psfhosted.org>
Message-ID: <1609850330.7.0.762172131185.issue41798@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

Hai Shi, do you mind if I have a go at the socket module CAPI capsule?

----------
nosy: +erlendaasland

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41798>
_______________________________________

From report at bugs.python.org  Tue Jan  5 07:42:52 2021
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 05 Jan 2021 12:42:52 +0000
Subject: [issue36543] Remove old-deprecated ElementTree features (part 2)
In-Reply-To: <1554566782.39.0.176680363975.issue36543@roundup.psfhosted.org>
Message-ID: <1609850572.11.0.602035180832.issue36543@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

Let me just point out there's an official process for making incompatible changes now: https://www.python.org/dev/peps/pep-0387/#making-incompatible-changes

A warning must be emitted (not just mentioned in docs) for two releases before a feature is removed.

----------
nosy: +petr.viktorin

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36543>
_______________________________________

From report at bugs.python.org  Tue Jan  5 07:49:20 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 05 Jan 2021 12:49:20 +0000
Subject: [issue42681] Incorrect range checks/documentation in curses
In-Reply-To: <1608339537.48.0.496910027234.issue42681@roundup.psfhosted.org>
Message-ID: <1609850960.16.0.550311058365.issue42681@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +22946
pull_request: https://github.com/python/cpython/pull/24116

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42681>
_______________________________________

From report at bugs.python.org  Tue Jan  5 07:54:54 2021
From: report at bugs.python.org (E. Paine)
Date: Tue, 05 Jan 2021 12:54:54 +0000
Subject: [issue42831] IDLE fix colours for MacOS dark mode
Message-ID: <1609851294.14.0.191191657845.issue42831@roundup.psfhosted.org>


New submission from E. Paine <paineelisha at gmail.com>:

Currently IDLE, in some places, uses predefined colours which assume it is in light mode. However, on the new Universal2 installers (I tested using 3.10.0a4) this causes issues, where this can no longer be assumed.

Taking the "About IDLE" dialogue as an example, it appears in a light theme and most notably makes button text very hard to read (as this is changed to white). I propose, on macOS systems running Tk >=8.6.10, we try to switch these colours to the system colours described in https://github.com/tcltk/tk/blob/main/macosx/README (IMO, we would test colour availability and catch a TclError rather than specifying conditions ourselves). For the about dialogue I think we would, for example, replace `#bbbbbb` with one of the `systemWindowBackgroundColor`s.

----------
assignee: terry.reedy
components: IDLE
messages: 384391
nosy: epaine, taleinat, terry.reedy
priority: normal
severity: normal
status: open
title: IDLE fix colours for MacOS dark mode
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42831>
_______________________________________

From report at bugs.python.org  Tue Jan  5 07:59:08 2021
From: report at bugs.python.org (hai shi)
Date: Tue, 05 Jan 2021 12:59:08 +0000
Subject: [issue41798] [C API] Revisit usage of the PyCapsule C API with
 multi-phase initialization API
In-Reply-To: <1600265269.2.0.881235166904.issue41798@roundup.psfhosted.org>
Message-ID: <1609851548.87.0.969431250989.issue41798@roundup.psfhosted.org>


hai shi <shihai1991 at 126.com> added the comment:

> Hai Shi, do you mind if I have a go at the socket module CAPI capsule?

Welcome to join this bpo, you can enhance those extension modules if you like :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41798>
_______________________________________

From report at bugs.python.org  Tue Jan  5 08:03:43 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Tue, 05 Jan 2021 13:03:43 +0000
Subject: [issue41798] [C API] Revisit usage of the PyCapsule C API with
 multi-phase initialization API
In-Reply-To: <1600265269.2.0.881235166904.issue41798@roundup.psfhosted.org>
Message-ID: <1609851823.25.0.217340148359.issue41798@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

> Welcome to join this bpo, you can enhance those extension modules if you like :)

Thanks :) I'll take a look at socket first.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41798>
_______________________________________

From report at bugs.python.org  Tue Jan  5 08:12:21 2021
From: report at bugs.python.org (Christian Heimes)
Date: Tue, 05 Jan 2021 13:12:21 +0000
Subject: [issue41798] [C API] Revisit usage of the PyCapsule C API with
 multi-phase initialization API
In-Reply-To: <1600265269.2.0.881235166904.issue41798@roundup.psfhosted.org>
Message-ID: <1609852341.13.0.0729415864038.issue41798@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

PySocketModuleAPI.timeout_error now points to builtin TimeoutError exception.

I'm also in the process of removing PySocketModuleAPI from _ssl.c.

----------
nosy: +christian.heimes

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41798>
_______________________________________

From report at bugs.python.org  Tue Jan  5 08:17:02 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Tue, 05 Jan 2021 13:17:02 +0000
Subject: [issue41798] [C API] Revisit usage of the PyCapsule C API with
 multi-phase initialization API
In-Reply-To: <1600265269.2.0.881235166904.issue41798@roundup.psfhosted.org>
Message-ID: <1609852622.54.0.931418189859.issue41798@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

> I'm also in the process of removing PySocketModuleAPI from _ssl.c.

That's the only user of the API, right? In that case, I'll target _decimal instead. Hai Shi is working on _curses and _datetime, AFAIK.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41798>
_______________________________________

From report at bugs.python.org  Tue Jan  5 08:37:15 2021
From: report at bugs.python.org (cptpcrd)
Date: Tue, 05 Jan 2021 13:37:15 +0000
Subject: [issue42780] os.set_inheritable() fails for O_PATH file descriptors
 on Linux
In-Reply-To: <1609262318.62.0.976413615492.issue42780@roundup.psfhosted.org>
Message-ID: <1609853835.73.0.282657395341.issue42780@roundup.psfhosted.org>


cptpcrd <cptpcrd.enterprise at gmail.com> added the comment:

I've put together some tests (patch attached). Should I PR this to python/cpython?

----------
Added file: https://bugs.python.org/file49721/set-inheritable-test.patch

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42780>
_______________________________________

From report at bugs.python.org  Tue Jan  5 09:00:17 2021
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Tue, 05 Jan 2021 14:00:17 +0000
Subject: [issue39457] Add an autocommit property to sqlite3.Connection with a
 PEP 249 compliant manual commit mode and migrate
In-Reply-To: <1580066229.26.0.0229158792904.issue39457@roundup.psfhosted.org>
Message-ID: <1609855217.87.0.438533412119.issue39457@roundup.psfhosted.org>


G?ry <gery.ogam at gmail.com> added the comment:

> If this ever gets implemented, "autocommit" would be a terrible name for it. That word has a very specific meaning in SQLite, which is essentially the same as "not in a transaction started with BEGIN ...".

Yes if you are talking about SQLite, the database ENGINE: the SQL statements inside BEGIN and COMMIT are said to be in manual commit mode, while SQL statements outside are said to be in autocommit mode. So the autocommit mode is the default mode for database ENGINES.

But here I am talking about SQLite3, the Python database DRIVER. You do not issue BEGIN statements with database DRIVERS, they are issued implicitly, so that the manual mode is the default mode for database DRIVERS.

Cf. this Stack Overflow answer for more details: https://stackoverflow.com/a/48391535/2326961

> At the moment, if you want to explicitly control when transactions start (a good idea considering how confusing the current behaviour is)

No, you do not want that at the database DRIVER level. Because like Mike Bayer explained in issue #9924, this is not what other database DRIVERS do, and this is not PEP 249 compliant (Python Database API Specification v2.0), as its author Marc-Andr? Lemburg explained (cf. https://mail.python.org/pipermail/db-sig/2010-September/005645.html):

> Randall Nortman wrote:
> # PEP 249 says that transactions end on commit() or rollback(), but it
> # doesn't explicitly state when transactions should begin, and there is
> # no begin() method. 
>
> Transactions start implicitly after you connect and after you call .commit() or .rollback(). They are not started for each statement.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39457>
_______________________________________

From report at bugs.python.org  Tue Jan  5 09:01:07 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Tue, 05 Jan 2021 14:01:07 +0000
Subject: [issue41798] [C API] Revisit usage of the PyCapsule C API with
 multi-phase initialization API
In-Reply-To: <1600265269.2.0.881235166904.issue41798@roundup.psfhosted.org>
Message-ID: <1609855267.92.0.339249170872.issue41798@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
pull_requests: +22947
pull_request: https://github.com/python/cpython/pull/24117

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41798>
_______________________________________

From report at bugs.python.org  Tue Jan  5 09:04:32 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 05 Jan 2021 14:04:32 +0000
Subject: [issue42681] Incorrect range checks/documentation in curses
In-Reply-To: <1608339537.48.0.496910027234.issue42681@roundup.psfhosted.org>
Message-ID: <1609855472.06.0.901379526282.issue42681@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset e2c847e0c518dd6c63a898b8265ba54b71548bd6 by Serhiy Storchaka in branch '3.8':
[3.8] [3.9] bpo-42681: Fix test_curses failures related to color pairs (GH-24089) (GH-24113) (GH-24116)
https://github.com/python/cpython/commit/e2c847e0c518dd6c63a898b8265ba54b71548bd6


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42681>
_______________________________________

From report at bugs.python.org  Tue Jan  5 09:06:11 2021
From: report at bugs.python.org (Pandu E POLUAN)
Date: Tue, 05 Jan 2021 14:06:11 +0000
Subject: [issue27820] Possible bug in smtplib when initial_response_ok=False
In-Reply-To: <1471739698.94.0.271523306415.issue27820@psf.upfronthosting.co.za>
Message-ID: <1609855571.81.0.853133508625.issue27820@roundup.psfhosted.org>


Change by Pandu E POLUAN <pepoluan at gmail.com>:


----------
keywords: +patch
pull_requests: +22948
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24118

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27820>
_______________________________________

From report at bugs.python.org  Tue Jan  5 09:11:18 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 05 Jan 2021 14:11:18 +0000
Subject: [issue36543] Remove old-deprecated ElementTree features (part 2)
In-Reply-To: <1554566782.39.0.176680363975.issue36543@roundup.psfhosted.org>
Message-ID: <1609855878.38.0.0517494415996.issue36543@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

This process is not new. The problem is that in this particular case warning will do more harm than removing the module. If we cannot just remove it, we should not introduce warning. It will be kept forever.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36543>
_______________________________________

From report at bugs.python.org  Tue Jan  5 09:14:48 2021
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 05 Jan 2021 14:14:48 +0000
Subject: [issue36543] Remove old-deprecated ElementTree features (part 2)
In-Reply-To: <1554566782.39.0.176680363975.issue36543@roundup.psfhosted.org>
Message-ID: <1609856088.01.0.0384796201019.issue36543@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

Should the process be changed?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36543>
_______________________________________

From report at bugs.python.org  Tue Jan  5 09:16:48 2021
From: report at bugs.python.org (Christian Heimes)
Date: Tue, 05 Jan 2021 14:16:48 +0000
Subject: [issue36543] Remove old-deprecated ElementTree features (part 2)
In-Reply-To: <1554566782.39.0.176680363975.issue36543@roundup.psfhosted.org>
Message-ID: <1609856208.9.0.349430785394.issue36543@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

The process is fine. A deprecation warning will give users time to update code before it hits production.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36543>
_______________________________________

From report at bugs.python.org  Tue Jan  5 09:33:37 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 05 Jan 2021 14:33:37 +0000
Subject: [issue42681] Incorrect range checks/documentation in curses
In-Reply-To: <1608339537.48.0.496910027234.issue42681@roundup.psfhosted.org>
Message-ID: <1609857217.32.0.988374798024.issue42681@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Well, a simple documentation issue has grown into large and complex changes that fix several bugs.

* Incorrect parameter name in color_pair().
* Incorrectly documented ranges for color and pair numbers.
* Based on incorrect documentation, incorrect checks was implemented in the code.
* It was not caught earlier because most tests were skipped on buildbots.
* BTW ncurses accepts some values outside of the documented ranges.
* But ncurses 6.1 does not accept all values in the documented ranges.
* There were other minor bugs introduced in issue36982.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42681>
_______________________________________

From report at bugs.python.org  Tue Jan  5 09:41:00 2021
From: report at bugs.python.org (E. Paine)
Date: Tue, 05 Jan 2021 14:41:00 +0000
Subject: [issue42637] Python macos11.0 release note tkinter problems in news
In-Reply-To: <1607942339.24.0.547653054528.issue42637@roundup.psfhosted.org>
Message-ID: <1609857660.79.0.49785902431.issue42637@roundup.psfhosted.org>


Change by E. Paine <paineelisha at gmail.com>:


----------
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42637>
_______________________________________

From report at bugs.python.org  Tue Jan  5 09:50:55 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 05 Jan 2021 14:50:55 +0000
Subject: [issue42681] Incorrect range checks/documentation in curses
In-Reply-To: <1608339537.48.0.496910027234.issue42681@roundup.psfhosted.org>
Message-ID: <1609858255.65.0.969994428098.issue42681@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Thanks a lot Serhiy for the fantastic work!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42681>
_______________________________________

From report at bugs.python.org  Tue Jan  5 10:07:33 2021
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 05 Jan 2021 15:07:33 +0000
Subject: [issue42832] classmethod change in 3.9 needs better documentation
Message-ID: <1609859253.42.0.13260337218.issue42832@roundup.psfhosted.org>


New submission from Irit Katriel <iritkatriel at yahoo.com>:

The change in issue 19072 broke our code where a decorator assumes that __get__ is only called for instance methods.

It might be worth adding this to What's new in 3.9.

Also in the documentation:
https://docs.python.org/3/library/functions.html#classmethod
It implies that before 3.9 it was not possible to wrap, but it was possible, it just behaved differently.

----------
assignee: docs at python
components: Documentation
messages: 384404
nosy: docs at python, iritkatriel
priority: normal
severity: normal
status: open
title: classmethod change in 3.9 needs better documentation
type: behavior
versions: Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42832>
_______________________________________

From report at bugs.python.org  Tue Jan  5 10:13:15 2021
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 05 Jan 2021 15:13:15 +0000
Subject: [issue19072] classmethod doesn't honour descriptor protocol of
 wrapped callable
In-Reply-To: <1379856164.11.0.6368818134.issue19072@psf.upfronthosting.co.za>
Message-ID: <1609859595.22.0.867378963116.issue19072@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

I've created a followup issue re documentation of this change: issue42832

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19072>
_______________________________________

From report at bugs.python.org  Tue Jan  5 10:28:34 2021
From: report at bugs.python.org (Zachary Ware)
Date: Tue, 05 Jan 2021 15:28:34 +0000
Subject: [issue42804] Unable to compile the cpython code x86 windows
In-Reply-To: <1609524007.28.0.23660757957.issue42804@roundup.psfhosted.org>
Message-ID: <1609860514.68.0.265936242606.issue42804@roundup.psfhosted.org>


Zachary Ware <zachary.ware at gmail.com> added the comment:

It seems possible that the fetch of the Tcl/Tk binaries failed somehow; you can try removing the entire `externals` directory (or just anything in it that includes `tcl` or `tk`); you can use `PCbuild\get_externals.bat --clean` to do so.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42804>
_______________________________________

From report at bugs.python.org  Tue Jan  5 10:29:23 2021
From: report at bugs.python.org (Steve Dower)
Date: Tue, 05 Jan 2021 15:29:23 +0000
Subject: [issue42804] Unable to compile the cpython code x86 windows
In-Reply-To: <1609524007.28.0.23660757957.issue42804@roundup.psfhosted.org>
Message-ID: <1609860563.24.0.176364415717.issue42804@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

If we can solve it, that would be better.

The access denied error looks a bit like a build process (or previous Python build?) is still running that has locked one of the files. Restarting the PC is the easiest way to make sure nothing is using them, or you could try renaming the directory in your Externals folder and running get_externals again.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42804>
_______________________________________

From report at bugs.python.org  Tue Jan  5 10:32:37 2021
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 05 Jan 2021 15:32:37 +0000
Subject: [issue41818] Lib/pty.py major revision
In-Reply-To: <1600557574.22.0.272934906824.issue41818@roundup.psfhosted.org>
Message-ID: <1609860757.8.0.962261314742.issue41818@roundup.psfhosted.org>


Change by Petr Viktorin <encukou at gmail.com>:


----------
nosy: +petr.viktorin
nosy_count: 11.0 -> 12.0
pull_requests: +22949
pull_request: https://github.com/python/cpython/pull/24119

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41818>
_______________________________________

From report at bugs.python.org  Tue Jan  5 10:34:38 2021
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 05 Jan 2021 15:34:38 +0000
Subject: [issue41818] Lib/pty.py major revision
In-Reply-To: <1600557574.22.0.272934906824.issue41818@roundup.psfhosted.org>
Message-ID: <1609860878.95.0.859523112707.issue41818@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

I noticed an issue in one of the newly added tests; see GH-24119

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41818>
_______________________________________

From report at bugs.python.org  Tue Jan  5 10:35:06 2021
From: report at bugs.python.org (Pierre Tardy)
Date: Tue, 05 Jan 2021 15:35:06 +0000
Subject: [issue42833] Lib/urllib/request.py: digest algorithm should be case
 insensitive
Message-ID: <1609860906.08.0.978981588338.issue42833@roundup.psfhosted.org>


New submission from Pierre Tardy <tardyp at gmail.com>:

original bug report: https://github.com/buildbot/buildbot/issues/5743

Twisted by default advertises its algorithm in lowercase, which is uncommon, but allowed by the spec.

https://tools.ietf.org/html/rfc3230#section-4.1.1


python's request.py is only supporting MD5 or SHA as algorithm, and not lowercase equivalent.

This is an easy and harmless fix.

----------
messages: 384409
nosy: Pierre.Tardy
priority: normal
severity: normal
status: open
title: Lib/urllib/request.py: digest algorithm should be case insensitive
type: behavior
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42833>
_______________________________________

From report at bugs.python.org  Tue Jan  5 10:35:32 2021
From: report at bugs.python.org (Pierre Tardy)
Date: Tue, 05 Jan 2021 15:35:32 +0000
Subject: [issue42833] Lib/urllib/request.py: digest algorithm should be case
 insensitive
In-Reply-To: <1609860906.08.0.978981588338.issue42833@roundup.psfhosted.org>
Message-ID: <1609860932.26.0.307841950287.issue42833@roundup.psfhosted.org>


Change by Pierre Tardy <tardyp at gmail.com>:


----------
components: +Library (Lib)
status: open -> pending

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42833>
_______________________________________

From report at bugs.python.org  Tue Jan  5 10:35:44 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 05 Jan 2021 15:35:44 +0000
Subject: [issue42794] test_nntplib fails on CI
In-Reply-To: <1609407398.52.0.195663540983.issue42794@roundup.psfhosted.org>
Message-ID: <1609860944.65.0.642953095493.issue42794@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +22950
pull_request: https://github.com/python/cpython/pull/22632

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42794>
_______________________________________

From report at bugs.python.org  Tue Jan  5 10:47:22 2021
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 05 Jan 2021 15:47:22 +0000
Subject: [issue40052] Incorrect pointer alignment in _PyVectorcall_Function()
 of cpython/abstract.h
In-Reply-To: <1585033092.63.0.928625583781.issue40052@roundup.psfhosted.org>
Message-ID: <1609861642.39.0.0618972051099.issue40052@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:


New changeset 6e72ab909de58e89b5a7cd6899587e203cf129a3 by Miss Islington (bot) in branch '3.9':
[3.9] bpo-40052: Fix alignment issue in PyVectorcall_Function() (GH-23999) (GH-24005)
https://github.com/python/cpython/commit/6e72ab909de58e89b5a7cd6899587e203cf129a3


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40052>
_______________________________________

From report at bugs.python.org  Tue Jan  5 10:54:05 2021
From: report at bugs.python.org (Ken Jin)
Date: Tue, 05 Jan 2021 15:54:05 +0000
Subject: [issue42834] [subinterpreters] Convert "global" static variable
 caches in _json to heap variables
Message-ID: <1609862045.06.0.177130417143.issue42834@roundup.psfhosted.org>


New submission from Ken Jin <kenjin4096 at gmail.com>:

_json currently uses a few static locals for caching of PyUnicode and one Exception object.  This patch aims to move them to the heap.

Apologies if this isn't the right way to track subinterpreter issues, I took a look at issue36876 but it seemed like a meta issue to me.

----------
components: Library (Lib), Subinterpreters
messages: 384411
nosy: eric.snow, kj, vstinner
priority: normal
severity: normal
status: open
title: [subinterpreters] Convert "global" static variable caches in _json to heap variables
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42834>
_______________________________________

From report at bugs.python.org  Tue Jan  5 10:54:25 2021
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 05 Jan 2021 15:54:25 +0000
Subject: [issue40052] Incorrect pointer alignment in _PyVectorcall_Function()
 of cpython/abstract.h
In-Reply-To: <1585033092.63.0.928625583781.issue40052@roundup.psfhosted.org>
Message-ID: <1609862065.35.0.0311961555108.issue40052@roundup.psfhosted.org>


Change by Petr Viktorin <encukou at gmail.com>:


----------
pull_requests: +22951
pull_request: https://github.com/python/cpython/pull/24120

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40052>
_______________________________________

From report at bugs.python.org  Tue Jan  5 10:59:21 2021
From: report at bugs.python.org (Ken Jin)
Date: Tue, 05 Jan 2021 15:59:21 +0000
Subject: [issue42834] [subinterpreters] Convert "global" static variable
 caches in _json to heap variables
In-Reply-To: <1609862045.06.0.177130417143.issue42834@roundup.psfhosted.org>
Message-ID: <1609862361.84.0.871756556961.issue42834@roundup.psfhosted.org>


Change by Ken Jin <kenjin4096 at gmail.com>:


----------
keywords: +patch
pull_requests: +22952
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24121

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42834>
_______________________________________

From report at bugs.python.org  Tue Jan  5 11:00:08 2021
From: report at bugs.python.org (Pierre Tardy)
Date: Tue, 05 Jan 2021 16:00:08 +0000
Subject: [issue42833] Lib/urllib/request.py: digest algorithm should be case
 insensitive
In-Reply-To: <1609860906.08.0.978981588338.issue42833@roundup.psfhosted.org>
Message-ID: <1609862408.38.0.313801087241.issue42833@roundup.psfhosted.org>


Change by Pierre Tardy <tardyp at gmail.com>:


----------
pull_requests: +22953
status: pending -> open
pull_request: https://github.com/python/cpython/pull/24122

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42833>
_______________________________________

From report at bugs.python.org  Tue Jan  5 11:05:12 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 05 Jan 2021 16:05:12 +0000
Subject: [issue36543] Remove old-deprecated ElementTree features (part 2)
In-Reply-To: <1554566782.39.0.176680363975.issue36543@roundup.psfhosted.org>
Message-ID: <1609862712.49.0.960853747131.issue36543@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Deprecation warning may help users of old lower-quality code at the cost of harming users of old higher-quality code. It does not look right to me.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36543>
_______________________________________

From report at bugs.python.org  Tue Jan  5 11:28:34 2021
From: report at bugs.python.org (Soumendra Ganguly)
Date: Tue, 05 Jan 2021 16:28:34 +0000
Subject: [issue41818] Lib/pty.py major revision
In-Reply-To: <1600557574.22.0.272934906824.issue41818@roundup.psfhosted.org>
Message-ID: <1609864114.33.0.300373331672.issue41818@roundup.psfhosted.org>


Soumendra Ganguly <soumendra at tamu.edu> added the comment:

Thank you for the fix. That test was created by modifying an existing test which already had that issue; it is documented in a comment by user nnorwitz in the file. If your solution resolves the problem for all the tests in "class PtyTest", then can you please also remove that comment?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41818>
_______________________________________

From report at bugs.python.org  Tue Jan  5 11:40:59 2021
From: report at bugs.python.org (James Oldfield)
Date: Tue, 05 Jan 2021 16:40:59 +0000
Subject: [issue39457] Add an autocommit property to sqlite3.Connection with a
 PEP 249 compliant manual commit mode and migrate
In-Reply-To: <1580066229.26.0.0229158792904.issue39457@roundup.psfhosted.org>
Message-ID: <1609864859.65.0.886771185809.issue39457@roundup.psfhosted.org>


James Oldfield <james.oldfield at cantab.net> added the comment:

> Yes if you are talking about SQLite, the database ENGINE

I sure was! In this comment I will stick to saying either "SQLite engine" or "sqlite3 driver" as appropriate, hopefully that will be clearer.

> But here I am talking about SQLite3, the Python database DRIVER

Yep, I was aware of that. I was trying to say, please don't use the word "autocommit" in the sqlite3 driver when that word has a related but different meaning in the SQLite engine.

> You do not issue BEGIN statements with database DRIVERS, they are issued implicitly, so that the manual mode is the default mode for database DRIVERS.

This sentence isn't literally true for several reasons (you say "you do not" but I certainly do, you use of "with database drivers" is dubious, and you seem to have causality in the wrong direction). I think there might be a bit of a language barrier here, so I hope you don't mind if I leave this to one side.

> Cf. this Stack Overflow answer for more details: https://stackoverflow.com/a/48391535/2326961

I am fully, and painfully, aware of when the sqlite3 driver code will automatically issue BEGIN statements to the engine. I have no need to read StackOverflow answers about it, I have read the C source code to sqlite3 (and pysqlite) directly. I spent more time than I care to admit recently doing that! In fact that happened as a result of reading several confusing StackOverflow answers about transactions (maybe I'll write my own and add to the confusion...)

What that answer doesn't mention is that, even with even with isolation_mode=None, it's perfectly possible to start a transaction, which takes the SQLite engine out of autocommit mode. This is fully and intentionally supported by the sqlite3 driver, and the original author has said so and even recommended. For example, let's look at this code:

    conn = sqlite3.connect(path, isolation_mode=None)
    conn.execute("INSERT INTO test (i) VALUES (?)", (1,))  # stmt 1
    foo = conn.execute("SELECT * FROM test").fetchall()    # stmt 2
    conn.execute("BEGIN")                                  # stmt 3
    conn.execute("INSERT INTO test (i) VALUES (?)", (4,))  # stmt 4
    bar = conn.execute("SELECT * FROM test").fetchall()    # stmt 5
    conn.execute("COMMIT")                                 # stmt 6

Statement 1 and statement 2 execute using the SQLite engine's autocommit mode. Statements 3 through to 5 execute in a single transaction and do *not* use the SQLite engine's autocommit mode. (Technically statement 6 actually does use autocommit because COMMIT uses the autocommit mechanism under the hood ... but let's forget about that!)

Under your proposal, the first line would be changed to say "autocommit=True", even though not all the code below is in autocommit mode (according to the SQLite engine's definition). What's more, I could insert this line of code between statements 3 and 6:

    print("Autocommit mode?", conn.autocommit)

And it would print True even though autocommit mode is off!

Now, maybe your reaction is that "autocommit mode *in the driver*" can have a different meaning from "autocommit mode *in the engine*". Yes, it can, but that doesn't mean it should! Please, just pick a different name! For example, say "manual mode" (instead of autocommit=True) or "auto-start-transaction mode" (instead of autocommit=False).


> No, you do not want that at the database DRIVER level. Because like Mike Bayer explained in issue #9924, this is not what other database DRIVERS do, and this is not PEP 249 compliant 

The "that" you are referring to here was when I said that I prefer to set isolation_level = None, like the above code snippet. Do not tell me that it is not what I want; it certainly IS what I want! I do not want the sqlite3 driver getting in the way between me and the SQLite engine. Many future users of the sqlite3 driver are likely to feel the same way, and the API should allow that to happen clearly.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39457>
_______________________________________

From report at bugs.python.org  Tue Jan  5 12:06:18 2021
From: report at bugs.python.org (Christian Heimes)
Date: Tue, 05 Jan 2021 17:06:18 +0000
Subject: [issue36543] Remove old-deprecated ElementTree features (part 2)
In-Reply-To: <1554566782.39.0.176680363975.issue36543@roundup.psfhosted.org>
Message-ID: <1609866378.44.0.336535475485.issue36543@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

Apparently my defusedxml package is low-quality code...

Anyhow PEP 387 has clear rules how to handle incompatible changes. Every core dev has to follow these rules. You cannot simply ignore the rule, because you don't like it. If you want to change the rules or get an exception for a special case, please open a discussion, lobby for an amendment to PEP 387, and get approval from the SC.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36543>
_______________________________________

From report at bugs.python.org  Tue Jan  5 12:16:29 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 05 Jan 2021 17:16:29 +0000
Subject: [issue42831] IDLE fix colours for MacOS dark mode
In-Reply-To: <1609851294.14.0.191191657845.issue42831@roundup.psfhosted.org>
Message-ID: <1609866989.49.0.0481752270692.issue42831@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

This might be related to #7949, about KDE/GTK dark themes.

In general, IDLE only controls colors for Shell and editor windows, leaving dialogs to system default.  This appears to be true for the settings and search dialogs. 'About' is unusual in having some colors specified.  I had nothing to do with that.  Would it work to just remove those specifications?  Otherwise, every widget should specify both foreground and background color.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42831>
_______________________________________

From report at bugs.python.org  Tue Jan  5 12:25:16 2021
From: report at bugs.python.org (Marc-Andre Lemburg)
Date: Tue, 05 Jan 2021 17:25:16 +0000
Subject: [issue39457] Add an autocommit property to sqlite3.Connection with a
 PEP 249 compliant manual commit mode and migrate
In-Reply-To: <1609864859.65.0.886771185809.issue39457@roundup.psfhosted.org>
Message-ID: <1a4f9c52-61ba-cd43-7bc5-3dfa0c8062fa@egenix.com>


Marc-Andre Lemburg <mal at egenix.com> added the comment:

I think there's a bit of a misunderstanding here. When relying on
a DB-API driver's transaction API, you are not allowed to issue
separate transaction commands to the DB backend via the .execute()
methods. You have to use conn.commit() and conn.rollback().

The DB-API wants drivers to have connections default to transactional
behavior and implicitly start transactions when opening the connection
as well as when ending one (via .commit() or .rollback()) - provided the
backend does support transactions.

It also suggests that a method may be used to set the transactional
behavior.

Now, historically, many drivers have not always used methods for
this, but instead (or in addition) provide a property
connection.autocommit to allow setting or querying the current
state. Over time, this has become more or less a standard.

Aside: This is a bit unfortunate, since users would not expect
exceptions from such properties (e.g. network errors), but this where
things have moved and it's hard to change.

I guess the SQLite driver does not start a new transaction for
SELECTs, since these are usually read-only, but don't know whether
this still holds today (e.g. think of UDFs running INSERTs or UPDATEs).

For the same reason, removing the SELECT "optimization" may cause
a backwards incompatible change, which can be tricky to identify
and cause corruption of data (in this case, data not written to
the database, where it previously was written).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39457>
_______________________________________

From report at bugs.python.org  Tue Jan  5 12:30:19 2021
From: report at bugs.python.org (William Schwartz)
Date: Tue, 05 Jan 2021 17:30:19 +0000
Subject: [issue42531] importlib.resources.path() raises TypeError for packages
 without __file__
In-Reply-To: <1606890702.39.0.177441013455.issue42531@roundup.psfhosted.org>
Message-ID: <1609867819.22.0.249657071802.issue42531@roundup.psfhosted.org>


William Schwartz <wkschwartz at gmail.com> added the comment:

@jaraco Did you have any other questions after my comments in msg382423? Do you think you or someone else could review PR 23611? Thanks!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42531>
_______________________________________

From report at bugs.python.org  Tue Jan  5 12:46:42 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 05 Jan 2021 17:46:42 +0000
Subject: [issue36543] Remove old-deprecated ElementTree features (part 2)
In-Reply-To: <1554566782.39.0.176680363975.issue36543@roundup.psfhosted.org>
Message-ID: <1609868801.99.0.7809610661.issue36543@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

I do not understand what this discussion in a long-closed article is about. If you propose to add warning, I am against it. You are against removing the module. Well, the module will not be removed, the warning is no longer needed. The issue is closed.

I do not propose to change the rule. I say that the procedure cannot be executed in this case, because it will cause more harm than benefit. If we cannot follow the procedure for removing module, we cannot remove that module. It is fine to me. If you want to change this, propose changes to the procedure, but it should be discussed not here.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36543>
_______________________________________

From report at bugs.python.org  Tue Jan  5 12:55:57 2021
From: report at bugs.python.org (E. Paine)
Date: Tue, 05 Jan 2021 17:55:57 +0000
Subject: [issue42831] IDLE fix colours for MacOS dark mode
In-Reply-To: <1609851294.14.0.191191657845.issue42831@roundup.psfhosted.org>
Message-ID: <1609869357.72.0.864727031484.issue42831@roundup.psfhosted.org>


E. Paine <paineelisha at gmail.com> added the comment:

I have also done a grep and believe the other affected parts from the user's perspective are the debugger (I haven't checked if Mark's version also suffers), the help dialog and hover tip (e.g. over the squeezer button).

> Would it work to just remove those specifications?

Almost certainly for the about dialog, though we would probably need to explicitly give the foreground colour for others (similar to what you did in PR 12262, I think)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42831>
_______________________________________

From report at bugs.python.org  Tue Jan  5 13:04:58 2021
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Tue, 05 Jan 2021 18:04:58 +0000
Subject: [issue39457] Add an autocommit property to sqlite3.Connection with a
 PEP 249 compliant manual commit mode and migrate
In-Reply-To: <1580066229.26.0.0229158792904.issue39457@roundup.psfhosted.org>
Message-ID: <1609869898.76.0.596674766427.issue39457@roundup.psfhosted.org>


G?ry <gery.ogam at gmail.com> added the comment:

@james.oldfield

> What that answer doesn't mention is that, even with even with isolation_mode=None, it's perfectly possible to start a transaction, which takes the SQLite engine out of autocommit mode.

Exactly, so since autocommit=True is equivalent to isolation_mode=None I do not see why you the name ?autocommit? would be a problem. As you said, when you issue BEGIN, you leave autocommit mode.

> Under your proposal, the first line would be changed to say "autocommit=True", even though not all the code below is in autocommit mode (according to the SQLite engine's definition).

What is the difference with isolation_mode=None which also means autocommit mode?

> What's more, I could insert this line of code between statements 3 and 6:
>    print("Autocommit mode?", conn.autocommit)
> And it would print True even though autocommit mode is off!

No, because the autocommit property would be automatically updated to False at conn.execute("BEGIN"), which is the standard behaviour as @lemburg explained.

@lemburg

> I guess the SQLite driver does not start a new transaction for SELECTs, since these are usually read-only

Nor for DDL statements (CREATE, DROP).

> For the same reason, removing the SELECT "optimization" may cause
> a backwards incompatible change, which can be tricky to identify
> and cause corruption of data (in this case, data not written to
> the database, where it previously was written).

Since DQL statements (SELECT) are read-only, maybe we could keep the optimization and start transactions implicitly only for DDL statements (CREATE, DROP)?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39457>
_______________________________________

From report at bugs.python.org  Tue Jan  5 13:12:00 2021
From: report at bugs.python.org (John Beeler)
Date: Tue, 05 Jan 2021 18:12:00 +0000
Subject: [issue38285] Asyncio BaseEventLoop can support socket types other
 than SOCK_STREAM
In-Reply-To: <1569499511.98.0.234005447809.issue38285@roundup.psfhosted.org>
Message-ID: <1609870320.38.0.366320054635.issue38285@roundup.psfhosted.org>


John Beeler <jbeeler at optictheory.com> added the comment:

For what it's worth, a library I use currently hacks in this functionality by accessing the private method _create_connection_transport directly. This is done to allow a SOCK_RAW to be passed (which is itself required to then enable asyncio to be used for handling BLE).

This works, but as it requires the use of a private method, it's not ideal.

----------
nosy: +jbeeler

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38285>
_______________________________________

From report at bugs.python.org  Tue Jan  5 13:41:01 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 05 Jan 2021 18:41:01 +0000
Subject: [issue42829] get_type_hints throws for nested class with __future__
 annotations
In-Reply-To: <1609845512.57.0.0433631135188.issue42829@roundup.psfhosted.org>
Message-ID: <1609872061.76.0.147698277604.issue42829@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

If you want this to work you have to pass the namespace where B is defined as locals to get_type_hint(). The recommended approach is to make B a global class; where that is not possible (as in your second example) you should chose a different name.

We're not going to guess additional namespaces to add to the lookup, so I will close this as won't fix.

PS. For short code snippets like your examples, I prefer pasting the code inline.

----------
nosy: +gvanrossum
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42829>
_______________________________________

From report at bugs.python.org  Tue Jan  5 13:42:18 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 05 Jan 2021 18:42:18 +0000
Subject: [issue42828] Python readline module
In-Reply-To: <1609841941.92.0.341483279239.issue42828@roundup.psfhosted.org>
Message-ID: <1609872138.7.0.919032366588.issue42828@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

This should be discussed on a user forum, not in our bug tracker.

----------
nosy: +gvanrossum
resolution:  -> rejected
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42828>
_______________________________________

From report at bugs.python.org  Tue Jan  5 13:58:08 2021
From: report at bugs.python.org (mike bayer)
Date: Tue, 05 Jan 2021 18:58:08 +0000
Subject: [issue39457] Add an autocommit property to sqlite3.Connection with a
 PEP 249 compliant manual commit mode and migrate
In-Reply-To: <1580066229.26.0.0229158792904.issue39457@roundup.psfhosted.org>
Message-ID: <1609873088.98.0.489133104494.issue39457@roundup.psfhosted.org>


mike bayer <mike_mp at zzzcomputing.com> added the comment:

> Under your proposal, the first line would be changed to say "autocommit=True", even though not all the code below is in autocommit mode (according to the SQLite engine's definition). What's more, I could insert this line of code between statements 3 and 6:

  >  print("Autocommit mode?", conn.autocommit)

As Marc-Andre indicated, this is in fact how "autocommit" behaves on other drivers, including:

    psycopg2 - uses either connection.autocommit, or extensions.ISOLATION_LEVEL_AUTOCOMMIT
    pymysql - uses conn.autocommit(True|False)
    mysqldb - uses conn.autocommit(True|False)
    cx_Oracle - uses conn.autocommit
    pyodbc - uses conn.autocommit

With all of the above drivers, one can emit "BEGIN" and "COMMIT" using
connection.execute(), and within the scope of that BEGIN/COMMIT pair, the 
database "engine" itself is in a transaction.  The "driver" however remains in 
"autocommit" mode.   This mode specifically means the driver is not getting
involved in starting and stopping transactions. 

As Marc mentions, we're not supposed to be emitting "BEGIN" and "COMMIT" on 
the driver, but none of them get in the way of us doing so, and additionally
most databases support additional options for the "BEGIN/START TRANSACTION" phase
that aren't available in the DBAPIs so sometimes we don't have much choice at least for the "BEGIN" command.

Here's an example using psycopg2, where the timestamp now() will freeze
when we're in a transaction started using manual "BEGIN"/ "COMMIT", while .autocommit stays True, and otherwise match statement execution time if we're not:

    >>> import psycopg2
    >>> conn = psycopg2.connect(user="scott", password="tiger", host="localhost", database="test")
    >>> conn.autocommit = True
    >>> cursor = conn.cursor()
    >>> cursor.execute("SELECT 1")
    >>> cursor.execute("select now() = statement_timestamp()")
    >>> cursor.fetchall()
    [(True,)]
    >>> cursor.execute("BEGIN")
    >>> cursor.execute("select now() = statement_timestamp();")
    >>> cursor.fetchall()
    [(False,)]  # we're in a transaction
    >>> conn.autocommit   # still in driver-level autocommit
    True
    >>> cursor.execute("COMMIT")
    >>> cursor.execute("select now() = statement_timestamp();")
    >>> cursor.fetchall()
    [(True,)]

For SQLAlchemy we already support pysqlite's "isolation_level=None" to implement "autocommit" so this issue does not affect us much, but the meaning of the term "autocommit" at the driver level shouldn't be controversial at this point as there's a lot of precedent.   "connection.autocommit" does not refer to the current transactional state of the database, just the current preference set upon the driver itself.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39457>
_______________________________________

From report at bugs.python.org  Tue Jan  5 14:01:17 2021
From: report at bugs.python.org (izomiac)
Date: Tue, 05 Jan 2021 19:01:17 +0000
Subject: [issue42498] smtplib is glitchy after receive server code 500
In-Reply-To: <1606627835.9.0.185077481862.issue42498@roundup.psfhosted.org>
Message-ID: <1609873277.67.0.530531961814.issue42498@roundup.psfhosted.org>


izomiac <izomiac at zrwb3.r-66y.com> added the comment:

I agree, it's my suspicion that the server's error message and python's outbound command are sent so close to each other that buffering ensures they disagree about the exact sequence of commands/responses.

As for my server, it was HAProxy doing the injection and I rewrote the server to both ignore PROXY commands and to listen on multiple ports so a proxy is not necessary. 

So this issue no longer exists for me, but I know that I'm not the only one who uses HAProxy to forward SMTP requests (residential ISPs block port 25), and Python was relatively unique in its intolerance of this behavior.  (Python uses lower case commands, which are easy to recognize on server logs to determine which clients are using it.)  It's certainly not a critical issue affecting thousands, but in my experience glitchy behavior is a good indicator that the code is buggy in general.  Plus, buffering errors scare me because there are so many potential security exploits associated with them (on top of being a pain to debug.)  But, yeah, this is more of a courtesy bug to let you know about a tricky glitch I encountered.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42498>
_______________________________________

From report at bugs.python.org  Tue Jan  5 14:30:16 2021
From: report at bugs.python.org (=?utf-8?q?Malvers=C3=A1n?=)
Date: Tue, 05 Jan 2021 19:30:16 +0000
Subject: [issue38285] Asyncio BaseEventLoop can support socket types other
 than SOCK_STREAM
In-Reply-To: <1569499511.98.0.234005447809.issue38285@roundup.psfhosted.org>
Message-ID: <1609875016.92.0.902742591442.issue38285@roundup.psfhosted.org>


Malvers?n <malverspam at gmail.com> added the comment:

That means the core code also works for SOCK_RAW sockets. It's only limited by explicit socket type checks at a higher level.

As a curious note (not related to the issue), I'm also using the SOCK_SEQPACKET connection created with BaseEventLoop to access a custom daemon related to BLE functionality.

----------
versions: +Python 3.10 -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38285>
_______________________________________

From report at bugs.python.org  Tue Jan  5 15:03:09 2021
From: report at bugs.python.org (Marco Franzo)
Date: Tue, 05 Jan 2021 20:03:09 +0000
Subject: [issue42828] Python readline module
In-Reply-To: <1609841941.92.0.341483279239.issue42828@roundup.psfhosted.org>
Message-ID: <1609876989.8.0.902247285674.issue42828@roundup.psfhosted.org>


Marco Franzo <frenzisys at gmail.com> added the comment:

So, I use Ubuntu 20.10 and the terminal
is the one distributed with the system.

I think this problem born in my code here:

def generate_input():
    while True:
        str = input().strip()
        yield helloworld_pb2.Operazione(operazione = str)


I think the string

os.system('stty sane')

it can be very useful for those who have the shell unusable at the end of the program.

If i remove import readline, I no longer have any problems, but i need 
the features of readline

----------
Added file: https://bugs.python.org/file49722/io_console.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42828>
_______________________________________

From report at bugs.python.org  Tue Jan  5 15:17:12 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Tue, 05 Jan 2021 20:17:12 +0000
Subject: [issue41798] [C API] Revisit usage of the PyCapsule C API with
 multi-phase initialization API
In-Reply-To: <1600265269.2.0.881235166904.issue41798@roundup.psfhosted.org>
Message-ID: <1609877832.63.0.0593417140524.issue41798@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

> I'm also in the process of removing PySocketModuleAPI from _ssl.c.

BTW, do we still want to keep the socket CAPI for external users?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41798>
_______________________________________

From report at bugs.python.org  Tue Jan  5 15:21:14 2021
From: report at bugs.python.org (Christian Heimes)
Date: Tue, 05 Jan 2021 20:21:14 +0000
Subject: [issue41798] [C API] Revisit usage of the PyCapsule C API with
 multi-phase initialization API
In-Reply-To: <1600265269.2.0.881235166904.issue41798@roundup.psfhosted.org>
Message-ID: <1609878074.21.0.555978082654.issue41798@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

> BTW, do we still want to keep the socket CAPI for external users?

Yes, at least for a while. socket.h is not part of the public include headers. It's still possible that the CAPI is used by an external project.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41798>
_______________________________________

From report at bugs.python.org  Tue Jan  5 15:24:01 2021
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Tue, 05 Jan 2021 20:24:01 +0000
Subject: [issue42827] pegen parser: Multiline eval with assignment to function
 call: assertion failed
In-Reply-To: <1609793289.79.0.762652539307.issue42827@roundup.psfhosted.org>
Message-ID: <1609878241.56.0.483855160325.issue42827@roundup.psfhosted.org>


Change by Lysandros Nikolaou <lisandrosnik at gmail.com>:


----------
pull_requests: +22954
pull_request: https://github.com/python/cpython/pull/24124

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42827>
_______________________________________

From report at bugs.python.org  Tue Jan  5 15:46:04 2021
From: report at bugs.python.org (Klaus Ethgen)
Date: Tue, 05 Jan 2021 20:46:04 +0000
Subject: [issue42818] AttributeError: 'zipimporter' object has no attribute
 'find_spec'
In-Reply-To: <1609682975.59.0.559934544299.issue42818@roundup.psfhosted.org>
Message-ID: <1609879564.98.0.489260020796.issue42818@roundup.psfhosted.org>


Klaus Ethgen <Klaus at Ethgen.de> added the comment:

I don't know if that is an issue with zipimporter or an issue with a version of setuptools.

My knowledge of python is very limited.

But from what I can see in the backtrace it is missing find_spec. How ever that reverting is or should be implemented, it seams to be obviously that it is not working.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42818>
_______________________________________

From report at bugs.python.org  Tue Jan  5 15:54:04 2021
From: report at bugs.python.org (Steve Dower)
Date: Tue, 05 Jan 2021 20:54:04 +0000
Subject: [issue41837] Upgrade installers to OpenSSL 1.1.1i
In-Reply-To: <1600822748.89.0.850484234677.issue41837@roundup.psfhosted.org>
Message-ID: <1609880044.68.0.918725351592.issue41837@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
pull_requests: +22955
pull_request: https://github.com/python/cpython/pull/24125

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41837>
_______________________________________

From report at bugs.python.org  Tue Jan  5 16:18:40 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Tue, 05 Jan 2021 21:18:40 +0000
Subject: [issue41798] [C API] Revisit usage of the PyCapsule C API with
 multi-phase initialization API
In-Reply-To: <1600265269.2.0.881235166904.issue41798@roundup.psfhosted.org>
Message-ID: <1609881520.48.0.380300864404.issue41798@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
pull_requests: +22956
pull_request: https://github.com/python/cpython/pull/24126

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41798>
_______________________________________

From report at bugs.python.org  Tue Jan  5 16:20:39 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 05 Jan 2021 21:20:39 +0000
Subject: [issue42746] python3.7.3 - ssl.SSLContext() - "Killed"
In-Reply-To: <1608939379.31.0.291479274657.issue42746@roundup.psfhosted.org>
Message-ID: <1609881639.71.0.105215737643.issue42746@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

3.7.3 is an old release of an old version.  It has already been patched a few times.  If you cannot upgrade to at least the last bugfix release of 3.7, you are somewhat on your own.

The word 'Killed' in not in the ssl module, so I presume it comes from the LibreSSL, which on your system is what is imported as _ssl.  On Win 10, 'import ssl' prints nothing (normal for most imports) and ssl.SSLContext returns an instance of class SSLContext.

You question would be better asked on a help forum, such as python-list or stackoverflow.

----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42746>
_______________________________________

From report at bugs.python.org  Tue Jan  5 16:23:10 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 05 Jan 2021 21:23:10 +0000
Subject: [issue42712] Segmentation fault in running ast.literal_eval() with
 large expression size.
In-Reply-To: <1608632245.06.0.0184110305677.issue42712@roundup.psfhosted.org>
Message-ID: <1609881790.83.0.568107295092.issue42712@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

I closed the following by Xinmeng as duplicates of this:
#42713 eval(...) 
#42714 compile(...)
#42715 exec(...)
#42716 ast.parse(...)

This is probably a duplicate of #42609, and should likely be closed also.

----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42712>
_______________________________________

From report at bugs.python.org  Tue Jan  5 16:35:11 2021
From: report at bugs.python.org (Steve Dower)
Date: Tue, 05 Jan 2021 21:35:11 +0000
Subject: [issue41837] Upgrade installers to OpenSSL 1.1.1i
In-Reply-To: <1600822748.89.0.850484234677.issue41837@roundup.psfhosted.org>
Message-ID: <1609882511.4.0.440018354165.issue41837@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset afb71443788a7b20f9104243b3d8d37e3d12cfe2 by Steve Dower in branch 'master':
bpo-41837: Updated Windows installer to include OpenSSL 1.1.1i (GH-24125)
https://github.com/python/cpython/commit/afb71443788a7b20f9104243b3d8d37e3d12cfe2


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41837>
_______________________________________

From report at bugs.python.org  Tue Jan  5 16:42:09 2021
From: report at bugs.python.org (Steve Dower)
Date: Tue, 05 Jan 2021 21:42:09 +0000
Subject: [issue41837] Upgrade installers to OpenSSL 1.1.1i
In-Reply-To: <1600822748.89.0.850484234677.issue41837@roundup.psfhosted.org>
Message-ID: <1609882929.84.0.26469073467.issue41837@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
pull_requests: +22957
pull_request: https://github.com/python/cpython/pull/24127

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41837>
_______________________________________

From report at bugs.python.org  Tue Jan  5 17:02:13 2021
From: report at bugs.python.org (Steve Dower)
Date: Tue, 05 Jan 2021 22:02:13 +0000
Subject: [issue42584] Upgrade macOS and Windows installers to use SQLite 3.34.0
In-Reply-To: <1607337382.55.0.591359272905.issue42584@roundup.psfhosted.org>
Message-ID: <1609884133.3.0.772146222641.issue42584@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset dd74c01d3bd2833f72ffe400a1d10b8583c0ba6a by Erlend Egeberg Aasland in branch 'master':
bpo-42584: Update Windows installer to use SQLite 3.34.0 (GH-23675)
https://github.com/python/cpython/commit/dd74c01d3bd2833f72ffe400a1d10b8583c0ba6a


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42584>
_______________________________________

From report at bugs.python.org  Tue Jan  5 17:04:41 2021
From: report at bugs.python.org (Ned Deily)
Date: Tue, 05 Jan 2021 22:04:41 +0000
Subject: [issue38946] IDLE on macOS 10.15 Catalina does not open
 double-clicked files if app already launched
In-Reply-To: <1575141041.2.0.751349559914.issue38946@roundup.psfhosted.org>
Message-ID: <1609884281.82.0.445868928795.issue38946@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Thanks, Ronald and others. I have done some testing now with macOS 11 Big Sur and retested on 10.15 Catalina and with various versions of Tk and what I am seeing is as follows.

- On macOS 11.1 Big Sur with IDLE.app from the python.org 3.9.1 universal2 installer set as the user default for .py files, double-clicking on a .py file causes IDLE 3.10 to launch and the .py file to open in an edit window as expected. Double-clicking on additional .py files in the Finder while IDLE is already launched does cause the files to be opened in the active IDLE.app also as expected. Performing the same sequence with the same 3.9.1 installer on macOS 10.15.7 Catalina, double-clicking on additional files do not cause them to be opened in the active IDLE.app as reported in this issue.

- I also verified that the same behavior is seen with IDLE.app from a couple of other python.org installers, for example, 3.8.7: double-clicking on additional .py files does not cause them to be opened in an active IDLE.ap on 10.15.7 but does on 11.1.

So, it looks like this really is an operating system (Launch Services?) issue in macOS 10.15 that has been changed/fixed in macOS 11. While there *might* be a way to programmatically workaround this within IDLE, Python, or Tk on 10.15, so far we haven't found one. And there is a fairly simple workaround on 10.15: just use the IDLE File -> Open menu item or keyboard shortcut (cmd-O).  It's not as elegant if you are used to double-clicking but it works and realistically we are not going to see a change in 10.15 behavior from Apple.

I would appreciate any other confirmations of this behavior or any ideas for a workaround. Barring the latter, I think we should probably just close this issue, unfortunately, as an OS bug.



Now just to make things a bit more complicated - sigh: I also tested with the recent python.org installer for the 3.10.0a4 pre-release. The principal difference between the 3.9.1 and 3.10.0a4 versions I tested with is that the 3.9.1 is linked with Tk 8.6.10 while 3.10.0a4 is linked with the just-released Tk 8.6.11. On macOS 11 Big Sur, there is one noticeable difference in behavior between the two. With the macOS 11 Big Sur / 3.10.0a4 / 8.6.11 combo, when double-clicking on a .py file without IDLE.app being active, a message window appears saying that the application cannot open Python Script files but does launch IDLE.app. With IDLE.app now active, double-clicking again on the same file then does cause the file to be opened in an edit window of the active IDLE as expected and double-clicking on other .py files then open edit windows for them as expected. Without more detailed investigation, this appears to be a minor problem (possibly a change in Tk) unrelated to those in this issue other than that it involves double-clicking on .py files but I thought I should mention it here in case someone runs into it before it is resolved.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38946>
_______________________________________

From report at bugs.python.org  Tue Jan  5 17:05:18 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Tue, 05 Jan 2021 22:05:18 +0000
Subject: [issue42584] Upgrade macOS and Windows installers to use SQLite 3.34.0
In-Reply-To: <1607337382.55.0.591359272905.issue42584@roundup.psfhosted.org>
Message-ID: <1609884318.53.0.969419292241.issue42584@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

Ned Deily, can you fix the macOS backports?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42584>
_______________________________________

From report at bugs.python.org  Tue Jan  5 17:06:43 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Tue, 05 Jan 2021 22:06:43 +0000
Subject: [issue41798] [C API] Revisit usage of the PyCapsule C API with
 multi-phase initialization API
In-Reply-To: <1600265269.2.0.881235166904.issue41798@roundup.psfhosted.org>
Message-ID: <1609884403.18.0.554055493937.issue41798@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
pull_requests: +22958
pull_request: https://github.com/python/cpython/pull/24128

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41798>
_______________________________________

From report at bugs.python.org  Tue Jan  5 17:27:57 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Tue, 05 Jan 2021 22:27:57 +0000
Subject: [issue42584] Upgrade macOS and Windows installers to use SQLite 3.34.0
In-Reply-To: <1607337382.55.0.591359272905.issue42584@roundup.psfhosted.org>
Message-ID: <1609885677.75.0.760947054442.issue42584@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
pull_requests: +22959
pull_request: https://github.com/python/cpython/pull/24129

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42584>
_______________________________________

From report at bugs.python.org  Tue Jan  5 17:30:15 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Tue, 05 Jan 2021 22:30:15 +0000
Subject: [issue42584] Upgrade macOS and Windows installers to use SQLite 3.34.0
In-Reply-To: <1607337382.55.0.591359272905.issue42584@roundup.psfhosted.org>
Message-ID: <1609885815.57.0.373712383641.issue42584@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
pull_requests: +22960
pull_request: https://github.com/python/cpython/pull/24130

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42584>
_______________________________________

From report at bugs.python.org  Tue Jan  5 17:37:12 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Tue, 05 Jan 2021 22:37:12 +0000
Subject: [issue42584] Upgrade macOS and Windows installers to use SQLite 3.34.0
In-Reply-To: <1607337382.55.0.591359272905.issue42584@roundup.psfhosted.org>
Message-ID: <1609886232.56.0.231040287552.issue42584@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

Steve Dower, do you mind if I create backports for the Windows build as well?

----------
resolution:  -> fixed
status: open -> pending

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42584>
_______________________________________

From report at bugs.python.org  Tue Jan  5 17:46:44 2021
From: report at bugs.python.org (miss-islington)
Date: Tue, 05 Jan 2021 22:46:44 +0000
Subject: [issue42584] Upgrade macOS and Windows installers to use SQLite 3.34.0
In-Reply-To: <1607337382.55.0.591359272905.issue42584@roundup.psfhosted.org>
Message-ID: <1609886804.92.0.548901007684.issue42584@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset f27451dc35f1c69be0c26e8aeafee7ba6771039a by Erlend Egeberg Aasland in branch '3.8':
[3.8] bpo-42584: Update macOS installer to use SQLite 3.34.0 (GH-23674). (GH-24129)
https://github.com/python/cpython/commit/f27451dc35f1c69be0c26e8aeafee7ba6771039a


----------
nosy: +miss-islington
status: pending -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42584>
_______________________________________

From report at bugs.python.org  Tue Jan  5 17:48:22 2021
From: report at bugs.python.org (Andrew Brunner)
Date: Tue, 05 Jan 2021 22:48:22 +0000
Subject: [issue22213] Make pyvenv style virtual environments easier to
 configure when embedding Python
In-Reply-To: <1408275761.36.0.915361061447.issue22213@psf.upfronthosting.co.za>
Message-ID: <1609886902.06.0.283135034985.issue22213@roundup.psfhosted.org>


Change by Andrew Brunner <bmanwi at yahoo.com>:


----------
nosy: +abrunner73

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue22213>
_______________________________________

From report at bugs.python.org  Tue Jan  5 17:53:12 2021
From: report at bugs.python.org (miss-islington)
Date: Tue, 05 Jan 2021 22:53:12 +0000
Subject: [issue42584] Upgrade macOS and Windows installers to use SQLite 3.34.0
In-Reply-To: <1607337382.55.0.591359272905.issue42584@roundup.psfhosted.org>
Message-ID: <1609887192.08.0.174708916653.issue42584@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset e9a71dab094c0467f07d13cce4324c8a93727863 by Erlend Egeberg Aasland in branch '3.9':
[3.9] bpo-42584: Update macOS installer to use SQLite 3.34.0 (GH-23674) (GH-24130)
https://github.com/python/cpython/commit/e9a71dab094c0467f07d13cce4324c8a93727863


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42584>
_______________________________________

From report at bugs.python.org  Tue Jan  5 17:58:00 2021
From: report at bugs.python.org (Christian Heimes)
Date: Tue, 05 Jan 2021 22:58:00 +0000
Subject: [issue42746] python3.7.3 - ssl.SSLContext() - "Killed"
In-Reply-To: <1608939379.31.0.291479274657.issue42746@roundup.psfhosted.org>
Message-ID: <1609887480.45.0.123855540067.issue42746@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

What exactly happens when you try to instantiate an SSLContext() object? Does it just print the string "Killed" or does the process stop and segfault immediately?

If it's a segfault then it is likely caused by an incompatibility between recent LibreSSL and old Python 3.7.3. Can you switch to OpenSSL? LibreSSL isn't well supported.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42746>
_______________________________________

From report at bugs.python.org  Tue Jan  5 18:37:38 2021
From: report at bugs.python.org (Steve Dower)
Date: Tue, 05 Jan 2021 23:37:38 +0000
Subject: [issue41837] Upgrade installers to OpenSSL 1.1.1i
In-Reply-To: <1600822748.89.0.850484234677.issue41837@roundup.psfhosted.org>
Message-ID: <1609889858.33.0.995073092595.issue41837@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset c8333931434389ae72da9eb0471054f4393249db by Steve Dower in branch '3.9':
bpo-41837: Updated Windows installer to include OpenSSL 1.1.1i (GH-24125)
https://github.com/python/cpython/commit/c8333931434389ae72da9eb0471054f4393249db


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41837>
_______________________________________

From report at bugs.python.org  Tue Jan  5 18:42:05 2021
From: report at bugs.python.org (Steve Dower)
Date: Tue, 05 Jan 2021 23:42:05 +0000
Subject: [issue41837] Upgrade installers to OpenSSL 1.1.1i
In-Reply-To: <1600822748.89.0.850484234677.issue41837@roundup.psfhosted.org>
Message-ID: <1609890125.98.0.512417597122.issue41837@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
pull_requests: +22961
pull_request: https://github.com/python/cpython/pull/24131

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41837>
_______________________________________

From report at bugs.python.org  Tue Jan  5 18:45:41 2021
From: report at bugs.python.org (Steve Dower)
Date: Tue, 05 Jan 2021 23:45:41 +0000
Subject: [issue42584] Upgrade macOS and Windows installers to use SQLite 3.34.0
In-Reply-To: <1607337382.55.0.591359272905.issue42584@roundup.psfhosted.org>
Message-ID: <1609890341.61.0.81479119353.issue42584@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
pull_requests: +22962
pull_request: https://github.com/python/cpython/pull/24132

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42584>
_______________________________________

From report at bugs.python.org  Tue Jan  5 18:53:31 2021
From: report at bugs.python.org (Michael L. Boom)
Date: Tue, 05 Jan 2021 23:53:31 +0000
Subject: [issue42835] Can't Built libxml2 When Using Python 3.9.x
Message-ID: <1609890811.68.0.419297459642.issue42835@roundup.psfhosted.org>


New submission from Michael L. Boom <mikeboom at mikeboom.com>:

When building libxml2 using Python 3.9.0 or Python 3.9.1 and gcc 10.2.0 I get the below error.  Others are having this problem according to my Google search.
make[4]: Entering directory '/local/users/michael.l.boom/gits/scoring_engine/git/aae_tmp_dir/libxml2-2.9.10/python'
  CC       libxml.lo
  CC       libxml2-py.lo
  CC       types.lo
In file included from /local/users/michael.l.boom/gits/scoring_engine/git/aae_build_python_3.9.1/include/python3.9/pytime.h:6,
                 from /local/users/michael.l.boom/gits/scoring_engine/git/aae_build_python_3.9.1/include/python3.9/Python.h:85,
                 from libxml_wrap.h:1,
                 from types.c:9:
types.c: In function ?libxml_xmlXPathObjectPtrConvert?:
/local/users/michael.l.boom/gits/scoring_engine/git/aae_build_python_3.9.1/include/python3.9/object.h:633:41: error: expected ?(? before ?PyType_HasFeature?
  633 | #define PyType_FastSubclass(type, flag) PyType_HasFeature(type, flag)
      |                                         ^~~~~~~~~~~~~~~~~
/local/users/michael.l.boom/gits/scoring_engine/git/aae_build_python_3.9.1/include/python3.9/longobject.h:15:9: note: in expansion of macro ?PyType_FastSubclass?
   15 |         PyType_FastSubclass(Py_TYPE(op), Py_TPFLAGS_LONG_SUBCLASS)
      |         ^~~~~~~~~~~~~~~~~~~
types.c:607:15: note: in expansion of macro ?PyLong_Check?
  607 |     } else if PyLong_Check(obj) {
      |               ^~~~~~~~~~~~
types.c:607:33: error: expected ?;? before ?{? token
  607 |     } else if PyLong_Check(obj) {
      |                                 ^
libxml.c: In function ?xmlPythonFileCloseRaw?:
libxml.c:259:5: warning: ?PyEval_CallMethod? is deprecated [-Wdeprecated-declarations]
  259 |     ret = PyEval_CallMethod(file, (char *) "close", (char *) "()");
      |     ^~~
In file included from /local/users/michael.l.boom/gits/scoring_engine/git/aae_build_python_3.9.1/include/python3.9/Python.h:145,
                 from libxml.c:14:
/local/users/michael.l.boom/gits/scoring_engine/git/aae_build_python_3.9.1/include/python3.9/ceval.h:28:43: note: declared here
   28 | Py_DEPRECATED(3.9) PyAPI_FUNC(PyObject *) PyEval_CallMethod(
      |                                           ^~~~~~~~~~~~~~~~~
libxml.c: In function ?xmlPythonFileReadRaw?:
libxml.c:289:5: warning: ?PyEval_CallMethod? is deprecated [-Wdeprecated-declarations]
  289 |     ret = PyEval_CallMethod(file, (char *) "read", (char *) "(i)", len);
      |     ^~~
In file included from /local/users/michael.l.boom/gits/scoring_engine/git/aae_build_python_3.9.1/include/python3.9/Python.h:145,
                 from libxml.c:14:
/local/users/michael.l.boom/gits/scoring_engine/git/aae_build_python_3.9.1/include/python3.9/ceval.h:28:43: note: declared here
   28 | Py_DEPRECATED(3.9) PyAPI_FUNC(PyObject *) PyEval_CallMethod(
      |                                           ^~~~~~~~~~~~~~~~~
In file included from /local/users/michael.l.boom/gits/scoring_engine/git/aae_build_python_3.9.1/include/python3.9/pytime.h:6,
                 from /local/users/michael.l.boom/gits/scoring_engine/git/aae_build_python_3.9.1/include/python3.9/Python.h:85,
                 from libxml.c:14:
/local/users/michael.l.boom/gits/scoring_engine/git/aae_build_python_3.9.1/include/python3.9/object.h:633:41: error: expected ?(? before ?PyType_HasFeature?
  633 | #define PyType_FastSubclass(type, flag) PyType_HasFeature(type, flag)
      |                                         ^~~~~~~~~~~~~~~~~
/local/users/michael.l.boom/gits/scoring_engine/git/aae_build_python_3.9.1/include/python3.9/unicodeobject.h:115:18: note: in expansion of macro ?PyType_FastSubclass?
  115 |                  PyType_FastSubclass(Py_TYPE(op), Py_TPFLAGS_UNICODE_SUBCLASS)
      |                  ^~~~~~~~~~~~~~~~~~~
libxml.c:297:15: note: in expansion of macro ?PyUnicode_Check?
  297 |     } else if PyUnicode_Check (ret) {
      |               ^~~~~~~~~~~~~~~
libxml.c:297:37: error: expected ?;? before ?{? token
  297 |     } else if PyUnicode_Check (ret) {
      |                                     ^
libxml.c: In function ?xmlPythonFileRead?:
libxml.c:354:5: warning: ?PyEval_CallMethod? is deprecated [-Wdeprecated-declarations]
  354 |     ret = PyEval_CallMethod(file, (char *) "io_read", (char *) "(i)", len);
      |     ^~~
In file included from /local/users/michael.l.boom/gits/scoring_engine/git/aae_build_python_3.9.1/include/python3.9/Python.h:145,
                 from libxml.c:14:
/local/users/michael.l.boom/gits/scoring_engine/git/aae_build_python_3.9.1/include/python3.9/ceval.h:28:43: note: declared here
   28 | Py_DEPRECATED(3.9) PyAPI_FUNC(PyObject *) PyEval_CallMethod(
      |                                           ^~~~~~~~~~~~~~~~~
In file included from /local/users/michael.l.boom/gits/scoring_engine/git/aae_build_python_3.9.1/include/python3.9/pytime.h:6,
                 from /local/users/michael.l.boom/gits/scoring_engine/git/aae_build_python_3.9.1/include/python3.9/Python.h:85,
                 from libxml.c:14:
/local/users/michael.l.boom/gits/scoring_engine/git/aae_build_python_3.9.1/include/python3.9/object.h:633:41: error: expected ?(? before ?PyType_HasFeature?
  633 | #define PyType_FastSubclass(type, flag) PyType_HasFeature(type, flag)
      |                                         ^~~~~~~~~~~~~~~~~
/local/users/michael.l.boom/gits/scoring_engine/git/aae_build_python_3.9.1/include/python3.9/unicodeobject.h:115:18: note: in expansion of macro ?PyType_FastSubclass?
  115 |                  PyType_FastSubclass(Py_TYPE(op), Py_TPFLAGS_UNICODE_SUBCLASS)
      |                  ^~~~~~~~~~~~~~~~~~~
libxml.c:362:15: note: in expansion of macro ?PyUnicode_Check?
  362 |     } else if PyUnicode_Check (ret) {
      |               ^~~~~~~~~~~~~~~
libxml.c:362:37: error: expected ?;? before ?{? token
  362 |     } else if PyUnicode_Check (ret) {
      |                                     ^

----------
components: C API
messages: 384443
nosy: boom0192
priority: normal
severity: normal
status: open
title: Can't Built libxml2 When Using Python 3.9.x
type: compile error
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42835>
_______________________________________

From report at bugs.python.org  Tue Jan  5 18:57:52 2021
From: report at bugs.python.org (Berker Peksag)
Date: Tue, 05 Jan 2021 23:57:52 +0000
Subject: [issue40956] Use Argument Clinic in sqlite3
In-Reply-To: <1591956335.72.0.553737405887.issue40956@roundup.psfhosted.org>
Message-ID: <1609891072.02.0.672940912495.issue40956@roundup.psfhosted.org>


Berker Peksag <berker.peksag at gmail.com> added the comment:


New changeset c7f8d3caf0b10c19cd46b1b334a98628eac15672 by Erlend Egeberg Aasland in branch 'master':
bpo-40956: Convert _sqlite3.Cursor to Argument Clinic (GH-24007)
https://github.com/python/cpython/commit/c7f8d3caf0b10c19cd46b1b334a98628eac15672


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40956>
_______________________________________

From report at bugs.python.org  Tue Jan  5 19:02:50 2021
From: report at bugs.python.org (Berker Peksag)
Date: Wed, 06 Jan 2021 00:02:50 +0000
Subject: [issue40810] sqlite3 test CheckTraceCallbackContent fails for sqlite
 v3.7.3 through 3.7.14.1
In-Reply-To: <1590688058.38.0.22519081316.issue40810@roundup.psfhosted.org>
Message-ID: <1609891370.03.0.828564468067.issue40810@roundup.psfhosted.org>


Berker Peksag <berker.peksag at gmail.com> added the comment:


New changeset cf0b23908cc902ac38cd83dd7ca5afdf89e1543b by Erlend Egeberg Aasland in branch 'master':
bpo-40810: Require SQLite 3.7.15 (GH-24106)
https://github.com/python/cpython/commit/cf0b23908cc902ac38cd83dd7ca5afdf89e1543b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40810>
_______________________________________

From report at bugs.python.org  Tue Jan  5 19:04:50 2021
From: report at bugs.python.org (Berker Peksag)
Date: Wed, 06 Jan 2021 00:04:50 +0000
Subject: [issue40810] sqlite3 test CheckTraceCallbackContent fails for sqlite
 v3.7.3 through 3.7.14.1
In-Reply-To: <1590688058.38.0.22519081316.issue40810@roundup.psfhosted.org>
Message-ID: <1609891490.48.0.173797790008.issue40810@roundup.psfhosted.org>


Berker Peksag <berker.peksag at gmail.com> added the comment:

I think this is now done. Thank you, Erlend!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40810>
_______________________________________

From report at bugs.python.org  Tue Jan  5 19:05:08 2021
From: report at bugs.python.org (Berker Peksag)
Date: Wed, 06 Jan 2021 00:05:08 +0000
Subject: [issue40810] sqlite3 test CheckTraceCallbackContent fails for sqlite
 v3.7.3 through 3.7.14.1
In-Reply-To: <1590688058.38.0.22519081316.issue40810@roundup.psfhosted.org>
Message-ID: <1609891508.02.0.657389769579.issue40810@roundup.psfhosted.org>


Change by Berker Peksag <berker.peksag at gmail.com>:


----------
versions:  -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40810>
_______________________________________

From report at bugs.python.org  Tue Jan  5 19:07:32 2021
From: report at bugs.python.org (Brett Cannon)
Date: Wed, 06 Jan 2021 00:07:32 +0000
Subject: [issue42811] Update docs for importlib.util.resolve_name() to use
 __spec__.parent instead of __package__
In-Reply-To: <1609619279.01.0.578638244778.issue42811@roundup.psfhosted.org>
Message-ID: <1609891652.77.0.646604945446.issue42811@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
title: Update docs for importlib.util.resolve_name() to use __spec__ instead of __package__ -> Update docs for importlib.util.resolve_name() to use __spec__.parent instead of __package__

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42811>
_______________________________________

From report at bugs.python.org  Tue Jan  5 19:07:40 2021
From: report at bugs.python.org (Steve Dower)
Date: Wed, 06 Jan 2021 00:07:40 +0000
Subject: [issue42584] Upgrade macOS and Windows installers to use SQLite 3.34.0
In-Reply-To: <1607337382.55.0.591359272905.issue42584@roundup.psfhosted.org>
Message-ID: <1609891660.09.0.309928285931.issue42584@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

> Steve Dower, do you mind if I create backports for the Windows build as well?

Sorry, I've been doing it. They're just slow because I'm getting OpenSSL done at the same time and they both keep causing merge conflicts.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42584>
_______________________________________

From report at bugs.python.org  Tue Jan  5 19:07:58 2021
From: report at bugs.python.org (Steve Dower)
Date: Wed, 06 Jan 2021 00:07:58 +0000
Subject: [issue41837] Upgrade installers to OpenSSL 1.1.1i
In-Reply-To: <1600822748.89.0.850484234677.issue41837@roundup.psfhosted.org>
Message-ID: <1609891678.51.0.829118325881.issue41837@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset 86b1207dbb9201d1259d1ec7603e720e29ba9042 by Steve Dower in branch '3.8':
bpo-41837: Updated Windows installer to include OpenSSL 1.1.1i (GH-24125)
https://github.com/python/cpython/commit/86b1207dbb9201d1259d1ec7603e720e29ba9042


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41837>
_______________________________________

From report at bugs.python.org  Tue Jan  5 19:09:15 2021
From: report at bugs.python.org (Steve Dower)
Date: Wed, 06 Jan 2021 00:09:15 +0000
Subject: [issue42584] Upgrade macOS and Windows installers to use SQLite 3.34.0
In-Reply-To: <1607337382.55.0.591359272905.issue42584@roundup.psfhosted.org>
Message-ID: <1609891755.46.0.032262165962.issue42584@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset 77d54710506b67e48b50bb1758fb31fc33a33c83 by Steve Dower in branch '3.9':
bpo-42584: Update Windows installer to use SQLite 3.34.0 (GH-23675)
https://github.com/python/cpython/commit/77d54710506b67e48b50bb1758fb31fc33a33c83


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42584>
_______________________________________

From report at bugs.python.org  Tue Jan  5 19:10:38 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Wed, 06 Jan 2021 00:10:38 +0000
Subject: [issue42584] Upgrade macOS and Windows installers to use SQLite 3.34.0
In-Reply-To: <1607337382.55.0.591359272905.issue42584@roundup.psfhosted.org>
Message-ID: <1609891838.08.0.798498531997.issue42584@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

> Sorry, I've been doing it. They're just slow because I'm getting OpenSSL done at the same time and they both keep causing merge conflicts.

No problem. I noticed that, so I aborted my cherry-picker.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42584>
_______________________________________

From report at bugs.python.org  Tue Jan  5 19:11:06 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 06 Jan 2021 00:11:06 +0000
Subject: [issue42835] Can't Built libxml2 When Using Python 3.9.x
In-Reply-To: <1609890811.68.0.419297459642.issue42835@roundup.psfhosted.org>
Message-ID: <1609891866.99.0.788540092734.issue42835@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Have you approached the libxml2 developers with this problem?

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42835>
_______________________________________

From report at bugs.python.org  Tue Jan  5 19:11:05 2021
From: report at bugs.python.org (Steve Dower)
Date: Wed, 06 Jan 2021 00:11:05 +0000
Subject: [issue42584] Upgrade macOS and Windows installers to use SQLite 3.34.0
In-Reply-To: <1607337382.55.0.591359272905.issue42584@roundup.psfhosted.org>
Message-ID: <1609891865.27.0.792813127633.issue42584@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
pull_requests: +22963
pull_request: https://github.com/python/cpython/pull/24133

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42584>
_______________________________________

From report at bugs.python.org  Tue Jan  5 19:12:22 2021
From: report at bugs.python.org (Steve Dower)
Date: Wed, 06 Jan 2021 00:12:22 +0000
Subject: [issue41837] Upgrade installers to OpenSSL 1.1.1i
In-Reply-To: <1600822748.89.0.850484234677.issue41837@roundup.psfhosted.org>
Message-ID: <1609891942.34.0.461082279179.issue41837@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

I believe this is all done now.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41837>
_______________________________________

From report at bugs.python.org  Tue Jan  5 19:18:54 2021
From: report at bugs.python.org (Berker Peksag)
Date: Wed, 06 Jan 2021 00:18:54 +0000
Subject: [issue38413] Remove or change "Multithreading" section
In-Reply-To: <1570563042.6.0.0902531064636.issue38413@roundup.psfhosted.org>
Message-ID: <1609892334.55.0.739787538409.issue38413@roundup.psfhosted.org>


Berker Peksag <berker.peksag at gmail.com> added the comment:


New changeset f9949f82e17c88609adb53eff3a7d5cd63a645bd by Vladimir in branch 'master':
bpo-38413: Remove outdated section about multithreading in sqlite3 (GH-23159)
https://github.com/python/cpython/commit/f9949f82e17c88609adb53eff3a7d5cd63a645bd


----------
nosy: +berker.peksag

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38413>
_______________________________________

From report at bugs.python.org  Tue Jan  5 19:19:07 2021
From: report at bugs.python.org (miss-islington)
Date: Wed, 06 Jan 2021 00:19:07 +0000
Subject: [issue38413] Remove or change "Multithreading" section
In-Reply-To: <1570563042.6.0.0902531064636.issue38413@roundup.psfhosted.org>
Message-ID: <1609892347.79.0.331858256243.issue38413@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 5.0 -> 6.0
pull_requests: +22964
pull_request: https://github.com/python/cpython/pull/24134

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38413>
_______________________________________

From report at bugs.python.org  Tue Jan  5 19:22:05 2021
From: report at bugs.python.org (Berker Peksag)
Date: Wed, 06 Jan 2021 00:22:05 +0000
Subject: [issue38413] Remove or change "Multithreading" section
In-Reply-To: <1570563042.6.0.0902531064636.issue38413@roundup.psfhosted.org>
Message-ID: <1609892525.39.0.954844130287.issue38413@roundup.psfhosted.org>


Berker Peksag <berker.peksag at gmail.com> added the comment:


New changeset 03a079f7cf8eacc29ea616060916e8a63ba6e5ba by Miss Islington (bot) in branch '3.8':
bpo-38413: Remove outdated section about multithreading in sqlite3 (GH-23159)
https://github.com/python/cpython/commit/03a079f7cf8eacc29ea616060916e8a63ba6e5ba


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38413>
_______________________________________

From report at bugs.python.org  Tue Jan  5 19:23:46 2021
From: report at bugs.python.org (Berker Peksag)
Date: Wed, 06 Jan 2021 00:23:46 +0000
Subject: [issue42755] sqlite3.Connection.backup default value is diffrent
 between implmentation and docs
In-Reply-To: <1609056718.52.0.719197971794.issue42755@roundup.psfhosted.org>
Message-ID: <1609892626.7.0.341969215698.issue42755@roundup.psfhosted.org>


Berker Peksag <berker.peksag at gmail.com> added the comment:


New changeset 28611c28474a7fafdcf7ea2712f2670dda940eef by Miss Islington (bot) in branch '3.8':
bpo-42755: Fix sqlite3.Connection.backup docs (GH-23965)
https://github.com/python/cpython/commit/28611c28474a7fafdcf7ea2712f2670dda940eef


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42755>
_______________________________________

From report at bugs.python.org  Tue Jan  5 19:27:24 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Wed, 06 Jan 2021 00:27:24 +0000
Subject: [issue40956] Use Argument Clinic in sqlite3
In-Reply-To: <1591956335.72.0.553737405887.issue40956@roundup.psfhosted.org>
Message-ID: <1609892844.46.0.735359751443.issue40956@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
pull_requests: +22965
pull_request: https://github.com/python/cpython/pull/24135

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40956>
_______________________________________

From report at bugs.python.org  Tue Jan  5 19:31:40 2021
From: report at bugs.python.org (Steve Dower)
Date: Wed, 06 Jan 2021 00:31:40 +0000
Subject: [issue42584] Upgrade macOS and Windows installers to use SQLite 3.34.0
In-Reply-To: <1607337382.55.0.591359272905.issue42584@roundup.psfhosted.org>
Message-ID: <1609893100.38.0.10709440209.issue42584@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42584>
_______________________________________

From report at bugs.python.org  Tue Jan  5 19:31:20 2021
From: report at bugs.python.org (Steve Dower)
Date: Wed, 06 Jan 2021 00:31:20 +0000
Subject: [issue42584] Upgrade macOS and Windows installers to use SQLite 3.34.0
In-Reply-To: <1607337382.55.0.591359272905.issue42584@roundup.psfhosted.org>
Message-ID: <1609893080.01.0.114596800992.issue42584@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset db91714faa6d3ede59003cdcc719a758160f3970 by Steve Dower in branch '3.8':
bpo-42584: Update Windows installer to use SQLite 3.34.0 (GH-23675)
https://github.com/python/cpython/commit/db91714faa6d3ede59003cdcc719a758160f3970


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42584>
_______________________________________

From report at bugs.python.org  Tue Jan  5 19:35:15 2021
From: report at bugs.python.org (Michael L. Boom)
Date: Wed, 06 Jan 2021 00:35:15 +0000
Subject: [issue42835] Can't Built libxml2 When Using Python 3.9.x
In-Reply-To: <1609891866.99.0.788540092734.issue42835@roundup.psfhosted.org>
Message-ID: <DM6PR10MB3724E026A0FAD280D0960254B5D00@DM6PR10MB3724.namprd10.prod.outlook.com>


Michael L. Boom <mikeboom at mikeboom.com> added the comment:

I thought the problem was in a Python file.  Perhaps I am mistaken.  The libxml2 builds fine when using Python 3.8.x.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42835>
_______________________________________

From report at bugs.python.org  Tue Jan  5 19:36:12 2021
From: report at bugs.python.org (Berker Peksag)
Date: Wed, 06 Jan 2021 00:36:12 +0000
Subject: [issue24464] "sqlite3_enable_shared_cache" deprecation warning when
 compiling with macOS system SQLite3
In-Reply-To: <1434627103.24.0.34027869681.issue24464@psf.upfronthosting.co.za>
Message-ID: <1609893372.35.0.82337982183.issue24464@roundup.psfhosted.org>


Berker Peksag <berker.peksag at gmail.com> added the comment:


New changeset ddb5e11683c8db9d2095f2f9406701443c4dc9b3 by Erlend Egeberg Aasland in branch 'master':
bpo-24464: Deprecate sqlite3.enable_shared_cache (GH-24008)
https://github.com/python/cpython/commit/ddb5e11683c8db9d2095f2f9406701443c4dc9b3


----------
nosy: +berker.peksag

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24464>
_______________________________________

From report at bugs.python.org  Tue Jan  5 19:37:33 2021
From: report at bugs.python.org (Berker Peksag)
Date: Wed, 06 Jan 2021 00:37:33 +0000
Subject: [issue24464] "sqlite3_enable_shared_cache" deprecation warning when
 compiling with macOS system SQLite3
In-Reply-To: <1434627103.24.0.34027869681.issue24464@psf.upfronthosting.co.za>
Message-ID: <1609893453.19.0.991049250459.issue24464@roundup.psfhosted.org>


Berker Peksag <berker.peksag at gmail.com> added the comment:

It's now deprecated in 3.10.

----------
components: +Extension Modules -Build, macOS
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
type:  -> enhancement
versions: +Python 3.10 -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24464>
_______________________________________

From report at bugs.python.org  Tue Jan  5 19:39:23 2021
From: report at bugs.python.org (Berker Peksag)
Date: Wed, 06 Jan 2021 00:39:23 +0000
Subject: [issue24464] "sqlite3_enable_shared_cache" deprecation warning when
 compiling with macOS system SQLite3
In-Reply-To: <1434627103.24.0.34027869681.issue24464@psf.upfronthosting.co.za>
Message-ID: <1609893563.8.0.590008925863.issue24464@roundup.psfhosted.org>


Change by Berker Peksag <berker.peksag at gmail.com>:


----------
components: +macOS

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24464>
_______________________________________

From report at bugs.python.org  Tue Jan  5 19:55:46 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 06 Jan 2021 00:55:46 +0000
Subject: [issue42835] Can't Built libxml2 When Using Python 3.9.x
In-Reply-To: <1609890811.68.0.419297459642.issue42835@roundup.psfhosted.org>
Message-ID: <1609894546.81.0.780048476634.issue42835@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Maybe libxml is using a deprecated API or an invalid combination of command line flags. I don't feel like debugging this until there's a clearer indication of who's at fault.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42835>
_______________________________________

From report at bugs.python.org  Tue Jan  5 19:56:08 2021
From: report at bugs.python.org (Berker Peksag)
Date: Wed, 06 Jan 2021 00:56:08 +0000
Subject: [issue40959] Remove unused and unneeded function declaration from
 sqlite3 header files
In-Reply-To: <1591960917.09.0.191201794303.issue40959@roundup.psfhosted.org>
Message-ID: <1609894568.24.0.792133548368.issue40959@roundup.psfhosted.org>


Berker Peksag <berker.peksag at gmail.com> added the comment:


New changeset 203b2493ae6fd7c1f039f3f906f087d67d9100d5 by Erlend Egeberg Aasland in branch 'master':
bpo-40959: Remove unused declarations from sqlite3 headers (GH-20828)
https://github.com/python/cpython/commit/203b2493ae6fd7c1f039f3f906f087d67d9100d5


----------
nosy: +berker.peksag

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40959>
_______________________________________

From report at bugs.python.org  Tue Jan  5 19:56:35 2021
From: report at bugs.python.org (Berker Peksag)
Date: Wed, 06 Jan 2021 00:56:35 +0000
Subject: [issue40959] Remove unused and unneeded function declaration from
 sqlite3 header files
In-Reply-To: <1591960917.09.0.191201794303.issue40959@roundup.psfhosted.org>
Message-ID: <1609894595.19.0.350702198645.issue40959@roundup.psfhosted.org>


Berker Peksag <berker.peksag at gmail.com> added the comment:

Thank you!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40959>
_______________________________________

From report at bugs.python.org  Tue Jan  5 20:09:02 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 06 Jan 2021 01:09:02 +0000
Subject: [issue42115] Caching infrastructure for the evaluation loop:
 specialised opcodes
In-Reply-To: <1603336898.74.0.366564812208.issue42115@roundup.psfhosted.org>
Message-ID: <1609895342.32.0.869287813493.issue42115@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

I've skimmed several papers by Stefan Brunthaler about something called Quickening that I first found via the Pyston blog, which linked to an ancient bpo issue with a patch created by Stefan (https://bugs.python.org/issue14757).

The gist seems to be to have extra opcodes that only work for certain situations (e.g. INT_BINARY_ADD). In a hot function we can rewrite opcodes with their specialized counterpart. The new opcode contains a guard that rewrites itself back if the guard fails (and then it stays unoptimized).

I think the idea is that it's pretty cheap to keep an extra pointer to a "alternate bytecode" array.

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42115>
_______________________________________

From report at bugs.python.org  Tue Jan  5 21:14:48 2021
From: report at bugs.python.org (Berker Peksag)
Date: Wed, 06 Jan 2021 02:14:48 +0000
Subject: [issue14014] codecs.StreamWriter.reset contract not fulfilled
In-Reply-To: <1329242513.77.0.581823861095.issue14014@psf.upfronthosting.co.za>
Message-ID: <1609899288.78.0.910107017865.issue14014@roundup.psfhosted.org>


Berker Peksag <berker.peksag at gmail.com> added the comment:


New changeset 1a9f51ed12feb4d95ad6d0faf610a030c05b9f5e by Berker Peksag in branch 'master':
bpo-14014: Clarify StreamWriter.reset() documentation (GH-13716)
https://github.com/python/cpython/commit/1a9f51ed12feb4d95ad6d0faf610a030c05b9f5e


----------
nosy: +berker.peksag

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue14014>
_______________________________________

From report at bugs.python.org  Tue Jan  5 21:14:57 2021
From: report at bugs.python.org (miss-islington)
Date: Wed, 06 Jan 2021 02:14:57 +0000
Subject: [issue14014] codecs.StreamWriter.reset contract not fulfilled
In-Reply-To: <1329242513.77.0.581823861095.issue14014@psf.upfronthosting.co.za>
Message-ID: <1609899297.58.0.412900932812.issue14014@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 6.0 -> 7.0
pull_requests: +22966
pull_request: https://github.com/python/cpython/pull/24136

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue14014>
_______________________________________

From report at bugs.python.org  Tue Jan  5 21:27:38 2021
From: report at bugs.python.org (Berker Peksag)
Date: Wed, 06 Jan 2021 02:27:38 +0000
Subject: [issue14014] codecs.StreamWriter.reset contract not fulfilled
In-Reply-To: <1329242513.77.0.581823861095.issue14014@psf.upfronthosting.co.za>
Message-ID: <1609900058.71.0.452594567009.issue14014@roundup.psfhosted.org>


Berker Peksag <berker.peksag at gmail.com> added the comment:


New changeset a3ca6747f50efa2fe59caf516a26b0fd1912b8e8 by Miss Islington (bot) in branch '3.9':
bpo-14014: Clarify StreamWriter.reset() documentation (GH-13716)
https://github.com/python/cpython/commit/a3ca6747f50efa2fe59caf516a26b0fd1912b8e8


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue14014>
_______________________________________

From report at bugs.python.org  Tue Jan  5 21:28:46 2021
From: report at bugs.python.org (Berker Peksag)
Date: Wed, 06 Jan 2021 02:28:46 +0000
Subject: [issue14014] codecs.StreamWriter.reset contract not fulfilled
In-Reply-To: <1329242513.77.0.581823861095.issue14014@psf.upfronthosting.co.za>
Message-ID: <1609900126.8.0.0181699898158.issue14014@roundup.psfhosted.org>


Change by Berker Peksag <berker.peksag at gmail.com>:


----------
assignee: lemburg -> 
components: +Documentation
nosy: +vstinner
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.10 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue14014>
_______________________________________

From report at bugs.python.org  Tue Jan  5 21:29:17 2021
From: report at bugs.python.org (Berker Peksag)
Date: Wed, 06 Jan 2021 02:29:17 +0000
Subject: [issue14014] codecs.StreamWriter.reset contract not fulfilled
In-Reply-To: <1329242513.77.0.581823861095.issue14014@psf.upfronthosting.co.za>
Message-ID: <1609900157.33.0.00639828659119.issue14014@roundup.psfhosted.org>


Change by Berker Peksag <berker.peksag at gmail.com>:


----------
assignee:  -> docs at python
components:  -Unicode
nosy: +docs at python -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue14014>
_______________________________________

From report at bugs.python.org  Tue Jan  5 22:42:49 2021
From: report at bugs.python.org (Yury Selivanov)
Date: Wed, 06 Jan 2021 03:42:49 +0000
Subject: [issue42115] Caching infrastructure for the evaluation loop:
 specialised opcodes
In-Reply-To: <1603336898.74.0.366564812208.issue42115@roundup.psfhosted.org>
Message-ID: <1609904569.95.0.504487689895.issue42115@roundup.psfhosted.org>


Yury Selivanov <yselivanov at gmail.com> added the comment:

> The gist seems to be to have extra opcodes that only work for certain situations (e.g. INT_BINARY_ADD). In a hot function we can rewrite opcodes with their specialized counterpart. The new opcode contains a guard that rewrites itself back if the guard fails (and then it stays unoptimized).

This is also roughly what I suggested in https://bugs.python.org/msg379333. Except that I don't think it's necessary to add new opcodes.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42115>
_______________________________________

From report at bugs.python.org  Tue Jan  5 23:21:58 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Wed, 06 Jan 2021 04:21:58 +0000
Subject: [issue42712] Segmentation fault in running ast.literal_eval() with
 large expression size.
In-Reply-To: <1608632245.06.0.0184110305677.issue42712@roundup.psfhosted.org>
Message-ID: <1609906918.13.0.834369774663.issue42712@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

I think we really need a customer parser for ast.literal_eval(), one that doesn't have the same constraints and that can be counted on for safe evaluation of untrusted input.

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42712>
_______________________________________

From report at bugs.python.org  Tue Jan  5 23:41:22 2021
From: report at bugs.python.org (Michael L. Boom)
Date: Wed, 06 Jan 2021 04:41:22 +0000
Subject: [issue42835] Can't Built libxml2 When Using Python 3.9.x
In-Reply-To: <1609894546.81.0.780048476634.issue42835@roundup.psfhosted.org>
Message-ID: <DM6PR10MB37243DC43FDBCEE581191770B5D00@DM6PR10MB3724.namprd10.prod.outlook.com>


Michael L. Boom <mikeboom at mikeboom.com> added the comment:

The gcc 10.x thinks that the right side of the expression on incoude/python3.9/object.h should be in parentheses.  It seems like a Python bug.  Perhaps earlier versions of gcc didn't have a problem with this.

/local/users/michael.l.boom/gits/scoring_engine/git/aae_build_python_3.9.1/include/python3.9/object.h:633:41: error: expected ?(? before ?PyType_HasFeature?
  633 | #define PyType_FastSubclass(type, flag) PyType_HasFeature(type, flag)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42835>
_______________________________________

From report at bugs.python.org  Tue Jan  5 23:52:51 2021
From: report at bugs.python.org (David Justo)
Date: Wed, 06 Jan 2021 04:52:51 +0000
Subject: [issue30044] shutil.copystat should (allow to) copy ownership,
 and other attributes
In-Reply-To: <1491925353.8.0.782070431072.issue30044@psf.upfronthosting.co.za>
Message-ID: <1609908771.09.0.395204050157.issue30044@roundup.psfhosted.org>


David Justo <david.justo.1996 at gmail.com> added the comment:

Hi folks,
I'd be interested in contributing to this issue, since it seems "easy" enough, but I'm unsure that consensus was reached about the right solution.

>From what I gathered from Giampaolo's comments, we have solutions that should work for Unix-y systems and MacOS. So that's clear.

For Windows though, I'm unsure. It appears, we'd need kernel-mode-enabled clients to do this and maybe that's enough to discourage this effort altogether.

So it appears we have 3 options then:
1. Implement a new function that copies ownership in linux+mac but not in Windows. Then to document that difference.
2. Implement a new function that copies ownership in linux+mac, then use the native NT API to achieve the same result in Windows. Document the limitations
3. Just document the existing limitations.

Do we have a preference? I do not, just excited to potentially contribute something :) 

Thanks!

----------
nosy: +davidmrdavid

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30044>
_______________________________________

From report at bugs.python.org  Wed Jan  6 00:03:37 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 06 Jan 2021 05:03:37 +0000
Subject: [issue42115] Caching infrastructure for the evaluation loop:
 specialised opcodes
In-Reply-To: <1603336898.74.0.366564812208.issue42115@roundup.psfhosted.org>
Message-ID: <1609909417.02.0.398733681133.issue42115@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Do we have good intuition or data about which operations need speeding up most? Everybody always assumes it's BINARY_ADD, but much Python code isn't actually numeric, and binary operations aren't all that common. (For example, IIRC at my previous employer the hottest code was some kind of web template expansion and another bottleneck was marshalling RPC requests and results.)

Optimizers usually evolve to be excellent at optimizing the benchmark du jour -- what benchmark do we want to use?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42115>
_______________________________________

From report at bugs.python.org  Wed Jan  6 00:18:02 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 06 Jan 2021 05:18:02 +0000
Subject: [issue42835] Can't Built libxml2 When Using Python 3.9.x
In-Reply-To: <1609890811.68.0.419297459642.issue42835@roundup.psfhosted.org>
Message-ID: <1609910282.37.0.176761686165.issue42835@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Looks to me like this line is at fault:

  607 |     } else if PyLong_Check(obj) {

That's not valid C. In the GitHub mirror this line has been corrected.

----------
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42835>
_______________________________________

From report at bugs.python.org  Wed Jan  6 00:20:36 2021
From: report at bugs.python.org (David Justo)
Date: Wed, 06 Jan 2021 05:20:36 +0000
Subject: [issue34451] docs: tutorial/introduction doesn't mention toggle of
 prompts
In-Reply-To: <1534877418.64.0.56676864532.issue34451@psf.upfronthosting.co.za>
Message-ID: <1609910436.32.0.688537902323.issue34451@roundup.psfhosted.org>


David Justo <david.justo.1996 at gmail.com> added the comment:

Hi folks! I'm interested in contributing to this issue, but I'm unsure about the context.

Can `>>>>` prompts be toggled on-and-off in the docs? I do not see that option. I read that this is possible in javascript-enabled versions of the site, but isn't that the default? If so, I have JS enabled and I do not see how to toggle them out :) . Maybe that's part of what we need to fix as well.

Thanks for your time!

----------
nosy: +davidmrdavid

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34451>
_______________________________________

From report at bugs.python.org  Wed Jan  6 00:29:59 2021
From: report at bugs.python.org (Michael L. Boom)
Date: Wed, 06 Jan 2021 05:29:59 +0000
Subject: [issue42835] Can't Built libxml2 When Using Python 3.9.x
In-Reply-To: <1609910282.37.0.176761686165.issue42835@roundup.psfhosted.org>
Message-ID: <DM6PR10MB37247D5A8CF023EF399D75D9B5D00@DM6PR10MB3724.namprd10.prod.outlook.com>


Michael L. Boom <mikeboom at mikeboom.com> added the comment:

The gcc 10.x seems to think this is also a bug:

/local/users/michael.l.boom/gits/scoring_engine/git/aae_build_python_3.9.1/include/python3.9/object.h:633:41: error: expected ?(? before ?PyType_HasFeature?
  633 | #define PyType_FastSubclass(type, flag) PyType_HasFeature(type, flag)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42835>
_______________________________________

From report at bugs.python.org  Wed Jan  6 00:34:58 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 06 Jan 2021 05:34:58 +0000
Subject: [issue42835] Can't Built libxml2 When Using Python 3.9.x
In-Reply-To: <1609890811.68.0.419297459642.issue42835@roundup.psfhosted.org>
Message-ID: <1609911298.81.0.384967095808.issue42835@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
nosy:  -gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42835>
_______________________________________

From report at bugs.python.org  Wed Jan  6 01:17:03 2021
From: report at bugs.python.org (Yury Selivanov)
Date: Wed, 06 Jan 2021 06:17:03 +0000
Subject: [issue42115] Caching infrastructure for the evaluation loop:
 specialised opcodes
In-Reply-To: <1603336898.74.0.366564812208.issue42115@roundup.psfhosted.org>
Message-ID: <1609913823.25.0.577199608269.issue42115@roundup.psfhosted.org>


Yury Selivanov <yselivanov at gmail.com> added the comment:

> Do we have good intuition or data about which operations need speeding up most? Everybody always assumes it's BINARY_ADD, but much Python code isn't actually numeric, and binary operations aren't all that common.

IMO, we shouldn't focus too much on optimizing binops. Regular webapps/network kind of code wouldn't benefit from that, and scientific code that uses numpy/ml libraries already offsets most of expensive computation to outside of CPython eval. Instead, I think, we should continue focusing on lowering the cost of function/method calls and attribute access.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42115>
_______________________________________

From report at bugs.python.org  Wed Jan  6 01:29:26 2021
From: report at bugs.python.org (Ammar Askar)
Date: Wed, 06 Jan 2021 06:29:26 +0000
Subject: [issue42825] Build libraries with "/OPT:REF" linker optimization on
 Windows
In-Reply-To: <1609782160.13.0.0224895080942.issue42825@roundup.psfhosted.org>
Message-ID: <1609914566.89.0.353043438888.issue42825@roundup.psfhosted.org>


Change by Ammar Askar <ammar at ammaraskar.com>:


----------
nosy: +eryksun
title: Optimization opportunity on Windows -> Build libraries with "/OPT:REF" linker optimization on Windows

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42825>
_______________________________________

From report at bugs.python.org  Wed Jan  6 01:46:27 2021
From: report at bugs.python.org (Ezio Melotti)
Date: Wed, 06 Jan 2021 06:46:27 +0000
Subject: [issue42821] HTMLParser: subsequent duplicate attributes should be
 ignored
In-Reply-To: <1609747254.8.0.505282394857.issue42821@roundup.psfhosted.org>
Message-ID: <1609915587.98.0.579924133337.issue42821@roundup.psfhosted.org>


Ezio Melotti <ezio.melotti at gmail.com> added the comment:

If we follow the behavior of the browser, we will have to pick one of the two values and discard the other, making this value unaccessible.  If we provide both, scripts and libraries that use HTMLParser will have access to both and can decide what to do.

For example BeautifulSoup already does the right thing:
>>> bs4.BeautifulSoup('<!doctype html><div class="bar" class="foo">text</div>')
<!DOCTYPE html>
<html><body><div class="bar">text</div></body></html>

Changing this might also break code that rely on this behavior.  I'm therefore going to close this as "not a bug".

----------
assignee:  -> ezio.melotti
nosy: +ezio.melotti
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42821>
_______________________________________

From report at bugs.python.org  Wed Jan  6 04:05:31 2021
From: report at bugs.python.org (Sandeep Subramanian)
Date: Wed, 06 Jan 2021 09:05:31 +0000
Subject: [issue42836] docs: struct: clarify struct caching behaviour
Message-ID: <1609923931.89.0.0226570295473.issue42836@roundup.psfhosted.org>


New submission from Sandeep Subramanian <sandeep at mercari.com>:

As per docs in :https://docs.python.org/3.7/library/struct.html#struct.Struct

> The compiled versions of the most recent format strings passed to Struct and the module-level functions are cached, so programs that use only a few format strings needn?t worry about reusing a single Struct instance.

This statement seems to imply that the format string passed as `struct.Struct(format)` is also cached. This doesn't appear to be the case.

Only format strings passed to the module level functions seems to be cached.

`cache_struct_converter` at https://github.com/python/cpython/blob/v3.7.7/Modules/_struct.c#L2052 
appears to be used only in the top module level functions `pack` and `pack_into` and is *not* used in `Struct.__init__`.


Would it be better to change the doc to:

> The compiled versions of the most recent format strings passed to the module-level functions are cached, so programs that use only a few format strings needn?t worry about reusing a single Struct instance.

This issue was introduced by https://github.com/python/cpython/commit/3666b3c1f695a145adab1bf644c22e564e8eb0ee

and is present in every version since.

Refs:
https://github.com/python/cpython/pull/7700
https://bugs.python.org/issue33032

----------
assignee: docs at python
components: Documentation
messages: 384476
nosy: docs at python, sandeep2
priority: normal
severity: normal
status: open
title: docs: struct: clarify struct caching behaviour
type: enhancement
versions: Python 3.10, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42836>
_______________________________________

From report at bugs.python.org  Wed Jan  6 04:13:10 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 06 Jan 2021 09:13:10 +0000
Subject: [issue32381] Python 3.6 cannot reopen .pyc file with non-ASCII path
In-Reply-To: <1513750045.01.0.213398074469.issue32381@psf.upfronthosting.co.za>
Message-ID: <1609924390.22.0.802170586045.issue32381@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

boost-python was using the removed private _Py_fopen() function, I proposed https://github.com/boostorg/python/pull/344 to replace _Py_fopen() with fopen().

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32381>
_______________________________________

From report at bugs.python.org  Wed Jan  6 04:35:43 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 06 Jan 2021 09:35:43 +0000
Subject: [issue42164] Python fails to compile in the Fedora Stable LTO
 buildbots
In-Reply-To: <1603751687.99.0.243163164232.issue42164@roundup.psfhosted.org>
Message-ID: <1609925743.55.0.925719417443.issue42164@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Buildbots are back to green. It seems like the bug is gone with "gcc (GCC) 10.2.1 20201125 (Red Hat 10.2.1-9)".

----------
resolution:  -> fixed
stage: needs patch -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42164>
_______________________________________

From report at bugs.python.org  Wed Jan  6 04:45:38 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 06 Jan 2021 09:45:38 +0000
Subject: [issue31951] import curses is broken on windows
In-Reply-To: <1509922553.69.0.213398074469.issue31951@psf.upfronthosting.co.za>
Message-ID: <1609926338.86.0.402662085726.issue31951@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> curses for win32

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31951>
_______________________________________

From report at bugs.python.org  Wed Jan  6 04:51:20 2021
From: report at bugs.python.org (Mark Shannon)
Date: Wed, 06 Jan 2021 09:51:20 +0000
Subject: [issue42837] Symbol table incorrectly identifies code as a generator, 
 when 'yield' occurs in an annotation
Message-ID: <1609926680.76.0.190133632062.issue42837@roundup.psfhosted.org>


New submission from Mark Shannon <mark at hotpy.org>:

This is an internal inconsistency. I have not identified any surface level bugs, but it is a trap for future compiler work.

----------
assignee: Mark.Shannon
messages: 384479
nosy: Mark.Shannon, larry
priority: normal
severity: normal
status: open
title: Symbol table incorrectly identifies code as a generator, when 'yield' occurs in an annotation

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42837>
_______________________________________

From report at bugs.python.org  Wed Jan  6 04:59:23 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 06 Jan 2021 09:59:23 +0000
Subject: [issue42837] Symbol table incorrectly identifies code as a generator, 
 when 'yield' occurs in an annotation
In-Reply-To: <1609926680.76.0.190133632062.issue42837@roundup.psfhosted.org>
Message-ID: <1609927163.58.0.0290342122837.issue42837@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

This is a duplicate of issue42725.

----------
nosy: +serhiy.storchaka
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> PEP 563: Should the behavior change for yield/yield from's

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42837>
_______________________________________

From report at bugs.python.org  Wed Jan  6 05:04:16 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 06 Jan 2021 10:04:16 +0000
Subject: [issue39508] no module curses error although i downloaded the module
 - windows 10
In-Reply-To: <1580482082.1.0.922196738704.issue39508@roundup.psfhosted.org>
Message-ID: <1609927456.77.0.543533865041.issue39508@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

The curses module is not supported on Windows.

----------
nosy: +serhiy.storchaka
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> curses for win32

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39508>
_______________________________________

From report at bugs.python.org  Wed Jan  6 05:05:22 2021
From: report at bugs.python.org (Mark Shannon)
Date: Wed, 06 Jan 2021 10:05:22 +0000
Subject: [issue42837] Symbol table incorrectly identifies code as a generator, 
 when 'yield' occurs in an annotation
In-Reply-To: <1609926680.76.0.190133632062.issue42837@roundup.psfhosted.org>
Message-ID: <1609927522.28.0.327175527496.issue42837@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

No this is not a duplicate.
This is about making the symbol table correct for current semantics.
#42725 is about changing the behavior

----------
resolution: duplicate -> 
status: closed -> open
superseder: PEP 563: Should the behavior change for yield/yield from's -> 

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42837>
_______________________________________

From report at bugs.python.org  Wed Jan  6 05:12:29 2021
From: report at bugs.python.org (Mark Shannon)
Date: Wed, 06 Jan 2021 10:12:29 +0000
Subject: [issue42725] PEP 563: Should the behavior change for yield/yield
 from's
In-Reply-To: <1608730131.08.0.595189962302.issue42725@roundup.psfhosted.org>
Message-ID: <1609927949.36.0.351784409369.issue42725@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

I've also opened #42837 which is about fixing the symbol table, so that it is correct w.r.t. to current behavior.

I'd like to fix it ASAP as the compiler should be able to rely on the symbol table being correct.

Of course, once we have decided what the behavior should be, then it may need to be updated again.

I'm inclined to agree that 'yield' in an annotation should probably be a syntax error, but I haven't put much thought into to.

----------
nosy: +Mark.Shannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42725>
_______________________________________

From report at bugs.python.org  Wed Jan  6 05:15:28 2021
From: report at bugs.python.org (Mark Shannon)
Date: Wed, 06 Jan 2021 10:15:28 +0000
Subject: [issue42837] Symbol table incorrectly identifies code as a generator, 
 when 'yield' occurs in an annotation
In-Reply-To: <1609926680.76.0.190133632062.issue42837@roundup.psfhosted.org>
Message-ID: <1609928128.25.0.149781114829.issue42837@roundup.psfhosted.org>


Change by Mark Shannon <mark at hotpy.org>:


----------
keywords: +patch
pull_requests: +22967
stage: resolved -> patch review
pull_request: https://github.com/python/cpython/pull/24138

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42837>
_______________________________________

From report at bugs.python.org  Wed Jan  6 05:32:26 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 06 Jan 2021 10:32:26 +0000
Subject: [issue42837] Symbol table incorrectly identifies code as a generator, 
 when 'yield' occurs in an annotation
In-Reply-To: <1609926680.76.0.190133632062.issue42837@roundup.psfhosted.org>
Message-ID: <1609929146.6.0.940880833983.issue42837@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Does not it change the current behavior? I do not see a difference with issue42725.

>>> def f():
...     x: (yield)
... 
>>> f()
<generator object f at 0x7f971b45d950>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42837>
_______________________________________

From report at bugs.python.org  Wed Jan  6 05:46:25 2021
From: report at bugs.python.org (Marc-Andre Lemburg)
Date: Wed, 06 Jan 2021 10:46:25 +0000
Subject: [issue39457] Add an autocommit property to sqlite3.Connection with a
 PEP 249 compliant manual commit mode and migrate
In-Reply-To: <1609869898.76.0.596674766427.issue39457@roundup.psfhosted.org>
Message-ID: <027c430d-a092-7751-46ce-2029b5d3aeb4@egenix.com>


Marc-Andre Lemburg <mal at egenix.com> added the comment:

On 05.01.2021 19:04, G?ry wrote:
> 
> @lemburg
> 
>> I guess the SQLite driver does not start a new transaction for SELECTs, since these are usually read-only
> 
> Nor for DDL statements (CREATE, DROP).

Those are definitely changing the database and AFAIK SQLite
does support DDLs in transactions (including rolling them back
if needed).

Looking at the _sqlite code, the module does indeed only start
a transaction for INSERT, UPDATE, DELETE and REPLACE, with
"starting a transaction" meaning that it inserts a "BEGIN"
(or one of the txn isolation alternatives) before the statement:

https://github.com/python/cpython/blob/3.9/Modules/_sqlite/cursor.c#L489

This is also documented:

https://docs.python.org/3/library/sqlite3.html#controlling-transactions

I wonder why the module does not implement this properly, but I also
believe it's too late to change.

I guess what could be done is to add a connection.autocommit,
defaulting to None, meaning "use the pre-3.10 behavior".

If this is set to False, the module could then implement the
correct way of handling transactions, which means:

a) start a new transaction when the connection is opened
b) start a new transaction after .commit() and .rollback()
c) don't start new transactions anywhere else
d) run an implicit .rollback() when the connection closes

The code could even check for "BEGIN", "ROLLBACK" and "COMMIT"
text in the .execute() and issues a warning when connection.autocommit
is set to True or False.

When set to True, the module would set the SQLite autocommit
flag and also issues warnings for the txn statements. .rollback()
would issue an exception and .commit() pass silently.

>> For the same reason, removing the SELECT "optimization" may cause
>> a backwards incompatible change, which can be tricky to identify
>> and cause corruption of data (in this case, data not written to
>> the database, where it previously was written).
> 
> Since DQL statements (SELECT) are read-only, maybe we could keep the optimization and start transactions implicitly only for DDL statements (CREATE, DROP)?

See https://sqlite.org/c3ref/stmt_readonly.html.

SELECT are usually read-only, but not always. Since SQLite does
support UDFs (user defined functions), it is possible that a call
to such a function does change the database.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39457>
_______________________________________

From report at bugs.python.org  Wed Jan  6 05:53:10 2021
From: report at bugs.python.org (Richard Neumann)
Date: Wed, 06 Jan 2021 10:53:10 +0000
Subject: [issue42765] Introduce new data model method __iter_items__
In-Reply-To: <1609169200.88.0.326770807054.issue42765@roundup.psfhosted.org>
Message-ID: <1609930390.5.0.321275372635.issue42765@roundup.psfhosted.org>


Richard Neumann <mail at richard-neumann.de> added the comment:

Thank you all for your input.
I had a look at aforementioned discussion and learned something new.
So I tried to implement the dict data model by implementing keys() and __getitem__() accordingly:

from typing import NamedTuple


class Spamm(NamedTuple):

    foo: int
    bar: str

    def __getitem__(self, item):
        if isinstance(item, str):
            try:
                return getattr(self, item)
            except AttributeError:
                raise KeyError(item) from None

        return super().__getitem__(item)

    def keys(self):
        yield 'foo'
        yield 'bar'


def main():

    spamm = Spamm(12, 'hello')
    print(spamm.__getitem__)
    print(spamm.__getitem__(1))
    d = dict(spamm)


if __name__ == '__main__':
    main()


Unfortunately this will result in an error:

Traceback (most recent call last):
  File "/home/neumann/test.py", line 4, in <module>
    class Spamm(NamedTuple):
RuntimeError: __class__ not set defining 'Spamm' as <class '__main__.Spamm'>. Was __classcell__ propagated to type.__new__?

Which seems to be caused by the __getitem__ implementation.
I found a corresponding issue here: https://bugs.python.org/issue41629
Can I assume, that this is a pending bug and thusly I cannot implement the desired behaviour until a fix?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42765>
_______________________________________

From report at bugs.python.org  Wed Jan  6 05:55:33 2021
From: report at bugs.python.org (E. Paine)
Date: Wed, 06 Jan 2021 10:55:33 +0000
Subject: [issue42541] Tkinter colours wrong on MacOS universal2
In-Reply-To: <1606920595.63.0.665509072103.issue42541@roundup.psfhosted.org>
Message-ID: <1609930533.19.0.459006345795.issue42541@roundup.psfhosted.org>


E. Paine <paineelisha at gmail.com> added the comment:

This does not appear to be a problem anymore on Tk 8.6.11 so I think this issue can be closed.

----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42541>
_______________________________________

From report at bugs.python.org  Wed Jan  6 05:58:49 2021
From: report at bugs.python.org (Richard Neumann)
Date: Wed, 06 Jan 2021 10:58:49 +0000
Subject: [issue42765] Introduce new data model method __iter_items__
In-Reply-To: <1609169200.88.0.326770807054.issue42765@roundup.psfhosted.org>
Message-ID: <1609930729.04.0.0414635678077.issue42765@roundup.psfhosted.org>


Richard Neumann <mail at richard-neumann.de> added the comment:

Okay, I found the solution. Not using super() works:

from typing import NamedTuple


class Spamm(NamedTuple):

    foo: int
    bar: str

    def __getitem__(self, index_or_key):
        if isinstance(index_or_key, str):
            try:
                return getattr(self, index_or_key)
            except AttributeError:
                raise KeyError(index_or_key) from None

        return tuple.__getitem__(self, index_or_key)

    def keys(self):
        yield 'foo'
        yield 'bar'


def main():

    spamm = Spamm(12, 'hello')
    print(spamm.__getitem__)
    print(spamm.__getitem__(1))
    d = dict(spamm)
    print(d)


if __name__ == '__main__':
    main()

Result:

<bound method Spamm.__getitem__ of Spamm(foo=12, bar='hello')>
hello
{'foo': 12, 'bar': 'hello'}

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42765>
_______________________________________

From report at bugs.python.org  Wed Jan  6 06:00:10 2021
From: report at bugs.python.org (Mark Shannon)
Date: Wed, 06 Jan 2021 11:00:10 +0000
Subject: [issue42837] Symbol table incorrectly identifies code as a generator, 
 when 'yield' occurs in an annotation
In-Reply-To: <1609926680.76.0.190133632062.issue42837@roundup.psfhosted.org>
Message-ID: <1609930810.67.0.84701724777.issue42837@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

The aim is to change the behavior of the symbol table to match the compiler.
The behavior has already changed at module scope.

Python 3.9.0+
>>> x:(yield None)
  File "<stdin>", line 1
SyntaxError: 'yield' outside function
>>> 


Python 3.10.0a4+
>>> x:(yield None)
>>>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42837>
_______________________________________

From report at bugs.python.org  Wed Jan  6 06:25:59 2021
From: report at bugs.python.org (Richard Neumann)
Date: Wed, 06 Jan 2021 11:25:59 +0000
Subject: [issue41629] __class__ not set defining 'X' as <class '__main__.X'>
In-Reply-To: <1598311979.7.0.775389193479.issue41629@roundup.psfhosted.org>
Message-ID: <1609932359.6.0.384727611958.issue41629@roundup.psfhosted.org>


Richard Neumann <mail at richard-neumann.de> added the comment:

I just stumbled across this issue trying to resolve this: https://bugs.python.org/issue42765?

While this fails:

from typing import NamedTuple


class Spamm(NamedTuple):

    foo: int
    bar: str

    def __getitem__(self, index_or_key):
        """Returns the respective item."""
        if isinstance(index_or_key, str):
            try:
                return getattr(self, index_or_key)
            except AttributeError:
                raise IndexError(index_or_key) from None

        return super().__getitem__(index_or_key)

    def keys(self):
        return self._fields


def main():

    spamm = Spamm(12, 'hello')
    print(dir(spamm))
    print(spamm._fields)
    d = dict(spamm)
    print(d)


if __name__ == '__main__':
    main()


with

Traceback (most recent call last):
  File "/home/neumann/test.py", line 4, in <module>
    class Spamm(NamedTuple):
RuntimeError: __class__ not set defining 'Spamm' as <class '__main__.Spamm'>. Was __classcell__ propagated to type.__new__?


The following works:

from typing import NamedTuple


def _getitem(instance, index_or_key):
    """Returns the respective item."""

    if isinstance(index_or_key, str):
        try:
            return getattr(instance, index_or_key)
        except AttributeError:
            raise IndexError(index_or_key) from None

    return super().__getitem__(index_or_key)


def dicttuple(cls: tuple):
    """Extends a tuple class with methods for the dict constructor."""

    cls.keys = lambda self: self._fields
    cls.__getitem__ = _getitem
    return cls


@dicttuple
class Spamm(NamedTuple):

    foo: int
    bar: str


def main():

    spamm = Spamm(12, 'hello')
    print(dir(spamm))
    print(spamm._fields)
    d = dict(spamm)
    print(d)


if __name__ == '__main__':
    main()


And produces:

['__add__', '__annotations__', '__class__', '__class_getitem__', '__contains__', '__delattr__', '__dir__', '__doc__', '__eq__', '__format__', '__ge__', '__getattribute__', '__getitem__', '__getnewargs__', '__gt__', '__hash__', '__init__', '__init_subclass__', '__iter__', '__le__', '__len__', '__lt__', '__module__', '__mul__', '__ne__', '__new__', '__orig_bases__', '__reduce__', '__reduce_ex__', '__repr__', '__rmul__', '__setattr__', '__sizeof__', '__slots__', '__str__', '__subclasshook__', '_asdict', '_field_defaults', '_fields', '_make', '_replace', 'bar', 'count', 'foo', 'index', 'keys']
('foo', 'bar')
{'foo': 12, 'bar': 'hello'}


I am a bit baffled, why it works when the method is injected via a decorator.

----------
nosy: +conqp

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41629>
_______________________________________

From report at bugs.python.org  Wed Jan  6 06:29:05 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 06 Jan 2021 11:29:05 +0000
Subject: [issue42837] Symbol table incorrectly identifies code as a generator, 
 when 'yield' occurs in an annotation
In-Reply-To: <1609926680.76.0.190133632062.issue42837@roundup.psfhosted.org>
Message-ID: <1609932545.38.0.378628832164.issue42837@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Then why not fix the compiler?

As I understand, it is not clear yet what behavior should be, and discussing it is the matter of issue42725. Any changes before the decision be made are preliminary.

It is very likely that the decision will be in favor of ignoring annotations. In that case your PR or even more radical changes can be merged.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42837>
_______________________________________

From report at bugs.python.org  Wed Jan  6 06:32:07 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 06 Jan 2021 11:32:07 +0000
Subject: [issue42681] Incorrect range checks/documentation in curses
In-Reply-To: <1608339537.48.0.496910027234.issue42681@roundup.psfhosted.org>
Message-ID: <1609932727.76.0.955982892537.issue42681@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Great work, thank you Serhiy!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42681>
_______________________________________

From report at bugs.python.org  Wed Jan  6 06:38:55 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 06 Jan 2021 11:38:55 +0000
Subject: [issue42528] Improve the docs of most Py*_Check{,Exact} API calls
In-Reply-To: <1606841265.25.0.130640674128.issue42528@roundup.psfhosted.org>
Message-ID: <1609933135.1.0.148646081662.issue42528@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 315fc52db17b19fe30aa9193f26adf69e18d8844 by Antonio Cuni in branch 'master':
bpo-42528: Improve the docs of most Py*_Check{,Exact} API calls (GH-23602)
https://github.com/python/cpython/commit/315fc52db17b19fe30aa9193f26adf69e18d8844


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42528>
_______________________________________

From report at bugs.python.org  Wed Jan  6 06:47:31 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 06 Jan 2021 11:47:31 +0000
Subject: [issue41798] [C API] Revisit usage of the PyCapsule C API with
 multi-phase initialization API
In-Reply-To: <1600265269.2.0.881235166904.issue41798@roundup.psfhosted.org>
Message-ID: <1609933651.61.0.0499059002606.issue41798@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset fe9f446afe46bd716592eda9fa2af8d9f46bbce4 by Erlend Egeberg Aasland in branch 'master':
bpo-41798: Allocate _decimal extension module C API on the heap (GH-24117)
https://github.com/python/cpython/commit/fe9f446afe46bd716592eda9fa2af8d9f46bbce4


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41798>
_______________________________________

From report at bugs.python.org  Wed Jan  6 07:03:37 2021
From: report at bugs.python.org (Mark Shannon)
Date: Wed, 06 Jan 2021 12:03:37 +0000
Subject: [issue42837] Symbol table incorrectly identifies code as a generator, 
 when 'yield' occurs in an annotation
In-Reply-To: <1609926680.76.0.190133632062.issue42837@roundup.psfhosted.org>
Message-ID: <1609934617.05.0.649147369727.issue42837@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

OK, I won't merge anything yet.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42837>
_______________________________________

From report at bugs.python.org  Wed Jan  6 07:05:31 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 06 Jan 2021 12:05:31 +0000
Subject: [issue22213] Make pyvenv style virtual environments easier to
 configure when embedding Python
In-Reply-To: <1408275761.36.0.915361061447.issue22213@psf.upfronthosting.co.za>
Message-ID: <1609934731.8.0.874255774262.issue22213@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

See also "Configure Python initialization (PyConfig) in Python"
https://mail.python.org/archives/list/python-dev at python.org/thread/HQNFTXOCDD5ROIQTDXPVMA74LMCDZUKH/#X45X2K4PICTDJQYK3YPRPR22IGT2CDXB

And bpo-42260: [C API] Add PyInterpreterState_SetConfig(): reconfigure an interpreter.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue22213>
_______________________________________

From report at bugs.python.org  Wed Jan  6 07:08:23 2021
From: report at bugs.python.org (miss-islington)
Date: Wed, 06 Jan 2021 12:08:23 +0000
Subject: [issue42528] Improve the docs of most Py*_Check{,Exact} API calls
In-Reply-To: <1606841265.25.0.130640674128.issue42528@roundup.psfhosted.org>
Message-ID: <1609934903.03.0.729596530633.issue42528@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 3.0 -> 4.0
pull_requests: +22968
pull_request: https://github.com/python/cpython/pull/24139

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42528>
_______________________________________

From report at bugs.python.org  Wed Jan  6 07:32:34 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 06 Jan 2021 12:32:34 +0000
Subject: [issue42115] Caching infrastructure for the evaluation loop:
 specialised opcodes
In-Reply-To: <1603336898.74.0.366564812208.issue42115@roundup.psfhosted.org>
Message-ID: <1609936354.75.0.495167328295.issue42115@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

I subscribe that but is also a matter of what are the optimizations with higher ratio impact/(cost+complexity). Caching the function pointers on binary operations or (better IMHO) comparisons is likely a good candidate

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42115>
_______________________________________

From report at bugs.python.org  Wed Jan  6 07:53:38 2021
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Wed, 06 Jan 2021 12:53:38 +0000
Subject: [issue42827] pegen parser: Multiline eval with assignment to function
 call: assertion failed
In-Reply-To: <1609793289.79.0.762652539307.issue42827@roundup.psfhosted.org>
Message-ID: <1609937618.53.0.55023426597.issue42827@roundup.psfhosted.org>


Change by Lysandros Nikolaou <lisandrosnik at gmail.com>:


----------
pull_requests: +22969
pull_request: https://github.com/python/cpython/pull/24140

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42827>
_______________________________________

From report at bugs.python.org  Wed Jan  6 07:54:26 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 06 Jan 2021 12:54:26 +0000
Subject: [issue42528] Improve the docs of most Py*_Check{,Exact} API calls
In-Reply-To: <1606841265.25.0.130640674128.issue42528@roundup.psfhosted.org>
Message-ID: <1609937666.29.0.665051304394.issue42528@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset faf49573963921033c608b4d2f398309d9f0d2b5 by Miss Islington (bot) in branch '3.9':
bpo-42528: Improve the docs of most Py*_Check{,Exact} API calls (GH-23602) (GH-24139)
https://github.com/python/cpython/commit/faf49573963921033c608b4d2f398309d9f0d2b5


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42528>
_______________________________________

From report at bugs.python.org  Wed Jan  6 08:05:28 2021
From: report at bugs.python.org (James Oldfield)
Date: Wed, 06 Jan 2021 13:05:28 +0000
Subject: [issue39457] Add an autocommit property to sqlite3.Connection with a
 PEP 249 compliant manual commit mode and migrate
In-Reply-To: <1580066229.26.0.0229158792904.issue39457@roundup.psfhosted.org>
Message-ID: <1609938328.96.0.542328422411.issue39457@roundup.psfhosted.org>


James Oldfield <james.oldfield at cantab.net> added the comment:

There's some confusion here over what autocommit=True would do. I believe the last three comments give three different interpretations! G?ry said conn.autocommit would change to False when I start a transaction with execute("BEGIN"), Mike said it wouldn't (because it represents the driver's state, not the engine's, by analogy with other DB API drivers), and Marc-Andre says execute("BEGIN") wouldn't be allowed in the first place (or at least it would issue a warning).

To reiterate, the ability to control transactions manually is already supported in the sqlite3 driver, in the form of isolation_mode=None. My first request is simply that **this ability continues to exist**. This functionality was implemented deliberately - the original author of pysqlite recommended this usage, and care has been taken over the years not to break it. Please do not point out that this is not DB API compliant; I know that, and I just don't care! So long as DB API compliant usage is _also_ supported, even the default, that doesn't prevent this other mode from existing too. Many others are using the mode, even if they are not commenters here, so I don't believe it is feasible to break or remove this functionality, even if you're not a fan.

My second request was: feel free to rename this option from "isolation_mode=None" to something else if you wish, but please don't call it "autocommit=True" because that's just too confusing. I feel like the confusion in the comments above justifies this point of view.

As I see it, that leaves two options:

Option 1: Suck it up and use autocommit=True as the option name. It's confusing, but there's so much precedent that it has to be so. This is Mike Bayer's suggestion (except he didn't say it was confusing, that's just my commentary). I think that this option is only feasible if conn.autocommit only refer's the driver's state, not the underlying engine's state, confusing though that is i.e. once set to true it would *always* be true, even if a transaction is started.

Option 2: Reserve autocommit=True for the underlying SQLite engine autocommit mode. That means detecting when there's an attempt to use execute("BEGIN") or similar, and then issuing a warning or error. It also means supplying some other, third, option for what I'm asking (like today's isolation_mode=None).

Although option 2 is closer to what I originally requested, I do worry it means that the non-DBAPI mode will appear unsupported and fall into neglect. If the API for accessing it is to set autocommit=None, to mean legacy behaviour, and then also isolation_mode=None to mean the type of legacy behaviour, then it doesn't look like the most recommended API ever. And yet, for those that don't care about DB API (which I imagine is most users of the sqlite3 driver), this is probably the best API to use.

So I reluctantly agree that option 1, using autocommit=True, is actually best overall. I would ask that there is at least a note in the documentation so that it's clear this is allowed to work. Something like this:

    If autocommit=True then the sqlite3 module will never automatically start transactions. The underlying SQLite database engine operates in autocommit mode whenever no transactions are active, so the net effect of this is to use SQLite's autocommit mode [1].

    Note that, when autocommit=True, the sqlite3 module will not intercept and stop a statement to explicitly start a transaction, such as with execute("BEGIN"). In that case, a transaction is started and the underlying SQLite engine is no longer in autocommit mode. (The sqlite3 Connection object will still report autocommit=True; this does not indicate that the SQLite engine is autocommit mode, just that the sqlite3 module is not going to implicitly start any transactions.)

    The connection commit() and rollback() methods may be used for transactions started explictly when autocommit=True, and the connection may be used as a context manager, just as it can be when autocommit=False. If no transaction is currently active then those methods silent pass with no effect.

[1] https://sqlite.org/lang_transaction.html#implicit_versus_explicit_transactions

Side note: When I started down this rabbit hole several weeks ago, I repeatedly came across the extremely confusing phrase "SQLite operates in autocommit mode by default". It took me a while to realise that autocommit is not a flag that it is possible to turn off on a connection *when you open it*. The text I used above, "The underlying SQLite database engine operates in autocommit mode whenever no transactions are active" was carefully chosen and I consider it to be much clearer, regardless of whatever else ends up happening.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39457>
_______________________________________

From report at bugs.python.org  Wed Jan  6 08:10:28 2021
From: report at bugs.python.org (Ned Batchelder)
Date: Wed, 06 Jan 2021 13:10:28 +0000
Subject: [issue42823] Incorrect frame.f_lineno when frame.f_trace is set
In-Reply-To: <1609777965.06.0.667792191004.issue42823@roundup.psfhosted.org>
Message-ID: <1609938628.45.0.0577331738678.issue42823@roundup.psfhosted.org>


Ned Batchelder <ned at nedbatchelder.com> added the comment:

This change seems like it has caused a problem.  Python trace functions behave as they did in Python 3.9, but C trace functions no longer get line numbers for call or return events.


Running this test code:

    def gen(inp):
        for n in inp:
            yield n

    list(gen([1,2,3]))

With my C trace function logging what it is passed, in Python 3.9 I got this:

    trace: CALL @ coverage_test_2616437928787223.py 1
    trace: LINE @ coverage_test_2616437928787223.py 1
    trace: LINE @ coverage_test_2616437928787223.py 5
    trace: CALL @ coverage_test_2616437928787223.py 1
    trace: LINE @ coverage_test_2616437928787223.py 2
    trace: LINE @ coverage_test_2616437928787223.py 3
    trace: RET  @ coverage_test_2616437928787223.py 3
    trace: CALL @ coverage_test_2616437928787223.py 3
    trace: LINE @ coverage_test_2616437928787223.py 2
    trace: LINE @ coverage_test_2616437928787223.py 3
    trace: RET  @ coverage_test_2616437928787223.py 3
    trace: CALL @ coverage_test_2616437928787223.py 3
    trace: LINE @ coverage_test_2616437928787223.py 2
    trace: LINE @ coverage_test_2616437928787223.py 3
    trace: RET  @ coverage_test_2616437928787223.py 3
    trace: CALL @ coverage_test_2616437928787223.py 3
    trace: LINE @ coverage_test_2616437928787223.py 2
    trace: RET  @ coverage_test_2616437928787223.py 2
    trace: RET  @ coverage_test_2616437928787223.py 5

With 3.10 (commit 1a9f51ed12feb4d95ad6d0faf610a030c05b9f5e) I get:

    trace: CALL @ coverage_test_40117094849631774.py 0
    trace: LINE @ coverage_test_40117094849631774.py 1
    trace: LINE @ coverage_test_40117094849631774.py 5
    trace: CALL @ coverage_test_40117094849631774.py 0
    trace: LINE @ coverage_test_40117094849631774.py 2
    trace: LINE @ coverage_test_40117094849631774.py 3
    trace: RET  @ coverage_test_40117094849631774.py 0
    trace: CALL @ coverage_test_40117094849631774.py 0
    trace: LINE @ coverage_test_40117094849631774.py 2
    trace: LINE @ coverage_test_40117094849631774.py 3
    trace: RET  @ coverage_test_40117094849631774.py 0
    trace: CALL @ coverage_test_40117094849631774.py 0
    trace: LINE @ coverage_test_40117094849631774.py 2
    trace: LINE @ coverage_test_40117094849631774.py 3
    trace: RET  @ coverage_test_40117094849631774.py 0
    trace: CALL @ coverage_test_40117094849631774.py 0
    trace: LINE @ coverage_test_40117094849631774.py 2
    trace: RET  @ coverage_test_40117094849631774.py 0
    trace: RET  @ coverage_test_40117094849631774.py 0

All of the call and return events now get a frame with f_lineno == 0.

Python trace functions seem unaffected.

The C code producing this debug output is here: https://github.com/nedbat/coveragepy/blob/a498ebc28273fd21b6a047a173b2e4443b91f563/coverage/ctracer/tracer.c#L786-L813

----------
nosy: +nedbat
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42823>
_______________________________________

From report at bugs.python.org  Wed Jan  6 08:21:56 2021
From: report at bugs.python.org (mike bayer)
Date: Wed, 06 Jan 2021 13:21:56 +0000
Subject: [issue39457] Add an autocommit property to sqlite3.Connection with a
 PEP 249 compliant manual commit mode and migrate
In-Reply-To: <1580066229.26.0.0229158792904.issue39457@roundup.psfhosted.org>
Message-ID: <1609939316.62.0.16408128795.issue39457@roundup.psfhosted.org>


mike bayer <mike_mp at zzzcomputing.com> added the comment:

I think this issue just discusses the naming of an attribute called ".autocommit".  for the discussion for SQLite's unusual starting of transactions, that's all in two other issues:

https://bugs.python.org/issue9924 

https://bugs.python.org/issue10740

so I would encourage folks to read those discussions.  at issue is the limitation of SQLite that it locks the whole file for transactions, which is the main rationale for why SQLite is hesitant to begin a transaction.  however, without configurability, this means it's not compatible with SAVEPOINT or serializable isolation levels.   when users want to use those two features we have them set isolation_level=None and emit "BEGIN" on the connection directly.    the connection.commit() and connection.rollback() methods continue to be functional

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39457>
_______________________________________

From report at bugs.python.org  Wed Jan  6 08:29:41 2021
From: report at bugs.python.org (Mark Shannon)
Date: Wed, 06 Jan 2021 13:29:41 +0000
Subject: [issue42823] Incorrect frame.f_lineno when frame.f_trace is set
In-Reply-To: <1609777965.06.0.667792191004.issue42823@roundup.psfhosted.org>
Message-ID: <1609939781.16.0.96509898455.issue42823@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

It looks like you are accessing the c field "f_lineno" directly.
That was never guaranteed to work, it just happened to.
You should use PyFrame_GetLineNumber()
If "f_lineno" is up to date, then it will be almost efficient as the direct field access (the overhead is a C call).
If "f_lineno" is not up to date, PyFrame_GetLineNumber() will compute the correct value.

In the interest of efficiency it makes sense that the internal f_line field is updated before CALL and RETURN trace events.
I'll make that change, but you really ought to use the API rather than probing into the frame internals.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42823>
_______________________________________

From report at bugs.python.org  Wed Jan  6 08:56:08 2021
From: report at bugs.python.org (xloem)
Date: Wed, 06 Jan 2021 13:56:08 +0000
Subject: [issue42838] Wait for cleanup coroutines before event loop is closed.
Message-ID: <1609941368.33.0.950412728581.issue42838@roundup.psfhosted.org>


New submission from xloem <0xloem at gmail.com>:

To handle destruction of resources especially during exceptions, it would be nice if there were some way to provide coroutines/tasks that run at the termination or closure of an event loop.  There are a lot of api options here.  Maybe a simple one would be to have close() call a run_until_closed() function that starts all of these and steps the loop to wait for them, before closing, and provide run_close() functions to queue them for delay.

----------
components: asyncio
messages: 384503
nosy: asvetlov, xloem, yselivanov
priority: normal
severity: normal
status: open
title: Wait for cleanup coroutines before event loop is closed.
type: enhancement
versions: Python 3.10, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42838>
_______________________________________

From report at bugs.python.org  Wed Jan  6 09:32:12 2021
From: report at bugs.python.org (favonia)
Date: Wed, 06 Jan 2021 14:32:12 +0000
Subject: [issue42839] SourceFileLoader does not (fully) accept path-like
 objects
Message-ID: <1609943532.78.0.260162878801.issue42839@roundup.psfhosted.org>


New submission from favonia <favonia at gmail.com>:

If one uses the loader created by importlib.machinery.SourceFileLoader(module_name, path) in a meta path finder, where path is not a str, then the following error would happen at the moment the module is being imported. Note that, the error would not occur if the corresponding bytecode cache (__pycache__/*.pyc) is present.

  File "/usr/lib/python3.9/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1030, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
  File "<frozen importlib._bootstrap>", line 972, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed
  File "<frozen importlib._bootstrap>", line 1030, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
  File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 680, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 786, in exec_module
  File "<frozen importlib._bootstrap_external>", line 932, in get_code
  File "<frozen importlib._bootstrap_external>", line 604, in _code_to_timestamp_pyc
ValueError: unmarshallable object

Here is an example that could trigger the error. The package unipath is not very important except that unipath.Path is not marshallable. (Any library with a fancy, unmarshallable path-like object would work.) The choice of 'local' and the use of 'os.getcwd()' are also irrelevant. The actual production code is quite complicated, using different path-like objects and convoluted logic. I made up this example from scratch.

import os
import sys
import importlib
import importlib.abc
import importlib.util
from unipath import Path # just an example

class DummyFinder(importlib.abc.MetaPathFinder):
    def __init__(self):
        self.cwd = os.getcwd()
    def find_spec(self, fullname, path, target=None):
        if fullname == 'local':
            initpath = os.path.join(self.cwd, '__init__.py')
            if os.path.isfile(initpath):
                loader = importlib.machinery.SourceFileLoader(fullname, Path(initpath)) # some non-str Path-like object here
                return importlib.util.spec_from_file_location(fullname, initpath,
                        loader = loader, submodule_search_locations=[self.cwd])
        else:
            return None

sys.meta_path.append(DummyFinder())
importlib.import_module("local.test2")

If this is indeed a bug, there might be other classes and functions in importlib that share the same problem.

----------
components: Library (Lib)
messages: 384504
nosy: favonia
priority: normal
severity: normal
status: open
title: SourceFileLoader does not (fully) accept path-like objects
type: enhancement
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42839>
_______________________________________

From report at bugs.python.org  Wed Jan  6 10:18:30 2021
From: report at bugs.python.org (Ned Batchelder)
Date: Wed, 06 Jan 2021 15:18:30 +0000
Subject: [issue42823] Incorrect frame.f_lineno when frame.f_trace is set
In-Reply-To: <1609777965.06.0.667792191004.issue42823@roundup.psfhosted.org>
Message-ID: <1609946310.31.0.42011607404.issue42823@roundup.psfhosted.org>


Ned Batchelder <ned at nedbatchelder.com> added the comment:

OK, thanks.  I guess the parallels between the Python frame object and the C frame object made it easy to think I could use the fields directly.  I'm updating the coverage.py code.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42823>
_______________________________________

From report at bugs.python.org  Wed Jan  6 10:21:21 2021
From: report at bugs.python.org (Erik Soma)
Date: Wed, 06 Jan 2021 15:21:21 +0000
Subject: [issue42840] `type` takes **kwargs for __init_subclass__
Message-ID: <1609946481.51.0.225785046936.issue42840@roundup.psfhosted.org>


New submission from Erik Soma <stillusingirc at gmail.com>:

The documentation (https://docs.python.org/3/library/functions.html#type) shows type's signature as:

class type(object)
class type(name, bases, dict)


But the "actual" 2nd signature in CPython 3.6+ is:

class type(name, bases, dict, **kwargs)


**kwargs here gets passed to __init_subclass__ in the same way that keywords in a class statement do so that:

type("Bar", (Foo,), {}, spam='ham')

is equivalent to

class Bar(Foo, spam='ham'): pass


It's not clear to me whether this is behavior to rely on. I started using this intuitively, but found that my type checker reasonably complained.

Looking through the commit that implemented PEP 487 (d78448e9), it seems this may have been incidental. Additionally I haven't found mention of this in PEP 487 or the documentation and I can't seem to find any tests for it.

----------
messages: 384506
nosy: esoma
priority: normal
severity: normal
status: open
title: `type` takes **kwargs for __init_subclass__
type: behavior
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42840>
_______________________________________

From report at bugs.python.org  Wed Jan  6 10:27:26 2021
From: report at bugs.python.org (Yurii Karabas)
Date: Wed, 06 Jan 2021 15:27:26 +0000
Subject: [issue42841] Add bitwise or operator to collections.abc Mapping and
 MutableMapping
Message-ID: <1609946846.04.0.311249244168.issue42841@roundup.psfhosted.org>


New submission from Yurii Karabas <1998uriyyo at gmail.com>:

In python3.9 `dict` `bitwise or` operator was introduced.

I think it will be great if `collections.abc.Mapping` and `collections.abc.MutableMapping` will have a default implementation of `bitwise or` operator.

----------
messages: 384507
nosy: uriyyo
priority: normal
severity: normal
status: open
title: Add bitwise or operator to collections.abc Mapping and MutableMapping

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42841>
_______________________________________

From report at bugs.python.org  Wed Jan  6 10:27:47 2021
From: report at bugs.python.org (Yurii Karabas)
Date: Wed, 06 Jan 2021 15:27:47 +0000
Subject: [issue42841] Add bitwise or operator to collections.abc Mapping and
 MutableMapping
In-Reply-To: <1609946846.04.0.311249244168.issue42841@roundup.psfhosted.org>
Message-ID: <1609946867.38.0.457300131296.issue42841@roundup.psfhosted.org>


Change by Yurii Karabas <1998uriyyo at gmail.com>:


----------
components: +Library (Lib)
type:  -> enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42841>
_______________________________________

From report at bugs.python.org  Wed Jan  6 10:31:21 2021
From: report at bugs.python.org (Yurii Karabas)
Date: Wed, 06 Jan 2021 15:31:21 +0000
Subject: [issue42841] Add bitwise or operator to collections.abc Mapping and
 MutableMapping
In-Reply-To: <1609946846.04.0.311249244168.issue42841@roundup.psfhosted.org>
Message-ID: <1609947081.1.0.521568562261.issue42841@roundup.psfhosted.org>


Change by Yurii Karabas <1998uriyyo at gmail.com>:


----------
keywords: +patch
pull_requests: +22970
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24141

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42841>
_______________________________________

From report at bugs.python.org  Wed Jan  6 10:38:20 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 06 Jan 2021 15:38:20 +0000
Subject: [issue42725] PEP 563: Should the behavior change for yield/yield
 from's
In-Reply-To: <1608730131.08.0.595189962302.issue42725@roundup.psfhosted.org>
Message-ID: <1609947500.13.0.616671835986.issue42725@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Yield in an annotation should be a syntax error.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42725>
_______________________________________

From report at bugs.python.org  Wed Jan  6 10:39:18 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 06 Jan 2021 15:39:18 +0000
Subject: [issue42837] Symbol table incorrectly identifies code as a generator, 
 when 'yield' occurs in an annotation
In-Reply-To: <1609926680.76.0.190133632062.issue42837@roundup.psfhosted.org>
Message-ID: <1609947558.96.0.345349042762.issue42837@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
nosy: +gvanrossum, lys.nikolaou, pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42837>
_______________________________________

From report at bugs.python.org  Wed Jan  6 11:30:16 2021
From: report at bugs.python.org (sasquatchplatypus)
Date: Wed, 06 Jan 2021 16:30:16 +0000
Subject: [issue42842] import logging.handlers shows weird behavior
Message-ID: <1609950616.34.0.697361127063.issue42842@roundup.psfhosted.org>


New submission from sasquatchplatypus <maxiwei at aol.com>:

when trying to import a handler from logging.handlers, you have to explicitely import logging.handlers, because trying to get it from logging directly (for example import logging, logging.handlers.RotatingFileHandlers)
raises this error: AttributeError: module 'logging' has no attribute 'handlers'

----------
messages: 384509
nosy: sasquatchplatypus
priority: normal
severity: normal
status: open
title: import logging.handlers shows weird behavior
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42842>
_______________________________________

From report at bugs.python.org  Wed Jan  6 11:32:08 2021
From: report at bugs.python.org (Eryk Sun)
Date: Wed, 06 Jan 2021 16:32:08 +0000
Subject: [issue30044] shutil.copystat should (allow to) copy ownership,
 and other attributes
In-Reply-To: <1491925353.8.0.782070431072.issue30044@psf.upfronthosting.co.za>
Message-ID: <1609950728.53.0.0193858452727.issue30044@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> For Windows though, I'm unsure.

If copystat() gains the ability to copy the file's owner and group in POSIX, it is not a priority to mirror this capability in Windows, which doesn't implement anything like the Unix owner-group-other permission model. The only security metadata that I expect to be copied in Windows is the file's resource attributes, which are named attributes set on an object -- and considered inherent to the object -- for use in conditional access-control entries. Normally, the rest of the security descriptor is not copied, including the owner, group, mandatory label (integrity level and read-up/write-up/execute-up access), discretionary access-control list, and system access-control list (audit entries). That level of deep copying is a backup and restore operation of the complete file context, not a normal file copy.

Regarding copy2(), what I've seen proposed a couple of times for Windows is to implement it via CopyFileExW(). The documentation of copy2() would have to be special cased to explain that the platform copy routine is used in Windows, which copies all named (alternate) data streams and settable file attributes, extended attributes, and resource attributes. It would also need to be emphasized that copy2() is not equivalent to copyfile() + copystat() in Windows.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30044>
_______________________________________

From report at bugs.python.org  Wed Jan  6 11:38:53 2021
From: report at bugs.python.org (sasquatchplatypus)
Date: Wed, 06 Jan 2021 16:38:53 +0000
Subject: [issue42842] module 'logging' has not attribute 'handlers'
In-Reply-To: <1609950616.34.0.697361127063.issue42842@roundup.psfhosted.org>
Message-ID: <1609951133.19.0.232686006803.issue42842@roundup.psfhosted.org>


Change by sasquatchplatypus <maxiwei at aol.com>:


----------
title: import logging.handlers shows weird behavior -> module 'logging' has not attribute 'handlers'

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42842>
_______________________________________

From report at bugs.python.org  Wed Jan  6 11:41:47 2021
From: report at bugs.python.org (Michael Felt)
Date: Wed, 06 Jan 2021 16:41:47 +0000
Subject: [issue42309] BUILD: AIX-64-bit segmentation fault using xlc-v11
In-Reply-To: <1605008695.96.0.78391537773.issue42309@roundup.psfhosted.org>
Message-ID: <1609951307.49.0.0180105847144.issue42309@roundup.psfhosted.org>


Michael Felt <aixtools at felt.demon.nl> added the comment:

OK - looking at this again.

This looks very similiar to another 'coredump' issue (will have to look for the number later). iirc, when something called 'pgen', or similiar was modified.

Here is a lengthy `dbx` dump.

If I am reading this correctly, it is 'starting' in this area:

_PyPegen_run_parser(p = 0x0fffffffffffcb40), line 1121 in "pegen.c"
_PyPegen_run_parser_from_string(str = "compile", start_rule = 1, filename_ob = 0x00000001100ee2b0, flags = 0x070000000007fb30, arena = 0x07000000000d3330), line 1250 in "pegen.c"
PyPegen_ASTFromStringObject(str = warning: Unable to access address 0x15d4 from core
(invalid char ptr (0x00000000000015d4)), filename = (nil), mode = 268435455, flags = 0x482448c200000000, arena = 0x00000001001a1e3c), line 27 in "peg_api.c"
Py_CompileStringObject(str = "", filename = (nil), start = 268435455, flags = 0x070000000007fb30, optimize = 268435455), line 1274 in "pythonrun.c"
builtin_compile_impl(module = 0x0000000100077a0c, source = (nil), filename = 0x0000000110000e28, mode = "", flags = 1, dont_inherit = 1, optimize = 0, feature_version = 0), line 819 in "bltinmodule.c"
builtin_compile(module = (nil), args = 0x00000001100741c0, nargs = 2, kwnames = 0x07000000000068f0), line 274 in "bltinmodule.c.h"
cfunction_vectorcall_FASTCALL_KEYWORDS(func = 0x0fffffffffffd030, args = 0x0000000000001300, nargsf = 0, kwnames = 0x0000000000000008), line 457 in "methodobject.c"


Here is the complete 'where' status:

(dbx) where
strncmp.strncmp(??, ??, ??) at 0x90000000001b3a0
_get_keyword_or_name_type(p = 0x0000000000000020, name = (nil), name_len = 0), line 535 in "pegen.c"
_PyPegen_fill_token(p = 0x00000001001be088), line 638 in "pegen.c"
_PyPegen_is_memoized(p = 0x0000000000000020, type = 0, pres = 0x0fffffffffffc370), line 716 in "pegen.c"
dotted_name_rule(p = 0x0fffffffffffc400), line 3443 in "parse.c"
dotted_as_name_rule at AF452_298(??), line 3410 in "parse.c"
_gather_36_rule at AF453_127(??), line 17755 in "parse.c"
dotted_as_names_rule at AF454_299(??), line 3368 in "parse.c"
import_name_rule(p = 0x0fffffffffffc660), line 3000 in "parse.c"
import_stmt_rule at AF462_305(??), line 2932 in "parse.c"
small_stmt_rule(p = 0x0fffffffffffc7a0), line 1606 in "parse.c"
unnamed block in simple_stmt_rule(p = 0x00000001000df758), line 1428 in "parse.c"
simple_stmt_rule(p = 0x00000001000df758), line 1428 in "parse.c"
unnamed block in statement_rule(p = 0x00000000000015d5), line 1262 in "parse.c"
statement_rule(p = 0x00000000000015d5), line 1262 in "parse.c"
_loop1_11_rule(p = 0x00000001000df6d4), line 16254 in "parse.c"
statements_rule at AF475_318(??), line 1197 in "parse.c"
file_rule at AF476_324(??), line 730 in "parse.c"
_PyPegen_run_parser(p = 0x0fffffffffffcb40), line 1121 in "pegen.c"
_PyPegen_run_parser_from_string(str = "compile", start_rule = 1, filename_ob = 0x00000001100ee2b0, flags = 0x070000000007fb30, arena = 0x07000000000d3330), line 1250 in "pegen.c"
PyPegen_ASTFromStringObject(str = warning: Unable to access address 0x15d4 from core
(invalid char ptr (0x00000000000015d4)), filename = (nil), mode = 268435455, flags = 0x482448c200000000, arena = 0x00000001001a1e3c), line 27 in "peg_api.c"
Py_CompileStringObject(str = "", filename = (nil), start = 268435455, flags = 0x070000000007fb30, optimize = 268435455), line 1274 in "pythonrun.c"
builtin_compile_impl(module = 0x0000000100077a0c, source = (nil), filename = 0x0000000110000e28, mode = "", flags = 1, dont_inherit = 1, optimize = 0, feature_version = 0), line 819 in "bltinmodule.c"
builtin_compile(module = (nil), args = 0x00000001100741c0, nargs = 2, kwnames = 0x07000000000068f0), line 274 in "bltinmodule.c.h"
cfunction_vectorcall_FASTCALL_KEYWORDS(func = 0x0fffffffffffd030, args = 0x0000000000001300, nargsf = 0, kwnames = 0x0000000000000008), line 457 in "methodobject.c"
PyVectorcall_Call(callable = 0x0fffffffffffd0c0, tuple = 0x07000000000b9900, kwargs = 0x07000000000bf1c8), line 257 in "call.c"
do_call_core(tstate = 0x0000000000000001, func = 0x0000000000000002, callargs = 0x0000000000000001, kwdict = 0x00000001100741c0), line 5092 in "ceval.c"
_PyEval_EvalFrameDefault(tstate = 0x0fffffffffffd370, f = 0x07000000000aced8, throwflag = 1), line 3580 in "ceval.c"
_PyEval_EvalCode(tstate = 0x9f63fdf1699118db, _co = 0x070000000004ed80, globals = 0x07000000000754c0, locals = 0x0700000000051070, args = 0x0fffffffffffd4a0, argcount = 4765972565237396600, kwnames = 0x00000001000bb5e4, kwargs = 0x07000000000683b0, kwcount = 2, kwstep = 0, defs = (nil), defcount = 0, kwdefs = (nil), closure = (nil), name = 0x0700000000055ad0, qualname = 0x0700000000055ad0), line 40 in "pycore_ceval.h"
_PyFunction_Vectorcall(func = 0x0fffffffffffd560, stack = 0x00000001100aefa8, nargsf = 1152921504606836064, kwnames = 0x07000000000b70f0), line 413 in "call.c"
_PyEval_EvalFrameDefault(tstate = 0x000000010001c9c4, f = 0xffffffff000b99c0, throwflag = 268435455), line 621 in "abstract.h"
_PyEval_EvalCode(tstate = 0x07000000000abd00, _co = 0x0700000000080870, globals = 0x0fffffffffffd880, locals = 0x07000000000acd60, args = 0x00000001000774ac, argcount = 5990971936392823232, kwnames = 0x0fffffffffffd880, kwargs = 0x00000001100741c0, kwcount = 0, kwstep = 0, defs = (nil), defcount = 0, kwdefs = 0x070000000008ee80, closure = (nil), name = 0x0700000000080870, qualname = 0x07000000000831c0), line 40 in "pycore_ceval.h"
_PyFunction_Vectorcall(func = 0x070000000005d920, stack = 0x00000001100a7cb0, nargsf = 1152921504606837152, kwnames = 0x4224224400000000), line 413 in "call.c"
_PyEval_EvalFrameDefault(tstate = 0x0000000100079094, f = 0x00000001100741c0, throwflag = 117440512), line 621 in "abstract.h"
function_code_fastcall(tstate = 0x0700000000071790, co = 0x0700000000071788, args = 0x0fffffffffffdc00, nargs = 0, globals = (nil)), line 40 in "pycore_ceval.h"
_PyEval_EvalFrameDefault(tstate = 0x0000000100079094, f = 0x00000001100741c0, throwflag = -2147483648), line 621 in "abstract.h"
function_code_fastcall(tstate = 0x07000000000abd30, co = 0x07000000000601b0, args = 0x0000000110010150, nargs = 5198324447627075472, globals = 0x00000001000cfd9c), line 40 in "pycore_ceval.h"
_PyEval_EvalFrameDefault(tstate = 0x07000000000642f8, f = 0x0000000000000001, throwflag = 0), line 621 in "abstract.h"
function_code_fastcall(tstate = 0x0700000000066326, co = 0x0700000000066310, args = 0x0700000000067200, nargs = 504403158266200968, globals = (nil)), line 40 in "pycore_ceval.h"
_PyEval_EvalFrameDefault(tstate = 0x0000000100079094, f = 0x09fffffff000d4d0, throwflag = 1), line 621 in "abstract.h"
function_code_fastcall(tstate = 0x000000007fffffff, co = 0x00000001100741c0, args = 0x0fffffffffffe2e0, nargs = 0, globals = 0x00000001000639b0), line 40 in "pycore_ceval.h"
_PyEval_EvalFrameDefault(tstate = 0x0fffffffffffe5b0, f = 0x000000011000f7b0, throwflag = 1), line 621 in "abstract.h"
function_code_fastcall(tstate = 0x0fffffffffffe540, co = 0x00000001100741c0, args = 0x00000001000775cc, nargs = 0, globals = (nil)), line 40 in "pycore_ceval.h"
object_vacall(tstate = 0x0fffffffffffe5e0, base = 0x482402c8000b98b0, callable = 0x0000000100093d1c, vargs = (nil)), line 62 in "abstract.h"
_PyObject_CallMethodIdObjArgs(obj = (nil), name = 0x000000011003f360, ... = 0x7000000000b98b0, 0x700000000050950, 0x0, 0x700000000053dc0, 0x700000000053b00, 0x700000000053bc0), line 897 in "call.c"
import_find_and_load(tstate = 0x0000000110068100, abs_name = (nil)), line 1771 in "import.c"
unnamed block in PyImport_ImportModuleLevelObject(name = 0x07000000000af090, globals = (nil), locals = 0x00000001003c75dc, fromlist = 0x000000011005ad00, level = 268435455), line 1887 in "import.c"
unnamed block in PyImport_ImportModuleLevelObject(name = 0x07000000000af090, globals = (nil), locals = 0x00000001003c75dc, fromlist = 0x000000011005ad00, level = 268435455), line 1887 in "import.c"
PyImport_ImportModuleLevelObject(name = 0x07000000000af090, globals = (nil), locals = 0x00000001003c75dc, fromlist = 0x000000011005ad00, level = 268435455), line 1887 in "import.c"
builtin___import__(self = 0x0000000100100c84, args = 0x0fffffffffffe970, kwds = 0xbadc0ffee0ddf00d), line 280 in "bltinmodule.c"
cfunction_call(func = 0x0000000100076e4c, args = 0xbadc0ffee0ddf00d, kwargs = 0x00000001100a7cb0), line 539 in "methodobject.c"
_PyObject_MakeTpCall(tstate = 0x0000000100088f74, callable = (nil), args = (nil), nargs = 4563878336, keywords = 0x0fffffffffffeaa0), line 191 in "call.c"
_PyObject_CallFunctionVa(tstate = 0x0ffffffffffffed0, callable = (nil), format = (nil), va = (nil), is_size_t = 117440512), line 60 in "abstract.h"
PyObject_CallFunction(callable = 0x0700000000050950, format = "OOOOi", ... = 0x7000000000b98b0, 0x7000000000ad400, 0x7000000000ad400, 0x700000000093580, 0x0, 0x0), line 579 in "call.c"
PyImport_Import(module_name = 0x0000000000000001), line 2088 in "import.c"
PyImport_ImportModule(name = "^O(invalid char ptr (0x0fffffffffffecf0))), line 1488 in "import.c"
PyImport_ImportModuleNoBlock(name = "^O(invalid char ptr (0x0fffffffffffedb0))), line 1506 in "import.c"
unnamed block in _PyCodecRegistry_Init(), line 1543 in "codecs.c"
_PyCodecRegistry_Init(), line 1543 in "codecs.c"
_PyCodec_Forget(encoding = ""), line 124 in "codecs.c"
init_stdio_encoding(tstate = 0x0000000000000013), line 16018 in "unicodeobject.c"
init_fs_encoding(tstate = 0x00000001100a7cb0), line 16132 in "unicodeobject.c"
_PyUnicode_InitEncodings(tstate = (nil)), line 16148 in "unicodeobject.c"
init_interp_main(tstate = (nil)), line 1009 in "pylifecycle.c"
pyinit_main(tstate = (nil)), line 1097 in "pylifecycle.c"
Py_InitializeFromConfig(config = 0x0000000110098c70), line 1141 in "pylifecycle.c"
pymain_init(args = 0x09fffffff000c9c8), line 66 in "main.c"
pymain_main(args = 0x09fffffff00009a0), line 698 in "main.c"
Py_BytesMain(argc = -1159983106, argv = 0xbadc0ffee0ddf00d), line 731 in "main.c"
python.main(argc = 0, argv = (nil)), line 15 in "python.c"
(dbx)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42309>
_______________________________________

From report at bugs.python.org  Wed Jan  6 11:46:41 2021
From: report at bugs.python.org (hai shi)
Date: Wed, 06 Jan 2021 16:46:41 +0000
Subject: [issue42842] module 'logging' has not attribute 'handlers'
In-Reply-To: <1609950616.34.0.697361127063.issue42842@roundup.psfhosted.org>
Message-ID: <1609951601.0.0.977628257991.issue42842@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
nosy: +vinay.sajip

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42842>
_______________________________________

From report at bugs.python.org  Wed Jan  6 11:52:47 2021
From: report at bugs.python.org (Julien Palard)
Date: Wed, 06 Jan 2021 16:52:47 +0000
Subject: [issue42843] What min_sphinx for Python 3.10
Message-ID: <1609951966.97.0.867485424131.issue42843@roundup.psfhosted.org>


New submission from Julien Palard <julien+python at palard.fr>:

According to [1] there's no concensus on which minimum Sphinx version we should use for Python 3.10.

"sadly" since https://github.com/python/cpython/pull/23620 which make use of a Sphinx 3.2.0 only feature, we should bump it to 3.2, but it may not work for everybody.

[1]: https://github.com/python/cpython/pull/23620#issuecomment-755420205

----------
assignee: mdk
components: Documentation
messages: 384512
nosy: mdk
priority: normal
severity: normal
status: open
title: What min_sphinx for Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42843>
_______________________________________

From report at bugs.python.org  Wed Jan  6 11:54:47 2021
From: report at bugs.python.org (Julien Palard)
Date: Wed, 06 Jan 2021 16:54:47 +0000
Subject: [issue42843] What min_sphinx for Python 3.10
In-Reply-To: <1609951966.97.0.867485424131.issue42843@roundup.psfhosted.org>
Message-ID: <1609952087.31.0.193876792058.issue42843@roundup.psfhosted.org>


Change by Julien Palard <julien+python at palard.fr>:


----------
keywords: +patch
pull_requests: +22971
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24142

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42843>
_______________________________________

From report at bugs.python.org  Wed Jan  6 12:00:12 2021
From: report at bugs.python.org (Stephen)
Date: Wed, 06 Jan 2021 17:00:12 +0000
Subject: [issue42844] Turtle Module -- "onclick" arguments enchancement
Message-ID: <1609952412.13.0.0764333219073.issue42844@roundup.psfhosted.org>


New submission from Stephen <carlson.stephen13 at gmail.com>:

I have created an enhancement in the Turtle module. When a programmer wants to have an action performed after clicking on a Turtle object, the programmer is currently unable to supply any arguments into the method that is run when "on_clicked" which is extremely limiting, especially to beginners who are looking to modify multiple objects on the screen at one time, such as in a game. I have modified the implementation of the ?on_clicked? method to be able to provide keyword arguments into the method through a dictionary that is later unpacked into the target method. Attached is an example of the benefits of this enhancement to the turtle module.

----------
components: Library (Lib)
files: on_click_arguments_example.py
messages: 384513
nosy: sc1341
priority: normal
severity: normal
status: open
title: Turtle Module -- "onclick" arguments enchancement
type: enhancement
versions: Python 3.10
Added file: https://bugs.python.org/file49723/on_click_arguments_example.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42844>
_______________________________________

From report at bugs.python.org  Wed Jan  6 12:04:03 2021
From: report at bugs.python.org (Julien Palard)
Date: Wed, 06 Jan 2021 17:04:03 +0000
Subject: [issue42843] What min_sphinx for Python 3.10
In-Reply-To: <1609951966.97.0.867485424131.issue42843@roundup.psfhosted.org>
Message-ID: <1609952643.81.0.106930491572.issue42843@roundup.psfhosted.org>


Julien Palard <julien+python at palard.fr> added the comment:

In favor of Sphinx 3 only :

- We have :no-trim-doctest-flags: which fixes https://bugs.python.org/issue36675
- backslash handing is different in Sphinx 2 and Sphinx 3: https://bugs.python.org/issue42822


In favor of keeping compatibility with Sphinx 2 :

- Some distribs may want/need to ship Python 3.10 along with Sphinx 2?

So I'm personally in favor of a full witch to Sphinx 3 with Python 3.10, but I'm open to hear everybody.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42843>
_______________________________________

From report at bugs.python.org  Wed Jan  6 12:08:08 2021
From: report at bugs.python.org (Shreyan Avigyan)
Date: Wed, 06 Jan 2021 17:08:08 +0000
Subject: [issue42845] Third Party Module Installation using pip fails in
 Python 3.10.0a3
Message-ID: <1609952888.82.0.0280575677398.issue42845@roundup.psfhosted.org>


New submission from Shreyan Avigyan <shreyan.avigyan at gmail.com>:

A few days ago, I tried installing Python 3.10.a3 for testing. After installing, I tried using the Python built-in modules, they were working fine. Then I tried going for installing third party modules using pip from the command prompt. While installing I noticed that some modules I could install perfectly but for most of the modules, they failed to install. After trying to install them, I tried looking for the full error message. After a lot of searching I found out that it is looking for Microsoft Visual C++ and couldn't find it because I haven't installed it and gave me that error. I haven't tried installing Python 3.10.0a4 yet and I don't know if it's already solved or not but this problem is continuously occurring in Python 3.10.0a3.

----------
components: Installation
messages: 384515
nosy: shreyanavigyan
priority: normal
severity: normal
status: open
title: Third Party Module Installation using pip fails in Python 3.10.0a3
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42845>
_______________________________________

From report at bugs.python.org  Wed Jan  6 12:12:03 2021
From: report at bugs.python.org (Stephen)
Date: Wed, 06 Jan 2021 17:12:03 +0000
Subject: [issue42844] Turtle Module -- "onclick" arguments enchancement
In-Reply-To: <1609952412.13.0.0764333219073.issue42844@roundup.psfhosted.org>
Message-ID: <1609953123.41.0.739689423548.issue42844@roundup.psfhosted.org>


Change by Stephen <carlson.stephen13 at gmail.com>:


----------
keywords: +patch
pull_requests: +22972
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24143

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42844>
_______________________________________

From report at bugs.python.org  Wed Jan  6 12:15:20 2021
From: report at bugs.python.org (Vinay Sajip)
Date: Wed, 06 Jan 2021 17:15:20 +0000
Subject: [issue42842] module 'logging' has not attribute 'handlers'
In-Reply-To: <1609950616.34.0.697361127063.issue42842@roundup.psfhosted.org>
Message-ID: <1609953320.53.0.170487166415.issue42842@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

This is not a bug - this is how it is supposed to work. The handlers module isn't automatically loaded; you have to import it. The basic handlers (NullHandler, StreamHandler, FileHandler) are in the logging module - additional handlers are in logging.handlers.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42842>
_______________________________________

From report at bugs.python.org  Wed Jan  6 12:22:06 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 06 Jan 2021 17:22:06 +0000
Subject: [issue42845] Third Party Module Installation using pip fails in
 Python 3.10.0a3
In-Reply-To: <1609952888.82.0.0280575677398.issue42845@roundup.psfhosted.org>
Message-ID: <1609953726.43.0.385011625759.issue42845@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

This is expected -- those modules contain C extensions for which no 3.10 wheels are available from PyPI yet, so pip tries to build them locally.

If you want to help testing, please install the recommended free version of the MS C++ compiler.  From CPython/PCbuild/readme.txt:

1.  Install Microsoft Visual Studio 2017 with Python workload and
    Python native development component.

----------
nosy: +gvanrossum
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42845>
_______________________________________

From report at bugs.python.org  Wed Jan  6 12:30:15 2021
From: report at bugs.python.org (Vinay Sajip)
Date: Wed, 06 Jan 2021 17:30:15 +0000
Subject: [issue38780] SysLogHandler crash atexit
In-Reply-To: <1573579569.01.0.575609345468.issue38780@roundup.psfhosted.org>
Message-ID: <1609954215.84.0.324277608336.issue38780@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

TBH as I said in the now-closed PR, using a NullSocket seems overkill. As mentioned in msg359594, it seems to make more sense to assign a socket attribute to None early in the constructor. If an error occurs during socket creation, the socket attribute will remain at None. When closing, just ensure the socket attribute isn't None before trying to close it. This mirrors what SocketHandler does.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38780>
_______________________________________

From report at bugs.python.org  Wed Jan  6 12:31:28 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 06 Jan 2021 17:31:28 +0000
Subject: [issue42841] Add bitwise or operator to collections.abc Mapping and
 MutableMapping
In-Reply-To: <1609946846.04.0.311249244168.issue42841@roundup.psfhosted.org>
Message-ID: <1609954288.61.0.114172874393.issue42841@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

This was discussed during the PEP review and rejected. The main reason is that this operator would need to create a new instance, and there is no standard API that's part of the Mapping protocol that can be used (the constructor of a Mapping instance might have unknown parameters).

----------
nosy: +gvanrossum
resolution:  -> wont fix
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42841>
_______________________________________

From report at bugs.python.org  Wed Jan  6 12:32:44 2021
From: report at bugs.python.org (Alan Robertson)
Date: Wed, 06 Jan 2021 17:32:44 +0000
Subject: [issue38780] SysLogHandler crash atexit
In-Reply-To: <1609954215.84.0.324277608336.issue38780@roundup.psfhosted.org>
Message-ID: <6dcf18fe-665e-4ba6-9e6d-79d50d3b9031@www.fastmail.com>


Alan Robertson <alanr at unix.sh> added the comment:

On Wed, Jan 6, 2021, at 10:30 AM, Vinay Sajip wrote:
> 
> Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:
> 
> TBH as I said in the now-closed PR, using a NullSocket seems overkill. 
> As mentioned in msg359594, it seems to make more sense to assign a 
> socket attribute to None early in the constructor. If an error occurs 
> during socket creation, the socket attribute will remain at None. When 
> closing, just ensure the socket attribute isn't None before trying to 
> close it. This mirrors what SocketHandler does.
> 
> ----------
> 
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue38780>
> _______________________________________
>

-- 
  Alan Robertson
  alanr at unix.sh

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38780>
_______________________________________

From report at bugs.python.org  Wed Jan  6 12:34:18 2021
From: report at bugs.python.org (Alan Robertson)
Date: Wed, 06 Jan 2021 17:34:18 +0000
Subject: [issue38780] SysLogHandler crash atexit
In-Reply-To: <1609954215.84.0.324277608336.issue38780@roundup.psfhosted.org>
Message-ID: <ca537c5e-59ba-4100-9882-620a4422ecb3@www.fastmail.com>


Alan Robertson <alanr at unix.sh> added the comment:

As far as I know, this only happens during shutdown. During shutdown it has already removed the attribute as part of the teardown process. In this case adding the attribute at the begining will do no good.

On Wed, Jan 6, 2021, at 10:30 AM, Vinay Sajip wrote:
> 
> Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:
> 
> TBH as I said in the now-closed PR, using a NullSocket seems overkill. 
> As mentioned in msg359594, it seems to make more sense to assign a 
> socket attribute to None early in the constructor. If an error occurs 
> during socket creation, the socket attribute will remain at None. When 
> closing, just ensure the socket attribute isn't None before trying to 
> close it. This mirrors what SocketHandler does.
> 
> ----------
> 
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue38780>
> _______________________________________
>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38780>
_______________________________________

From report at bugs.python.org  Wed Jan  6 12:36:24 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 06 Jan 2021 17:36:24 +0000
Subject: [issue42840] `type` takes **kwargs for __init_subclass__
In-Reply-To: <1609946481.51.0.225785046936.issue42840@roundup.psfhosted.org>
Message-ID: <1609954584.36.0.551784057645.issue42840@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

That sounds intentional to me (else the class statement would have a capability that cannot be dynamically emulated by calling type()).

We should probably update the docs (if you could submit a small PR that would be appreciated) and also typeshed (ditto).

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42840>
_______________________________________

From report at bugs.python.org  Wed Jan  6 12:36:30 2021
From: report at bugs.python.org (Brandt Bucher)
Date: Wed, 06 Jan 2021 17:36:30 +0000
Subject: [issue42841] Add bitwise or operator to collections.abc Mapping and
 MutableMapping
In-Reply-To: <1609946846.04.0.311249244168.issue42841@roundup.psfhosted.org>
Message-ID: <1609954590.13.0.0821077827987.issue42841@roundup.psfhosted.org>


Brandt Bucher <brandtbucher at gmail.com> added the comment:

(Also, it would break virtual subclasses.)

----------
nosy: +brandtbucher

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42841>
_______________________________________

From report at bugs.python.org  Wed Jan  6 12:37:45 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 06 Jan 2021 17:37:45 +0000
Subject: [issue42839] SourceFileLoader does not (fully) accept path-like
 objects
In-Reply-To: <1609943532.78.0.260162878801.issue42839@roundup.psfhosted.org>
Message-ID: <1609954665.83.0.714840897511.issue42839@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Maybe Brett can help?

----------
nosy: +brett.cannon, gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42839>
_______________________________________

From report at bugs.python.org  Wed Jan  6 12:42:30 2021
From: report at bugs.python.org (miss-islington)
Date: Wed, 06 Jan 2021 17:42:30 +0000
Subject: [issue42811] Update docs for importlib.util.resolve_name() to use
 __spec__.parent instead of __package__
In-Reply-To: <1609619279.01.0.578638244778.issue42811@roundup.psfhosted.org>
Message-ID: <1609954950.87.0.68451237696.issue42811@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 2.0 -> 3.0
pull_requests: +22973
pull_request: https://github.com/python/cpython/pull/24144

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42811>
_______________________________________

From report at bugs.python.org  Wed Jan  6 12:42:33 2021
From: report at bugs.python.org (miss-islington)
Date: Wed, 06 Jan 2021 17:42:33 +0000
Subject: [issue42811] Update docs for importlib.util.resolve_name() to use
 __spec__.parent instead of __package__
In-Reply-To: <1609619279.01.0.578638244778.issue42811@roundup.psfhosted.org>
Message-ID: <1609954953.47.0.99426343472.issue42811@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset ff8458b918050168acda1ad6d079f52b8effa821 by Yair Frid in branch 'master':
bpo-42811: Update importlib.utils.resolve_name() docs to use __spec__.parent (GH-24100)
https://github.com/python/cpython/commit/ff8458b918050168acda1ad6d079f52b8effa821


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42811>
_______________________________________

From report at bugs.python.org  Wed Jan  6 12:42:44 2021
From: report at bugs.python.org (Brett Cannon)
Date: Wed, 06 Jan 2021 17:42:44 +0000
Subject: [issue42811] Update docs for importlib.util.resolve_name() to use
 __spec__.parent instead of __package__
In-Reply-To: <1609619279.01.0.578638244778.issue42811@roundup.psfhosted.org>
Message-ID: <1609954964.61.0.0259374079014.issue42811@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42811>
_______________________________________

From report at bugs.python.org  Wed Jan  6 12:43:06 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 06 Jan 2021 17:43:06 +0000
Subject: [issue42115] Caching infrastructure for the evaluation loop:
 specialised opcodes
In-Reply-To: <1603336898.74.0.366564812208.issue42115@roundup.psfhosted.org>
Message-ID: <1609954986.1.0.779269343831.issue42115@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Undoubtedly -- but impact should be measured on what typical users would see, not on narrow benchmarks.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42115>
_______________________________________

From report at bugs.python.org  Wed Jan  6 12:49:54 2021
From: report at bugs.python.org (Yurii Karabas)
Date: Wed, 06 Jan 2021 17:49:54 +0000
Subject: [issue42841] Add bitwise or operator to collections.abc Mapping and
 MutableMapping
In-Reply-To: <1609946846.04.0.311249244168.issue42841@roundup.psfhosted.org>
Message-ID: <1609955394.42.0.565722655807.issue42841@roundup.psfhosted.org>


Yurii Karabas <1998uriyyo at gmail.com> added the comment:

Thanks, for the replies, didn't know about that.

Interesting thing that `collections.abc.Set` base class has implementations of `__and__`, `__or__`, `__sub__` and `__xor__` methods, it also provide `_from_iterable` class method that is used to create `Set` instance from iterable (all of those operators use this method).
```
class Set(Collection):
    ...
    @classmethod
    def _from_iterable(cls, it):
        '''Construct an instance of the class from any iterable input.

        Must override this method if the class constructor signature
        does not accept an iterable for an input.
        '''
        return cls(it)
```

Basically, my proposition was to do smth similar to `collections.abc.Mapping`, but I understand your motivation not to implement this feature.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42841>
_______________________________________

From report at bugs.python.org  Wed Jan  6 13:15:41 2021
From: report at bugs.python.org (=?utf-8?q?Miro_Hron=C4=8Dok?=)
Date: Wed, 06 Jan 2021 18:15:41 +0000
Subject: [issue42299] Remove formatter module
In-Reply-To: <1604965286.22.0.755561980419.issue42299@roundup.psfhosted.org>
Message-ID: <1609956941.48.0.389131936694.issue42299@roundup.psfhosted.org>


Miro Hron?ok <miro at hroncok.cz> added the comment:

I am confused. Why is this still online when the source was removed?

https://docs.python.org/3.10/library/formatter.html

----------
nosy: +hroncok

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42299>
_______________________________________

From report at bugs.python.org  Wed Jan  6 13:23:31 2021
From: report at bugs.python.org (Vinay Sajip)
Date: Wed, 06 Jan 2021 18:23:31 +0000
Subject: [issue38780] SysLogHandler crash atexit
In-Reply-To: <1573579569.01.0.575609345468.issue38780@roundup.psfhosted.org>
Message-ID: <1609957411.16.0.721596702202.issue38780@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

> As far as I know, this only happens during shutdown. During shutdown it has already removed the attribute as part of the teardown process. In this case adding the attribute at the begining will do no good.

Certainly, that's true - there are a number of issues that get laid at logging's door because of interpreter shutdown sometimes intersecting with asyncio, threads and error handling using logging to report, which then fails in turn because of inconsistent interpreter state during shutdown. That would then perhaps be a "wontfix" or "cantfix" because there is no good solution. But the missing socket attribute in SysLogHandler might cause other problems in the future - I'm just saying that the approach you suggested is, to me, preferable to the NullSocket approach to deal with a similar issue in this area.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38780>
_______________________________________

From report at bugs.python.org  Wed Jan  6 13:37:18 2021
From: report at bugs.python.org (Erik Soma)
Date: Wed, 06 Jan 2021 18:37:18 +0000
Subject: [issue42840] `type` takes **kwargs for __init_subclass__
In-Reply-To: <1609946481.51.0.225785046936.issue42840@roundup.psfhosted.org>
Message-ID: <1609958238.32.0.286875482035.issue42840@roundup.psfhosted.org>


Erik Soma <stillusingirc at gmail.com> added the comment:

Can do.

I have found a blurb in the 3.6 What's New that confirms it was purposeful (https://docs.python.org/3/whatsnew/3.6.html#index-37).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42840>
_______________________________________

From report at bugs.python.org  Wed Jan  6 13:41:54 2021
From: report at bugs.python.org (Brett Cannon)
Date: Wed, 06 Jan 2021 18:41:54 +0000
Subject: [issue42839] SourceFileLoader does not (fully) accept path-like
 objects
In-Reply-To: <1609943532.78.0.260162878801.issue42839@roundup.psfhosted.org>
Message-ID: <1609958514.19.0.558132966187.issue42839@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

importlib is probably not os.PathLike-clean due to its bootstrapping restrictions of not getting to use anything implemented in Python from 'os' (i.e. if it isn't being managed in posixmodule.c then it probably won't work).

If you follow the traceback it's trying to marshal a code object for the eventual .pyc file and failing (https://github.com/python/cpython/blob/faf49573963921033c608b4d2f398309d9f0d2b5/Lib/importlib/_bootstrap_external.py#L604). The real question is why is any unmarshallable object getting passed in the first place since that object is the code object that compile() returned.

Best guess? The compile() function is being given the path-like object (via https://github.com/python/cpython/blob/faf49573963921033c608b4d2f398309d9f0d2b5/Lib/importlib/_bootstrap_external.py#L848) and it's blindly setting it on the code object itself, and then marhsal fails since it can't handle pathlib.Path. If my hunch is right, then the possible solutions are:

- Don't do that ?
- Make compile() aware of path-like objects
- Have importlib explicitly work around compile()'s shortcoming by doing the right thing for path-like objects before passing in the the 'path' argument.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42839>
_______________________________________

From report at bugs.python.org  Wed Jan  6 13:46:31 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 06 Jan 2021 18:46:31 +0000
Subject: [issue42839] SourceFileLoader does not (fully) accept path-like
 objects
In-Reply-To: <1609943532.78.0.260162878801.issue42839@roundup.psfhosted.org>
Message-ID: <1609958791.29.0.0954200109486.issue42839@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

If Brett's theory is right, compile() has a bug though -- it shouldn't plug a non-string into the code object. Or possibly the code object constructor should reject such objects (or extract the string).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42839>
_______________________________________

From report at bugs.python.org  Wed Jan  6 14:00:05 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 06 Jan 2021 19:00:05 +0000
Subject: [issue42840] `type` takes **kwargs for __init_subclass__
In-Reply-To: <1609946481.51.0.225785046936.issue42840@roundup.psfhosted.org>
Message-ID: <1609959605.64.0.570884361823.issue42840@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Excellent!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42840>
_______________________________________

From report at bugs.python.org  Wed Jan  6 14:09:31 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 06 Jan 2021 19:09:31 +0000
Subject: [issue42115] Caching infrastructure for the evaluation loop:
 specialised opcodes
In-Reply-To: <1603336898.74.0.366564812208.issue42115@roundup.psfhosted.org>
Message-ID: <1609960171.83.0.470833854801.issue42115@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Agreed. In that regard the most standard thing that we have is the pyperformance suite, which are almost all macro benchmarks. Is also what is displayed in speed.python.org

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42115>
_______________________________________

From report at bugs.python.org  Wed Jan  6 14:26:24 2021
From: report at bugs.python.org (Vladimir Ryabtsev)
Date: Wed, 06 Jan 2021 19:26:24 +0000
Subject: [issue38413] Remove or change "Multithreading" section
In-Reply-To: <1570563042.6.0.0902531064636.issue38413@roundup.psfhosted.org>
Message-ID: <1609961184.43.0.0509762052486.issue38413@roundup.psfhosted.org>


Change by Vladimir Ryabtsev <greatvovan at gmail.com>:


----------
pull_requests: +22974
pull_request: https://github.com/python/cpython/pull/24145

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38413>
_______________________________________

From report at bugs.python.org  Wed Jan  6 14:29:22 2021
From: report at bugs.python.org (Christian Heimes)
Date: Wed, 06 Jan 2021 19:29:22 +0000
Subject: [issue42299] Remove formatter module
In-Reply-To: <1604965286.22.0.755561980419.issue42299@roundup.psfhosted.org>
Message-ID: <1609961362.11.0.757589574026.issue42299@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

https://docs.python.org/3.10/library/index.html no longer links to https://docs.python.org/3.10/library/misc.html but misc.html and formatter.html are still there. It looks like a bug in the build and update process. I bet it's not removing files.

Ee, could you take a look, please?

----------
nosy: +EWDurbin

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42299>
_______________________________________

From report at bugs.python.org  Wed Jan  6 14:31:45 2021
From: report at bugs.python.org (Ernest W. Durbin III)
Date: Wed, 06 Jan 2021 19:31:45 +0000
Subject: [issue42299] Remove formatter module
In-Reply-To: <1604965286.22.0.755561980419.issue42299@roundup.psfhosted.org>
Message-ID: <1609961505.68.0.324645727253.issue42299@roundup.psfhosted.org>


Ernest W. Durbin III <ewdurbin at gmail.com> added the comment:

Issues relating to documentation build likely need to be looked at and addressed by Julien. If it does end up being an infra issue, feel free to read me to nosy.

----------
nosy: +mdk

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42299>
_______________________________________

From report at bugs.python.org  Wed Jan  6 14:32:20 2021
From: report at bugs.python.org (Vladimir Ryabtsev)
Date: Wed, 06 Jan 2021 19:32:20 +0000
Subject: [issue38413] Remove or change "Multithreading" section
In-Reply-To: <1570563042.6.0.0902531064636.issue38413@roundup.psfhosted.org>
Message-ID: <1609961540.62.0.94601308622.issue38413@roundup.psfhosted.org>


Change by Vladimir Ryabtsev <greatvovan at gmail.com>:


----------
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.10 -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38413>
_______________________________________

From report at bugs.python.org  Wed Jan  6 14:43:14 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 06 Jan 2021 19:43:14 +0000
Subject: [issue41798] [C API] Revisit usage of the PyCapsule C API with
 multi-phase initialization API
In-Reply-To: <1600265269.2.0.881235166904.issue41798@roundup.psfhosted.org>
Message-ID: <1609962194.37.0.399254229143.issue41798@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset f22b7ca1afd98a7381a9fe9e53bd6dfa2a5eba16 by Erlend Egeberg Aasland in branch 'master':
bpo-41798: Allocate _socket module C API on the heap (GH-24126)
https://github.com/python/cpython/commit/f22b7ca1afd98a7381a9fe9e53bd6dfa2a5eba16


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41798>
_______________________________________

From report at bugs.python.org  Wed Jan  6 14:47:27 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 06 Jan 2021 19:47:27 +0000
Subject: [issue41798] [C API] Revisit usage of the PyCapsule C API with
 multi-phase initialization API
In-Reply-To: <1600265269.2.0.881235166904.issue41798@roundup.psfhosted.org>
Message-ID: <1609962447.27.0.3998275067.issue41798@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 1ab045933b90d1954af983cc08d1bf0bc46b6240 by Hai Shi in branch 'master':
bpo-41798: Allocate the _datetime.datetime_CAPI on the heap memory (GH-24096)
https://github.com/python/cpython/commit/1ab045933b90d1954af983cc08d1bf0bc46b6240


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41798>
_______________________________________

From report at bugs.python.org  Wed Jan  6 15:53:30 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 06 Jan 2021 20:53:30 +0000
Subject: [issue40601] [C API] Hide static types from the limited C API
In-Reply-To: <1589235805.82.0.0888479979707.issue40601@roundup.psfhosted.org>
Message-ID: <1609966410.74.0.130516915727.issue40601@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

PC/python3dll.c exports 66 types in the stable ABI:

Py_GenericAliasType
PyObject_Type
_PyWeakref_CallableProxyType
_PyWeakref_ProxyType
_PyWeakref_RefType
PyBaseObject_Type
PyBool_Type
PyByteArray_Type
PyByteArrayIter_Type
PyBytes_Type
PyBytesIter_Type
PyCallIter_Type
PyCapsule_Type
PyCFunction_Type
PyClassMethodDescr_Type
PyComplex_Type
PyDict_Type
PyDictItems_Type
PyDictIterItem_Type
PyDictIterKey_Type
PyDictIterValue_Type
PyDictKeys_Type
PyDictProxy_Type
PyDictValues_Type
PyEllipsis_Type
PyEnum_Type
PyExc_TypeError
PyFilter_Type
PyFloat_Type
PyFrozenSet_Type
PyGetSetDescr_Type
PyList_Type
PyListIter_Type
PyListRevIter_Type
PyLong_Type
PyLongRangeIter_Type
PyMap_Type
PyMemberDescr_Type
PyMemoryView_Type
PyMethodDescr_Type
PyModule_Type
PyModuleDef_Type
PyNullImporter_Type
PyODict_Type
PyODictItems_Type
PyODictIter_Type
PyODictKeys_Type
PyODictValues_Type
PyProperty_Type
PyRange_Type
PyRangeIter_Type
PyReversed_Type
PySeqIter_Type
PySet_Type
PySetIter_Type
PySlice_Type
PySortWrapper_Type
PySuper_Type
PyTraceBack_Type
PyTuple_Type
PyTupleIter_Type
PyType_Type
PyUnicode_Type
PyUnicodeIter_Type
PyWrapperDescr_Type
PyZip_Type

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40601>
_______________________________________

From report at bugs.python.org  Wed Jan  6 15:57:43 2021
From: report at bugs.python.org (Berker Peksag)
Date: Wed, 06 Jan 2021 20:57:43 +0000
Subject: [issue38413] Remove or change "Multithreading" section
In-Reply-To: <1570563042.6.0.0902531064636.issue38413@roundup.psfhosted.org>
Message-ID: <1609966663.6.0.604011828535.issue38413@roundup.psfhosted.org>


Berker Peksag <berker.peksag at gmail.com> added the comment:


New changeset 49c150f1f16398a4e77e051244f27adc5ac7b47b by Vladimir in branch '3.9':
bpo-38413: Remove outdated section about multithreading in sqlite3 (GH-23159)
https://github.com/python/cpython/commit/49c150f1f16398a4e77e051244f27adc5ac7b47b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38413>
_______________________________________

From report at bugs.python.org  Wed Jan  6 15:58:40 2021
From: report at bugs.python.org (Berker Peksag)
Date: Wed, 06 Jan 2021 20:58:40 +0000
Subject: [issue38413] Remove or change "Multithreading" section
In-Reply-To: <1570563042.6.0.0902531064636.issue38413@roundup.psfhosted.org>
Message-ID: <1609966720.55.0.334968361625.issue38413@roundup.psfhosted.org>


Change by Berker Peksag <berker.peksag at gmail.com>:


----------
resolution:  -> fixed
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38413>
_______________________________________

From report at bugs.python.org  Wed Jan  6 17:38:22 2021
From: report at bugs.python.org (neonene)
Date: Wed, 06 Jan 2021 22:38:22 +0000
Subject: [issue42846] Using _multibytecodec module on Windows,
 test_threading/embed get failure
Message-ID: <1609972702.01.0.789985510588.issue42846@roundup.psfhosted.org>


New submission from neonene <nicesalmon at gmail.com>:

After https://github.com/python/cpython/commit/0b858cdd5d114f0890b11b6c4d6559d0ceb468ab
(bpo-1635741: Convert _multibytecodec to multi-phase init),

On Windows x64/x86 with chinese/japanese/korean system-locale,
MultibyteCodec_Check() in multibytecodec.c returns false and
PyExc_TypeError follows. This affects some tests and PGO training.



1) python -m test --verbose test_threading

======================================================================
FAIL: test_daemon_threads_fatal_error (test.test_threading.SubinterpThreadi
ngTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "C:\cpython-0b858\lib\test\test_threading.py", line 1124, in test_da
emon_threads_fatal_error
    self.assertIn("Fatal Python error: Py_EndInterpreter: "
AssertionError: 'Fatal Python error: Py_EndInterpreter: not the last thread
' not found in 'TypeError: codec is unexpected type\nFatal Python error: _P
yThreadState_Delete: tstate 00000000003FF980 is still current\nPython runti
me state: initialized\n\nThread 0x00000710 (most recent call first):\n<no P
ython frame>\n'



2) python -m test --verbose test_embed

======================================================================
FAIL: test_audit_subinterpreter (test.test_embed.AuditingTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "C:\cpython-0b858\lib\test\test_embed.py", line 1433, in test_audit_
subinterpreter
    self.run_embedded_interpreter("test_audit_subinterpreter")
  File "C:\cpython-0b858\lib\test\test_embed.py", line 104, in run_embedded
_interpreter
    self.assertEqual(p.returncode, returncode,
AssertionError: 3221225477 != 0 : bad returncode 3221225477, stderr is 'Typ
eError: codec is unexpected type\nFatal Python error: _PyThreadState_Delete
: tstate 000000000050CAF0 is still current\nPython runtime state: initializ
ed\n\nThread 0x000009d8 (most recent call first):\n<no Python frame>\n'

======================================================================
FAIL: test_subinterps_different_ids (test.test_embed.EmbeddingTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "C:\cpython-0b858\lib\test\test_embed.py", line 169, in test_subinte
rps_different_ids
    for run in self.run_repeated_init_and_subinterpreters():
  File "C:\cpython-0b858\lib\test\test_embed.py", line 110, in run_repeated
_init_and_subinterpreters
    out, err = self.run_embedded_interpreter("test_repeated_init_and_subint
erpreters")
  File "C:\cpython-0b858\lib\test\test_embed.py", line 104, in run_embedded
_interpreter
    self.assertEqual(p.returncode, returncode,
AssertionError: 3221225477 != 0 : bad returncode 3221225477, stderr is 'Typ
eError: codec is unexpected type\nFatal Python error: _PyThreadState_Delete
: tstate 000000000041C960 is still current\nPython runtime state: initializ
ed\n\nThread 0x00000a40 (most recent call first):\n<no Python frame>\n'

======================================================================
FAIL: test_subinterps_distinct_state (test.test_embed.EmbeddingTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "C:\cpython-0b858\lib\test\test_embed.py", line 177, in test_subinte
rps_distinct_state
    for run in self.run_repeated_init_and_subinterpreters():
  File "C:\cpython-0b858\lib\test\test_embed.py", line 110, in run_repeated
_init_and_subinterpreters
    out, err = self.run_embedded_interpreter("test_repeated_init_and_subint
erpreters")
  File "C:\cpython-0b858\lib\test\test_embed.py", line 104, in run_embedded
_interpreter
    self.assertEqual(p.returncode, returncode,
AssertionError: 3221225477 != 0 : bad returncode 3221225477, stderr is 'Typ
eError: codec is unexpected type\nFatal Python error: _PyThreadState_Delete
: tstate 000000000047C960 is still current\nPython runtime state: initializ
ed\n\nThread 0x00000b34 (most recent call first):\n<no Python frame>\n'

======================================================================
FAIL: test_subinterps_main (test.test_embed.EmbeddingTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "C:\cpython-0b858\lib\test\test_embed.py", line 163, in test_subinte
rps_main
    for run in self.run_repeated_init_and_subinterpreters():
  File "C:\cpython-0b858\lib\test\test_embed.py", line 110, in run_repeated
_init_and_subinterpreters
    out, err = self.run_embedded_interpreter("test_repeated_init_and_subint
erpreters")
  File "C:\cpython-0b858\lib\test\test_embed.py", line 104, in run_embedded
_interpreter
    self.assertEqual(p.returncode, returncode,
AssertionError: 3221225477 != 0 : bad returncode 3221225477, stderr is 'Typ
eError: codec is unexpected type\nFatal Python error: _PyThreadState_Delete
: tstate 000000000032C960 is still current\nPython runtime state: initializ
ed\n\nThread 0x00000bf0 (most recent call first):\n<no Python frame>\n'

----------
components: Extension Modules, Subinterpreters, Tests, Windows
messages: 384541
nosy: corona10, erlendaasland, neonene, paul.moore, petr.viktorin, shihai1991, steve.dower, tim.golden, vstinner, zach.ware
priority: normal
severity: normal
status: open
title: Using _multibytecodec module on Windows, test_threading/embed get failure
type: behavior
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42846>
_______________________________________

From report at bugs.python.org  Wed Jan  6 18:37:55 2021
From: report at bugs.python.org (Vladimir Ryabtsev)
Date: Wed, 06 Jan 2021 23:37:55 +0000
Subject: [issue42179] Clarify chaining exceptions in tutorial/errors.rst
In-Reply-To: <1603873891.9.0.500762071742.issue42179@roundup.psfhosted.org>
Message-ID: <1609976275.32.0.753919665812.issue42179@roundup.psfhosted.org>


Vladimir Ryabtsev <greatvovan at gmail.com> added the comment:

The issue won't be fixed, but other useful changes applied.

----------
resolution:  -> wont fix
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42179>
_______________________________________

From report at bugs.python.org  Wed Jan  6 18:41:04 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Wed, 06 Jan 2021 23:41:04 +0000
Subject: [issue42847] Normalise file encodings in Lib/sqlite3/test/
Message-ID: <1609976464.16.0.541873091964.issue42847@roundup.psfhosted.org>


New submission from Erlend Egeberg Aasland <erlend.aasland at innova.no>:

GitHub does not play well with other file encodings than UTF-8. For example, when the "suggestion" in https://github.com/python/cpython/pull/20538#discussion_r552926126 was applied, GitHub silently converted Lib/sqlite3/test/types.py from ISO-8859 to UTF-8, as seen in the resulting commit fd4f65141925f2d84e0efd17ca4b9395c171d7ba. Apart from being annoying, this created an inconsistency between the `#-*- coding: iso-8859-1 -*-` header in Lib/sqlite3/test/types.py and its actual encoding (now UTF-8).

I suggest to convert Lib/sqlite3/test/* to UTF-8 encoding for consistency.

$ file Lib/sqlite3/test/*.py
Lib/sqlite3/test/backup.py:        Python script text executable, ASCII text
Lib/sqlite3/test/dbapi.py:         Python script text executable, ISO-8859 text
Lib/sqlite3/test/dump.py:          Python script text executable, ASCII text
Lib/sqlite3/test/factory.py:       Python script text executable, ISO-8859 text
Lib/sqlite3/test/hooks.py:         Python script text executable, ISO-8859 text
Lib/sqlite3/test/regression.py:    Python script text executable, ISO-8859 text
Lib/sqlite3/test/transactions.py:  Python script text executable, ISO-8859 text
Lib/sqlite3/test/types.py:         Python script text executable, ISO-8859 text
Lib/sqlite3/test/userfunctions.py: Python script text executable, UTF-8 Unicode text

----------
components: Library (Lib)
messages: 384543
nosy: berker.peksag, erlendaasland
priority: normal
severity: normal
status: open
title: Normalise file encodings in Lib/sqlite3/test/
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42847>
_______________________________________

From report at bugs.python.org  Wed Jan  6 18:51:00 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 06 Jan 2021 23:51:00 +0000
Subject: [issue42847] Normalise file encodings in Lib/sqlite3/test/
In-Reply-To: <1609976464.16.0.541873091964.issue42847@roundup.psfhosted.org>
Message-ID: <1609977060.63.0.355311138402.issue42847@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

SGTM, the use of ISO-8859 is surely a legacy issue.

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42847>
_______________________________________

From report at bugs.python.org  Wed Jan  6 18:52:48 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Wed, 06 Jan 2021 23:52:48 +0000
Subject: [issue42847] Normalise file encodings in Lib/sqlite3/test/
In-Reply-To: <1609976464.16.0.541873091964.issue42847@roundup.psfhosted.org>
Message-ID: <1609977168.14.0.555150336501.issue42847@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

Indeed it is. I'll create a PR as soon as GH-20538 is merged.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42847>
_______________________________________

From report at bugs.python.org  Wed Jan  6 19:05:15 2021
From: report at bugs.python.org (Berker Peksag)
Date: Thu, 07 Jan 2021 00:05:15 +0000
Subject: [issue40823] Don't use obsolete unittest.makeSuite() in sqlite3 tests
In-Reply-To: <1590838553.12.0.97963003429.issue40823@roundup.psfhosted.org>
Message-ID: <1609977915.42.0.013147886075.issue40823@roundup.psfhosted.org>


Berker Peksag <berker.peksag at gmail.com> added the comment:


New changeset 849e339a925fb398be31e566c31b99ce6cdb6006 by Erlend Egeberg Aasland in branch 'master':
bpo-40823: Use loadTestsFromTestCase() iso. makeSuite() in sqlite3 tests (GH-20538)
https://github.com/python/cpython/commit/849e339a925fb398be31e566c31b99ce6cdb6006


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40823>
_______________________________________

From report at bugs.python.org  Wed Jan  6 19:05:40 2021
From: report at bugs.python.org (Berker Peksag)
Date: Thu, 07 Jan 2021 00:05:40 +0000
Subject: [issue40823] Don't use obsolete unittest.makeSuite() in sqlite3 tests
In-Reply-To: <1590838553.12.0.97963003429.issue40823@roundup.psfhosted.org>
Message-ID: <1609977940.36.0.249359447467.issue40823@roundup.psfhosted.org>


Berker Peksag <berker.peksag at gmail.com> added the comment:

Thank you!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
type:  -> enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40823>
_______________________________________

From report at bugs.python.org  Wed Jan  6 19:14:35 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Thu, 07 Jan 2021 00:14:35 +0000
Subject: [issue42847] Normalise file encodings in Lib/sqlite3/test/
In-Reply-To: <1609976464.16.0.541873091964.issue42847@roundup.psfhosted.org>
Message-ID: <1609978475.55.0.305957743373.issue42847@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
keywords: +patch
pull_requests: +22975
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24147

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42847>
_______________________________________

From report at bugs.python.org  Wed Jan  6 19:36:50 2021
From: report at bugs.python.org (Berker Peksag)
Date: Thu, 07 Jan 2021 00:36:50 +0000
Subject: [issue42847] Normalise file encodings in Lib/sqlite3/test/
In-Reply-To: <1609976464.16.0.541873091964.issue42847@roundup.psfhosted.org>
Message-ID: <1609979810.63.0.602927659531.issue42847@roundup.psfhosted.org>


Berker Peksag <berker.peksag at gmail.com> added the comment:


New changeset deab1e54ff1695cdbe87f8db3d2c382d8e78330f by Erlend Egeberg Aasland in branch 'master':
bpo-42847: Normalise Lib/sqlite3/test/* file encodings (GH-24147)
https://github.com/python/cpython/commit/deab1e54ff1695cdbe87f8db3d2c382d8e78330f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42847>
_______________________________________

From report at bugs.python.org  Wed Jan  6 19:38:06 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Thu, 07 Jan 2021 00:38:06 +0000
Subject: [issue42847] Normalise file encodings in Lib/sqlite3/test/
In-Reply-To: <1609976464.16.0.541873091964.issue42847@roundup.psfhosted.org>
Message-ID: <1609979886.27.0.117037394483.issue42847@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42847>
_______________________________________

From report at bugs.python.org  Wed Jan  6 19:40:15 2021
From: report at bugs.python.org (Berker Peksag)
Date: Thu, 07 Jan 2021 00:40:15 +0000
Subject: [issue42847] Normalise file encodings in Lib/sqlite3/test/
In-Reply-To: <1609976464.16.0.541873091964.issue42847@roundup.psfhosted.org>
Message-ID: <1609980015.24.0.363484141428.issue42847@roundup.psfhosted.org>


Berker Peksag <berker.peksag at gmail.com> added the comment:

iso-8859-1 is still commonly used in some parts of Nordic countries, but I don't see a reason not to change it here :) Thank you, Erlend!

----------
components: +Tests -Library (Lib)
type:  -> enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42847>
_______________________________________

From report at bugs.python.org  Wed Jan  6 19:56:35 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Thu, 07 Jan 2021 00:56:35 +0000
Subject: [issue10572] Move test sub-packages to Lib/test
In-Reply-To: <1290991979.58.0.262973706564.issue10572@psf.upfronthosting.co.za>
Message-ID: <1609980995.18.0.677877958394.issue10572@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
pull_requests: +22976
pull_request: https://github.com/python/cpython/pull/24148

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue10572>
_______________________________________

From report at bugs.python.org  Wed Jan  6 21:03:27 2021
From: report at bugs.python.org (Nick Coghlan)
Date: Thu, 07 Jan 2021 02:03:27 +0000
Subject: [issue42783] asyncio.sleep(0) idiom is not documented
In-Reply-To: <1609270826.19.0.331548885122.issue42783@roundup.psfhosted.org>
Message-ID: <1609985007.42.0.040085937456.issue42783@roundup.psfhosted.org>


Nick Coghlan <ncoghlan at gmail.com> added the comment:


New changeset 5c30145afb6053998e3518befff638d207047f00 by Simon Willison in branch 'master':
bpo-42783: Documentation for asyncio.sleep(0) (#24002)
https://github.com/python/cpython/commit/5c30145afb6053998e3518befff638d207047f00


----------
nosy: +ncoghlan

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42783>
_______________________________________

From report at bugs.python.org  Wed Jan  6 21:10:12 2021
From: report at bugs.python.org (asleep-cult)
Date: Thu, 07 Jan 2021 02:10:12 +0000
Subject: [issue42848] asyncio produces an unexpected traceback with recursive
 __getattribute__
Message-ID: <1609985412.09.0.749639106788.issue42848@roundup.psfhosted.org>


New submission from asleep-cult <asleep.cult at gmail.com>:

The code below produces an unexpected traceback format that makes the source of an error very hard to find, this more than likely happens in less specific situations but this is how I came across it. I'm also not sure if this is an issue with asyncio, logging or the traceback module.


import asyncio

class Bar:
    def __init__(self):
        self.y = None

class Foo:
    def __init__(self):
        self._bar = Bar()
        self.y

    def __getattribute__(self, name):
        try:
            attr = super().__getattribute__(name)
        except AttributeError as e:
            try:
                attr = self.ooops_spelled_bar_wrong.__getattribute__(name)
            except AttributeError:
                raise e
        return attr

async def foo():
    Foo()

loop = asyncio.get_event_loop()
loop.create_task(foo())
loop.run_forever()


Traceback:


Exception in default exception handler
Traceback (most recent call last):
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\asyncio\base_events.py", line 1733, in call_exception_handler    self.default_exception_handler(context)
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\asyncio\base_events.py", line 1707, in default_exception_handler
    logger.error('\n'.join(log_lines), exc_info=exc_info)
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\logging\__init__.py", line 1471, in error
    self._log(ERROR, msg, args, **kwargs)
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\logging\__init__.py", line 1585, in _log
    self.handle(record)
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\logging\__init__.py", line 1595, in handle
    self.callHandlers(record)
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\logging\__init__.py", line 1665, in callHandlers
    lastResort.handle(record)
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\logging\__init__.py", line 950, in handle
    self.emit(record)
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\logging\__init__.py", line 1081, in emit
    msg = self.format(record)
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\logging\__init__.py", line 925, in format
    return fmt.format(record)
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\logging\__init__.py", line 672, in format
    record.exc_text = self.formatException(record.exc_info)
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\logging\__init__.py", line 622, in formatException
    traceback.print_exception(ei[0], ei[1], tb, None, sio)
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\traceback.py", line 103, in print_exception
    for line in TracebackException(
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\traceback.py", line 493, in __init__
    context = TracebackException(
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\traceback.py", line 493, in __init__
    context = TracebackException(
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\traceback.py", line 493, in __init__
    context = TracebackException(
  [Previous line repeated 488 more times]
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\traceback.py", line 476, in __init__
    _seen.add(id(exc_value))
RecursionError: maximum recursion depth exceeded while calling a Python object
``` 

The code below procures the expected traceback

 
import traceback

class Bar:
    def __init__(self):
        self.y = None

class Foo:
    def __init__(self):
        self._bar = Bar()
        self.y

    def __getattribute__(self, name):
        try:
            attr = super().__getattribute__(name)
        except AttributeError as e:
            try:
                attr = self.ooops_spelled_bar_wrong.__getattribute__(name)
            except AttributeError:
                raise e
        return attr

try:
    Foo()
except:
    traceback.print_exc()


Traceback:


During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "c:/Development/test/test.py", line 15, in __getattribute__
    attr = super().__getattribute__(name)
AttributeError: 'Foo' object has no attribute 'ooops_spelled_bar_wrong'

# The part above is repeated hundreds of times

Traceback (most recent call last):
  File "c:/Development/test/test.py", line 24, in <module>
    Foo()
  File "c:/Development/test/test.py", line 11, in __init__
    self.y
  File "c:/Development/test/test.py", line 18, in __getattribute__
    attr = self.ooops_spelled_bar_wrong.__getattribute__(name)
  File "c:/Development/test/test.py", line 18, in __getattribute__
    attr = self.ooops_spelled_bar_wrong.__getattribute__(name)
  File "c:/Development/test/test.py", line 18, in __getattribute__
    attr = self.ooops_spelled_bar_wrong.__getattribute__(name)
  [Previous line repeated 992 more times]
  File "c:/Development/test/test.py", line 15, in __getattribute__
    attr = super().__getattribute__(name)
RecursionError: maximum recursion depth exceeded while calling a Python object

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "c:/Development/test/test.py", line 26, in <module>
    traceback.print_exc()
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\traceback.py", line 163, in print_exc
    print_exception(*sys.exc_info(), limit=limit, file=file, chain=chain)
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\traceback.py", line 103, in print_exception
    for line in TracebackException(
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\traceback.py", line 493, in __init__
    context = TracebackException(
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\traceback.py", line 493, in __init__
    context = TracebackException(
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\traceback.py", line 493, in __init__
    context = TracebackException(
  [Previous line repeated 495 more times]
RecursionError: maximum recursion depth exceeded

----------
components: Library (Lib)
messages: 384551
nosy: asleep-cult
priority: normal
severity: normal
status: open
title: asyncio produces an unexpected traceback with recursive __getattribute__
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42848>
_______________________________________

From report at bugs.python.org  Wed Jan  6 21:11:08 2021
From: report at bugs.python.org (Nick Coghlan)
Date: Thu, 07 Jan 2021 02:11:08 +0000
Subject: [issue42783] asyncio.sleep(0) idiom is not documented
In-Reply-To: <1609270826.19.0.331548885122.issue42783@roundup.psfhosted.org>
Message-ID: <1609985468.38.0.153962667744.issue42783@roundup.psfhosted.org>


Nick Coghlan <ncoghlan at gmail.com> added the comment:

I merged the update to the 3.10 docs, but the automated backport to 3.9 to update the online docs failed.

----------
resolution:  -> fixed
stage: patch review -> backport needed
versions: +Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42783>
_______________________________________

From report at bugs.python.org  Wed Jan  6 21:32:53 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Thu, 07 Jan 2021 02:32:53 +0000
Subject: [issue42848] asyncio produces an unexpected traceback with recursive
 __getattribute__
In-Reply-To: <1609985412.09.0.749639106788.issue42848@roundup.psfhosted.org>
Message-ID: <1609986773.79.0.741937704329.issue42848@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Is there anything specific about __getattribute__ here? Wouldn't you have the same issue for *any* function that raises RecursionError called inside an async def?

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42848>
_______________________________________

From report at bugs.python.org  Wed Jan  6 22:03:07 2021
From: report at bugs.python.org (asleep-cult)
Date: Thu, 07 Jan 2021 03:03:07 +0000
Subject: [issue42848] asyncio produces an unexpected traceback with recursive
 __getattribute__
In-Reply-To: <1609985412.09.0.749639106788.issue42848@roundup.psfhosted.org>
Message-ID: <1609988587.12.0.507831454569.issue42848@roundup.psfhosted.org>


asleep-cult <asleep.cult at gmail.com> added the comment:

I did test it with a simple recursive function but a more realistic test confirms that its not just __getattribute__ (which makes sense)

import asyncio

class Test(Exception):
    ...

def x():
    raise Test('Hello World!')

def bar():
    try:
        x()
    except Test as e:
        try:
            bar()
        except Test as e:
            raise e

async def foo():
    bar()

loop = asyncio.get_event_loop()
loop.create_task(foo())
loop.run_forever()

Traceback:

Exception in default exception handler
Traceback (most recent call last):
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\asyncio\base_events.py", line 1733, in call_exception_handler    self.default_exception_handler(context)
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\asyncio\base_events.py", line 1707, in default_exception_handler
    logger.error('\n'.join(log_lines), exc_info=exc_info)
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\logging\__init__.py", line 1471, in error
    self._log(ERROR, msg, args, **kwargs)
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\logging\__init__.py", line 1585, in _log
    self.handle(record)
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\logging\__init__.py", line 1595, in handle
    self.callHandlers(record)
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\logging\__init__.py", line 1665, in callHandlers
    lastResort.handle(record)
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\logging\__init__.py", line 950, in handle
    self.emit(record)
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\logging\__init__.py", line 1081, in emit
    msg = self.format(record)
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\logging\__init__.py", line 925, in format
    return fmt.format(record)
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\logging\__init__.py", line 672, in format
    record.exc_text = self.formatException(record.exc_info)
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\logging\__init__.py", line 622, in formatException
    traceback.print_exception(ei[0], ei[1], tb, None, sio)
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\traceback.py", line 103, in print_exception
    for line in TracebackException(
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\traceback.py", line 493, in __init__
    context = TracebackException(
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\traceback.py", line 493, in __init__
    context = TracebackException(
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\traceback.py", line 493, in __init__
    context = TracebackException(
  [Previous line repeated 488 more times]
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\traceback.py", line 476, in __init__
    _seen.add(id(exc_value))
RecursionError: maximum recursion depth exceeded while calling a Python object

The Test('Hello World') exception is suppressed entirely

try:
    bar()
except:
    traceback.print_exc()

but when running it this way the traceback looks like this:

File "c:/Development/test/test.py", line 7, in x
    raise Test('Hello World!')
RecursionError: maximum recursion depth exceeded while calling a Python object

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "c:/Development/test/test.py", line 21, in <module>
    traceback.print_exc()
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\traceback.py", line 163, in print_exc
    print_exception(*sys.exc_info(), limit=limit, file=file, chain=chain)
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\traceback.py", line 103, in print_exception
    for line in TracebackException(
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\traceback.py", line 493, in __init__
    context = TracebackException(
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\traceback.py", line 493, in __init__
    context = TracebackException(
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\traceback.py", line 493, in __init__
    context = TracebackException(
  [Previous line repeated 495 more times]
RecursionError: maximum recursion depth exceeded

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42848>
_______________________________________

From report at bugs.python.org  Wed Jan  6 22:10:25 2021
From: report at bugs.python.org (asleep-cult)
Date: Thu, 07 Jan 2021 03:10:25 +0000
Subject: [issue42848] asyncio produces an unexpected traceback with recursive
 __getattribute__
In-Reply-To: <1609985412.09.0.749639106788.issue42848@roundup.psfhosted.org>
Message-ID: <1609989025.03.0.102420466732.issue42848@roundup.psfhosted.org>


asleep-cult <asleep.cult at gmail.com> added the comment:

Didn't show enough of the traceback to show that the latter does not suppress the Test exception

Traceback (most recent call last):
  File "c:/Development/test/test.py", line 11, in bar
    x()
  File "c:/Development/test/test.py", line 7, in x
    raise Test('Hello World!')
__main__.Test: Hello World!

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "c:/Development/test/test.py", line 19, in <module>
    bar()
  File "c:/Development/test/test.py", line 14, in bar
    bar()
  File "c:/Development/test/test.py", line 14, in bar
    bar()
  File "c:/Development/test/test.py", line 14, in bar
    bar()
  [Previous line repeated 994 more times]
  File "c:/Development/test/test.py", line 11, in bar
    x()
  File "c:/Development/test/test.py", line 7, in x
    raise Test('Hello World!')
RecursionError: maximum recursion depth exceeded while calling a Python object

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "c:/Development/test/test.py", line 21, in <module>
    traceback.print_exc()
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\traceback.py", line 163, in print_exc
    print_exception(*sys.exc_info(), limit=limit, file=file, chain=chain)
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\traceback.py", line 103, in print_exception
    for line in TracebackException(
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\traceback.py", line 493, in __init__
    context = TracebackException(
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\traceback.py", line 493, in __init__
    context = TracebackException(
  File "C:\Users\User\AppData\Local\Programs\Python\Python38\lib\traceback.py", line 493, in __init__
    context = TracebackException(
  [Previous line repeated 495 more times]
RecursionError: maximum recursion depth exceeded

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42848>
_______________________________________

From report at bugs.python.org  Wed Jan  6 22:17:39 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Thu, 07 Jan 2021 03:17:39 +0000
Subject: [issue42848] asyncio produces an unexpected traceback with recursive
 __getattribute__
In-Reply-To: <1609985412.09.0.749639106788.issue42848@roundup.psfhosted.org>
Message-ID: <1609989459.04.0.852468249288.issue42848@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

The recursion error is actually inside the traceback module. The reason is that the code there calls itself recursively for each level of context. Since bar() builds up an endless chain of contexts as it calls itself recursively, that chain is very long.

Given that, do you feel comfortable trying to come up with a fix and submit a PR?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42848>
_______________________________________

From report at bugs.python.org  Wed Jan  6 22:33:06 2021
From: report at bugs.python.org (asleep-cult)
Date: Thu, 07 Jan 2021 03:33:06 +0000
Subject: [issue42848] asyncio produces an unexpected traceback with recursive
 __getattribute__
In-Reply-To: <1609985412.09.0.749639106788.issue42848@roundup.psfhosted.org>
Message-ID: <1609990386.9.0.747858551074.issue42848@roundup.psfhosted.org>


asleep-cult <asleep.cult at gmail.com> added the comment:

I'm not sure I have a deep enough understanding of how this works, so no

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42848>
_______________________________________

From report at bugs.python.org  Wed Jan  6 22:52:38 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Thu, 07 Jan 2021 03:52:38 +0000
Subject: [issue42848] asyncio produces an unexpected traceback with recursive
 __getattribute__
In-Reply-To: <1609985412.09.0.749639106788.issue42848@roundup.psfhosted.org>
Message-ID: <1609991558.64.0.556160665257.issue42848@roundup.psfhosted.org>


Guido van Rossum <gvanrossum at gmail.com> added the comment:

No problem. Riot, are you interested in this?

----------
nosy: +Guido.van.Rossum, iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42848>
_______________________________________

From report at bugs.python.org  Wed Jan  6 22:53:22 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Thu, 07 Jan 2021 03:53:22 +0000
Subject: [issue42848] asyncio produces an unexpected traceback with recursive
 __getattribute__
In-Reply-To: <1609985412.09.0.749639106788.issue42848@roundup.psfhosted.org>
Message-ID: <1609991602.48.0.503970049942.issue42848@roundup.psfhosted.org>


Guido van Rossum <gvanrossum at gmail.com> added the comment:

I meant Irit. Silly autocorrect.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42848>
_______________________________________

From report at bugs.python.org  Wed Jan  6 23:00:06 2021
From: report at bugs.python.org (Zhesi Huang)
Date: Thu, 07 Jan 2021 04:00:06 +0000
Subject: [issue42849] pool worker can't be terminated
Message-ID: <1609992006.83.0.897606551243.issue42849@roundup.psfhosted.org>


New submission from Zhesi Huang <huangzhesi at gmail.com>:

i see a case, the worker proc of pool can't be terminated, i try kill -SIGTERM or -SIGINT, but it still can't terminated the worker proc, then the pool __exit__ will hang forever

```
class NonDaemonProcess(multiprocessing.Process):
    # https://stackoverflow.com/questions/6974695/python-process-pool-non-daemonic

    # make 'daemon' attribute always return False
    def _get_daemon(self):
        return False

    def _set_daemon(self, value):
        pass

    daemon = property(_get_daemon, _set_daemon)


def wrapper_copy_parallel(output_name, local_output_path, obs_path):
    log_thread('upload the content of [%s] outputs' % output_name)
    try:
        if os.path.exists(local_output_path):
            log_thread('%s has %d files to be uploaded' % (output_name, len(file_list)))
            
            xxxxxx

            log_thread('upload the content of [%s] outputs successfully' % output_name)
            log_thread('it can be accessed at obs path [%s]' % obs_path)
        else:
            log_thread('local output path is not found, skip upload the content of [%s] outputs' % output_name)
    except Exception as upload_exception:
        err_thread('upload the content of [%s] outputs failed: %s' % (output_name, str(upload_exception)))
        return 255

    return 0


def upload_to_s3():
    """
    upload the content of local path to s3, handle action [on_completed]
    :return:
    """
    outputs = []
    for local_output_path, (output_name, obs_path, action, _, _) in local_to_target.items():
        if action == ACTION_ON_COMPLETED:
            outputs.append((output_name, local_output_path, obs_path))

    if len(outputs) == 0:
        return 0

    with NonDaemonPool(processes=len(outputs)) as pool:
        results = pool.starmap(wrapper_copy_parallel, outputs)

    for result in results:
        if result != 0:
            return result

    return 0
```

stdout/stderr log

[ma-test Service Log][INFO][2021/01/05 03:07:49,218]: registered signal handler
[ma-test Service Log][INFO][2021/01/05 03:09:40,299]: output-handler finalizing
[ma-test Service Log][INFO][2021-01-05 03:09:40,309][NonDaemonPoolWorker-1]: child process calling self.run()
[ma-test Service Log][INFO][2021-01-05 03:09:40,311][NonDaemonPoolWorker-1]: upload the content of [] outputs
[ma-test Service Log][INFO][2021-01-05 03:09:41,331][Process-1:1]: child process calling self.run()
[ma-test Service Log][INFO][2021-01-05 03:09:41,333][Process-1:2]: child process calling self.run()
[ma-test Service Log][INFO][2021-01-05 03:09:41,338][Process-1:3]: child process calling self.run()
[ma-test Service Log][INFO][2021-01-05 03:09:41,351][Process-1:1]: process shutting down
[ma-test Service Log][INFO][2021-01-05 03:09:41,351][Process-1:1]: process exiting with exitcode 0
[ma-test Service Log][INFO][2021-01-05 03:09:41,386][Process-1:2]: process shutting down
[ma-test Service Log][INFO][2021-01-05 03:09:41,386][Process-1:2]: process exiting with exitcode 0
[ma-test Service Log][INFO][2021-01-05 03:09:41,410][Process-1:3]: process shutting down
[ma-test Service Log][INFO][2021-01-05 03:09:41,410][Process-1:3]: process exiting with exitcode 0
[ma-test Service Log][INFO][2021-01-05 03:09:41,415][NonDaemonPoolWorker-1]: upload the content of [] outputs successfully
[ma-test Service Log][INFO][2021-01-05 03:09:41,415][NonDaemonPoolWorker-1]: it can be accessed at obs path [s3://ma-test-algorancher-intel/model_evaluation/6e5746ff-2839-400a-ba93-df38311415f4/dac957b0-b43b-43e2-ab19-0b45672a7ea0/]

18 (pid) proc python stacktrace

>>>
Interrupting process at following point:
  File "/home/ma-user/runtime-scripts-v2/init-container/outputs-handler.py", line 396, in <module>
    ret_code = upload_to_obs()
  File "/home/ma-user/runtime-scripts-v2/init-container/outputs-handler.py", line 287, in upload_to_obs
    results = pool.starmap(wrapper_copy_parallel, outputs)
  File "/home/ma-user/miniconda3/lib/python3.7/multiprocessing/pool.py", line 623, in __exit__
    self.terminate()
  File "/home/ma-user/miniconda3/lib/python3.7/multiprocessing/pool.py", line 548, in terminate
    self._terminate()
  File "/home/ma-user/miniconda3/lib/python3.7/multiprocessing/util.py", line 201, in __call__
    res = self._callback(*self._args, **self._kwargs)
  File "/home/ma-user/miniconda3/lib/python3.7/multiprocessing/pool.py", line 617, in _terminate_pool
    p.join()
  File "/home/ma-user/miniconda3/lib/python3.7/multiprocessing/process.py", line 140, in join
    res = self._popen.wait(timeout)
  File "/home/ma-user/miniconda3/lib/python3.7/multiprocessing/popen_fork.py", line 48, in wait
    return self.poll(os.WNOHANG if timeout == 0.0 else 0)
  File "/home/ma-user/miniconda3/lib/python3.7/multiprocessing/popen_fork.py", line 28, in poll
    pid, sts = os.waitpid(self.pid, flag)

18 (pid) proc gdb bt

#0  0x00007f15c2c5ff7b in waitpid () from /lib/x86_64-linux-gnu/libpthread.so.0
#1  0x000055f54a8a5180 in os_waitpid_impl.isra.78 (options=0, pid=28) at /tmp/build/80754af9/python_1588882889832/work/Modules/posixmodule.c:7066
#2  os_waitpid () at /tmp/build/80754af9/python_1588882889832/work/Modules/clinic/posixmodule.c.h:3049
#3  0x000055f54a7f1b19 in _PyMethodDef_RawFastCallKeywords () at /tmp/build/80754af9/python_1588882889832/work/Objects/call.c:655
#4  0x000055f54a7f1db1 in _PyCFunction_FastCallKeywords (func=0x7f15c1f175f0, args=<optimized out>, nargs=<optimized out>, kwnames=<optimized out>)
    at /tmp/build/80754af9/python_1588882889832/work/Objects/call.c:734

28 (pid) proc python stacktrace

Interrupting process at following point:
  File "/home/ma-user/runtime-scripts-v2/init-container/outputs-handler.py", line 396, in <module>
    ret_code = upload_to_obs()
  File "/home/ma-user/runtime-scripts-v2/init-container/outputs-handler.py", line 286, in upload_to_obs
    with NonDaemonPool(processes=len(outputs)) as pool:
  File "/home/ma-user/miniconda3/lib/python3.7/multiprocessing/pool.py", line 176, in __init__
    self._repopulate_pool()
  File "/home/ma-user/miniconda3/lib/python3.7/multiprocessing/pool.py", line 241, in _repopulate_pool
    w.start()
  File "/home/ma-user/miniconda3/lib/python3.7/multiprocessing/process.py", line 112, in start
    self._popen = self._Popen(self)
  File "/home/ma-user/miniconda3/lib/python3.7/multiprocessing/context.py", line 223, in _Popen
    return _default_context.get_context().Process._Popen(process_obj)
  File "/home/ma-user/miniconda3/lib/python3.7/multiprocessing/context.py", line 277, in _Popen
    return Popen(process_obj)
  File "/home/ma-user/miniconda3/lib/python3.7/multiprocessing/popen_fork.py", line 20, in __init__
    self._launch(process_obj)
  File "/home/ma-user/miniconda3/lib/python3.7/multiprocessing/popen_fork.py", line 74, in _launch
    code = process_obj._bootstrap()
  File "/home/ma-user/miniconda3/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap
    self.run()
  File "/home/ma-user/miniconda3/lib/python3.7/multiprocessing/process.py", line 99, in run
    self._target(*self._args, **self._kwargs)
  File "/home/ma-user/miniconda3/lib/python3.7/multiprocessing/pool.py", line 110, in worker
    task = get()
  File "/home/ma-user/miniconda3/lib/python3.7/multiprocessing/queues.py", line 351, in get
    with self._rlock:
  File "/home/ma-user/miniconda3/lib/python3.7/multiprocessing/synchronize.py", line 95, in __enter__
    return self._semlock.__enter__()

28 (pid) proc gdb bt

#0  0x00007f15c2c5e827 in do_futex_wait.constprop () from /lib/x86_64-linux-gnu/libpthread.so.0
#1  0x00007f15c2c5e8d4 in __new_sem_wait_slow.constprop.0 () from /lib/x86_64-linux-gnu/libpthread.so.0
#2  0x00007f15c2c5e97a in sem_wait@@GLIBC_2.2.5 () from /lib/x86_64-linux-gnu/libpthread.so.0
#3  0x00007f15a98058b1 in semlock_acquire () at /usr/local/src/conda/python-3.7.7/Modules/_multiprocessing/semaphore.c:319
#4  0x000055f54a7f1c94 in _PyMethodDef_RawFastCallKeywords () at /tmp/build/80754af9/python_1588882889832/work/Objects/call.c:694
#5  0x000055f54a7f8aef in _PyMethodDescr_FastCallKeywords () at /tmp/build/80754af9/python_1588882889832/work/Objects/descrobject.c:288

proc list

ma-user at ma-test-eval-dac957b0-b43b-43e2-ab19-0b45672a7ea0-worker-0:/$ ps -ef
UID        PID  PPID  C STIME TTY          TIME CMD
ma-user      1     0  0 Jan05 ?        00:00:00 /bin/bash /home/ma-user/sidecar.sh
ma-user     16     1  0 Jan05 ?        00:00:00 tail -n 0 -F /home/ma-user/ma-test/log/-0---ma-platform-sidecar.log
ma-user     18     1  0 Jan05 ?        00:00:00 python /home/ma-user/runtime-scripts-v2/init-container/outputs-handler.py
ma-user     28    18  0 Jan05 ?        00:00:00 python /home/ma-user/runtime-scripts-v2/init-container/outputs-handler.py
ma-user    102     0  0 Jan05 pts/0    00:00:00 bash
ma-user    911     0  0 14:56 pts/1    00:00:00 bash
ma-user    931   911  0 14:57 pts/1    00:00:00 ps -ef
ma-user at ma-test-eval-dac957b0-b43b-43e2-ab19-0b45672a7ea0-worker-0:/$ 

28 fd

ma-user at ma-test-eval-dac957b0-b43b-43e2-ab19-0b45672a7ea0-worker-0:/$ ls -alh /proc/28/fd
total 0
dr-x------ 2 ma-user ma-group  0 Jan  6 20:23 .
dr-xr-xr-x 9 ma-user ma-group  0 Jan  5 17:27 ..
lr-x------ 1 ma-user ma-group 64 Jan  6 20:23 0 -> /dev/null
l-wx------ 1 ma-user ma-group 64 Jan  6 20:23 1 -> /home/ma-user/ma-test/log/-0---ma-platform-sidecar.log
l-wx------ 1 ma-user ma-group 64 Jan  6 20:23 2 -> /home/ma-user/ma-test/log/-0---ma-platform-sidecar.log
lr-x------ 1 ma-user ma-group 64 Jan  6 20:23 3 -> /dev/urandom
lr-x------ 1 ma-user ma-group 64 Jan  6 20:23 4 -> pipe:[952852668]
lrwx------ 1 ma-user ma-group 64 Jan  6 20:23 5 -> socket:[952857499]
lrwx------ 1 ma-user ma-group 64 Jan  6 20:23 6 -> /home/ma-user/conf/scc_logger.conf
l-wx------ 1 ma-user ma-group 64 Jan  6 20:23 7 -> pipe:[952852671]
lr-x------ 1 ma-user ma-group 64 Jan  6 20:23 8 -> /dev/null
l-wx------ 1 ma-user ma-group 64 Jan  6 20:23 9 -> pipe:[952852675]

18 fd

ma-user at ma-test-eval-dac957b0-b43b-43e2-ab19-0b45672a7ea0-worker-0:/$ ls -alh /proc/18/fd
total 0
dr-x------ 2 ma-user ma-group  0 Jan  6 20:26 .
dr-xr-xr-x 9 ma-user ma-group  0 Jan  5 03:07 ..
lr-x------ 1 ma-user ma-group 64 Jan  6 20:26 0 -> /dev/null
l-wx------ 1 ma-user ma-group 64 Jan  6 20:26 1 -> /home/ma-user/ma-test/log/-0---ma-platform-sidecar.log
l-wx------ 1 ma-user ma-group 64 Jan  6 20:26 2 -> /home/ma-user/ma-test/log/-0---ma-platform-sidecar.log
lr-x------ 1 ma-user ma-group 64 Jan  6 20:26 3 -> /dev/urandom
lr-x------ 1 ma-user ma-group 64 Jan  6 20:26 4 -> pipe:[952852668]
l-wx------ 1 ma-user ma-group 64 Jan  6 20:26 5 -> pipe:[952852668]
lr-x------ 1 ma-user ma-group 64 Jan  6 20:26 6 -> pipe:[952852671]
l-wx------ 1 ma-user ma-group 64 Jan  6 20:26 7 -> pipe:[952852671]
lr-x------ 1 ma-user ma-group 64 Jan  6 20:26 8 -> pipe:[952852675]

SIGTERM / SIGINT not work

ma-user at ma-test-eval-dac957b0-b43b-43e2-ab19-0b45672a7ea0-worker-0:/$ ps -ef 
UID        PID  PPID  C STIME TTY          TIME CMD
ma-user      1     0  0 Jan05 ?        00:00:00 /bin/bash /home/ma-user/sidecar.sh
ma-user     16     1  0 Jan05 ?        00:00:00 tail -n 0 -F /home/ma-user/ma-test/log/-0---ma-platform-sidecar.log
ma-user     18     1  0 Jan05 ?        00:00:00 python /home/ma-user/runtime-scripts-v2/init-container/outputs-handler.py
ma-user     28    18  0 Jan05 ?        00:00:00 python /home/ma-user/runtime-scripts-v2/init-container/outputs-handler.py
ma-user    102     0  0 Jan05 pts/0    00:00:00 bash
ma-user   1166     0  0 Jan06 pts/1    00:00:00 bash
ma-user   1216  1166  0 10:51 pts/1    00:00:00 ps -ef
ma-user at ma-test-eval-dac957b0-b43b-43e2-ab19-0b45672a7ea0-worker-0:/$ kill -SIGTERM 28
ma-user at ma-test-eval-dac957b0-b43b-43e2-ab19-0b45672a7ea0-worker-0:/$ 
ma-user at ma-test-eval-dac957b0-b43b-43e2-ab19-0b45672a7ea0-worker-0:/$ kill -SIGINT 28
ma-user at ma-test-eval-dac957b0-b43b-43e2-ab19-0b45672a7ea0-worker-0:/$ 
ma-user at ma-test-eval-dac957b0-b43b-43e2-ab19-0b45672a7ea0-worker-0:/$ 

finally, pool hang

----------
components: Library (Lib)
messages: 384560
nosy: huangzhesi
priority: normal
severity: normal
status: open
title: pool worker can't be terminated
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42849>
_______________________________________

From report at bugs.python.org  Thu Jan  7 00:55:30 2021
From: report at bugs.python.org (karl)
Date: Thu, 07 Jan 2021 05:55:30 +0000
Subject: [issue19683] test_minidom has many empty tests
In-Reply-To: <1385047059.66.0.790496754317.issue19683@psf.upfronthosting.co.za>
Message-ID: <1609998930.22.0.922867942603.issue19683@roundup.psfhosted.org>


karl <karl+pythonbugs at la-grange.net> added the comment:

@zach.ware 
@r.david.murray

I'm going through the source currently. 

I see that the test file is using:

class MinidomTest(unittest.TestCase):
    def confirm(self, test, testname = "Test"):
        self.assertTrue(test, testname)


Is there a specific reason to use this form instead of just directly using self.assertEqual or similar forms for new tests or reorganizing some of the tests. 


I see that it is used for example for giving a testname but

    def testAAA(self):
        dom = parseString("<abc/>")
        el = dom.documentElement
        el.setAttribute("spam", "jam2")
        self.confirm(el.toxml() == '<abc spam="jam2"/>', "testAAA")


testAAA is not specifically helping. :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19683>
_______________________________________

From report at bugs.python.org  Thu Jan  7 01:13:57 2021
From: report at bugs.python.org (Robin Scheibler)
Date: Thu, 07 Jan 2021 06:13:57 +0000
Subject: [issue42850] Process hangs when calling urllib.request in a
 multiprocessing.Process with import of sounddevice package
Message-ID: <1610000036.98.0.246954881352.issue42850@roundup.psfhosted.org>


New submission from Robin Scheibler <fakufaku at gmail.com>:

I am having an issue with using urllib in a multiprocessing.Process when the package sounddevice (https://github.com/spatialaudio/python-sounddevice) has been already imported.

The sub-process hangs upon calling urllib.request.urlopen (and methods from the requests package too).

1. If the package sounddevice is not imported, things work as expected.
2. If the package sounddevice is imported, but urllib.request.urlopen is called once prior to launching thee sub-process, then things also work as expected.

I have attached a file containing code to reproduce the issue.

I have run this example file in:
- Python 3.7.9 (conda distribution)
- Mac OS X 10.15.7

# Running the code as is reproduces the problem
> python ./test_mp_req.py
Nothing in the queue. Leave.
wait for process to terminate...
finished

# Running the code with either line 8 commented *or* line 32 uncommented
# gives the expected output
> python ./test_mp_req.py
Received https://api.github.com. Send GET request... done.
Received https://www.google.com. Send GET request... done.
https://api.github.com: ok
https://www.google.com: ok
Nothing in the queue. Leave.
wait for process to terminate...
finished

----------
components: Interpreter Core, Library (Lib), ctypes
files: test_mp_req.py
messages: 384562
nosy: fakufaku
priority: normal
severity: normal
status: open
title: Process hangs when calling urllib.request in a multiprocessing.Process with import of sounddevice package
type: crash
versions: Python 3.7
Added file: https://bugs.python.org/file49724/test_mp_req.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42850>
_______________________________________

From report at bugs.python.org  Thu Jan  7 01:39:43 2021
From: report at bugs.python.org (Mariusz Felisiak)
Date: Thu, 07 Jan 2021 06:39:43 +0000
Subject: [issue42851] Subclassing Enum with ipaddress.IPv4Network/IPv6Network
 raises TypeError.
Message-ID: <1610001583.18.0.772940964765.issue42851@roundup.psfhosted.org>


New submission from Mariusz Felisiak <felisiak.mariusz at gmail.com>:

We noticed a behavior change in Python3.10.0a4 (it works properly in Python3.10.0a3) when running Django's test suite[1]. Subclassing `enum.Enum` with `ipaddress.IPv4Network/IPv6Network` raises `TypeError`, e.g.

>>> import enum
>>> import ipaddress
>>> class NewEnum(ipaddress.IPv4Address, enum.Enum):
...     pass
... 
>>> class NewEnum(ipaddress.IPv4Network, enum.Enum):
...     pass
... 
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/local/lib/python3.10/enum.py", line 239, in __new__
    enum_class.__bases__ = enum_class.__bases__[1:] #or (object, )
  File "/usr/local/lib/python3.10/enum.py", line 483, in __setattr__
    super().__setattr__(name, value)
TypeError: __bases__ assignment: 'IPv4Network' object layout differs from '_NoInitSubclass'

It still works for `ipaddress.IPv4Address/IPv6Address`.

[1] https://github.com/django/django/blob/102d92fc09849e1a9004dd3f9a14a0ea9ca392cd/tests/model_enums/tests.py#L225-L235

----------
components: Library (Lib)
messages: 384563
nosy: barry, eli.bendersky, ethan.furman, felixxm
priority: normal
severity: normal
status: open
title: Subclassing Enum with ipaddress.IPv4Network/IPv6Network raises TypeError.
type: crash
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42851>
_______________________________________

From report at bugs.python.org  Thu Jan  7 01:47:34 2021
From: report at bugs.python.org (Xinmeng Xia)
Date: Thu, 07 Jan 2021 06:47:34 +0000
Subject: [issue42852] pprint fails in transformming non-breaking space
Message-ID: <1610002054.28.0.212080312966.issue42852@roundup.psfhosted.org>


New submission from Xinmeng Xia <xiaxm at smail.nju.edu.cn>:

"pprint" can transform unicode like "print". However, pprint fails to transform non-breaking space('\240') . See the following example:

Python 3.10.0a2 (default, Nov 24 2020, 14:18:46) 
[GCC 7.5.0] on linux
Type "help", "copyright", "credits" or "license" for more information.

Example 1(Results as expected):
---------------------------------------------------------------------
>>> import pprint
>>> print(u'\041 hello')
! hello
>>> pprint.pprint(u'\041 hello')
'! hello'

Example 2(Results not as expected):
---------------------------------------------------------------------
>>> print(u'\240 hello')
  hello
>>> pprint.pprint(u'\240 hello')
'\xa0 hello'

Expected output: the output of pprint.pprint(u'\240 hello') should be consistent with output of print(u'\240 hello')

----------
components: Unicode
messages: 384564
nosy: ezio.melotti, vstinner, xxm
priority: normal
severity: normal
status: open
title: pprint fails in transformming non-breaking space
type: behavior
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42852>
_______________________________________

From report at bugs.python.org  Thu Jan  7 03:03:09 2021
From: report at bugs.python.org (Andrew MacDonald)
Date: Thu, 07 Jan 2021 08:03:09 +0000
Subject: [issue42853] `OverflowError: signed integer is greater than maximum`
 in ssl.py for files larger than 2GB
Message-ID: <1610006589.59.0.311109371799.issue42853@roundup.psfhosted.org>


New submission from Andrew MacDonald <andrew at maccas.net>:

When attempting to read a large file (> 2GB) over HTTPS the read fails with "OverflowError: signed integer is greater than maximum".

This occurs with Python >=3.8 and I've been able to reproduce the problem with the below snippet of code on Linux, Mac OS X, and Windows (the remote file can be any HTTPS hosted file larger than 2GB, e.g. an empty file generated with `dd if=/dev/zero of=2g.img bs=1 count=0 seek=2G` will also do the job.).

```
import http.client
connection = http.client.HTTPSConnection("mirror.aarnet.edu.au")
connection.request("GET", "/pub/centos/8/isos/x86_64/CentOS-8.3.2011-x86_64-dvd1.iso")
response = connection.getresponse()
data = response.read()
```

Doing a git bisect it looks like this is the result of a change in commit d6bf6f2d0c83f0c64ce86e7b9340278627798090 (https://github.com/python/cpython/commit/d6bf6f2d0c83f0c64ce86e7b9340278627798090). Looking over the associated issue and commit message it seems like this was not an intended outcome for the change.

----------
assignee: christian.heimes
components: SSL
messages: 384565
nosy: amacd31, christian.heimes
priority: normal
severity: normal
status: open
title: `OverflowError: signed integer is greater than maximum` in ssl.py for files larger than 2GB
type: behavior
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42853>
_______________________________________

From report at bugs.python.org  Thu Jan  7 03:07:32 2021
From: report at bugs.python.org (Christian Heimes)
Date: Thu, 07 Jan 2021 08:07:32 +0000
Subject: [issue42853] `OverflowError: signed integer is greater than maximum`
 in ssl.py for files larger than 2GB
In-Reply-To: <1610006589.59.0.311109371799.issue42853@roundup.psfhosted.org>
Message-ID: <1610006852.28.0.0489959238997.issue42853@roundup.psfhosted.org>


Change by Christian Heimes <lists at cheimes.de>:


----------
assignee: christian.heimes -> methane
components: +Library (Lib) -SSL
nosy: +methane

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42853>
_______________________________________

From report at bugs.python.org  Thu Jan  7 03:15:02 2021
From: report at bugs.python.org (Christian Heimes)
Date: Thu, 07 Jan 2021 08:15:02 +0000
Subject: [issue42853] `OverflowError: signed integer is greater than maximum`
 in ssl.py for files larger than 2GB
In-Reply-To: <1610006589.59.0.311109371799.issue42853@roundup.psfhosted.org>
Message-ID: <1610007302.5.0.0628458148011.issue42853@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

I cannot lift the overflow restriction until we drop support for OpenSSL 1.0.2. The function SSL_write() and SSL_read() are limited to signed 32bit int. OpenSSL 1.1.1 has new SSL_write_ex() and SSL_read_ex() functions that support size_t. Even size_t limits the maximum value to unsigned 32bit (~4GB) on 32bit systems.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42853>
_______________________________________

From report at bugs.python.org  Thu Jan  7 03:23:09 2021
From: report at bugs.python.org (Christian Heimes)
Date: Thu, 07 Jan 2021 08:23:09 +0000
Subject: [issue42854] OpenSSL 1.1.1: use SSL_write_ex() and SSL_read_ex()
Message-ID: <1610007789.81.0.109119647565.issue42854@roundup.psfhosted.org>


New submission from Christian Heimes <lists at cheimes.de>:

SSL_read() and SSL_write() are limited to int. The new SSL_write_ex() and SSL_read_ex() APIs support size_t just like read(2) and recv(2). Also see bpo-42853.

int SSL_write_ex(SSL *s, const void *buf, size_t num, size_t *written);
int SSL_read_ex(SSL *ssl, void *buf, size_t num, size_t *readbytes);

Both functions return 1 for success or 0 for failure.

----------
assignee: christian.heimes
components: SSL
messages: 384567
nosy: christian.heimes
priority: normal
severity: normal
status: open
title: OpenSSL 1.1.1: use SSL_write_ex() and SSL_read_ex()
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42854>
_______________________________________

From report at bugs.python.org  Thu Jan  7 03:35:16 2021
From: report at bugs.python.org (Christian Heimes)
Date: Thu, 07 Jan 2021 08:35:16 +0000
Subject: [issue42854] OpenSSL 1.1.1: use SSL_write_ex() and SSL_read_ex()
In-Reply-To: <1610007789.81.0.109119647565.issue42854@roundup.psfhosted.org>
Message-ID: <1610008516.08.0.191729164419.issue42854@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

As of version 3.3.1, LibreSSL does not have SSL_write_ex() and SSL_read_ex(). The read and write functions are limited to int.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42854>
_______________________________________

From report at bugs.python.org  Thu Jan  7 03:54:20 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 07 Jan 2021 08:54:20 +0000
Subject: [issue42035] [C API] PyType_GetSlot cannot get tp_name
In-Reply-To: <1602683525.08.0.938781399322.issue42035@roundup.psfhosted.org>
Message-ID: <1610009660.69.0.418479326161.issue42035@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42035>
_______________________________________

From report at bugs.python.org  Thu Jan  7 03:56:24 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 07 Jan 2021 08:56:24 +0000
Subject: [issue42852] pprint fails in transformming non-breaking space
In-Reply-To: <1610002054.28.0.212080312966.issue42852@roundup.psfhosted.org>
Message-ID: <1610009784.31.0.343778346586.issue42852@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42852>
_______________________________________

From report at bugs.python.org  Thu Jan  7 04:23:21 2021
From: report at bugs.python.org (gaborjbernat)
Date: Thu, 07 Jan 2021 09:23:21 +0000
Subject: [issue42855] pathlib.exists on Windows raises an exception on URL
 like/bad input
Message-ID: <1610011401.69.0.814272139734.issue42855@roundup.psfhosted.org>


New submission from gaborjbernat <gaborjbernat at gmail.com>:

? py -c "from pathlib import Path; Path('http://w.org').exists()"
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "C:\Python39\lib\pathlib.py", line 1407, in exists
    self.stat()
  File "C:\Python39\lib\pathlib.py", line 1221, in stat
    return self._accessor.stat(self)
OSError: [WinError 123] The filename, directory name, or volume label syntax is incorrect: 'http:\\w.org'

The above code returns correctly False on UNIX systems.

----------
components: Windows
messages: 384569
nosy: gaborjbernat, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: pathlib.exists on Windows raises an exception on URL like/bad input
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42855>
_______________________________________

From report at bugs.python.org  Thu Jan  7 04:33:57 2021
From: report at bugs.python.org (Paul Moore)
Date: Thu, 07 Jan 2021 09:33:57 +0000
Subject: [issue42855] pathlib.exists on Windows raises an exception on URL
 like/bad input
In-Reply-To: <1610011401.69.0.814272139734.issue42855@roundup.psfhosted.org>
Message-ID: <1610012037.67.0.505495940875.issue42855@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:

It's an invalid filename so it raises an exception.

You can get the same on Unix by using an invalid filename (embedded null):

>>> from pathlib import Path
>>> Path("/usr/\0").exists()
Traceback (most recent call last):
? File "<stdin>", line 1, in <module>
? File "/usr/lib64/python3.7/pathlib.py", line 1356, in exists
? ? self.stat()
? File "/usr/lib64/python3.7/pathlib.py", line 1178, in stat
? ? return self._accessor.stat(self)
ValueError: embedded null byte

You need to be prepared for exceptions if you aren't sure you have a valid path. One thing that might be useful, I guess, is a `Path.is_valid()` function. But I don't know if all platforms have a way of asking the OS "is this a valid pathname?" So catching the exception is probably best.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42855>
_______________________________________

From report at bugs.python.org  Thu Jan  7 04:39:34 2021
From: report at bugs.python.org (gaborjbernat)
Date: Thu, 07 Jan 2021 09:39:34 +0000
Subject: [issue42855] pathlib.exists on Windows raises an exception on URL
 like/bad input
In-Reply-To: <1610011401.69.0.814272139734.issue42855@roundup.psfhosted.org>
Message-ID: <1610012374.41.0.898421684526.issue42855@roundup.psfhosted.org>


gaborjbernat <gaborjbernat at gmail.com> added the comment:

How come the link is invalid on Windows but valid on UNIX?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42855>
_______________________________________

From report at bugs.python.org  Thu Jan  7 04:45:07 2021
From: report at bugs.python.org (Paul Moore)
Date: Thu, 07 Jan 2021 09:45:07 +0000
Subject: [issue42855] pathlib.exists on Windows raises an exception on URL
 like/bad input
In-Reply-To: <1610011401.69.0.814272139734.issue42855@roundup.psfhosted.org>
Message-ID: <1610012707.76.0.167898269168.issue42855@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:

"http:" isn't a valid drive letter, I'd imagine.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42855>
_______________________________________

From report at bugs.python.org  Thu Jan  7 04:55:59 2021
From: report at bugs.python.org (Dominic Davis-Foster)
Date: Thu, 07 Jan 2021 09:55:59 +0000
Subject: [issue42855] pathlib.exists on Windows raises an exception on URL
 like/bad input
In-Reply-To: <1610011401.69.0.814272139734.issue42855@roundup.psfhosted.org>
Message-ID: <1610013359.74.0.761489517899.issue42855@roundup.psfhosted.org>


Dominic Davis-Foster <d.davis-foster at research.staffs.ac.uk> added the comment:

Paul's example with the embedded null no longer works on Python 3.8 as Path.exists returns False on ValueError (added in gh-7695)

Path.exists already ignores some Windows-specific errors, so I don't see why it shouldn't also ignore invalid paths which can't exist.

----------
nosy: +domdfcoding2

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42855>
_______________________________________

From report at bugs.python.org  Thu Jan  7 05:29:33 2021
From: report at bugs.python.org (Yair Frid)
Date: Thu, 07 Jan 2021 10:29:33 +0000
Subject: [issue42811] Update docs for importlib.util.resolve_name() to use
 __spec__.parent instead of __package__
In-Reply-To: <1609619279.01.0.578638244778.issue42811@roundup.psfhosted.org>
Message-ID: <1610015373.55.0.711916120406.issue42811@roundup.psfhosted.org>


Change by Yair Frid <fridyair at gmail.com>:


----------
pull_requests: +22977
pull_request: https://github.com/python/cpython/pull/24149

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42811>
_______________________________________

From report at bugs.python.org  Thu Jan  7 05:47:41 2021
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 07 Jan 2021 10:47:41 +0000
Subject: [issue42848] asyncio produces an unexpected traceback with recursive
 __getattribute__
In-Reply-To: <1609985412.09.0.749639106788.issue42848@roundup.psfhosted.org>
Message-ID: <1610016461.28.0.566395979866.issue42848@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Yes I'll have a look.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42848>
_______________________________________

From report at bugs.python.org  Thu Jan  7 05:54:48 2021
From: report at bugs.python.org (Mark Shannon)
Date: Thu, 07 Jan 2021 10:54:48 +0000
Subject: [issue42823] Incorrect frame.f_lineno when frame.f_trace is set
In-Reply-To: <1609777965.06.0.667792191004.issue42823@roundup.psfhosted.org>
Message-ID: <1610016888.41.0.506205302466.issue42823@roundup.psfhosted.org>


Change by Mark Shannon <mark at hotpy.org>:


----------
pull_requests: +22978
stage: resolved -> patch review
pull_request: https://github.com/python/cpython/pull/24150

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42823>
_______________________________________

From report at bugs.python.org  Thu Jan  7 06:08:12 2021
From: report at bugs.python.org (karl)
Date: Thu, 07 Jan 2021 11:08:12 +0000
Subject: [issue19683] test_minidom has many empty tests
In-Reply-To: <1385047059.66.0.790496754317.issue19683@psf.upfronthosting.co.za>
Message-ID: <1610017692.76.0.148522809597.issue19683@roundup.psfhosted.org>


karl <karl+pythonbugs at la-grange.net> added the comment:

These methods are not used anywhere in the code. 

https://github.com/python/cpython/blob/5c30145afb6053998e3518befff638d207047f00/Lib/xml/dom/minidom.py#L71-L80

What was the purpose when they were created? hmm maybe blame would give clue. Ah they were added a long time ago

https://github.com/python/cpython/commit/73678dac48e5858e40cba6d526970cba7e7c769c#diff-365c30899ded02b18a2d8f92de47af6ca213eefe7883064c8723598da600ea42R83-R88

but never used? or was it in the spirit to reserve the keyword for future use?
https://developer.mozilla.org/en-US/docs/Web/API/Node/firstChild

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19683>
_______________________________________

From report at bugs.python.org  Thu Jan  7 06:12:55 2021
From: report at bugs.python.org (karl)
Date: Thu, 07 Jan 2021 11:12:55 +0000
Subject: [issue19683] test_minidom has many empty tests
In-Reply-To: <1385047059.66.0.790496754317.issue19683@psf.upfronthosting.co.za>
Message-ID: <1610017975.97.0.753117399675.issue19683@roundup.psfhosted.org>


karl <karl+pythonbugs at la-grange.net> added the comment:

Ah no. They ARE used

through defproperty and minicompat.py

get = getattr(klass, ("_get_" + name))

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19683>
_______________________________________

From report at bugs.python.org  Thu Jan  7 06:21:06 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 07 Jan 2021 11:21:06 +0000
Subject: [issue42856] ensurepip: add configure --with-wheel-pkg-dir=PATH to
 get wheel packages from a system directory
Message-ID: <1610018466.49.0.695886938784.issue42856@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at python.org>:

The Fedora packaging policy recommends to "unbundle" bundled dependencies.

"Fedora packages SHOULD make every effort to avoid having multiple, separate, upstream projects bundled together in a single package."
https://docs.fedoraproject.org/en-US/packaging-guidelines/#bundling

The main motivation is to ease updates when fix serious vulnerabilities (less packaging work).

The ensurepip package contains bundled wheel packages of setuptools and pip:

$ ls Lib/ensurepip/_bundled/
pip-20.2.3-py2.py3-none-any.whl
setuptools-47.1.0-py3-none-any.whl

The Fedora python3 package doesn't contain the ensurepip._bundled package:

$ python3
Python 3.9.1 (default, Dec  8 2020, 00:00:00) 
>>> import ensurepip._bundled
ModuleNotFoundError: No module named 'ensurepip._bundled'

Instead, a separated RPM package python-pip-wheel provides wheel packages in /usr/share/python-wheels/ directory:

$ ls /usr/share/python-wheels/
pip-20.2.2-py2.py3-none-any.whl*
setuptools-49.1.3-py3-none-any.whl*
wheel-0.34.2-py2.py3-none-any.whl*

Fedora has a downstream patch on ensurepip (written by Miro Hron?ok) to always use /usr/share/python-wheels/:

https://src.fedoraproject.org/rpms/python3.10/blob/master/f/00189-use-rpm-wheels.patch

Fedora has packages of 9 CPython versions: 2.6, 2.7, 3.4, 3.5, 3.6, 3.7, 3.8, 3.9, 3.10.

https://developer.fedoraproject.org/tech/languages/python/multiple-pythons.html

Having a separated package for wheel packages allows us to upgrade a single package (python-pip-wheel) for setuptools/pip bugfix or security vulnerability.

--

I propose to add a new --with-wheel-pkg-dir=PATH option to the ./configure script. If used, ensurepip will only use wheel packages from this directory. Otherwise, the existing code is unchanged. In short, the behavior is unchanged, unless the option is used explicitly.

If a directory is specified but wheel packages are missing, ensurepip fails.

If the directory contains multiple wheel packages of different versions, the most recent version is used of each package.

Note: In practice, the Fedora package only provides a single wheel package of each Python module. But I propose to make the Python upstream code as generic as possible.

I'm working on a pull request to implement this.

Downstream Fedora issue: https://bugzilla.redhat.com/show_bug.cgi?id=1874803

--

Fedora (Miro) already contributed to ensurepip to make ensurepip less dependent on pip internals:

commit 88f82b2b9ea3514359cb6e3218121f75334063ac
Author: Miro Hron?ok <miro at hroncok.cz>
Date:   Tue Mar 10 22:16:28 2020 +0100

    bpo-38662: ensurepip invokes pip via runpy (GH-18901)
    
    The ensurepip module now invokes pip via the runpy module.
    Hence it is no longer tightly coupled with the internal API of the bundled
    pip version, allowing easier updates to a newer pip version both
    internally and for distributors.
    
    This way, any changes to the internal pip API won't mean ensurepip needs to be
    changed as well. Also, distributors can update their pip wheels independent on
    CPython release schedule.
    
    Co-Authored-By: Pradyun Gedam <pradyunsg at gmail.com>
    Co-Authored-By: Miro Hron?ok <miro at hroncok.cz>

This change was already related to Fedora downstream change to get wheel packages from a different directory. Fedora can use a different pip version (older or more recent) than ensurepip._bundled.

----------
components: Library (Lib)
messages: 384577
nosy: vstinner
priority: normal
severity: normal
status: open
title: ensurepip: add configure --with-wheel-pkg-dir=PATH to get wheel packages from a system directory
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42856>
_______________________________________

From report at bugs.python.org  Thu Jan  7 06:26:59 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 07 Jan 2021 11:26:59 +0000
Subject: [issue42856] ensurepip: add configure --with-wheel-pkg-dir=PATH to
 get wheel packages from a system directory
In-Reply-To: <1610018466.49.0.695886938784.issue42856@roundup.psfhosted.org>
Message-ID: <1610018819.99.0.177803695856.issue42856@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> If used, ensurepip will only use wheel packages from this directory.

An alternative is to find packages in all directories and pick the most recent version.

Example with a specified directory *and* ensurepip._bundled is available:

* wheel package directory: 

  * pip 20.2.2
  * setuptools 49.1.3
  * wheel 0.34.2

* ensurepip._bundled

  * pip 20.2.3
  * setuptools 47.1.0

Most recent versions:

* pip 20.2.3 from ensurepip._bundled
* setuptools 49.1.3 from the wheel package directory

Problem: I'm not sure that pip is fully compatible with any setuptools version.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42856>
_______________________________________

From report at bugs.python.org  Thu Jan  7 06:33:04 2021
From: report at bugs.python.org (=?utf-8?q?Miro_Hron=C4=8Dok?=)
Date: Thu, 07 Jan 2021 11:33:04 +0000
Subject: [issue42856] ensurepip: add configure --with-wheel-pkg-dir=PATH to
 get wheel packages from a system directory
In-Reply-To: <1610018466.49.0.695886938784.issue42856@roundup.psfhosted.org>
Message-ID: <1610019184.45.0.849919086122.issue42856@roundup.psfhosted.org>


Miro Hron?ok <miro at hroncok.cz> added the comment:

For simplicity, I would avoid mixing wheels from 2 different directories.

----------
nosy: +hroncok

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42856>
_______________________________________

From report at bugs.python.org  Thu Jan  7 06:42:48 2021
From: report at bugs.python.org (Mark Shannon)
Date: Thu, 07 Jan 2021 11:42:48 +0000
Subject: [issue42725] PEP 563: Should the behavior change for yield/yield
 from's
In-Reply-To: <1608730131.08.0.595189962302.issue42725@roundup.psfhosted.org>
Message-ID: <1610019768.68.0.283644061815.issue42725@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

What's the process for making a decision on whether to make 'yield' in an annotation a syntax error?

As a language change it should have a PEP, IMO.
The PEP will be short, and shouldn't need a long-winded acceptance process.
I just think that a PEP is more visible to the community than the bug tracker.

I'm happy to write the PEP.

----------
nosy: +larry

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42725>
_______________________________________

From report at bugs.python.org  Thu Jan  7 06:49:48 2021
From: report at bugs.python.org (Xinmeng Xia)
Date: Thu, 07 Jan 2021 11:49:48 +0000
Subject: [issue42857] Fails to construct paths lead to "python is likely
 shutting down"
Message-ID: <1610020188.09.0.60258603326.issue42857@roundup.psfhosted.org>


New submission from Xinmeng Xia <xiaxm at smail.nju.edu.cn>:

The attached file "test_zipfile.py" is from test directory in cPython. We delete irrelevant code. Running this code on Python 3.10 will lead to the following error messages.
----------------------------------------------------------------------------------------
Exception ignored in: <generator object temp_dir at 0x7f13f30ff2e0>
Traceback (most recent call last):
  File "/usr/local/python310/lib/python3.10/test/support/os_helper.py", line 401, in temp_dir
  File "/usr/local/python310/lib/python3.10/test/support/os_helper.py", line 358, in rmtree
  File "/usr/local/python310/lib/python3.10/test/support/os_helper.py", line 322, in _rmtree
ImportError: sys.meta_path is None, Python is likely shutting down
Exception ignored in: <generator object temp_dir at 0x7f13f30bd5f0>
Traceback (most recent call last):
  File "/usr/local/python310/lib/python3.10/test/support/os_helper.py", line 401, in temp_dir
  File "/usr/local/python310/lib/python3.10/test/support/os_helper.py", line 358, in rmtree
  File "/usr/local/python310/lib/python3.10/test/support/os_helper.py", line 322, in _rmtree
ImportError: sys.meta_path is None, Python is likely shutting down
----------------------------------------------------------------------------------------
The expected output should be something like" ImportError: No module named XXX"  rather than "Python is likely shutting down"

----------
components: Interpreter Core
files: test_zipfile.py
messages: 384581
nosy: xxm
priority: normal
severity: normal
status: open
title: Fails to construct paths lead to "python is likely shutting down"
type: crash
versions: Python 3.10
Added file: https://bugs.python.org/file49725/test_zipfile.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42857>
_______________________________________

From report at bugs.python.org  Thu Jan  7 06:52:55 2021
From: report at bugs.python.org (Christian Heimes)
Date: Thu, 07 Jan 2021 11:52:55 +0000
Subject: [issue42856] ensurepip: add configure --with-wheel-pkg-dir=PATH to
 get wheel packages from a system directory
In-Reply-To: <1610018466.49.0.695886938784.issue42856@roundup.psfhosted.org>
Message-ID: <1610020375.73.0.182741763062.issue42856@roundup.psfhosted.org>


Change by Christian Heimes <lists at cheimes.de>:


----------
nosy: +christian.heimes, dstufft, ncoghlan, pradyunsg

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42856>
_______________________________________

From report at bugs.python.org  Thu Jan  7 06:54:25 2021
From: report at bugs.python.org (Xinmeng Xia)
Date: Thu, 07 Jan 2021 11:54:25 +0000
Subject: [issue42858] Incorrect return value for os.system() in recognizing
 import error
Message-ID: <1610020465.58.0.34787573132.issue42858@roundup.psfhosted.org>


New submission from Xinmeng Xia <xiaxm at smail.nju.edu.cn>:

Running attached "test_zipfile.py" on Python 3.10 will lead to the following error messages:
----------------------------------------------------------------------------------------------------
Exception ignored in: <generator object temp_dir at 0x7f13f30ff2e0>
Traceback (most recent call last):
  File "/usr/local/python310/lib/python3.10/test/support/os_helper.py", line 401, in temp_dir
  File "/usr/local/python310/lib/python3.10/test/support/os_helper.py", line 358, in rmtree
  File "/usr/local/python310/lib/python3.10/test/support/os_helper.py", line 322, in _rmtree
ImportError: sys.meta_path is None, Python is likely shutting down
Exception ignored in: <generator object temp_dir at 0x7f13f30bd5f0>
Traceback (most recent call last):
  File "/usr/local/python310/lib/python3.10/test/support/os_helper.py", line 401, in temp_dir
  File "/usr/local/python310/lib/python3.10/test/support/os_helper.py", line 358, in rmtree
  File "/usr/local/python310/lib/python3.10/test/support/os_helper.py", line 322, in _rmtree
ImportError: sys.meta_path is None, Python is likely shutting down
----------------------------------------------------------------------------------------------------

However, if we run this program with os.system, the return value is 0 instead of 256. 0 represent no fails in this running! This is obviously incorrect.

Reproduce:
=========================================
import os
scode = os.system('python310  test_zipfile.py')
print("The system code of this execution is:", scode)
=========================================

The expected output: "The system code of this execution is: 256"
The actual output: "The system code of this execution is: 0"

Version info:
>>python310 -V
Python 3.10.0a2
>>uname -v
16.04.1-Ubuntu SMP Fri Sep 13 09:56:18 UTC 2019

----------
components: Library (Lib)
files: test_zipfile.py
messages: 384582
nosy: xxm
priority: normal
severity: normal
status: open
title: Incorrect return value for os.system() in recognizing import error
versions: Python 3.10
Added file: https://bugs.python.org/file49726/test_zipfile.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42858>
_______________________________________

From report at bugs.python.org  Thu Jan  7 06:54:30 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 07 Jan 2021 11:54:30 +0000
Subject: [issue42856] ensurepip: add configure --with-wheel-pkg-dir=PATH to
 get wheel packages from a system directory
In-Reply-To: <1610018466.49.0.695886938784.issue42856@roundup.psfhosted.org>
Message-ID: <1610020470.72.0.787235285713.issue42856@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
keywords: +patch
pull_requests: +22979
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24151

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42856>
_______________________________________

From report at bugs.python.org  Thu Jan  7 06:54:53 2021
From: report at bugs.python.org (Xinmeng Xia)
Date: Thu, 07 Jan 2021 11:54:53 +0000
Subject: [issue42858] Incorrect return value for os.system() in recognizing
 import error
In-Reply-To: <1610020465.58.0.34787573132.issue42858@roundup.psfhosted.org>
Message-ID: <1610020493.82.0.896749626494.issue42858@roundup.psfhosted.org>


Change by Xinmeng Xia <xiaxm at smail.nju.edu.cn>:


----------
type:  -> compile error

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42858>
_______________________________________

From report at bugs.python.org  Thu Jan  7 06:59:56 2021
From: report at bugs.python.org (Steven D'Aprano)
Date: Thu, 07 Jan 2021 11:59:56 +0000
Subject: [issue42852] pprint fails in transformming non-breaking space
In-Reply-To: <1610002054.28.0.212080312966.issue42852@roundup.psfhosted.org>
Message-ID: <1610020796.56.0.161864241805.issue42852@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

By the way, there is no need to use the u'' prefix on strings in Python 3.

Unfortunately, I think this is a case where pprint doesn't meet your expectations. pprint is designed to print the repr of a string, while regular print prints the human-visible str:

>>> print(repr('\240 hello'))
'\xa0 hello'
>>> print('\240 hello')
? hello

Its not just non-breaking space, it also includes ASCII characters:


>>> print(repr('\01 hello'))
'\x01 hello'
>>> print('\01 hello')
 hello
>>> pprint.pprint('\01 hello')
'\x01 hello'


So this is intentional behaviour, not a bug. If you want to change the behaviour, it will probably require a re-design of the way strings are printed by the pprint module.

----------
nosy: +steven.daprano

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42852>
_______________________________________

From report at bugs.python.org  Thu Jan  7 08:04:38 2021
From: report at bugs.python.org (Eryk Sun)
Date: Thu, 07 Jan 2021 13:04:38 +0000
Subject: [issue42855] pathlib.exists on Windows raises an exception on URL
 like/bad input
In-Reply-To: <1610011401.69.0.814272139734.issue42855@roundup.psfhosted.org>
Message-ID: <1610024678.14.0.597474308116.issue42855@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> "http:" isn't a valid drive letter, I'd imagine.

It's not a valid DOS drive, but that's not the problem. "http://w.org" is parsed as a relative path. The double slashes are replaced by a single backslash, and the Windows API tries to open the path relative to a handle for the current working directory. 

The issue is handling a path component named "http:". Some filesystems such as FAT32 reserve ":" as an invalid name character. Others such as NTFS and ReFS reserve ":" as the stream delimiter [1], and "http:" is not a valid stream name. I'm on the fence about how to handle names that the OS rejects as invalid in a boolean context (e.g. exists, isfile, etc). In one sense, returning False is reasonable because an invalid name cannot exist. But on the other hand, asking whether something that's invalid exists is a nonsense question that warrants an exception. That said, the issue has already been decided multiple times in favor of returning False, so at this point that's a pattern that should be consistently supported by the standard library.

Note that a filesystem may allow ":" as name character, such as the VirtualBox shared-folder filesystem redirector. But the latter brings up yet another twist. Adding a redirector into the device stack, and thus including the MUP (multiple UNC provider) device, brings along more path-parsing baggage. In this case a component name with ":" in it fails as bad syntax, which gets mapped to WinAPI ERROR_BAD_PATHNAME (161), and thus C ENOENT, and ultimately FileNotFoundError in Python. This is the case regardless of the filesystem. For example, let's use the SMB redirector to set the "//localhost/C$" share for the "C:" drive as the working directory:

    >>> os.chdir('//localhost/C$')
    >>> os.stat('http://w.org')
    Traceback (most recent call last):
      File "<stdin>", line 1, in <module>
    FileNotFoundError: [WinError 161] The specified path is invalid: 'http://w.org'

    >>> Path('http://w.org').exists()
    False

---

[1] https://docs.microsoft.com/en-us/windows/win32/fileio/file-streams

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42855>
_______________________________________

From report at bugs.python.org  Thu Jan  7 08:15:23 2021
From: report at bugs.python.org (Paul Moore)
Date: Thu, 07 Jan 2021 13:15:23 +0000
Subject: [issue42855] pathlib.exists on Windows raises an exception on URL
 like/bad input
In-Reply-To: <1610011401.69.0.814272139734.issue42855@roundup.psfhosted.org>
Message-ID: <1610025323.27.0.257879190758.issue42855@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:

So I guess the key question then is whether Path.exists() should trap exceptions and interpret them as "does not exist" (on all platforms, although it looks like the null character case in Unix has now been fixed). Which doesn't seem unreasonable, I guess.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42855>
_______________________________________

From report at bugs.python.org  Thu Jan  7 08:38:33 2021
From: report at bugs.python.org (Barney Stratford)
Date: Thu, 07 Jan 2021 13:38:33 +0000
Subject: [issue42513] Socket.recv hangs
In-Reply-To: <1606737349.78.0.516615398151.issue42513@roundup.psfhosted.org>
Message-ID: <1610026713.71.0.463056459395.issue42513@roundup.psfhosted.org>


Barney Stratford <barney_stratford at fastmail.fm> added the comment:

The instrumented code froze today, so I'm finally able to probe the bug. Despite what that website said, it's looking like checking the return fron the poll syscall isn't the problem here. I'm probably going to close this bug report as not a bug, but want to check fully before I do so.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42513>
_______________________________________

From report at bugs.python.org  Thu Jan  7 08:43:49 2021
From: report at bugs.python.org (Christian Heimes)
Date: Thu, 07 Jan 2021 13:43:49 +0000
Subject: [issue42858] Incorrect return value for os.system() in recognizing
 import error
In-Reply-To: <1610020465.58.0.34787573132.issue42858@roundup.psfhosted.org>
Message-ID: <1610027029.82.0.84004945673.issue42858@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

The exceptions are ignored (Exception ignored in) on shutdown and therefore don't cause the interpreter to fail with an error code. Unraisable exceptions typically occur when the interpreter is mostly shut down and garbage collection, import or atexit hook is triggered as a side-effect.

----------
nosy: +christian.heimes

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42858>
_______________________________________

From report at bugs.python.org  Thu Jan  7 08:48:32 2021
From: report at bugs.python.org (karl)
Date: Thu, 07 Jan 2021 13:48:32 +0000
Subject: [issue19683] test_minidom has many empty tests
In-Reply-To: <1385047059.66.0.790496754317.issue19683@psf.upfronthosting.co.za>
Message-ID: <1610027312.59.0.238071604785.issue19683@roundup.psfhosted.org>


Change by karl <karl+pythonbugs at la-grange.net>:


----------
pull_requests: +22980
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/24152

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19683>
_______________________________________

From report at bugs.python.org  Thu Jan  7 08:59:53 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 07 Jan 2021 13:59:53 +0000
Subject: [issue42858] Incorrect return value for os.system() in recognizing
 import error
In-Reply-To: <1610020465.58.0.34787573132.issue42858@roundup.psfhosted.org>
Message-ID: <1610027993.04.0.0301047672994.issue42858@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

See also https://docs.python.org/dev/library/sys.html#sys.unraisablehook

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42858>
_______________________________________

From report at bugs.python.org  Thu Jan  7 09:35:00 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 07 Jan 2021 14:35:00 +0000
Subject: [issue42852] pprint fails in transformming non-breaking space
In-Reply-To: <1610002054.28.0.212080312966.issue42852@roundup.psfhosted.org>
Message-ID: <1610030100.91.0.61587204322.issue42852@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42852>
_______________________________________

From report at bugs.python.org  Thu Jan  7 09:35:12 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 07 Jan 2021 14:35:12 +0000
Subject: [issue42852] pprint fails in transformming non-breaking space
In-Reply-To: <1610002054.28.0.212080312966.issue42852@roundup.psfhosted.org>
Message-ID: <1610030112.21.0.178184812853.issue42852@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution: fixed -> not a bug

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42852>
_______________________________________

From report at bugs.python.org  Thu Jan  7 09:39:28 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 07 Jan 2021 14:39:28 +0000
Subject: [issue42725] PEP 563: Should the behavior change for yield/yield
 from's
In-Reply-To: <1608730131.08.0.595189962302.issue42725@roundup.psfhosted.org>
Message-ID: <1610030368.88.0.66816360282.issue42725@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Should not "await" and "async for" (in comprehesions) and ":=" be forbidden too?

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42725>
_______________________________________

From report at bugs.python.org  Thu Jan  7 09:47:44 2021
From: report at bugs.python.org (Sebastian Voigt)
Date: Thu, 07 Jan 2021 14:47:44 +0000
Subject: [issue41837] Upgrade installers to OpenSSL 1.1.1i
In-Reply-To: <1600822748.89.0.850484234677.issue41837@roundup.psfhosted.org>
Message-ID: <1610030864.99.0.0755378882301.issue41837@roundup.psfhosted.org>


Sebastian Voigt <sebastian.voigt at autodesk.com> added the comment:

The fix has only be done for 3.8, 3.9 and 3.10. Are 3.7 and 3.6 are not impacted?

----------
nosy: +squear

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41837>
_______________________________________

From report at bugs.python.org  Thu Jan  7 09:48:50 2021
From: report at bugs.python.org (Ken Jin)
Date: Thu, 07 Jan 2021 14:48:50 +0000
Subject: [issue42783] asyncio.sleep(0) idiom is not documented
In-Reply-To: <1609270826.19.0.331548885122.issue42783@roundup.psfhosted.org>
Message-ID: <1610030930.73.0.0587374080768.issue42783@roundup.psfhosted.org>


Change by Ken Jin <kenjin4096 at gmail.com>:


----------
nosy: +kj
nosy_count: 5.0 -> 6.0
pull_requests: +22981
stage: backport needed -> patch review
pull_request: https://github.com/python/cpython/pull/24153

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42783>
_______________________________________

From report at bugs.python.org  Thu Jan  7 10:06:37 2021
From: report at bugs.python.org (Ethan Furman)
Date: Thu, 07 Jan 2021 15:06:37 +0000
Subject: [issue42851] Subclassing Enum with ipaddress.IPv4Network/IPv6Network
 raises TypeError.
In-Reply-To: <1610001583.18.0.772940964765.issue42851@roundup.psfhosted.org>
Message-ID: <1610031997.25.0.900378546248.issue42851@roundup.psfhosted.org>


Ethan Furman <ethan at stoneleaf.us> added the comment:

That would be due to some changes to try and get `Enum` and `__init_subclass__` to work together.

I'll revert those changes.  Thank you for the report.

----------
assignee:  -> ethan.furman
priority: normal -> high

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42851>
_______________________________________

From report at bugs.python.org  Thu Jan  7 10:31:43 2021
From: report at bugs.python.org (Christian Heimes)
Date: Thu, 07 Jan 2021 15:31:43 +0000
Subject: [issue41837] Upgrade installers to OpenSSL 1.1.1i
In-Reply-To: <1600822748.89.0.850484234677.issue41837@roundup.psfhosted.org>
Message-ID: <1610033503.17.0.558671333041.issue41837@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

They are impacted. However 3.7.9 and 3.6.8 were the last releases with binaries for Windows and macOS. All subsequent releases are source-only releases. Since we don't release binaries for 3.6 and 3.7 any more, we typically don't update them.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41837>
_______________________________________

From report at bugs.python.org  Thu Jan  7 11:08:42 2021
From: report at bugs.python.org (Barney Stratford)
Date: Thu, 07 Jan 2021 16:08:42 +0000
Subject: [issue42513] Socket.recv hangs
In-Reply-To: <1606737349.78.0.516615398151.issue42513@roundup.psfhosted.org>
Message-ID: <1610035722.66.0.204952984923.issue42513@roundup.psfhosted.org>


Barney Stratford <barney_stratford at fastmail.fm> added the comment:

Instrumented code shows that the poll is in fact working completely correctly, and I've run into a documented edge-case in an unrelated area. Hence, closing the bug report and cancelling the pull request.

----------
resolution:  -> not a bug
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42513>
_______________________________________

From report at bugs.python.org  Thu Jan  7 11:13:41 2021
From: report at bugs.python.org (Jakub Stasiak)
Date: Thu, 07 Jan 2021 16:13:41 +0000
Subject: [issue42513] Socket.recv hangs
In-Reply-To: <1606737349.78.0.516615398151.issue42513@roundup.psfhosted.org>
Message-ID: <1610036021.68.0.383959363607.issue42513@roundup.psfhosted.org>


Jakub Stasiak <jakub+python.org at stasiak.at> added the comment:

If the edge-case is vaguely socket/file descriptor-related and not application-specific or otherwise secret do you mind sharing what is it? (I'm just curious)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42513>
_______________________________________

From report at bugs.python.org  Thu Jan  7 11:51:41 2021
From: report at bugs.python.org (Steve Dower)
Date: Thu, 07 Jan 2021 16:51:41 +0000
Subject: [issue42855] pathlib.exists on Windows raises an exception on URL
 like/bad input
In-Reply-To: <1610011401.69.0.814272139734.issue42855@roundup.psfhosted.org>
Message-ID: <1610038301.12.0.831848297329.issue42855@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Yeah, I think saying "return True if it provably exists and False if existence cannot be proven (and never raise)" is a good general rule for boolean-returning functions.

This definitely raises some edge cases where we can infer from certain error codes that a path exists, but I don't think it obliges us to prioritise fixing those in order to handle more obvious cases.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42855>
_______________________________________

From report at bugs.python.org  Thu Jan  7 11:53:45 2021
From: report at bugs.python.org (Barney Stratford)
Date: Thu, 07 Jan 2021 16:53:45 +0000
Subject: [issue42513] Socket.recv hangs
In-Reply-To: <1606737349.78.0.516615398151.issue42513@roundup.psfhosted.org>
Message-ID: <1610038425.1.0.0948556025131.issue42513@roundup.psfhosted.org>


Barney Stratford <barney_stratford at fastmail.fm> added the comment:

Sure. So, I'm using STOMP to connect to a messaging server. STOMP uses heartbeats to detect and close failed connections. The problem was that if the connection fails before the protocol has set up its heartbeats then there's nothing to stop the whole thing hanging. I had a timeout on the socket.create_connection, thinking this would protect against this edge-case, but it wasn't sufficient.

STOMP is such a simple protocol that it's often worth writing your own code to handle it. Indeed, this is actively encouraged. My own STOMP code is about 250 lines in a single source file, compared to nearly 3500 lines in 13 files for stomp.py. I very much prefer to simplify things as much as possible, and smaller is almost always better in my view. Simplify!

So, I kept seeing this very occasional hang-up in my code, and probing it with gdb showed that the execution was always stuck inside the poll. Of course it was, as that's where it sits to wait for something to happen. Then I was lead astray by finding that website, so I saddled up to save the world, as one does in such situations.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42513>
_______________________________________

From report at bugs.python.org  Thu Jan  7 12:30:44 2021
From: report at bugs.python.org (Eryk Sun)
Date: Thu, 07 Jan 2021 17:30:44 +0000
Subject: [issue42855] pathlib.exists on Windows raises an exception on URL
 like/bad input
In-Reply-To: <1610011401.69.0.814272139734.issue42855@roundup.psfhosted.org>
Message-ID: <1610040644.84.0.270003892808.issue42855@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

An alternative would be to add a "strict" parameter that defaults to False. In non-strict mode, map all OSError exceptions to a False return value. In strict mode, use _ignore_error(e) to determine whether to return False or propagate the exception. The question then is whether to add ERROR_INVALID_NAME (123) to _IGNORED_WINERRORS since the error means the name can never exist. On the other hand, ERROR_ACCESS_DENIED due to a permission error would be propagated in strict mode -- because the path's existence is unknown.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42855>
_______________________________________

From report at bugs.python.org  Thu Jan  7 13:06:22 2021
From: report at bugs.python.org (miss-islington)
Date: Thu, 07 Jan 2021 18:06:22 +0000
Subject: [issue42811] Update docs for importlib.util.resolve_name() to use
 __spec__.parent instead of __package__
In-Reply-To: <1609619279.01.0.578638244778.issue42811@roundup.psfhosted.org>
Message-ID: <1610042782.93.0.705045460173.issue42811@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 8c3914aef47e6e5a31b48a0b1f165ec3f4dc4c98 by Yair Frid in branch '3.9':
[3.9] bpo-42811: Update importlib.utils.resolve_name() docs to use __spec__.parent (GH-24100) (GH-24149)
https://github.com/python/cpython/commit/8c3914aef47e6e5a31b48a0b1f165ec3f4dc4c98


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42811>
_______________________________________

From report at bugs.python.org  Thu Jan  7 13:07:56 2021
From: report at bugs.python.org (Brett Cannon)
Date: Thu, 07 Jan 2021 18:07:56 +0000
Subject: [issue42811] Update docs for importlib.util.resolve_name() to use
 __spec__.parent instead of __package__
In-Reply-To: <1609619279.01.0.578638244778.issue42811@roundup.psfhosted.org>
Message-ID: <1610042876.91.0.493351400509.issue42811@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:


New changeset ca8e96d1edbeb536f58da91e607082463398fce1 by Miss Islington (bot) in branch '3.8':
bpo-42811: Update importlib.utils.resolve_name() docs to use __spec__.parent (GH-24100) (GH-24144)
https://github.com/python/cpython/commit/ca8e96d1edbeb536f58da91e607082463398fce1


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42811>
_______________________________________

From report at bugs.python.org  Thu Jan  7 14:28:50 2021
From: report at bugs.python.org (Dmitry Goldenberg)
Date: Thu, 07 Jan 2021 19:28:50 +0000
Subject: [issue42859] smtplib: recipe for certifying message delivery
Message-ID: <1610047730.69.0.693075661816.issue42859@roundup.psfhosted.org>


New submission from Dmitry Goldenberg <dgoldenberg123 at gmail.com>:

Is there a reliable way to certify (ensure, track) the delivery of an email message when using smtplib?

For example:
Disposition-Notification-To message header which enables the e-mail reader of the recipient to send confirmation e-mail when the recipient opens the message for the first time. That e-mail reader program must support this functionality.

Return-Receipt-To message header which enables the e-mail server of the recipient to send confirmation e-mail when the original e-mail gets received by that server. However, most newer e-mail servers do not support Return-Receipt-To header.

Are these message headers at all reliable?

The request is to enhance the documentation to provide an example of how to track a message delivery. Conversely, if it's plain not possible, the request is to state that explicitly in the docs.

----------
assignee: docs at python
components: Documentation
messages: 384600
nosy: dgoldenberg123, docs at python
priority: normal
severity: normal
status: open
title: smtplib: recipe for certifying message delivery
type: enhancement
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42859>
_______________________________________

From report at bugs.python.org  Thu Jan  7 15:31:05 2021
From: report at bugs.python.org (Ethan Furman)
Date: Thu, 07 Jan 2021 20:31:05 +0000
Subject: [issue42851] Subclassing Enum with ipaddress.IPv4Network/IPv6Network
 raises TypeError.
In-Reply-To: <1610001583.18.0.772940964765.issue42851@roundup.psfhosted.org>
Message-ID: <1610051465.74.0.51107090912.issue42851@roundup.psfhosted.org>


Change by Ethan Furman <ethan at stoneleaf.us>:


----------
keywords: +patch
pull_requests: +22982
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24154

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42851>
_______________________________________

From report at bugs.python.org  Thu Jan  7 16:01:50 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Thu, 07 Jan 2021 21:01:50 +0000
Subject: [issue42859] smtplib: recipe for certifying message delivery
In-Reply-To: <1610047730.69.0.693075661816.issue42859@roundup.psfhosted.org>
Message-ID: <1610053310.61.0.909050008145.issue42859@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

This looks more like a question than an issue.  Have you tried stackoverflow or a user forum?

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42859>
_______________________________________

From report at bugs.python.org  Thu Jan  7 16:07:44 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Thu, 07 Jan 2021 21:07:44 +0000
Subject: [issue42725] PEP 563: Should the behavior change for yield/yield
 from's
In-Reply-To: <1608730131.08.0.595189962302.issue42725@roundup.psfhosted.org>
Message-ID: <1610053664.67.0.22092570544.issue42725@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

I wouldn?t have thought you?d need a PEP for this but if you want to write one that sounds like the right thing.

Re: async and walrus: I think those are different, their presence doesn?t affect the meaning of the function like yield. We can?t hope to prevent side effects syntactically.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42725>
_______________________________________

From report at bugs.python.org  Thu Jan  7 16:09:27 2021
From: report at bugs.python.org (Tobias Kohn)
Date: Thu, 07 Jan 2021 21:09:27 +0000
Subject: [issue42860] Incompatible types in Python grammar
Message-ID: <1610053767.4.0.390149770714.issue42860@roundup.psfhosted.org>


New submission from Tobias Kohn <kohnt at tobiaskohn.ch>:

There seems to be a small type error in the Python grammar in the rule `invalid_parameters`:
```
invalid_parameters:
    | param_no_default* (slash_with_default | param_with_default+) param_no_default
```
While the `slash_with_default` returns a single element, the `param_with_default` returns a list/sequence.

----------
messages: 384603
nosy: tobias.kohn
priority: normal
severity: normal
status: open
title: Incompatible types in Python grammar
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42860>
_______________________________________

From report at bugs.python.org  Thu Jan  7 16:09:53 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Thu, 07 Jan 2021 21:09:53 +0000
Subject: [issue42858] Incorrect return value for os.system() in recognizing
 import error
In-Reply-To: <1610020465.58.0.34787573132.issue42858@roundup.psfhosted.org>
Message-ID: <1610053793.83.0.239603190485.issue42858@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42858>
_______________________________________

From report at bugs.python.org  Thu Jan  7 16:11:57 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Thu, 07 Jan 2021 21:11:57 +0000
Subject: [issue42857] Fails to construct paths lead to "python is likely
 shutting down"
In-Reply-To: <1610020188.09.0.60258603326.issue42857@roundup.psfhosted.org>
Message-ID: <1610053917.65.0.690129682152.issue42857@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

You are doing something very evil during finalization here. There?s nothing that can be done reasonably.

----------
nosy: +gvanrossum
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42857>
_______________________________________

From report at bugs.python.org  Thu Jan  7 16:18:15 2021
From: report at bugs.python.org (Ethan Furman)
Date: Thu, 07 Jan 2021 21:18:15 +0000
Subject: [issue42851] Subclassing Enum with ipaddress.IPv4Network/IPv6Network
 raises TypeError.
In-Reply-To: <1610001583.18.0.772940964765.issue42851@roundup.psfhosted.org>
Message-ID: <1610054295.78.0.801652108199.issue42851@roundup.psfhosted.org>


Ethan Furman <ethan at stoneleaf.us> added the comment:


New changeset a581a868d97f649aedf868a1d27865a10925c73a by Ethan Furman in branch 'master':
bpo-42851: [Enum] remove brittle __init_subclass__ support (GH-24154)
https://github.com/python/cpython/commit/a581a868d97f649aedf868a1d27865a10925c73a


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42851>
_______________________________________

From report at bugs.python.org  Thu Jan  7 16:25:19 2021
From: report at bugs.python.org (Ethan Furman)
Date: Thu, 07 Jan 2021 21:25:19 +0000
Subject: [issue42851] Subclassing Enum with ipaddress.IPv4Network/IPv6Network
 raises TypeError.
In-Reply-To: <1610001583.18.0.772940964765.issue42851@roundup.psfhosted.org>
Message-ID: <1610054719.06.0.349564548286.issue42851@roundup.psfhosted.org>


Change by Ethan Furman <ethan at stoneleaf.us>:


----------
pull_requests: +22983
pull_request: https://github.com/python/cpython/pull/24155

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42851>
_______________________________________

From report at bugs.python.org  Thu Jan  7 16:27:18 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Thu, 07 Jan 2021 21:27:18 +0000
Subject: [issue42850] Process hangs when calling urllib.request in a
 multiprocessing.Process with import of sounddevice package
In-Reply-To: <1610000036.98.0.246954881352.issue42850@roundup.psfhosted.org>
Message-ID: <1610054838.42.0.274825867348.issue42850@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

I would assume it?s some interaction between threads and fork. Have you asked the authors of sound device about this?

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42850>
_______________________________________

From report at bugs.python.org  Thu Jan  7 16:52:26 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Thu, 07 Jan 2021 21:52:26 +0000
Subject: [issue42846] Using _multibytecodec module on Windows,
 test_threading/embed get failure
In-Reply-To: <1609972702.01.0.789985510588.issue42846@roundup.psfhosted.org>
Message-ID: <1610056346.77.0.165498828571.issue42846@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

I'm unable to reproduce this on Windows 10 (amd64). What's your exact locale setting? Are you compiling with HEAD at 0b858cdd5d114f0890b11b6c4d6559d0ceb468ab?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42846>
_______________________________________

From report at bugs.python.org  Thu Jan  7 16:56:05 2021
From: report at bugs.python.org (Ethan Furman)
Date: Thu, 07 Jan 2021 21:56:05 +0000
Subject: [issue42851] Subclassing Enum with ipaddress.IPv4Network/IPv6Network
 raises TypeError.
In-Reply-To: <1610001583.18.0.772940964765.issue42851@roundup.psfhosted.org>
Message-ID: <1610056565.84.0.532321274272.issue42851@roundup.psfhosted.org>


Ethan Furman <ethan at stoneleaf.us> added the comment:


New changeset 9ab4dd452287169f08a8cf4d4c68c2139f8de714 by Ethan Furman in branch '3.9':
[3.9] bpo-42851: [Enum] remove brittle __init_subclass__ support (GH-24154) (GH-24155)
https://github.com/python/cpython/commit/9ab4dd452287169f08a8cf4d4c68c2139f8de714


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42851>
_______________________________________

From report at bugs.python.org  Thu Jan  7 17:00:25 2021
From: report at bugs.python.org (Dmitry Goldenberg)
Date: Thu, 07 Jan 2021 22:00:25 +0000
Subject: [issue42859] smtplib: recipe for certifying message delivery
In-Reply-To: <1610047730.69.0.693075661816.issue42859@roundup.psfhosted.org>
Message-ID: <1610056825.35.0.356165169043.issue42859@roundup.psfhosted.org>


Dmitry Goldenberg <dgoldenberg123 at gmail.com> added the comment:

Yes, it's a question which could lend itself well to a documentation issue.

I've looked at things like:
https://stackoverflow.com/questions/54047021/python-smtplib-how-to-use-disposition-notification-to
https://stackoverflow.com/questions/40369645/detect-bounced-emails-in-python-smtplib

But I'm not seeing a generic approach which would let me prove messages got to the destination. It seems Disposition-Notification-To is not always available.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42859>
_______________________________________

From report at bugs.python.org  Thu Jan  7 17:06:25 2021
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Thu, 07 Jan 2021 22:06:25 +0000
Subject: [issue42860] Incompatible types in Python grammar
In-Reply-To: <1610053767.4.0.390149770714.issue42860@roundup.psfhosted.org>
Message-ID: <1610057185.58.0.710108659377.issue42860@roundup.psfhosted.org>


Change by Lysandros Nikolaou <lisandrosnik at gmail.com>:


----------
nosy: +lys.nikolaou

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42860>
_______________________________________

From report at bugs.python.org  Thu Jan  7 17:10:07 2021
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Thu, 07 Jan 2021 22:10:07 +0000
Subject: [issue42860] Incompatible types in Python grammar
In-Reply-To: <1610053767.4.0.390149770714.issue42860@roundup.psfhosted.org>
Message-ID: <1610057407.61.0.343083196911.issue42860@roundup.psfhosted.org>


Change by Lysandros Nikolaou <lisandrosnik at gmail.com>:


----------
keywords: +patch
pull_requests: +22984
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24156

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42860>
_______________________________________

From report at bugs.python.org  Thu Jan  7 17:14:16 2021
From: report at bugs.python.org (Batuhan Taskaya)
Date: Thu, 07 Jan 2021 22:14:16 +0000
Subject: [issue42837] Symbol table incorrectly identifies code as a generator, 
 when 'yield' occurs in an annotation
In-Reply-To: <1609926680.76.0.190133632062.issue42837@roundup.psfhosted.org>
Message-ID: <1610057656.1.0.245208026149.issue42837@roundup.psfhosted.org>


Change by Batuhan Taskaya <isidentical at gmail.com>:


----------
nosy: +BTaskaya

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42837>
_______________________________________

From report at bugs.python.org  Thu Jan  7 17:18:28 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 07 Jan 2021 22:18:28 +0000
Subject: [issue42846] Using _multibytecodec module on Windows,
 test_threading/embed get failure
In-Reply-To: <1609972702.01.0.789985510588.issue42846@roundup.psfhosted.org>
Message-ID: <1610057908.23.0.0613650740301.issue42846@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I can reproduce the issue on Windows configured in Japanese language: ANSI code page cp932.

I managed to reproduce the bug on Linux with attached bug.py

----------
Added file: https://bugs.python.org/file49727/bug.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42846>
_______________________________________

From report at bugs.python.org  Thu Jan  7 17:21:36 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 07 Jan 2021 22:21:36 +0000
Subject: [issue42846] Using _multibytecodec module on Windows,
 test_threading/embed get failure
In-Reply-To: <1609972702.01.0.789985510588.issue42846@roundup.psfhosted.org>
Message-ID: <1610058096.59.0.339991025407.issue42846@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

It took me a while to understand it, the _multibytecodec module itself is fine. The issue comes from the _codecs_jp module which uses the legacy module API:

    codec = _codecs_jp.getcodec('cp932')

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42846>
_______________________________________

From report at bugs.python.org  Thu Jan  7 17:24:28 2021
From: report at bugs.python.org (Batuhan Taskaya)
Date: Thu, 07 Jan 2021 22:24:28 +0000
Subject: [issue42837] Symbol table incorrectly identifies code as a generator, 
 when 'yield' occurs in an annotation
In-Reply-To: <1609926680.76.0.190133632062.issue42837@roundup.psfhosted.org>
Message-ID: <1610058268.27.0.174592242083.issue42837@roundup.psfhosted.org>


Batuhan Taskaya <isidentical at gmail.com> added the comment:

Well even though I still don't understand 'how this issue is different than issue42725', I don't think you actually fix the symbol table;
see this one: https://bugs.python.org/msg383659

Annotations still have side effects on the symbol table (even though they shouldn't have). and I already had a fix but decided not to go for it until issue42737 is resolved since it would make the language inconsistent. Just FYI.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42837>
_______________________________________

From report at bugs.python.org  Thu Jan  7 17:25:30 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Thu, 07 Jan 2021 22:25:30 +0000
Subject: [issue42846] Using _multibytecodec module on Windows,
 test_threading/embed get failure
In-Reply-To: <1609972702.01.0.789985510588.issue42846@roundup.psfhosted.org>
Message-ID: <1610058330.72.0.480770021379.issue42846@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

It should be sufficient to convert cjkcodecs.h to multi-phase init then? From what I can see, the support modules are state less, right?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42846>
_______________________________________

From report at bugs.python.org  Thu Jan  7 17:31:56 2021
From: report at bugs.python.org (miss-islington)
Date: Thu, 07 Jan 2021 22:31:56 +0000
Subject: [issue42860] Incompatible types in Python grammar
In-Reply-To: <1610053767.4.0.390149770714.issue42860@roundup.psfhosted.org>
Message-ID: <1610058716.38.0.308734138314.issue42860@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 07dcd86ceed0bd88d1e96dcf53b1de2fea024385 by Lysandros Nikolaou in branch 'master':
bpo-42860: Remove type error from grammar (GH-24156)
https://github.com/python/cpython/commit/07dcd86ceed0bd88d1e96dcf53b1de2fea024385


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42860>
_______________________________________

From report at bugs.python.org  Thu Jan  7 17:33:05 2021
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Thu, 07 Jan 2021 22:33:05 +0000
Subject: [issue42860] Incompatible types in Python grammar
In-Reply-To: <1610053767.4.0.390149770714.issue42860@roundup.psfhosted.org>
Message-ID: <1610058786.0.0.104795640676.issue42860@roundup.psfhosted.org>


Lysandros Nikolaou <lisandrosnik at gmail.com> added the comment:

This is now fixed, Tobias!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42860>
_______________________________________

From report at bugs.python.org  Thu Jan  7 17:36:31 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 07 Jan 2021 22:36:31 +0000
Subject: [issue42846] Using _multibytecodec module on Windows,
 test_threading/embed get failure
In-Reply-To: <1609972702.01.0.789985510588.issue42846@roundup.psfhosted.org>
Message-ID: <1610058991.51.0.592374517021.issue42846@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I'm working on a fix.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42846>
_______________________________________

From report at bugs.python.org  Thu Jan  7 17:44:26 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 07 Jan 2021 22:44:26 +0000
Subject: [issue42725] PEP 563: Should the behavior change for yield/yield
 from's
In-Reply-To: <1608730131.08.0.595189962302.issue42725@roundup.psfhosted.org>
Message-ID: <1610059466.77.0.632053735655.issue42725@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Does not walrus affect the meaning of variable? And await affects the meaning of generator expression.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42725>
_______________________________________

From report at bugs.python.org  Thu Jan  7 17:45:55 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 07 Jan 2021 22:45:55 +0000
Subject: [issue42846] Using _multibytecodec module on Windows,
 test_threading/embed get failure
In-Reply-To: <1609972702.01.0.789985510588.issue42846@roundup.psfhosted.org>
Message-ID: <1610059555.61.0.48990274045.issue42846@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
keywords: +patch
pull_requests: +22985
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24157

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42846>
_______________________________________

From report at bugs.python.org  Thu Jan  7 18:05:41 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 07 Jan 2021 23:05:41 +0000
Subject: [issue42846] Using _multibytecodec module on Windows,
 test_threading/embed get failure
In-Reply-To: <1609972702.01.0.789985510588.issue42846@roundup.psfhosted.org>
Message-ID: <1610060741.83.0.911035522238.issue42846@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Attached PR 24157 should fix the issue.

> FAIL: test_daemon_threads_fatal_error (test.test_threading.SubinterpThreadingTests)

This test runs code in a subinterpreter which is run in a subprocess. The problem is not in the code run in the subinterpreter, but the creation of sys.stdout in the subprocess.

The test creates a subprocess and redirects its stdout and stderr. In this case, Python doesn't create a _io._WindowsConsoleIO for sys.stdout.buffer.raw, but a regular _io.FileIO object. When the raw I/O is a _WindowsConsoleIO instance, create_stdio() of Python/pylifecycle.c forces the usage of the UTF-8 encoding. But for FileIO, it keeps the locale encoding.

If the locale encoding is "cp932", a CJK multicodec is used. In the main interpreter, it's fine. In a subinterpreter, we hit the bug of the _codecs_jp which doesn't use the new multi-phase initialization API.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42846>
_______________________________________

From report at bugs.python.org  Thu Jan  7 18:08:48 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 07 Jan 2021 23:08:48 +0000
Subject: [issue42846] Using _multibytecodec module on Windows,
 test_threading/embed get failure
In-Reply-To: <1609972702.01.0.789985510588.issue42846@roundup.psfhosted.org>
Message-ID: <1610060928.95.0.109934885023.issue42846@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Simpler way to reproduce the issue with t.py script:
---
import test.support
import sys

import _testcapi

print(f"{sys.stdout.encoding=}", file=sys.stderr)

with test.support.SuppressCrashReport():
    _testcapi.run_in_subinterp("pass")
---

By default, UTF-8 is used, everything is fine:
-----
C:\> python t.py
sys.stdout.encoding='utf-8'
-----

Disable _WindowsConsoleIO with PYTHONLEGACYWINDOWSSTDIO env var, we get the issue:
-----
C:\> set PYTHONLEGACYWINDOWSSTDIO=1

C:\> python t.py
Running Debug|x64 interpreter...
sys.stdout.encoding='cp932'
TypeError: codec is unexpected type
Fatal Python error: (...)
-----

Or redirect the output into a program or a file to disable _WindowsConsoleIO to also reproduce the issue:
-----
C:\> python t.py|more
sys.stdout.encoding='cp932'
TypeError: codec is unexpected type
(...)
-----

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42846>
_______________________________________

From report at bugs.python.org  Thu Jan  7 18:13:00 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 07 Jan 2021 23:13:00 +0000
Subject: [issue42846] Using _multibytecodec module on Windows,
 test_threading/embed get failure
In-Reply-To: <1609972702.01.0.789985510588.issue42846@roundup.psfhosted.org>
Message-ID: <1610061180.02.0.36322256817.issue42846@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Ah, if you don't want to change the ANSI code page to cp932 (Japanese language) just to reproduce the issue, you can just set the stdio encoding:
-----
C:\> set PYTHONIOENCODING=cp932
C:\> python t.py|more
sys.stdout.encoding='cp1250'

TypeError: codec is unexpected type
(...)
-----

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42846>
_______________________________________

From report at bugs.python.org  Thu Jan  7 18:15:29 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 07 Jan 2021 23:15:29 +0000
Subject: [issue42846] Using _multibytecodec module on Windows,
 test_threading/embed get failure
In-Reply-To: <1609972702.01.0.789985510588.issue42846@roundup.psfhosted.org>
Message-ID: <1610061329.84.0.657124720408.issue42846@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 07f2cee93f1b619650403981c455f47bfed8d818 by Victor Stinner in branch 'master':
bpo-42846: Convert CJK codec extensions to multiphase init (GH-24157)
https://github.com/python/cpython/commit/07f2cee93f1b619650403981c455f47bfed8d818


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42846>
_______________________________________

From report at bugs.python.org  Thu Jan  7 18:18:25 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 07 Jan 2021 23:18:25 +0000
Subject: [issue42846] Using _multibytecodec module on Windows,
 test_threading/embed get failure
In-Reply-To: <1609972702.01.0.789985510588.issue42846@roundup.psfhosted.org>
Message-ID: <1610061505.24.0.678184589552.issue42846@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> 1) python -m test --verbose test_threading
> 2) python -m test --verbose test_embed

I ran manually these two tests with cp932 ANSI code page: they now pass with my fix.

I also added a regression test to test_multibytecodec.py.

Thanks for your quick bug report neonene! It's now fixed.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42846>
_______________________________________

From report at bugs.python.org  Thu Jan  7 19:30:51 2021
From: report at bugs.python.org (Faisal Mahmood)
Date: Fri, 08 Jan 2021 00:30:51 +0000
Subject: [issue42861] ipaddress - add ability to get next closet subnet of any
 prefix size
Message-ID: <1610065851.06.0.929191666424.issue42861@roundup.psfhosted.org>


New submission from Faisal Mahmood <fasial.mahmood94 at gmail.com>:

The ipaddress module in Python is an excellent tool, but I noticed it is missing a feature that I needed several months ago, which is the ability to find the next closest subnet with a specific prefix length.

For example, imagine I had a IPv4Network("10.10.0.72/30"), how would I find the next possible /25 address? It is not the most straightforward thing to do, so think it would be a great enhancement to the ipaddress library.

I think this can be achieved by adding in a new method to the BaseNetwork class, the method could be defined like "next_prefix(next_prefix=None)".  Calling this method would return an IPv4/v6 address that is the closest possible match with the new prefix (defined as next_prefix).

Example calls:
v4 = IPv4Network("10.10.0.72/30")
next_network = v4.next_subnet(next_prefix=25)
# Output: next_network = IPv4Network("10.10.0.128/25")

v4 = IPv4Network("10.10.0.72/30")
next_network = v4.next_subnet(next_prefix=30)
# Output: next_network = IPv4Network("10.10.0.76/30")

v4 = IPv4Network("10.10.0.72/30")
next_network = v4.next_subnet() # if next_prefix is not defined it will use the existing prefix of /30, so this call is exactly the same as the previous
# Output: next_network = IPv4Network("10.10.0.76/30")

v6 = IPv6Network("2001:db8:aaaa:aaaa:aaaa:aaaa:aaaa:0000/112")
next_network = v6.next_subnet()
# Output: next_network = IPv6Network("2001:db8:aaaa:aaaa:aaaa:aaaa:aaab:0/112")

v6 = IPv6Network("2001:db8:aaaa:aaaa:aaaa:aaaa:aaaa:0000/112")
next_network = v6.next_subnet(next_prefix=64)
# Output: next_network = IPv6Network("2001:db8:aaaa:aaab::/64")

I am going to be working on this and plan to raise a PR soon.  This is my first time contributing to Python, so I appreciate your help / comments / suggestions / guidance as I go along.

----------
components: Library (Lib)
messages: 384623
nosy: fasial.mahmood94
priority: normal
severity: normal
status: open
title: ipaddress - add ability to get next closet subnet of any prefix size
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42861>
_______________________________________

From report at bugs.python.org  Thu Jan  7 19:33:20 2021
From: report at bugs.python.org (Faisal Mahmood)
Date: Fri, 08 Jan 2021 00:33:20 +0000
Subject: [issue42861] ipaddress - add ability to get next closet subnet of any
 prefix size
In-Reply-To: <1610065851.06.0.929191666424.issue42861@roundup.psfhosted.org>
Message-ID: <1610066000.01.0.532472580788.issue42861@roundup.psfhosted.org>


Faisal Mahmood <fasial.mahmood94 at gmail.com> added the comment:

Not sure how to edit an issue, but I made a mistake, where I said:
"...Calling this method would return an IPv4/v6 address that is the closest possible match..."

I meant to say:
"...Calling this method would return an IPv4/v6 -NETWORK- that is the closest possible match..."

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42861>
_______________________________________

From report at bugs.python.org  Thu Jan  7 19:39:03 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Fri, 08 Jan 2021 00:39:03 +0000
Subject: [issue42862] Use functools.lru_cache iso. _sqlite.Cache in sqlite3
 module
Message-ID: <1610066343.94.0.466682345605.issue42862@roundup.psfhosted.org>


New submission from Erlend Egeberg Aasland <erlend.aasland at innova.no>:

Pro: less code, less complexity, improved maintainability
Con: minor performance hit

PoC here: https://github.com/erlend-aasland/cpython/commits/sqlite-cache

$ ./python.exe
>>> import sqlite3
>>> con = sqlite3.connect(":memory:")
>>> con.execute("select * from sqlite_master")
>>> con.execute("select * from sqlite_master")
>>> c = con.cache()
>>> c.cache_info()
CacheInfo(hits=1, misses=1, maxsize=128, currsize=1)

The test suite runs approx. 10-20 ms slower with this change. Using _functools._lru_cache_wrapper iso. functools.lru_cache almost removes this performance regression.


Berker, is it worth pursuing?

----------
components: Library (Lib)
messages: 384625
nosy: berker.peksag, erlendaasland, serhiy.storchaka
priority: normal
severity: normal
status: open
title: Use functools.lru_cache iso. _sqlite.Cache in sqlite3 module
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42862>
_______________________________________

From report at bugs.python.org  Thu Jan  7 19:41:45 2021
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 08 Jan 2021 00:41:45 +0000
Subject: [issue42848] asyncio produces an unexpected traceback with recursive
 __getattribute__
In-Reply-To: <1609985412.09.0.749639106788.issue42848@roundup.psfhosted.org>
Message-ID: <1610066505.77.0.441973169285.issue42848@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

So, we have a contact chain of length almost equal to the recursion limit, which is too much to process recursively in python (in c it does work, hence the difference between the outputs of the OP's two scripts).

The PR removes recursion from TracebackException (in constructor as well as in format()).  The code is less readable and I'm not sure this case is worth that. Should we instead truncate the output, ie add a limit on the recursion depth?  (note that in this case this would remove the last "recursion depth exceeded" exception and show only some of the repetitive ones).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42848>
_______________________________________

From report at bugs.python.org  Thu Jan  7 19:42:38 2021
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 08 Jan 2021 00:42:38 +0000
Subject: [issue42848] asyncio produces an unexpected traceback with recursive
 __getattribute__
In-Reply-To: <1609985412.09.0.749639106788.issue42848@roundup.psfhosted.org>
Message-ID: <1610066558.54.0.176286250285.issue42848@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
keywords: +patch
pull_requests: +22986
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24158

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42848>
_______________________________________

From report at bugs.python.org  Thu Jan  7 19:51:09 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Fri, 08 Jan 2021 00:51:09 +0000
Subject: [issue42862] Use functools.lru_cache iso. _sqlite.Cache in sqlite3
 module
In-Reply-To: <1610066343.94.0.466682345605.issue42862@roundup.psfhosted.org>
Message-ID: <1610067069.55.0.231455463045.issue42862@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

Short diffstat: 8 files changed, 85 insertions(+), 406 deletions(-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42862>
_______________________________________

From report at bugs.python.org  Thu Jan  7 20:10:38 2021
From: report at bugs.python.org (Jeff Moguillansky)
Date: Fri, 08 Jan 2021 01:10:38 +0000
Subject: [issue42863] Python venv inconsistent folder structure on windows
Message-ID: <1610068238.28.0.631501714908.issue42863@roundup.psfhosted.org>


New submission from Jeff Moguillansky <jmoguill2 at gmail.com>:

When creating a virtual environment on windows using venv, the folder structure: "Scripts", "Include", "Lib", is inconsistent with other platforms (e.g. "include", "lib", "bin", etc).  

This causes various integration issues.  

For example, suppose we want to build a native C library, and install it to the folder structure generated by the virtual environment.  
The pkg-config file assumes a folder structure of "include", "lib", "bin", and the generated pkg-config files are inconsistent with the python virtual environment folder structure.  

Can we have a consistent folder structure across platforms?

----------
components: Windows
messages: 384628
nosy: jmoguill2, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: Python venv inconsistent folder structure on windows
type: behavior
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42863>
_______________________________________

From report at bugs.python.org  Thu Jan  7 21:38:02 2021
From: report at bugs.python.org (Desmond Cheong)
Date: Fri, 08 Jan 2021 02:38:02 +0000
Subject: [issue14678] Update zipimport to support importlib.invalidate_caches()
In-Reply-To: <1335462110.31.0.00575372691618.issue14678@psf.upfronthosting.co.za>
Message-ID: <1610073482.09.0.494781658496.issue14678@roundup.psfhosted.org>


Change by Desmond Cheong <desmondcheongzx at gmail.com>:


----------
keywords: +patch
nosy: +desmondcheongzx
nosy_count: 9.0 -> 10.0
pull_requests: +22987
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24159

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue14678>
_______________________________________

From report at bugs.python.org  Thu Jan  7 21:38:31 2021
From: report at bugs.python.org (Robin Scheibler)
Date: Fri, 08 Jan 2021 02:38:31 +0000
Subject: [issue42850] Process hangs when calling urllib.request in a
 multiprocessing.Process with import of sounddevice package
In-Reply-To: <1610000036.98.0.246954881352.issue42850@roundup.psfhosted.org>
Message-ID: <1610073511.74.0.191081212015.issue42850@roundup.psfhosted.org>


Robin Scheibler <fakufaku at gmail.com> added the comment:

Thank you very much for the reply! I was indeed hesitating where to post the issue. I have now cross-posted in the sounddevice issue tracker.

https://github.com/spatialaudio/python-sounddevice/issues/302

I'll update the issue if things progress on that side.

The sounddevice is essentially a wrapper around the portaudio library, similar to pyaudio. I have tried the test code with an import of pyaudio rather than sounddevice, but the issue does not happen in that case.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42850>
_______________________________________

From report at bugs.python.org  Thu Jan  7 22:03:30 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 08 Jan 2021 03:03:30 +0000
Subject: [issue42864] Improve error messages regarding unclosed parentheses
Message-ID: <1610075010.91.0.684383999677.issue42864@roundup.psfhosted.org>


New submission from Pablo Galindo Salgado <pablogsal at gmail.com>:

Consider this file:

```
x = (


```

The error that we get is:

? python ../a.py
  File "/home/pablogsal/github/python/master/../a.py", line 6

    ^
SyntaxError: unexpected EOF while parsin

This is quite uninformative of the actual problem, which is the closed parentheses.

The same happens with something like this:

( 1+2

  File "/home/pablogsal/github/python/master/lel.py", line 3

    ^
SyntaxError: unexpected EOF while parsing

With some effort, we can include the location of the unclosed parentheses.

----------
messages: 384630
nosy: pablogsal
priority: normal
severity: normal
status: open
title: Improve error messages regarding unclosed parentheses
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42864>
_______________________________________

From report at bugs.python.org  Thu Jan  7 22:04:15 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 08 Jan 2021 03:04:15 +0000
Subject: [issue42864] Improve error messages regarding unclosed parentheses
In-Reply-To: <1610075010.91.0.684383999677.issue42864@roundup.psfhosted.org>
Message-ID: <1610075055.24.0.942147089867.issue42864@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
keywords: +patch
pull_requests: +22988
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24161

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42864>
_______________________________________

From report at bugs.python.org  Thu Jan  7 22:04:28 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 08 Jan 2021 03:04:28 +0000
Subject: [issue42864] Improve error messages regarding unclosed parentheses
In-Reply-To: <1610075010.91.0.684383999677.issue42864@roundup.psfhosted.org>
Message-ID: <1610075068.23.0.428441120088.issue42864@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
nosy: +lys.nikolaou
stage: patch review -> 

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42864>
_______________________________________

From report at bugs.python.org  Thu Jan  7 22:52:18 2021
From: report at bugs.python.org (Xinmeng Xia)
Date: Fri, 08 Jan 2021 03:52:18 +0000
Subject: [issue42762] infinite loop resulted by "yield"
In-Reply-To: <1609130295.32.0.912620547313.issue42762@roundup.psfhosted.org>
Message-ID: <1610077938.53.0.33078172348.issue42762@roundup.psfhosted.org>


Xinmeng Xia <xiaxm at smail.nju.edu.cn> added the comment:

I get a little confused. So is it a bug in Python 3.5 and 3.6?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42762>
_______________________________________

From report at bugs.python.org  Thu Jan  7 23:00:38 2021
From: report at bugs.python.org (Victor Lopez)
Date: Fri, 08 Jan 2021 04:00:38 +0000
Subject: [issue42865] sysconfig appends CFLAGS to LD
Message-ID: <1610078438.84.0.384790848261.issue42865@roundup.psfhosted.org>


New submission from Victor Lopez <development at greentwip.xyz>:

This should not happen as some CFLAGS are exclusive to the compiler and it will break cross-compiling linkers

The proposed sysconfig is attached

----------
components: Distutils
files: sysconfig.py
messages: 384632
nosy: Greentwip, dstufft, eric.araujo
priority: normal
pull_requests: 22989
severity: normal
status: open
title: sysconfig appends CFLAGS to LD
versions: Python 3.9
Added file: https://bugs.python.org/file49728/sysconfig.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42865>
_______________________________________

From report at bugs.python.org  Thu Jan  7 23:03:27 2021
From: report at bugs.python.org (Victor Lopez)
Date: Fri, 08 Jan 2021 04:03:27 +0000
Subject: [issue42865] sysconfig appends CFLAGS to LD
In-Reply-To: <1610078438.84.0.384790848261.issue42865@roundup.psfhosted.org>
Message-ID: <1610078607.97.0.119455983331.issue42865@roundup.psfhosted.org>


Victor Lopez <development at greentwip.xyz> added the comment:

I'm updating this to comply with the GitHub PR policies

----------
keywords: +patch
message_count: 1.0 -> 2.0
pull_requests: +22991
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24163

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42865>
_______________________________________

From report at bugs.python.org  Thu Jan  7 23:58:36 2021
From: report at bugs.python.org (naught101)
Date: Fri, 08 Jan 2021 04:58:36 +0000
Subject: [issue25457] json dump fails for mixed-type keys when sort_keys is
 specified
In-Reply-To: <1445500861.68.0.856599723102.issue25457@psf.upfronthosting.co.za>
Message-ID: <1610081916.79.0.929455619641.issue25457@roundup.psfhosted.org>


naught101 <naught101 at gmail.com> added the comment:

I want to do something like this:

    hashlib.md5(json.dumps(d, sort_keys=True))

So I can check if a dict's contents are the same as a DB version, but I can't guarantee that all the keys are strings, so it breaks, annoyingly. I would very much like the apply-default-function-then-sort approach. Until then, my work-around is this:

    def deep_stringize_dict_keys(item):
        """Converts all keys to strings in a nested dictionary"""
        if isinstance(item, dict):
            return {str(k): deep_stringize_dict_keys(v) for k, v in item.items()}

        if isinstance(item, list):
            # This will check only ONE layer deep for nested dictionaries inside lists.
            # If you need deeper than that, you're probably doing something stupid.
            if any(isinstance(v, dict) for v in item):
                return [deep_stringize_dict_keys(v) if isinstance(v, dict) else v
                        for v in item]

        # I don't care about tuples, since they don't exist in JSON

        return item

Maybe it can be of some use for others.

----------
nosy: +naught101

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue25457>
_______________________________________

From report at bugs.python.org  Fri Jan  8 00:10:56 2021
From: report at bugs.python.org (Desmond Cheong)
Date: Fri, 08 Jan 2021 05:10:56 +0000
Subject: [issue42818] AttributeError: 'zipimporter' object has no attribute
 'find_spec'
In-Reply-To: <1609682975.59.0.559934544299.issue42818@roundup.psfhosted.org>
Message-ID: <1610082656.89.0.652315548786.issue42818@roundup.psfhosted.org>


Desmond Cheong <desmondcheongzx at gmail.com> added the comment:

Could you provide some information about the system you're running this on? I might be wrong, but this does seem like an issue with this copy of setuptools. From the Traceback, it seems that line 2196 of /usr/lib/python3/dist-packages/pkg_resources/__init__.py runs `loader = importer.find_spec(packageName)` when trying to handle the AttributeError exception. However, this line should instead have run `loader = importer.find_module(packageName)` based on the source code https://github.com/pypa/setuptools/blob/95a9c474d30acc729b536f9ad88ead7efab62c5d/pkg_resources/__init__.py#L2190-L2197

Git blame also tells me that this fall-back has been implemented for a few years now.

It also appears that the zipimporter.find_spec method is not implemented in Python3.9 and earlier. However, zipimporter.find_module has been implemented for at least Python3.8 onwards, if not earlier (https://github.com/python/cpython/blob/ca8e96d1edbeb536f58da91e607082463398fce1/Lib/zipimport.py#L139-L150).

----------
nosy: +desmondcheongzx

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42818>
_______________________________________

From report at bugs.python.org  Fri Jan  8 00:57:03 2021
From: report at bugs.python.org (Desmond Cheong)
Date: Fri, 08 Jan 2021 05:57:03 +0000
Subject: [issue42798] pip search fails
In-Reply-To: <1609442411.49.0.32642630503.issue42798@roundup.psfhosted.org>
Message-ID: <1610085423.64.0.701969759045.issue42798@roundup.psfhosted.org>


Desmond Cheong <desmondcheongzx at gmail.com> added the comment:

Seems that this is due to PyPI's search API being disabled.

https://github.com/pypa/pip/issues/5216#issuecomment-744605466

----------
nosy: +desmondcheongzx

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42798>
_______________________________________

From report at bugs.python.org  Fri Jan  8 00:59:05 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Fri, 08 Jan 2021 05:59:05 +0000
Subject: [issue42725] PEP 563: Should the behavior change for yield/yield
 from's
In-Reply-To: <1608730131.08.0.595189962302.issue42725@roundup.psfhosted.org>
Message-ID: <1610085545.46.0.472022840807.issue42725@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Oh, you?re right about walrus. And I don?t actually understand async generator expressions.

This suggests that we definitely need a PEP. :-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42725>
_______________________________________

From report at bugs.python.org  Fri Jan  8 01:05:25 2021
From: report at bugs.python.org (Roundup Robot)
Date: Fri, 08 Jan 2021 06:05:25 +0000
Subject: [issue42836] docs: struct: clarify struct caching behaviour
In-Reply-To: <1609923931.89.0.0226570295473.issue42836@roundup.psfhosted.org>
Message-ID: <1610085925.85.0.879233786098.issue42836@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
keywords: +patch
nosy: +python-dev
nosy_count: 2.0 -> 3.0
pull_requests: +22992
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24164

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42836>
_______________________________________

From report at bugs.python.org  Fri Jan  8 01:59:11 2021
From: report at bugs.python.org (Mariusz Felisiak)
Date: Fri, 08 Jan 2021 06:59:11 +0000
Subject: [issue42851] Subclassing Enum with ipaddress.IPv4Network/IPv6Network
 raises TypeError.
In-Reply-To: <1610001583.18.0.772940964765.issue42851@roundup.psfhosted.org>
Message-ID: <1610089151.17.0.737237936077.issue42851@roundup.psfhosted.org>


Mariusz Felisiak <felisiak.mariusz at gmail.com> added the comment:

Ethan, Thanks for the patch.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42851>
_______________________________________

From report at bugs.python.org  Fri Jan  8 02:55:37 2021
From: report at bugs.python.org (Klaus Ethgen)
Date: Fri, 08 Jan 2021 07:55:37 +0000
Subject: [issue42818] AttributeError: 'zipimporter' object has no attribute
 'find_spec'
In-Reply-To: <1609682975.59.0.559934544299.issue42818@roundup.psfhosted.org>
Message-ID: <1610092537.95.0.206637282745.issue42818@roundup.psfhosted.org>


Klaus Ethgen <Klaus at Ethgen.de> added the comment:

You are right.

Generally I have the installation on devuan Linux, the unstable tree.

But... In 2019-03-13 I started to patch this file as many python scripts started to fail due to the fact that they had the find_spec implemented. This was still true in Apr 2020, when I had to renew the patch. And let me say, many failed; not only the egg part.

I don't know where I found the patch at first but it worked now for nearly two years. I did revert it now and for the moment, the scripts that I remember was failing, seems to work now.

Let me say that this find_spec/find_module stuff is (or was) a bit of a mess.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42818>
_______________________________________

From report at bugs.python.org  Fri Jan  8 02:58:17 2021
From: report at bugs.python.org (Klaus Ethgen)
Date: Fri, 08 Jan 2021 07:58:17 +0000
Subject: [issue42818] AttributeError: 'zipimporter' object has no attribute
 'find_spec'
In-Reply-To: <1609682975.59.0.559934544299.issue42818@roundup.psfhosted.org>
Message-ID: <1610092697.78.0.177407991798.issue42818@roundup.psfhosted.org>


Klaus Ethgen <Klaus at Ethgen.de> added the comment:

I also tested the original bug and it seems to be gone.

----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42818>
_______________________________________

From report at bugs.python.org  Fri Jan  8 03:14:04 2021
From: report at bugs.python.org (Tobias Kohn)
Date: Fri, 08 Jan 2021 08:14:04 +0000
Subject: [issue42860] Incompatible types in Python grammar
In-Reply-To: <1610053767.4.0.390149770714.issue42860@roundup.psfhosted.org>
Message-ID: <1610093644.69.0.862627486691.issue42860@roundup.psfhosted.org>


Tobias Kohn <kohnt at tobiaskohn.ch> added the comment:

Great, thanks a lot!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42860>
_______________________________________

From report at bugs.python.org  Fri Jan  8 04:28:39 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 08 Jan 2021 09:28:39 +0000
Subject: [issue42866] test test_multibytecodec:
 Test_IncrementalEncoder.test_subinterp() leaks references
Message-ID: <1610098119.51.0.27659926103.issue42866@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at python.org>:

$ ./python -m test test_multibytecodec -m test.test_multibytecodec.Test_IncrementalEncoder.test_subinterp -R 3:3
(...)
test_multibytecodec leaked [258, 258, 258] references, sum=774

I simplified the code. The following test leaks references:

    def test_subinterp(self):
        import _testcapi
        code = textwrap.dedent("""
            import _codecs_jp
            codec = _codecs_jp.getcodec('cp932')
            codec = None
        """)
        _testcapi.run_in_subinterp(code)

_codecs_jp.getcodec() is defined in Modules/cjkcodecs/cjkcodecs.h. Extract:

    cofunc = getmultibytecodec();
    ...
    codecobj = PyCapsule_New((void *)codec, PyMultibyteCodec_CAPSULE_NAME, NULL);
    if (codecobj == NULL)
        return NULL;

    r = PyObject_CallOneArg(cofunc, codecobj);
    Py_DECREF(codecobj);

getmultibytecodec() is the _multibytecodec.__create_codec() which is defined in Modules/cjkcodecs/multibytecodec.c. Simplified code:

    codec = PyCapsule_GetPointer(arg, PyMultibyteCodec_CAPSULE_NAME);
    _multibytecodec_state *state = _multibytecodec_get_state(module);
    self = PyObject_New(MultibyteCodecObject, state->multibytecodec_type);
    self->codec = codec;
    return (PyObject *)self;

----------
components: Library (Lib)
messages: 384643
nosy: vstinner
priority: normal
severity: normal
status: open
title: test test_multibytecodec: Test_IncrementalEncoder.test_subinterp() leaks references
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42866>
_______________________________________

From report at bugs.python.org  Fri Jan  8 04:30:21 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 08 Jan 2021 09:30:21 +0000
Subject: [issue42846] Using _multibytecodec module on Windows,
 test_threading/embed get failure
In-Reply-To: <1609972702.01.0.789985510588.issue42846@roundup.psfhosted.org>
Message-ID: <1610098221.44.0.317441711223.issue42846@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> bpo-42846: Convert CJK codec extensions to multiphase init (GH-24157)

I added a new test and new test spotted a reference leak, likely an existing one: bpo-42866 "test test_multibytecodec: Test_IncrementalEncoder.test_subinterp() leaks references".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42846>
_______________________________________

From report at bugs.python.org  Fri Jan  8 04:31:03 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 08 Jan 2021 09:31:03 +0000
Subject: [issue42866] test test_multibytecodec:
 Test_IncrementalEncoder.test_subinterp() leaks references
In-Reply-To: <1610098119.51.0.27659926103.issue42866@roundup.psfhosted.org>
Message-ID: <1610098263.12.0.68945149858.issue42866@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I added the test which leaks in bpo-42846.

commit 07f2cee93f1b619650403981c455f47bfed8d818
Author: Victor Stinner <vstinner at python.org>
Date:   Fri Jan 8 00:15:22 2021 +0100

    bpo-42846: Convert CJK codec extensions to multiphase init (GH-24157)
    
    Convert the 6 CJK codec extension modules (_codecs_cn, _codecs_hk,
    _codecs_iso2022, _codecs_jp, _codecs_kr and _codecs_tw) to the
    multiphase initialization API (PEP 489).
    
    Remove getmultibytecodec() local cache: always import
    _multibytecodec. It should be uncommon to get a codec. For example,
    this function is only called once per CJK codec module.
    
    Fix a reference leak in register_maps() error path.

I don't think that the leak is new. It's just that it wasn't seen previously.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42866>
_______________________________________

From report at bugs.python.org  Fri Jan  8 04:32:50 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 08 Jan 2021 09:32:50 +0000
Subject: [issue42866] test test_multibytecodec:
 Test_IncrementalEncoder.test_subinterp() leaks references
In-Reply-To: <1610098119.51.0.27659926103.issue42866@roundup.psfhosted.org>
Message-ID: <1610098370.25.0.881808126231.issue42866@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy: +corona10, erlendaasland

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42866>
_______________________________________

From report at bugs.python.org  Fri Jan  8 04:33:00 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 08 Jan 2021 09:33:00 +0000
Subject: [issue1635741] Py_Finalize() doesn't clear all Python objects at exit
Message-ID: <1610098380.0.0.836789432103.issue1635741@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> New changeset 0b858cdd5d114f0890b11b6c4d6559d0ceb468ab by Erlend Egeberg Aasland in branch 'master':
> bpo-1635741: Convert _multibytecodec to multi-phase init (GH-24095)

This change introduced two regressions:

* bpo-42846: "Using _multibytecodec module on Windows, test_threading/embed get failure" (FIXED)
* bpo-42866: "test test_multibytecodec: Test_IncrementalEncoder.test_subinterp() leaks references"

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1635741>
_______________________________________

From report at bugs.python.org  Fri Jan  8 04:34:30 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 08 Jan 2021 09:34:30 +0000
Subject: [issue42866] test test_multibytecodec:
 Test_IncrementalEncoder.test_subinterp() leaks references
In-Reply-To: <1610098119.51.0.27659926103.issue42866@roundup.psfhosted.org>
Message-ID: <1610098470.93.0.844864290252.issue42866@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

By the way, I wrote an article "Leaks discovered by subinterpreters":
https://vstinner.github.io/subinterpreter-leaks.html

This leak may be new kind related to capsule, I'm not sure so far.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42866>
_______________________________________

From report at bugs.python.org  Fri Jan  8 04:44:39 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Fri, 08 Jan 2021 09:44:39 +0000
Subject: [issue42866] test test_multibytecodec:
 Test_IncrementalEncoder.test_subinterp() leaks references
In-Reply-To: <1610098119.51.0.27659926103.issue42866@roundup.psfhosted.org>
Message-ID: <1610099079.68.0.116110487155.issue42866@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

Thank you so much for taking the time to write these blog posts, Victor, and for explaining your fixes is such great detail. It is very helpful!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42866>
_______________________________________

From report at bugs.python.org  Fri Jan  8 04:52:17 2021
From: report at bugs.python.org (Ronald Oussoren)
Date: Fri, 08 Jan 2021 09:52:17 +0000
Subject: [issue42853] `OverflowError: signed integer is greater than maximum`
 in ssl.py for files larger than 2GB
In-Reply-To: <1610006589.59.0.311109371799.issue42853@roundup.psfhosted.org>
Message-ID: <1610099537.02.0.856160892754.issue42853@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

The API documentation already implies that write might not write the entire buffer because it returns the number of bytes actually written (just like os.write).  

A possible workaround on the SSL layer is hence to clamp the amount of bytes to write to MAX_INT (or later MAX_SSIZE_T) bytes. 

That said, this does require checking that users of the SSL layer write method in the stdib actually check for the number of bytes written, otherwise we'd exchange the exception to a silent error.

----------
nosy: +ronaldoussoren

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42853>
_______________________________________

From report at bugs.python.org  Fri Jan  8 04:58:17 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 08 Jan 2021 09:58:17 +0000
Subject: [issue42866] test test_multibytecodec:
 Test_IncrementalEncoder.test_subinterp() leaks references
In-Reply-To: <1610098119.51.0.27659926103.issue42866@roundup.psfhosted.org>
Message-ID: <1610099897.21.0.595317901043.issue42866@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
keywords: +patch
pull_requests: +22993
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24165

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42866>
_______________________________________

From report at bugs.python.org  Fri Jan  8 04:59:16 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 08 Jan 2021 09:59:16 +0000
Subject: [issue42866] test test_multibytecodec:
 Test_IncrementalEncoder.test_subinterp() leaks references
In-Reply-To: <1610098119.51.0.27659926103.issue42866@roundup.psfhosted.org>
Message-ID: <1610099956.71.0.139175634401.issue42866@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

PR 24165 fix one reference leak in the getcodec() function of CJK codecs. But it doesn't fix all ref leaks of this issue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42866>
_______________________________________

From report at bugs.python.org  Fri Jan  8 05:24:16 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 08 Jan 2021 10:24:16 +0000
Subject: [issue42866] test test_multibytecodec:
 Test_IncrementalEncoder.test_subinterp() leaks references
In-Reply-To: <1610098119.51.0.27659926103.issue42866@roundup.psfhosted.org>
Message-ID: <1610101456.16.0.91322175356.issue42866@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The leak can be simplified to:

    @support.cpython_only
    def test_subinterp(self):
        import _testcapi
        code = textwrap.dedent("""
            import encodings
            import _codecs_jp
            encodings._cache['cp932'] = _codecs_jp.getcodec('cp932')
        """)
        res = _testcapi.run_in_subinterp(code)
        self.assertEqual(res, 0)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42866>
_______________________________________

From report at bugs.python.org  Fri Jan  8 05:29:30 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 08 Jan 2021 10:29:30 +0000
Subject: [issue42866] test test_multibytecodec:
 Test_IncrementalEncoder.test_subinterp() leaks references
In-Reply-To: <1610098119.51.0.27659926103.issue42866@roundup.psfhosted.org>
Message-ID: <1610101770.88.0.181069671381.issue42866@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Links about ref leaks related to encodings:

* https://bugs.python.org/issue1635741#msg364833 
* https://bugs.python.org/issue1635741#msg364968
* https://bugs.python.org/issue36854#msg357160
* https://github.com/python/cpython/compare/master...phsilva:remove-codec-caches

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42866>
_______________________________________

From report at bugs.python.org  Fri Jan  8 07:00:06 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 08 Jan 2021 12:00:06 +0000
Subject: [issue42866] test test_multibytecodec:
 Test_IncrementalEncoder.test_subinterp() leaks references
In-Reply-To: <1610098119.51.0.27659926103.issue42866@roundup.psfhosted.org>
Message-ID: <1610107206.86.0.591835282893.issue42866@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

See also bpo-42671 "Make the Python finalization more deterministic" but it seems like PR 23826 makes the leak worse (+2000 leaked references instead of +200) :-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42866>
_______________________________________

From report at bugs.python.org  Fri Jan  8 07:23:51 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 08 Jan 2021 12:23:51 +0000
Subject: [issue42866] test test_multibytecodec:
 Test_IncrementalEncoder.test_subinterp() leaks references
In-Reply-To: <1610098119.51.0.27659926103.issue42866@roundup.psfhosted.org>
Message-ID: <1610108631.55.0.0877328017147.issue42866@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> encodings._cache['cp932'] = _codecs_jp.getcodec('cp932')

* encodings._cache is kept alive by encodings.search_function.__globals__
* encodings.search_function function is kept alive by PyInterpreterState.codec_search_path list. The function by _PyCodec_Register() in encodings/__init__.py: codecs.register(search_function).

For example, unregistering the search function prevents the leak:

            import encodings
            import _codecs_jp
            encodings._cache['cp932'] = _codecs_jp.getcodec('cp932')

            import codecs
            codecs.unregister(encodings.search_function)

The PyInterpreterState.codec_search_path list is cleared at Python exit by interpreter_clear().

The weird part is that the _codecs_jp.getcodec('cp932') codec object *is* deleted. I checked and multibytecodec_dealloc() is called with the object stored in the encodings cache.

A _multibytecodec.MultibyteCodec instance (MultibyteCodecObject* structure in C) is a simple type: it only stores pointer to C functions and C strings. It doesn't contain any Python object. So I don't see how it could be part of a reference cycle by itself. Moreover, again, it is deleted.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42866>
_______________________________________

From report at bugs.python.org  Fri Jan  8 07:46:13 2021
From: report at bugs.python.org (John McCabe)
Date: Fri, 08 Jan 2021 12:46:13 +0000
Subject: [issue42867] Entry Widget not editable on Windows 10,
 but is on Linux Ubuntu 16.04
Message-ID: <1610109973.36.0.703695549775.issue42867@roundup.psfhosted.org>


New submission from John McCabe <john at mccabe.org.uk>:

I've built an application using tkinter (see below). I'm fairly new to tkinter, despite having substantial software experience (33 years), so the layout might be a bit odd/wrong, and the example obviously doesn't follow PEP-8 guidelines, however...

Basically this application (which is a bit more than minimal, but should be easy to follow) is designed to manage pairs of text values as JSON, saving/loading from a file. When it starts, the user is asked if they want to read in an existing file of data; if they select NO, a fairly empty frame with 3 buttons showing "+", "Save" and "Quit" is displayed.

At this point, if "+" is pressed, a new row with two labels and two Entry widgets is added to the frame.

However (and this is the problem which appears to be identical to that reported in Issue #9673), it is not possible to set focus into either of the Entry widgets on Windows 10; there is no problem doing this on Ubuntu 16.04 (although I've only got Python 3.5 on there)

If the "Save" button is then pressed, a message box pops up telling the use that no changes have been saved. Once OK has been pressed on that, it becomes possible to set focus into the Entry widgets.

One of the problems with Issue #9673 was that no 'minimal' example was provided showing this behaviour, and the very minimal example given in https://bugs.python.org/issue9673#msg218765 doesn't exhibit the problem, hence the example below being a bit more than minimal, while still not being particularly complicated.

====
#!/usr/bin/python3

import os
import tkinter as tk
from tkinter import filedialog, messagebox
import json

class Application(tk.Frame):

    def __init__(self, master):
        super().__init__(master)
        self.master = master
        self.grid()
        self.originalJson = {}
        self.inFileName = ""
        self.leftRightEntries = []
        self.fileDlgOpts = { "initialdir"       : os.getcwd(),
                             "initialfile"      : "file.json",
                             "filetypes"        : (("JSON File", "*.json"), ("All Files","*.*")),
                             "defaultextension" : '.json',
                             "title"            : "Select A File" }
        self.createWidgets()

    def openInFile(self):
        fileName = ""
        reuse = tk.messagebox.askquestion("Use An Existing File", "Do you want to load and use an existing file?")
        if reuse == "yes":
            fileName = tk.filedialog.askopenfilename(**self.fileDlgOpts)
            if fileName is not "":
                try:
                    with open(fileName, 'r') as json_file:
                        self.originalJson = json.load(json_file)
                        json_file.close()
                except Exception:
                    tk.messagebox.showerror("Use An Existing File", "File could not be loaded; continuing without one.")
                    fileName = ""
            else:
                tk.messagebox.showwarning("Use An Existing File", "No existing file specified; continuing without one.")

        return fileName

    def createWidgets(self):
        self.inFileName = self.openInFile()

        # We add the buttons to some huge numbered row because we might want to insert more
        # rows, and the layout manager will collapse everything in between. Also we
        # add these first because of the way the tab order is set up
        self.addBtn = tk.Button(self.master, text = "+", command = self.addNew)
        self.addBtn.grid(row = 100, column = 0, sticky = tk.W)

        # Save button; pretty self-explanatory
        self.saveBtn = tk.Button(self.master, text = "Save", command = self.save)
        self.saveBtn.grid(row = 100, column = 2, sticky = tk.W)

        # Quit button; pretty self-explanatory
        self.quitBtn = tk.Button(self.master, text = "QUIT", fg = "red", command = self.quit)
        self.quitBtn.grid(row = 100, column = 3, sticky = tk.E)

        # If there is original json, work through each key and put the fields on the display
        rowNum = 0
        for leftText in sorted(self.originalJson.keys()):
            self.insertRow(rowNum, leftText);
            rowNum = rowNum + 1

        self.nextEmptyRow = rowNum

        self.redoPadding()

    def redoPadding(self):
        for child in self.master.winfo_children():
            child.grid_configure(padx = 5, pady = 5)

    def focusNextWidget(self, event):
        event.widget.tk_focusNext().focus()
        return("break")

    def insertRow(self, rowNum, initialLeft = None):
        tk.Label(self.master, height = 1, text = "Left: ").grid(row = rowNum, column = 0, sticky = tk.W)
        leftBox = tk.Entry(self.master, width = 20)
        leftBox.grid(row = rowNum, column = 1, sticky = tk.W)
        leftBox.bind("<Tab>", self.focusNextWidget)
        if initialLeft is not None:
            leftBox.insert(tk.END, initialLeft)
        tk.Label(self.master, height = 1, text = "Right: ").grid(row = rowNum, column = 2, sticky = tk.W)
        rightBox = tk.Entry(self.master, width = 20)
        rightBox.grid(row = rowNum, column = 3, sticky = tk.W)
        rightBox.bind("<Tab>", self.focusNextWidget)
        if initialLeft is not None:
            rightBox.insert(tk.END, initialLeft)
        self.leftRightEntries.append((leftBox, rightBox))
        leftBox.focus_set()

    def addNew(self):
        # Add a new row before the button
        self.insertRow(self.nextEmptyRow)
        self.nextEmptyRow = self.nextEmptyRow + 1
        self.redoPadding()

    def getCurrent(self):
        # Work through the rows and check stuff
        current = {}
        for (leftEntry, rightEntry) in self.leftRightEntries:
            leftText = leftEntry.get()
            rightText = rightEntry.get()
            if leftText == "" and rightText == "":
                pass
            elif leftText == "":
                print("No leftText specified for rightText [{}]".format(rightText))
            elif rightText == "":
                print("No rightText specified for leftText [{}]".format(leftText))
            else:
                print("lefText: {}, rightText: {}".format(leftText, rightText))
                current[leftText] = rightText
        return current

    def save(self):
        # Get the current values, and then dump the new json to a file, if it's changed!
        finalResult = self.getCurrent()
        if finalResult != self.originalJson:
            if self.inFileName == "":
                self.inFileName = tk.filedialog.asksaveasfilename(**self.fileDlgOpts)

            if self.inFileName != "":
                with open(self.inFileName, 'w') as json_file:
                    json.dump(finalResult, json_file, indent = 4)
                    self.originalJson = finalResult
                tk.messagebox.showinfo("Save Data", "Data saved to {}".format(self.inFileName))
            else:
                tk.messagebox.showwarning("Save Data", "Data has not been saved; no file name was supplied!")
        else:
            tk.messagebox.showwarning("Save Data", "Data has not been saved; there are no changes")

    def quit(self):
        # Deal with quitting when the file's been modified, check original vs current JSON
        reallyQuit = True
        finalResult = self.getCurrent()
        if finalResult != self.originalJson:
            answer = tk.messagebox.askquestion("Quit", "Data has changed; do you really want to quit?", icon = "warning")
            if answer != "yes":
                reallyQuit = False

        if reallyQuit:
            self.master.destroy()

if __name__ == "__main__":
    root = tk.Tk()
    root.title("Inactive Entry Example")
    app = Application(root)
    root.protocol("WM_DELETE_WINDOW", app.quit)
    app.mainloop()

----------
components: Tkinter
messages: 384655
nosy: cosimo193
priority: normal
severity: normal
status: open
title: Entry Widget not editable on Windows 10, but is on Linux Ubuntu 16.04
type: behavior
versions: Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42867>
_______________________________________

From report at bugs.python.org  Fri Jan  8 07:50:24 2021
From: report at bugs.python.org (Christian Heimes)
Date: Fri, 08 Jan 2021 12:50:24 +0000
Subject: [issue42867] Entry Widget not editable on Windows 10,
 but is on Linux Ubuntu 16.04
In-Reply-To: <1610109973.36.0.703695549775.issue42867@roundup.psfhosted.org>
Message-ID: <1610110224.46.0.957483462388.issue42867@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

Hi,

bugs.python.org is an issue tracker for bugs and feature requests. Please use platforms like Python user mailing list, stack overflow, or reddit for general help with Python and libraries.

----------
nosy: +christian.heimes

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42867>
_______________________________________

From report at bugs.python.org  Fri Jan  8 08:05:25 2021
From: report at bugs.python.org (Christian Heimes)
Date: Fri, 08 Jan 2021 13:05:25 +0000
Subject: [issue42853] `OverflowError: signed integer is greater than maximum`
 in ssl.py for files larger than 2GB
In-Reply-To: <1610006589.59.0.311109371799.issue42853@roundup.psfhosted.org>
Message-ID: <1610111125.82.0.20189778345.issue42853@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

That's a good idea, Ronald! socket.c:sock_send_impl() already clamps the input length on Windows:

#ifdef MS_WINDOWS
    if (ctx->len > INT_MAX)
        ctx->len = INT_MAX;
    ctx->result = send(s->sock_fd, ctx->buf, (int)ctx->len, ctx->flags);
#else
    ctx->result = send(s->sock_fd, ctx->buf, ctx->len, ctx->flags);
#endif

I could implement a similar logic for SSLSocket. Applications have to check the return value of send() any way or use sendall(). The socket.send() method / send(2) libc function may also write less bytes.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42853>
_______________________________________

From report at bugs.python.org  Fri Jan  8 08:12:48 2021
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 08 Jan 2021 13:12:48 +0000
Subject: [issue14655] traceback module docs should show how to print/fomat an
 exception object
In-Reply-To: <1335216172.17.0.173976069373.issue14655@psf.upfronthosting.co.za>
Message-ID: <1610111568.25.0.164259846566.issue14655@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

In issue 26389 the api was changed so that now format_exception(exc) works.

----------
resolution:  -> duplicate
stage: needs patch -> resolved
status: open -> closed
superseder:  -> Expand traceback module API to accept just an exception as an argument

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue14655>
_______________________________________

From report at bugs.python.org  Fri Jan  8 08:35:18 2021
From: report at bugs.python.org (John McCabe)
Date: Fri, 08 Jan 2021 13:35:18 +0000
Subject: [issue42867] Entry Widget not editable on Windows 10,
 but is on Linux Ubuntu 16.04
In-Reply-To: <1610109973.36.0.703695549775.issue42867@roundup.psfhosted.org>
Message-ID: <1610112918.89.0.605565196902.issue42867@roundup.psfhosted.org>


John McCabe <john at mccabe.org.uk> added the comment:

Is behaviour that differs between platforms, using components that are listed in the "classification" -> "Components" section NOT a bug then?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42867>
_______________________________________

From report at bugs.python.org  Fri Jan  8 08:59:38 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 08 Jan 2021 13:59:38 +0000
Subject: [issue42866] test test_multibytecodec:
 Test_IncrementalEncoder.test_subinterp() leaks references
In-Reply-To: <1610098119.51.0.27659926103.issue42866@roundup.psfhosted.org>
Message-ID: <1610114378.27.0.714696476113.issue42866@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Calling gc.collect() twice works around the issue, which sounds like a missing traverse function somewhere.

diff --git a/Python/pystate.c b/Python/pystate.c
index c791b23999..66bbe1bf7d 100644
--- a/Python/pystate.c
+++ b/Python/pystate.c
@@ -321,6 +321,7 @@ interpreter_clear(PyInterpreterState *interp, PyThreadState *tstate)
 
     /* Last garbage collection on this interpreter */
     _PyGC_CollectNoFail(tstate);
+    _PyGC_CollectNoFail(tstate);
     _PyGC_Fini(tstate);
 
     /* We don't clear sysdict and builtins until the end of this function.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42866>
_______________________________________

From report at bugs.python.org  Fri Jan  8 09:01:49 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 08 Jan 2021 14:01:49 +0000
Subject: [issue42866] test test_multibytecodec:
 Test_IncrementalEncoder.test_subinterp() leaks references
In-Reply-To: <1610098119.51.0.27659926103.issue42866@roundup.psfhosted.org>
Message-ID: <1610114509.41.0.030375722357.issue42866@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset e542d417b96077d04aec089505eacb990c9799ae by Victor Stinner in branch 'master':
bpo-42866: Fix refleak in CJK getcodec() (GH-24165)
https://github.com/python/cpython/commit/e542d417b96077d04aec089505eacb990c9799ae


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42866>
_______________________________________

From report at bugs.python.org  Fri Jan  8 09:02:53 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 08 Jan 2021 14:02:53 +0000
Subject: [issue42866] test test_multibytecodec:
 Test_IncrementalEncoder.test_subinterp() leaks references
In-Reply-To: <1610098119.51.0.27659926103.issue42866@roundup.psfhosted.org>
Message-ID: <1610114573.65.0.0066839409145.issue42866@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +22994
pull_request: https://github.com/python/cpython/pull/24166

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42866>
_______________________________________

From report at bugs.python.org  Fri Jan  8 09:04:00 2021
From: report at bugs.python.org (Christian Heimes)
Date: Fri, 08 Jan 2021 14:04:00 +0000
Subject: [issue42867] Entry Widget not editable on Windows 10,
 but is on Linux Ubuntu 16.04
In-Reply-To: <1610109973.36.0.703695549775.issue42867@roundup.psfhosted.org>
Message-ID: <1610114640.52.0.670762481033.issue42867@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

Can your produce the issue with Python 3.8 or newer on any platform? 3.6 and 3.7 are in security fix-only mode. If it's truly a bug in Python, then we won't fix the issue any way.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42867>
_______________________________________

From report at bugs.python.org  Fri Jan  8 09:09:12 2021
From: report at bugs.python.org (John McCabe)
Date: Fri, 08 Jan 2021 14:09:12 +0000
Subject: [issue42867] Entry Widget not editable on Windows 10,
 but is on Linux Ubuntu 16.04
In-Reply-To: <1610109973.36.0.703695549775.issue42867@roundup.psfhosted.org>
Message-ID: <1610114952.04.0.966440319508.issue42867@roundup.psfhosted.org>


John McCabe <john at mccabe.org.uk> added the comment:

It's reproducible in both 3.8 and 3.9 on Windows 10.

----------
versions: +Python 3.9 -Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42867>
_______________________________________

From report at bugs.python.org  Fri Jan  8 09:12:48 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Fri, 08 Jan 2021 14:12:48 +0000
Subject: [issue42866] test test_multibytecodec:
 Test_IncrementalEncoder.test_subinterp() leaks references
In-Reply-To: <1610098119.51.0.27659926103.issue42866@roundup.psfhosted.org>
Message-ID: <1610115168.89.0.0533559208302.issue42866@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

Don't you need to free memory using PyObject_GC_Del when you allocate using PyObject_GC_New?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42866>
_______________________________________

From report at bugs.python.org  Fri Jan  8 09:13:30 2021
From: report at bugs.python.org (John McCabe)
Date: Fri, 08 Jan 2021 14:13:30 +0000
Subject: [issue42867] Entry Widget not editable on Windows 10,
 but is on Linux Ubuntu 16.04
In-Reply-To: <1610109973.36.0.703695549775.issue42867@roundup.psfhosted.org>
Message-ID: <1610115210.66.0.699072932327.issue42867@roundup.psfhosted.org>


John McCabe <john at mccabe.org.uk> added the comment:

In addition, changing "Entry" to "Text" (+ necessary associated changes) makes no difference to the outcome. Removing the call to tk.messagebox.askquestion() does. It appears that tk.messagebox.askquestion() is screwing something up on Windows; perhaps it's locking some resources, or not correctly releasing them.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42867>
_______________________________________

From report at bugs.python.org  Fri Jan  8 09:13:55 2021
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 08 Jan 2021 14:13:55 +0000
Subject: [issue30701] Exception parsing certain invalid email address headers
In-Reply-To: <1497864347.44.0.160991763633.issue30701@psf.upfronthosting.co.za>
Message-ID: <1610115235.15.0.236424100426.issue30701@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> out of date
stage:  -> resolved
status: pending -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30701>
_______________________________________

From report at bugs.python.org  Fri Jan  8 09:14:03 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Fri, 08 Jan 2021 14:14:03 +0000
Subject: [issue42866] test test_multibytecodec:
 Test_IncrementalEncoder.test_subinterp() leaks references
In-Reply-To: <1610098119.51.0.27659926103.issue42866@roundup.psfhosted.org>
Message-ID: <1610115243.76.0.297469000732.issue42866@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

Ref. https://docs.python.org/3/c-api/typeobj.html#Py_TPFLAGS_HAVE_GC

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42866>
_______________________________________

From report at bugs.python.org  Fri Jan  8 09:22:07 2021
From: report at bugs.python.org (Christian Heimes)
Date: Fri, 08 Jan 2021 14:22:07 +0000
Subject: [issue42867] Entry Widget not editable on Windows 10,
 but is on Linux Ubuntu 16.04
In-Reply-To: <1610109973.36.0.703695549775.issue42867@roundup.psfhosted.org>
Message-ID: <1610115727.11.0.626376590059.issue42867@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

I'm involving TJ and Serhiy. They might have free resources and might be able to assist.

I initially suggested to get assistance in user forums, because we have very limited resources. To give you an impression, there are more than 7,500 open bugs on BPO and more than 1,400 open PRs on Github..

----------
nosy: +serhiy.storchaka, terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42867>
_______________________________________

From report at bugs.python.org  Fri Jan  8 09:23:23 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 08 Jan 2021 14:23:23 +0000
Subject: [issue42866] test test_multibytecodec:
 Test_IncrementalEncoder.test_subinterp() leaks references
In-Reply-To: <1610098119.51.0.27659926103.issue42866@roundup.psfhosted.org>
Message-ID: <1610115803.19.0.746476625385.issue42866@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> Don't you need to free memory using PyObject_GC_Del when you allocate using PyObject_GC_New?

My PR uses the generic tp->tp_free which PyObject_GC_Del().

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42866>
_______________________________________

From report at bugs.python.org  Fri Jan  8 09:23:42 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 08 Jan 2021 14:23:42 +0000
Subject: [issue42866] test test_multibytecodec:
 Test_IncrementalEncoder.test_subinterp() leaks references
In-Reply-To: <1610098119.51.0.27659926103.issue42866@roundup.psfhosted.org>
Message-ID: <1610115822.79.0.556355217302.issue42866@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

typo: My PR uses the generic tp->tp_free which *is* PyObject_GC_Del().

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42866>
_______________________________________

From report at bugs.python.org  Fri Jan  8 09:24:52 2021
From: report at bugs.python.org (miss-islington)
Date: Fri, 08 Jan 2021 14:24:52 +0000
Subject: [issue42866] test test_multibytecodec:
 Test_IncrementalEncoder.test_subinterp() leaks references
In-Reply-To: <1610098119.51.0.27659926103.issue42866@roundup.psfhosted.org>
Message-ID: <1610115892.45.0.478439412824.issue42866@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 3.0 -> 4.0
pull_requests: +22995
pull_request: https://github.com/python/cpython/pull/24167

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42866>
_______________________________________

From report at bugs.python.org  Fri Jan  8 09:26:04 2021
From: report at bugs.python.org (miss-islington)
Date: Fri, 08 Jan 2021 14:26:04 +0000
Subject: [issue42866] test test_multibytecodec:
 Test_IncrementalEncoder.test_subinterp() leaks references
In-Reply-To: <1610098119.51.0.27659926103.issue42866@roundup.psfhosted.org>
Message-ID: <1610115964.03.0.858479020262.issue42866@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +22996
pull_request: https://github.com/python/cpython/pull/24168

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42866>
_______________________________________

From report at bugs.python.org  Fri Jan  8 09:29:01 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Fri, 08 Jan 2021 14:29:01 +0000
Subject: [issue42866] test test_multibytecodec:
 Test_IncrementalEncoder.test_subinterp() leaks references
In-Reply-To: <1610098119.51.0.27659926103.issue42866@roundup.psfhosted.org>
Message-ID: <1610116141.08.0.768613372173.issue42866@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

Ah, thanks! I also found that info in the docs: https://docs.python.org/3/c-api/typeobj.html#c.PyTypeObject.tp_free

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42866>
_______________________________________

From report at bugs.python.org  Fri Jan  8 09:29:52 2021
From: report at bugs.python.org (John McCabe)
Date: Fri, 08 Jan 2021 14:29:52 +0000
Subject: [issue42867] Entry Widget not editable on Windows 10,
 but is on Linux Ubuntu 16.04
In-Reply-To: <1610109973.36.0.703695549775.issue42867@roundup.psfhosted.org>
Message-ID: <1610116192.69.0.130126105887.issue42867@roundup.psfhosted.org>


John McCabe <john at mccabe.org.uk> added the comment:

Thank you.

Wrt to your initial suggestion, I recognise Python's popularity will make things busy, and I will ask if anyone knows of a workaround in other fora, but a bug's a bug and, IMO, if something behaves differently on different platforms, using packages that are part of the Python install, for no apparent reason, then that's a bug! (Especially as the same thing was reported over 10 years ago, on what would be a very different version of Python).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42867>
_______________________________________

From report at bugs.python.org  Fri Jan  8 09:44:10 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 08 Jan 2021 14:44:10 +0000
Subject: [issue42866] test test_multibytecodec:
 Test_IncrementalEncoder.test_subinterp() leaks references
In-Reply-To: <1610098119.51.0.27659926103.issue42866@roundup.psfhosted.org>
Message-ID: <1610117050.9.0.726271609013.issue42866@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 11ef53aefbecfac18b63cee518a7184f771f708c by Victor Stinner in branch 'master':
bpo-42866: Add traverse func to _multibytecodec.MultibyteCodec (GH-24166)
https://github.com/python/cpython/commit/11ef53aefbecfac18b63cee518a7184f771f708c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42866>
_______________________________________

From report at bugs.python.org  Fri Jan  8 09:46:35 2021
From: report at bugs.python.org (Jin-oh Kang)
Date: Fri, 08 Jan 2021 14:46:35 +0000
Subject: [issue42868] SpooledTemporaryFile.__iter__ is not transparent to
 rollover
Message-ID: <1610117195.08.0.928321664408.issue42868@roundup.psfhosted.org>


New submission from Jin-oh Kang <jinoh.kang.kr at gmail.com>:

In tempfile, SpooledTemporaryFile.__iter__ is defined as follows:

    # file protocol
    def __iter__(self):
        return self._file.__iter__()

A rollover would switch the underlying _file object from a BytesIO to a TemporaryFile, thereby leaving the original iterator stale.

This may be fixed by:

    def __iter__(self):
        while True:
            line = self._file.readline()
            if not line:
                break
            yield line

Or perhaps:

    def __iter__(self):
        while True:
            file = self._file
            for line in file:
                yield line
                if file is not self._file:
                    break
            else:
                break

----------
components: Library (Lib)
messages: 384674
nosy: jinoh.kang.kr
priority: normal
severity: normal
status: open
title: SpooledTemporaryFile.__iter__ is not transparent to rollover
type: behavior
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42868>
_______________________________________

From report at bugs.python.org  Fri Jan  8 09:49:29 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 08 Jan 2021 14:49:29 +0000
Subject: [issue42866] test test_multibytecodec:
 Test_IncrementalEncoder.test_subinterp() leaks references
In-Reply-To: <1610098119.51.0.27659926103.issue42866@roundup.psfhosted.org>
Message-ID: <1610117369.22.0.385110952501.issue42866@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Ok, it's now fixed.

To make sure that a heap type can be deleted, it must by a GC type, has a traverse function, and it must track its instances. We should take this in account when we convert static types to heap types. In practice, deleting a type is mostly an issue when we check for reference leak and an instance is kept alive until the last GC collection, at the end of Py_EndInterpreter().

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42866>
_______________________________________

From report at bugs.python.org  Fri Jan  8 10:41:40 2021
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 08 Jan 2021 15:41:40 +0000
Subject: [issue31213] __context__ reset to None in nested exception
In-Reply-To: <1502819039.28.0.810222147268.issue31213@psf.upfronthosting.co.za>
Message-ID: <1610120500.48.0.485618385539.issue31213@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This seems to be deliberately done here in order to prevent context cycles from forming: https://github.com/python/cpython/blob/fe6e5e7cfd68eeaa69fd1511f354a1b4d8d90990/Python/errors.c#L148

In your code you are creating a cycle where foo is the context (and cause) for bar which is the context (and cause) of the second time foo is raised. 

If you create a new instance of foo for the second raise then there is no cycle and you get what you expect:

try:
    try:
        raise Exception('foo')
    except Exception as foo:
        print("1--", foo, foo.__context__, foo.__cause__)
        try:
            raise Exception('bar') from foo
        except Exception as bar:
            print("2--", bar, bar.__context__, bar.__context__.__context__)
            raise Exception('foo2') from bar
except Exception as foo:
    wat = foo

print("3--", wat, wat.__context__, wat.__context__.__context__)
print("4--", wat, wat.__cause__, wat.__cause__.__context__)
print("5--", wat, wat.__cause__, wat.__cause__.__cause__)


Output is:

1-- foo None None
2-- bar foo None
3-- foo2 bar foo
4-- foo2 bar foo
5-- foo2 bar foo


I think the bug is in your code - you can't create an exception chain that contains the same exception instance more than once.

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31213>
_______________________________________

From report at bugs.python.org  Fri Jan  8 10:48:11 2021
From: report at bugs.python.org (=?utf-8?q?Miro_Hron=C4=8Dok?=)
Date: Fri, 08 Jan 2021 15:48:11 +0000
Subject: [issue9694] argparse required arguments displayed under "optional
 arguments"
In-Reply-To: <1282846759.11.0.900867962743.issue9694@psf.upfronthosting.co.za>
Message-ID: <1610120891.92.0.308459605932.issue9694@roundup.psfhosted.org>


Miro Hron?ok <miro at hroncok.cz> added the comment:

Coudl this please be mentioned on https://docs.python.org/3.10/whatsnew/3.10.html ?

At least two packages fail tests because of the change (ipython and sphinxcontrib-autoprogram).

----------
nosy: +hroncok

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue9694>
_______________________________________

From report at bugs.python.org  Fri Jan  8 10:55:48 2021
From: report at bugs.python.org (lcy)
Date: Fri, 08 Jan 2021 15:55:48 +0000
Subject: [issue42269] Add ability to set __slots__ in dataclasses
In-Reply-To: <1604590694.08.0.0173517280171.issue42269@roundup.psfhosted.org>
Message-ID: <1610121348.68.0.421985416639.issue42269@roundup.psfhosted.org>


Change by lcy <u900011+python at gmail.com>:


----------
nosy: +lcy0321

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42269>
_______________________________________

From report at bugs.python.org  Fri Jan  8 11:06:50 2021
From: report at bugs.python.org (E. Paine)
Date: Fri, 08 Jan 2021 16:06:50 +0000
Subject: [issue42867] Entry Widget not editable on Windows 10,
 but is on Linux Ubuntu 16.04
In-Reply-To: <1610109973.36.0.703695549775.issue42867@roundup.psfhosted.org>
Message-ID: <1610122010.8.0.302943281887.issue42867@roundup.psfhosted.org>


E. Paine <paineelisha at gmail.com> added the comment:

This is a Tk/Windows issue, not tkinter. I tested the following on Windows 10 using Tk 8.6.9:

# Our entry
pack [entry .e]

# Causes the entry to fail
#tk_messageBox -title Title -message Message
#after 0 tk_messageBox -title Title -message Message

# Does not cause the entry to fail
#after 1 tk_messageBox -title Title -message Message
after idle tk_messageBox -title Title -message Message

I have not tried on a later version of Tk so it may be fixed but it also may be a fundamental Windows issue. The workaround would be to either use .after(1, ...) or .after_idle(...)

----------
nosy: +epaine
versions: +Python 3.10, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42867>
_______________________________________

From report at bugs.python.org  Fri Jan  8 11:34:29 2021
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 08 Jan 2021 16:34:29 +0000
Subject: [issue41742] Request for
 docs.python.org/3/library/configparser.html#exceptions improvement
In-Reply-To: <1599554715.27.0.66152205525.issue41742@roundup.psfhosted.org>
Message-ID: <1610123669.96.0.82260689966.issue41742@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
keywords: +easy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41742>
_______________________________________

From report at bugs.python.org  Fri Jan  8 11:39:38 2021
From: report at bugs.python.org (seb)
Date: Fri, 08 Jan 2021 16:39:38 +0000
Subject: [issue41116] build on macOS 11 (beta) does not find system-supplied
 third-party libraries
In-Reply-To: <1593100264.48.0.613850075185.issue41116@roundup.psfhosted.org>
Message-ID: <1610123978.72.0.587186886289.issue41116@roundup.psfhosted.org>


seb <s_rath at maxon.net> added the comment:

I am running macOS Big Sur Version 11.1 on Silicon and still get the error about the missing lzma.h file. I can confirm that I use the latest Python 3.9.1 version which includes the patches of this issue.

gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -std=c99 -Wextra -Wno-unused-result -Wno-unused-parameter -Wno-missing-field-initializers -Wstrict-prototypes -Werror=implicit-function-declaration -fvisibility=hidden -I./Include/internal -I./Include -I. -I/usr/local/include -I/Users/dev/Downloads/Python-3.9.1/Include -I/Users/dev/Downloads/Python-3.9.1 -c /Users/dev/Downloads/Python-3.9.1/Modules/_lzmamodule.c -o build/temp.macosx-11.1-arm64-3.9/Users/dev/Downloads/Python-3.9.1/Modules/_lzmamodule.o
/Users/dev/Downloads/Python-3.9.1/Modules/_lzmamodule.c:16:10: fatal error: 'lzma.h' file not found
#include <lzma.h>

Is this supposed to be still the case? Thank you!

----------
nosy: +seb

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41116>
_______________________________________

From report at bugs.python.org  Fri Jan  8 11:43:53 2021
From: report at bugs.python.org (Ned Deily)
Date: Fri, 08 Jan 2021 16:43:53 +0000
Subject: [issue41116] build on macOS 11 (beta) does not find system-supplied
 third-party libraries
In-Reply-To: <1593100264.48.0.613850075185.issue41116@roundup.psfhosted.org>
Message-ID: <1610124233.38.0.832296114161.issue41116@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

> I am running macOS Big Sur Version 11.1 on Silicon and still get the error about the missing lzma.h file.

Unfortunately, Apple does not include the XZ library with macOS so, to build that module, you will need to supply a copy from another source, either build it yourself or from a third-party library provider like Homebrew or MacPorts.  The Python Developer's Guid has some suggestions:

https://devguide.python.org/setup/#macos-and-os-x

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41116>
_______________________________________

From report at bugs.python.org  Fri Jan  8 11:54:47 2021
From: report at bugs.python.org (Benjamin Peterson)
Date: Fri, 08 Jan 2021 16:54:47 +0000
Subject: [issue42798] pip search fails
In-Reply-To: <1609442411.49.0.32642630503.issue42798@roundup.psfhosted.org>
Message-ID: <1610124887.61.0.73713731155.issue42798@roundup.psfhosted.org>


Change by Benjamin Peterson <benjamin at python.org>:


----------
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42798>
_______________________________________

From report at bugs.python.org  Fri Jan  8 11:59:47 2021
From: report at bugs.python.org (Ned Deily)
Date: Fri, 08 Jan 2021 16:59:47 +0000
Subject: [issue42865] sysconfig appends CFLAGS to LD
In-Reply-To: <1610078438.84.0.384790848261.issue42865@roundup.psfhosted.org>
Message-ID: <1610125187.32.0.150299162392.issue42865@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
nosy: +ned.deily

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42865>
_______________________________________

From report at bugs.python.org  Fri Jan  8 12:25:29 2021
From: report at bugs.python.org (Ned Deily)
Date: Fri, 08 Jan 2021 17:25:29 +0000
Subject: [issue42850] Process hangs when calling urllib.request in a
 multiprocessing.Process with import of sounddevice package
In-Reply-To: <1610000036.98.0.246954881352.issue42850@roundup.psfhosted.org>
Message-ID: <1610126729.84.0.0677276669263.issue42850@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Also note that there are known problems with using the "fork" start method of multiprocessing on macOS. As of Python 3.8, the default start methord on macOS is now "spawn":

https://docs.python.org/3.9/library/multiprocessing.html#contexts-and-start-methods

Try using "spawn" and/or upgrade to a more recent version of Python 3 (3.9.1 is current).

----------
nosy: +ned.deily

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42850>
_______________________________________

From report at bugs.python.org  Fri Jan  8 12:41:15 2021
From: report at bugs.python.org (John McCabe)
Date: Fri, 08 Jan 2021 17:41:15 +0000
Subject: [issue42867] Entry Widget not editable on Windows 10,
 but is on Linux Ubuntu 16.04
In-Reply-To: <1610109973.36.0.703695549775.issue42867@roundup.psfhosted.org>
Message-ID: <1610127675.59.0.889965737609.issue42867@roundup.psfhosted.org>


John McCabe <john at mccabe.org.uk> added the comment:

@epaine Thank you for your comments. Although the order of events in the example you quoted isn't the same as in the application I'm using (tk.messagebox.askquestion() is called a long time before the Enter widget is created in the application, not the other way round), what you've suggested, and a bit of extra thought, has led to a solution for me. I wrapped the self.createWidgets call in self.after_idle() (so self.after_idle(self.createWidgets)) and that appears to do the job.

Many thanks; it's appreciated.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42867>
_______________________________________

From report at bugs.python.org  Fri Jan  8 12:53:26 2021
From: report at bugs.python.org (Steve Dower)
Date: Fri, 08 Jan 2021 17:53:26 +0000
Subject: [issue42863] Python venv inconsistent folder structure on windows
In-Reply-To: <1610068238.28.0.631501714908.issue42863@roundup.psfhosted.org>
Message-ID: <1610128406.22.0.153595554298.issue42863@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

I'm afraid not, at least not without breaking everyone who has hardcoded the paths already. And I'm pretty sure that include directory is never used anymore, either (at least not by distutils, and not by default).

The sysconfig module provides the programmatic interface to the directory structure - I'd suggest using "sysconfig.get_paths()" to find the locations where files may be written to.

I'd also suggest building your native C library to a wheel and then installing that into the virtual environment, as that's the supported way of adding files. In that case, there's other tooling for specifying the destination for particular files, and it all already takes into account the layout on different platforms.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42863>
_______________________________________

From report at bugs.python.org  Fri Jan  8 13:01:27 2021
From: report at bugs.python.org (paul j3)
Date: Fri, 08 Jan 2021 18:01:27 +0000
Subject: [issue9694] argparse required arguments displayed under "optional
 arguments"
In-Reply-To: <1282846759.11.0.900867962743.issue9694@psf.upfronthosting.co.za>
Message-ID: <1610128887.4.0.354789984545.issue9694@roundup.psfhosted.org>


paul j3 <ajipanca at gmail.com> added the comment:

Since this issue is closed it might be a good idea to open a new one with this problem.  And if possible identify the failed tests.  

We forgot to allow for the fact that working code/tests might be checking for specific help messages, checks the will fail when this group label is changed.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue9694>
_______________________________________

From report at bugs.python.org  Fri Jan  8 13:02:04 2021
From: report at bugs.python.org (Jeff Moguillansky)
Date: Fri, 08 Jan 2021 18:02:04 +0000
Subject: [issue42863] Python venv inconsistent folder structure on windows
In-Reply-To: <1610068238.28.0.631501714908.issue42863@roundup.psfhosted.org>
Message-ID: <1610128924.96.0.69467387913.issue42863@roundup.psfhosted.org>


Jeff Moguillansky <jmoguill2 at gmail.com> added the comment:

To give more context regarding this issue:
I'm currently using meson build system to generate the pkg-config files, and it seems that the paths "include", "lib" are hardcoded.  

>From the perspective of the overall system, I think it would simplify integration and reduce complexity if we normalize folder structures across platforms instead of having different folder structures.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42863>
_______________________________________

From report at bugs.python.org  Fri Jan  8 13:13:45 2021
From: report at bugs.python.org (Ethan Furman)
Date: Fri, 08 Jan 2021 18:13:45 +0000
Subject: [issue42851] Subclassing Enum with ipaddress.IPv4Network/IPv6Network
 raises TypeError.
In-Reply-To: <1610001583.18.0.772940964765.issue42851@roundup.psfhosted.org>
Message-ID: <1610129625.43.0.182161262402.issue42851@roundup.psfhosted.org>


Change by Ethan Furman <ethan at stoneleaf.us>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42851>
_______________________________________

From report at bugs.python.org  Fri Jan  8 13:13:56 2021
From: report at bugs.python.org (Steve Dower)
Date: Fri, 08 Jan 2021 18:13:56 +0000
Subject: [issue42863] Python venv inconsistent folder structure on windows
In-Reply-To: <1610068238.28.0.631501714908.issue42863@roundup.psfhosted.org>
Message-ID: <1610129636.27.0.787438596844.issue42863@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

> From the perspective of the overall system, I think it would simplify integration and reduce complexity if we normalize folder structures across platforms instead of having different folder structures.

I agree. But from the perspective of not breaking every existing system out there, it makes more sense to not suddenly change it.

If you'd like to champion the 2-3 year (a.k.a. 2-3 release) migration effort to get there, I'm more than happy to make sure you're taken seriously by the rest of the core team. I'm just not prepared to champion it myself :) I have other concerns to use my OSS time for.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42863>
_______________________________________

From report at bugs.python.org  Fri Jan  8 13:34:00 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Fri, 08 Jan 2021 18:34:00 +0000
Subject: [issue24464] "sqlite3_enable_shared_cache" deprecation warning when
 compiling with macOS system SQLite3
In-Reply-To: <1434627103.24.0.34027869681.issue24464@psf.upfronthosting.co.za>
Message-ID: <1610130840.16.0.4389426132.issue24464@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
pull_requests: +22997
pull_request: https://github.com/python/cpython/pull/24170

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24464>
_______________________________________

From report at bugs.python.org  Fri Jan  8 13:34:18 2021
From: report at bugs.python.org (Jeff Moguillansky)
Date: Fri, 08 Jan 2021 18:34:18 +0000
Subject: [issue42863] Python venv inconsistent folder structure on windows
In-Reply-To: <1610068238.28.0.631501714908.issue42863@roundup.psfhosted.org>
Message-ID: <1610130858.1.0.887865465829.issue42863@roundup.psfhosted.org>


Jeff Moguillansky <jmoguill2 at gmail.com> added the comment:

Maybe we can consider adding additional params and a new code path to python -m venv?  This way we don't break any existing functionality?

e.g. -includedir=... -libdir=... -bindir=...
?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42863>
_______________________________________

From report at bugs.python.org  Fri Jan  8 14:04:24 2021
From: report at bugs.python.org (Paul Moore)
Date: Fri, 08 Jan 2021 19:04:24 +0000
Subject: [issue42863] Python venv inconsistent folder structure on windows
In-Reply-To: <1610068238.28.0.631501714908.issue42863@roundup.psfhosted.org>
Message-ID: <1610132664.85.0.316146363865.issue42863@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:

Many tools hard code the "if windows then 'Scripts' else 'bin'" logic. They will simply fail to work with environments that don't have that layout. Yes, they probably should use sysconfig, but many don't (and sometimes for arguably good reasons, for example tools run using one Python interpreter that manipulate the environment of a different one).

It's something that *could* be changed, but the cost would be significant, the work needed to manage the transition is non-trivial, and the benefit isn't particularly obvious - "consistency" is never very compelling in isolation, and "works better with meson" is likely to be met with the argument that Python's layout has been around longer than meson, so it's on meson to accommodate Python, not the other way around.

I'm not actively against the idea, but neither do I particularly support it (I'm pretty sure it would require work for pip, for no benefit to pip's existing users, so it's a net loss for me personally).

If you're interested in pushing for this change go for it - I suspect that it would probably need a PEP, and at the very least it would need a community discussion - but be prepared for it to meet with a certain amount of resistance.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42863>
_______________________________________

From report at bugs.python.org  Fri Jan  8 14:13:56 2021
From: report at bugs.python.org (Jeff Moguillansky)
Date: Fri, 08 Jan 2021 19:13:56 +0000
Subject: [issue42863] Python venv inconsistent folder structure on windows
In-Reply-To: <1610068238.28.0.631501714908.issue42863@roundup.psfhosted.org>
Message-ID: <1610133236.85.0.746747929924.issue42863@roundup.psfhosted.org>


Jeff Moguillansky <jmoguill2 at gmail.com> added the comment:

Thanks for the feedback, I understand

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42863>
_______________________________________

From report at bugs.python.org  Fri Jan  8 15:40:14 2021
From: report at bugs.python.org (Yurii Karabas)
Date: Fri, 08 Jan 2021 20:40:14 +0000
Subject: [issue42269] Add ability to set __slots__ in dataclasses
In-Reply-To: <1604590694.08.0.0173517280171.issue42269@roundup.psfhosted.org>
Message-ID: <1610138414.79.0.541883954752.issue42269@roundup.psfhosted.org>


Change by Yurii Karabas <1998uriyyo at gmail.com>:


----------
keywords: +patch
nosy: +uriyyo
nosy_count: 5.0 -> 6.0
pull_requests: +22998
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24171

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42269>
_______________________________________

From report at bugs.python.org  Fri Jan  8 15:44:20 2021
From: report at bugs.python.org (Yurii Karabas)
Date: Fri, 08 Jan 2021 20:44:20 +0000
Subject: [issue42269] Add ability to set __slots__ in dataclasses
In-Reply-To: <1604590694.08.0.0173517280171.issue42269@roundup.psfhosted.org>
Message-ID: <1610138660.41.0.581206024411.issue42269@roundup.psfhosted.org>


Yurii Karabas <1998uriyyo at gmail.com> added the comment:

Hi Eric, I tried to help you with this feature and have opened a PR. I thought that you are too busy to implement this feature, so that's why I decided to help you (It almost two months since your last message in this thread).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42269>
_______________________________________

From report at bugs.python.org  Fri Jan  8 15:53:10 2021
From: report at bugs.python.org (cptpcrd)
Date: Fri, 08 Jan 2021 20:53:10 +0000
Subject: [issue42780] os.set_inheritable() fails for O_PATH file descriptors
 on Linux
In-Reply-To: <1609262318.62.0.976413615492.issue42780@roundup.psfhosted.org>
Message-ID: <1610139190.69.0.934326523959.issue42780@roundup.psfhosted.org>


Change by cptpcrd <cptpcrd.enterprise at gmail.com>:


----------
pull_requests: +22999
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24172

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42780>
_______________________________________

From report at bugs.python.org  Fri Jan  8 16:11:44 2021
From: report at bugs.python.org (Erik Soma)
Date: Fri, 08 Jan 2021 21:11:44 +0000
Subject: [issue42840] `type` takes **kwargs for __init_subclass__
In-Reply-To: <1609946481.51.0.225785046936.issue42840@roundup.psfhosted.org>
Message-ID: <1610140304.52.0.0161886399673.issue42840@roundup.psfhosted.org>


Change by Erik Soma <stillusingirc at gmail.com>:


----------
keywords: +patch
pull_requests: +23000
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24173

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42840>
_______________________________________

From report at bugs.python.org  Fri Jan  8 16:25:45 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Fri, 08 Jan 2021 21:25:45 +0000
Subject: [issue42862] Use functools.lru_cache iso. _sqlite.Cache in sqlite3
 module
In-Reply-To: <1610066343.94.0.466682345605.issue42862@roundup.psfhosted.org>
Message-ID: <1610141145.4.0.365175111393.issue42862@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

$ python3.10 -m timeit -s 'import sqlite3; con = sqlite3.connect(":memory:"); query="select * from sqlite_master"' 'con.execute(query); con.execute(query)'
100000 loops, best of 5: 2.95 usec per loop
$ ./python.exe -m timeit -s 'import sqlite3; con = sqlite3.connect(":memory:"); query="select * from sqlite_master"' 'con.execute(query); con.execute(query)'
100000 loops, best of 5: 2.68 usec per loop

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42862>
_______________________________________

From report at bugs.python.org  Fri Jan  8 16:34:29 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 08 Jan 2021 21:34:29 +0000
Subject: [issue42807] smtplib send_message should gives more clear exception
 if the msg is None
In-Reply-To: <1609561396.29.0.629926386929.issue42807@roundup.psfhosted.org>
Message-ID: <1610141669.41.0.903861027247.issue42807@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

I am not familiar with either smtp or email, but I can make some general comments.

1. "AttributeError: 'NoneType' object has no attribute 'get_all'" seems pretty straightforward to me.  Hard to debug?  Depends on knowledge and experience. When coming from library code, it nearly always means that one called a library function with an invalid argument.  None, with only standard dunder attributes, is perhaps the most common bad argument.  Look in the traceback to find the bad call in one's own code, where one must have passed None, even if not by that name.  In this case, if one does not know that 'get_all' is a method of the two email message classes, this can be discovered in the document index.

2. It is not a bug for a function to expect users to know the above and in effect say "Don't do that!" when an attribute reference fails.  So I see this as an enhancement request, not a bugfix report.  But why add a check for None to this particular function?

3. Python functions often use duck-typing, allowing arguments that act sufficiently well like the documented requirement.  While https://docs.python.org/3/library/smtplib.html#smtplib.SMTP.send_message  says that msg should be a Message object, this may not be an exact requirement.  Indeed, https://docs.python.org/3/library/smtplib.html#smtplib.SMTP.send_message starts with "The Message class is very similar to the EmailMessage class ...".  So I wonder, "Is EmailMessage is also allowed?"  Or, "Do  any users pass instances of custom message classes?"

If so, perhaps the doc should be augmented.  But checking only for Message would be wrong, and would break code passing non-Message instances.

----------
nosy: +barry, maxking, r.david.murray, terry.reedy
stage:  -> test needed
type: behavior -> enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42807>
_______________________________________

From report at bugs.python.org  Fri Jan  8 16:40:09 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 08 Jan 2021 21:40:09 +0000
Subject: [issue42812] @overload-ing method of parent class without actual
 implementation
In-Reply-To: <1609653092.18.0.893619520042.issue42812@roundup.psfhosted.org>
Message-ID: <1610142009.96.0.747628716483.issue42812@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
nosy: +gvanrossum, levkivskyi

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42812>
_______________________________________

From report at bugs.python.org  Fri Jan  8 16:55:55 2021
From: report at bugs.python.org (Julien Palard)
Date: Fri, 08 Jan 2021 21:55:55 +0000
Subject: [issue42869] pydoc does not append .html to documentation
Message-ID: <1610142955.15.0.664460414569.issue42869@roundup.psfhosted.org>


New submission from Julien Palard <julien+python at palard.fr>:

Running `python3 -m pydoc ensurepip` gives me:

https://docs.python.org/3.9/library/ensurepip
but it should be:

https://docs.python.org/3.9/library/ensurepip.html

Issue is in getdocloc function on the line:

    docloc = "%s/%s" % (docloc.rstrip("/"), object.__name__.lower())

But it previously worked as the nginx config for the doc server contains:

    # Emulate Apache's content-negotiation. Was a temporary measure,
    # but now people are using it like a feature.
    location ~ ^/((2|3)(\.[0-8])?|dev)/\w+/[\d\w\.]+(?!\.html)$ {
        if (-f "${request_filename}.html") {
            return 301 https://$host:$request_uri.html;
        }
    }

(So yes "people are using it like a feature" contains pydoc :))

Notice the [0-8], which does not match for my /3.9/.

I propose to fix the issue on both sides:
- On psf-salt to allow 3.9 to get the "temporary" measure.
- pydoc side to simplify the code

----------
assignee: docs at python
components: Documentation
messages: 384693
nosy: docs at python, mdk
priority: normal
severity: normal
status: open
title: pydoc does not append .html to documentation
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42869>
_______________________________________

From report at bugs.python.org  Fri Jan  8 17:08:45 2021
From: report at bugs.python.org (Julien Palard)
Date: Fri, 08 Jan 2021 22:08:45 +0000
Subject: [issue42869] pydoc does not append .html to documentation
In-Reply-To: <1610142955.15.0.664460414569.issue42869@roundup.psfhosted.org>
Message-ID: <1610143725.08.0.875815319577.issue42869@roundup.psfhosted.org>


Change by Julien Palard <julien+python at palard.fr>:


----------
keywords: +patch
pull_requests: +23001
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24174

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42869>
_______________________________________

From report at bugs.python.org  Fri Jan  8 17:11:03 2021
From: report at bugs.python.org (Julien Palard)
Date: Fri, 08 Jan 2021 22:11:03 +0000
Subject: [issue42869] pydoc does not append .html to documentation
In-Reply-To: <1610142955.15.0.664460414569.issue42869@roundup.psfhosted.org>
Message-ID: <1610143863.0.0.724768207167.issue42869@roundup.psfhosted.org>


Julien Palard <julien+python at palard.fr> added the comment:

This is now fixed on the docs server thanks to [1], so it should work for already release Python 3.9 :)

[1]: https://github.com/python/psf-salt/pull/198

I still did a PR on cpython to avoid a redirection, and get cpython itself out of the "people use this temporary fix as a feature now".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42869>
_______________________________________

From report at bugs.python.org  Fri Jan  8 17:44:05 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Fri, 08 Jan 2021 22:44:05 +0000
Subject: [issue1635741] Py_Finalize() doesn't clear all Python objects at exit
Message-ID: <1610145845.03.0.736929728515.issue1635741@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
pull_requests: +23002
pull_request: https://github.com/python/cpython/pull/24175

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1635741>
_______________________________________

From report at bugs.python.org  Fri Jan  8 17:59:56 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 08 Jan 2021 22:59:56 +0000
Subject: [issue42820] Sphinx conf.py needs_version entry is outdated
In-Reply-To: <1609723694.82.0.961390909546.issue42820@roundup.psfhosted.org>
Message-ID: <1610146796.99.0.0775544186083.issue42820@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
nosy: +mdk

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42820>
_______________________________________

From report at bugs.python.org  Fri Jan  8 18:27:30 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 08 Jan 2021 23:27:30 +0000
Subject: [issue42825] Build libraries with "/OPT:REF" linker optimization on
 Windows
In-Reply-To: <1609782160.13.0.0224895080942.issue42825@roundup.psfhosted.org>
Message-ID: <1610148450.86.0.588542851436.issue42825@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

The PR says that this deletes "uncalled code".  I imagine that this is safe for a .exe.  But for a .dll?  As i understand it, one can, from python code, access any function via ctypes, so it seems to me that there is no way for the linker to know which callable functions in a .dll can be safely deleted.  Am I missing something?

----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42825>
_______________________________________

From report at bugs.python.org  Fri Jan  8 18:35:25 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 08 Jan 2021 23:35:25 +0000
Subject: [issue42802] distutils: Remove bdist_wininst command
In-Reply-To: <1609511307.58.0.913169413627.issue42802@roundup.psfhosted.org>
Message-ID: <1610148925.25.0.674978067413.issue42802@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 0e2a0f72cc9af0899eacb5604e44a563c0b06110 by Victor Stinner in branch 'master':
bpo-42802: Remove distutils bdist_wininst command (GH-24043)
https://github.com/python/cpython/commit/0e2a0f72cc9af0899eacb5604e44a563c0b06110


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42802>
_______________________________________

From report at bugs.python.org  Fri Jan  8 18:35:42 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 08 Jan 2021 23:35:42 +0000
Subject: [issue42820] Sphinx conf.py needs_version entry is outdated
In-Reply-To: <1609723694.82.0.961390909546.issue42820@roundup.psfhosted.org>
Message-ID: <1610148942.57.0.817987673334.issue42820@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

This is related to #42843, which is about deciding what the min sphinx should be.  Since the alternative to 3.2 is some 2.x, 1,8 is certainly wrong.

----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42820>
_______________________________________

From report at bugs.python.org  Fri Jan  8 18:38:15 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 08 Jan 2021 23:38:15 +0000
Subject: [issue42802] distutils: Remove bdist_wininst command
In-Reply-To: <1609511307.58.0.913169413627.issue42802@roundup.psfhosted.org>
Message-ID: <1610149095.53.0.895817584579.issue42802@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42802>
_______________________________________

From report at bugs.python.org  Fri Jan  8 18:42:29 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 08 Jan 2021 23:42:29 +0000
Subject: [issue42849] pool worker can't be terminated
In-Reply-To: <1609992006.83.0.897606551243.issue42849@roundup.psfhosted.org>
Message-ID: <1610149349.81.0.418324980541.issue42849@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

3.7 has not gotten bug fixes for a couple of years.  This needs to be verified on a current release.

----------
nosy: +davin, pitrou, terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42849>
_______________________________________

From report at bugs.python.org  Fri Jan  8 18:50:53 2021
From: report at bugs.python.org (=?utf-8?q?Miro_Hron=C4=8Dok?=)
Date: Fri, 08 Jan 2021 23:50:53 +0000
Subject: [issue42870] Document changed argparse output wrt optional arguments
 in What's new in Python 3.10
Message-ID: <1610149853.78.0.949568295376.issue42870@roundup.psfhosted.org>


New submission from Miro Hron?ok <miro at hroncok.cz>:

A followup from https://bugs.python.org/issue9694

Could the change in output please be mentioned on https://docs.python.org/3.10/whatsnew/3.10.html ?

In Fedora, at least 3 packages fail tests because of the change:

ipython: https://github.com/ipython/ipython/pull/12759
m2r: https://github.com/miyakogi/m2r/pull/62
sphinxcontrib-autoprogram: https://bugzilla.redhat.com/show_bug.cgi?id=1914341

Thanks.

----------
assignee: docs at python
components: Documentation
messages: 384699
nosy: docs at python, hroncok, paul.j3, rhettinger
priority: normal
severity: normal
status: open
title: Document changed argparse output wrt optional arguments in What's new in Python 3.10
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42870>
_______________________________________

From report at bugs.python.org  Fri Jan  8 18:51:14 2021
From: report at bugs.python.org (=?utf-8?q?Miro_Hron=C4=8Dok?=)
Date: Fri, 08 Jan 2021 23:51:14 +0000
Subject: [issue9694] argparse required arguments displayed under "optional
 arguments"
In-Reply-To: <1282846759.11.0.900867962743.issue9694@psf.upfronthosting.co.za>
Message-ID: <1610149874.33.0.792829918605.issue9694@roundup.psfhosted.org>


Miro Hron?ok <miro at hroncok.cz> added the comment:

https://bugs.python.org/issue42870

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue9694>
_______________________________________

From report at bugs.python.org  Fri Jan  8 19:18:24 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 09 Jan 2021 00:18:24 +0000
Subject: [issue9673] Entry Widget Not Editable under Windows XP with dialog
 call.
In-Reply-To: <1282672182.44.0.886074830019.issue9673@psf.upfronthosting.co.za>
Message-ID: <1610151504.01.0.40024090803.issue9673@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

My testing was inadequate.  From #42867, it appears that 0. the bug is limited to Windows; 1. opening a canned dialog or message box is part of getting the buggy behavior; 2. timing is involved; 3. the bug can be exhibited on Windows directly with wish/tk, so that it is a 3rd party tcl/tk issue and not a tkinter issue.  Hence changing the issue resolution.

A workaround mentioned in both the referenced tkinter thread and #42867 is to call after_idle() at some point.

----------
resolution: out of date -> third party
title: Entry Widget Not Editable under Windows XP -> Entry Widget Not Editable under Windows XP with dialog call.

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue9673>
_______________________________________

From report at bugs.python.org  Fri Jan  8 19:44:15 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 09 Jan 2021 00:44:15 +0000
Subject: [issue42867] Entry Widget not editable on Windows 10,
 but is on Linux Ubuntu 16.04
In-Reply-To: <1610109973.36.0.703695549775.issue42867@roundup.psfhosted.org>
Message-ID: <1610153055.92.0.305532049972.issue42867@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

I added this note to #9673 after rereading the posts and the 2010 tkinter list thread.

"My testing was inadequate.  From #42867, it appears that 0. the bug is limited to Windows; 1. opening a canned dialog or message box is part of getting the buggy behavior; 2. timing is involved; 3. the bug can be exhibited on Windows directly with wish/tk, so that it is a 3rd party tcl/tk issue and not a tkinter issue.  Hence changing the issue resolution.

A workaround mentioned in both the referenced tkinter thread and #42867 is to call after_idle() at some point."

Paine, thank you for verifying both the bug and workaround directly with tk.  I am closing this also as 3rd party.

----------
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42867>
_______________________________________

From report at bugs.python.org  Fri Jan  8 20:25:31 2021
From: report at bugs.python.org (Renji)
Date: Sat, 09 Jan 2021 01:25:31 +0000
Subject: [issue42871] Regex compilation crashed if I change order of
 alternatives under quantifier
Message-ID: <1610155530.98.0.643940594728.issue42871@roundup.psfhosted.org>


New submission from Renji <AsoRenji at gmail.com>:

I can compile "((a)|b\2)*" expression and this expression successfully return captures from first repetition and second repetition in one time. But if I write (b\2|(a))* expression, I get "invalid group reference 2 at position 3" error. Either first or second behavior incorrect.
python3 --version Python 3.7.3

import re
text="aba"
#match=re.search(r"(b\2|(a))*",text) - not worked
match=re.search(r"((a)|b\2)*",text)
if(match):
    #show aba ba a
    print(match.group(0)+" "+match.group(1)+" "+match.group(2))

----------
components: Regular Expressions
messages: 384703
nosy: Renji, ezio.melotti, mrabarnett
priority: normal
severity: normal
status: open
title: Regex compilation crashed if I change order of alternatives under quantifier
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42871>
_______________________________________

From report at bugs.python.org  Fri Jan  8 20:26:20 2021
From: report at bugs.python.org (Ryan Hileman)
Date: Sat, 09 Jan 2021 01:26:20 +0000
Subject: [issue42800] Traceback objects allow accessing frame objects without
 triggering audit hooks
In-Reply-To: <1609460218.67.0.01717828776.issue42800@roundup.psfhosted.org>
Message-ID: <1610155580.9.0.723786689947.issue42800@roundup.psfhosted.org>


Ryan Hileman <lunixbochs at gmail.com> added the comment:

traceback's `tb_code` attribute also allows you to bypass the `object.__getattr__` audit event for `__code__`.

Perhaps accessing a traceback object's `tb_code` and `tb_frame` should both raise an `object.__getattr__` event?

----------
nosy: +lunixbochs2

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42800>
_______________________________________

From report at bugs.python.org  Fri Jan  8 20:38:21 2021
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 09 Jan 2021 01:38:21 +0000
Subject: [issue42800] Traceback objects allow accessing frame objects without
 triggering audit hooks
In-Reply-To: <1609460218.67.0.01717828776.issue42800@roundup.psfhosted.org>
Message-ID: <1610156301.73.0.601198167126.issue42800@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42800>
_______________________________________

From report at bugs.python.org  Fri Jan  8 20:42:42 2021
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 09 Jan 2021 01:42:42 +0000
Subject: [issue42800] Traceback objects allow accessing frame objects without
 triggering audit hooks
In-Reply-To: <1609460218.67.0.01717828776.issue42800@roundup.psfhosted.org>
Message-ID: <1610156562.67.0.026179574784.issue42800@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I don't think that audit hooks should be seen as a way to build a robust sandbox.
https://www.python.org/dev/peps/pep-0578/#why-not-a-sandbox

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42800>
_______________________________________

From report at bugs.python.org  Fri Jan  8 20:44:13 2021
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 09 Jan 2021 01:44:13 +0000
Subject: [issue42800] Traceback objects allow accessing frame objects without
 triggering audit hooks
In-Reply-To: <1609460218.67.0.01717828776.issue42800@roundup.psfhosted.org>
Message-ID: <1610156653.11.0.350778345881.issue42800@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Even if no audit hook is registered, adding an audit event on a function has a cost on runtime performance. object.__getattr__() is a core Python function, if an event is added, we should properly measure the performance overhead to decide if it's acceptable or not.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42800>
_______________________________________

From report at bugs.python.org  Fri Jan  8 20:49:33 2021
From: report at bugs.python.org (Erik Soma)
Date: Sat, 09 Jan 2021 01:49:33 +0000
Subject: [issue42840] `type` takes **kwargs for __init_subclass__
In-Reply-To: <1609946481.51.0.225785046936.issue42840@roundup.psfhosted.org>
Message-ID: <1610156973.51.0.359644766766.issue42840@roundup.psfhosted.org>


Erik Soma <stillusingirc at gmail.com> added the comment:

Seems I misframed the issue a bit. I didn't realize keyword arguments besides 'metaclass' were introduced with PEP 3115 with Python 3.0.


In any case I've posted a PR to update the docs and typeshed.
Typeshed PR for reference: https://github.com/python/typeshed/pull/4918

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42840>
_______________________________________

From report at bugs.python.org  Fri Jan  8 21:00:02 2021
From: report at bugs.python.org (Matthew Barnett)
Date: Sat, 09 Jan 2021 02:00:02 +0000
Subject: [issue42871] Regex compilation crashed if I change order of
 alternatives under quantifier
In-Reply-To: <1610155530.98.0.643940594728.issue42871@roundup.psfhosted.org>
Message-ID: <1610157602.53.0.966446615795.issue42871@roundup.psfhosted.org>


Matthew Barnett <python at mrabarnett.plus.com> added the comment:

It's not a crash. It's complaining that you're referring to group 2 before defining it. The re module doesn't support forward references to groups, but only backward references to them.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42871>
_______________________________________

From report at bugs.python.org  Fri Jan  8 21:11:40 2021
From: report at bugs.python.org (Renji)
Date: Sat, 09 Jan 2021 02:11:40 +0000
Subject: [issue42871] Regex compilation crashed if I change order of
 alternatives under quantifier
In-Reply-To: <1610155530.98.0.643940594728.issue42871@roundup.psfhosted.org>
Message-ID: <1610158300.37.0.864062525446.issue42871@roundup.psfhosted.org>


Renji <AsoRenji at gmail.com> added the comment:

In my example reference and capture group presents in two difference alternatives. They don't follow each other, but executed in random order. If this don't supported in one case, why it supported in other case?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42871>
_______________________________________

From report at bugs.python.org  Fri Jan  8 21:25:37 2021
From: report at bugs.python.org (Ryan Hileman)
Date: Sat, 09 Jan 2021 02:25:37 +0000
Subject: [issue42800] Traceback objects allow accessing frame objects without
 triggering audit hooks
In-Reply-To: <1609460218.67.0.01717828776.issue42800@roundup.psfhosted.org>
Message-ID: <1610159137.46.0.282032297041.issue42800@roundup.psfhosted.org>


Ryan Hileman <lunixbochs at gmail.com> added the comment:

I'm definitely not proposing to hook all of object.__getattr__, as my intuition says that would be very slow. I simply refer to "object.__getattr__" as the event name used by a couple of rare event audit hooks. This is how getting __code__ is emitted: https://github.com/python/cpython/blob/7301979b23406220510dd2c7934a21b41b647119/Objects/funcobject.c#L250

However, there's not much point in the sys._getframe and func.__code__ family of audit hooks right now as tracebacks expose the same information (and may even do so accidentally). I am personally interested in these hooks for non sandbox reasons in a production application that cares about perf, FWIW.

I think this would be implemented by extending the traceback object's getters to include tb_code and tb_frame: https://github.com/python/cpython/blob/7301979b23406220510dd2c7934a21b41b647119/Python/traceback.c#L156-L159

I project it won't have any noticeable perf impact (especially if the audit hook is written in C), as most reasons to inspect a traceback object will be exceptional and not in critical paths.

I'd be happy to write a proposed patch if that would help.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42800>
_______________________________________

From report at bugs.python.org  Fri Jan  8 21:38:37 2021
From: report at bugs.python.org (Matthew Barnett)
Date: Sat, 09 Jan 2021 02:38:37 +0000
Subject: [issue42871] Regex compilation crashed if I change order of
 alternatives under quantifier
In-Reply-To: <1610155530.98.0.643940594728.issue42871@roundup.psfhosted.org>
Message-ID: <1610159917.5.0.99181953023.issue42871@roundup.psfhosted.org>


Matthew Barnett <python at mrabarnett.plus.com> added the comment:

Example 1:

    ((a)|b\2)*
     ^^^       Group 2

    ((a)|b\2)*
          ^^   Reference to group 2

    The reference refers backwards to the group.

Example 2:

    (b\2|(a))*
         ^^^   Group 2

    (b\2|(a))*
      ^^       Reference to group 2

    The reference refers forwards to the group.

As I said, the re module doesn't support forward references to groups.

If you have a regex where forward references are unavoidable, try the 3rd-party 'regex' module instead. It's available on PyPI.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42871>
_______________________________________

From report at bugs.python.org  Fri Jan  8 22:04:21 2021
From: report at bugs.python.org (Renji)
Date: Sat, 09 Jan 2021 03:04:21 +0000
Subject: [issue42871] Regex compilation crashed if I change order of
 alternatives under quantifier
In-Reply-To: <1610155530.98.0.643940594728.issue42871@roundup.psfhosted.org>
Message-ID: <1610161461.71.0.510956607457.issue42871@roundup.psfhosted.org>


Renji <AsoRenji at gmail.com> added the comment:

I through "forward reference" is "\1 (abcd)". Not "some sort of reference in second repetition to data from first repetition".

Ok. In other words refers from on repetition to other supported, but with purely formal restrictions. And remove this restrictions don't planned. Than this issue may be closed.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42871>
_______________________________________

From report at bugs.python.org  Fri Jan  8 23:16:21 2021
From: report at bugs.python.org (Ryan Hileman)
Date: Sat, 09 Jan 2021 04:16:21 +0000
Subject: [issue42800] Traceback objects allow accessing frame objects without
 triggering audit hooks
In-Reply-To: <1609460218.67.0.01717828776.issue42800@roundup.psfhosted.org>
Message-ID: <1610165781.54.0.483466612863.issue42800@roundup.psfhosted.org>


Ryan Hileman <lunixbochs at gmail.com> added the comment:

Oops, by tb_code I meant traceback.tb_frame.f_code. So you can get to a frame from traceback.tb_frame (without triggering audit) or sys._getframe (which has an audit hook already), and you can get to __code__ from a frame via frame.f_code (without triggering audit).

Here's a patch for both frame.f_code and traceback.tb_frame:
https://github.com/lunixbochs/cpython/commit/2334a00c833874b7a2427e88abc9b51315bb010c

---

Benchmarks follow this section, made using the commit I linked (and the parent commit without the patch for comparison). My takeaways from playing around:

1. You probably shouldn't install a Python audit hook if you care about performance.
2. C audit hook performance impact shows up in microbenchmarking but only have a small impact on real workloads (see the traceback.format_tb benchmark at the end).
3. Performance impact of this change when you _don't_ have an audit hook installed is very small.
4. This seems to mostly impact debugging and test code. A quick check of the stdlib shows:
- traceback.tb_frame usage seems to be entirely in debugger, traceback, and testing code: https://github.com/python/cpython/search?l=Python&p=3&q=tb_frame
- frame.f_code primarily has similar debug use (dis, warnings, profiling, inspect): https://github.com/python/cpython/search?l=Python&p=3&q=f_code

Attached (c_audit_ext.zip) is the empty C audit hook I used for the benchmarks. `python3 setup.py build_ext` builds a `c_audit` module which registers an empty audit hook on import.

################################################################################
#### frame.f_code object.__getattr__ audit hook

# Testing frame.f_code impact (no audit hook installed):
./python.exe -m timeit -s 'frame = sys._getframe()' -- 'frame.f_code'

with patch 2334a00c833874b7a2427e88abc9b51315bb010c
20000000 loops, best of 5: 19.1 nsec per loop
20000000 loops, best of 5: 18.7 nsec per loop
20000000 loops, best of 5: 19.1 nsec per loop

without patch 2334a00c833874b7a2427e88abc9b51315bb010c
20000000 loops, best of 5: 17 nsec per loop
20000000 loops, best of 5: 16.7 nsec per loop
20000000 loops, best of 5: 17 nsec per loop

# Testing frame.f_code impact (C audit hook installed):
python.exe -m timeit -s 'import c_audit; frame = sys._getframe()' -- 'frame.f_code'

with patch 2334a00c833874b7a2427e88abc9b51315bb010c
5000000 loops, best of 5: 66.1 nsec per loop
5000000 loops, best of 5: 66.1 nsec per loop
5000000 loops, best of 5: 66.5 nsec per loop

without patch 2334a00c833874b7a2427e88abc9b51315bb010c
20000000 loops, best of 5: 16.9 nsec per loop
20000000 loops, best of 5: 16.9 nsec per loop
20000000 loops, best of 5: 16.8 nsec per loop

# Testing frame.f_code impact (pure Python audit hook installed):
./python.exe -m timeit -s 'frame = sys._getframe(); sys.addaudithook(lambda *a: None)' -- 'frame.f_code'

with patch 2334a00c833874b7a2427e88abc9b51315bb010c
500000 loops, best of 5: 1.02 usec per loop
500000 loops, best of 5: 1.04 usec per loop
500000 loops, best of 5: 1.02 usec per loop

without patch 2334a00c833874b7a2427e88abc9b51315bb010c
20000000 loops, best of 5: 16.8 nsec per loop
20000000 loops, best of 5: 17.1 nsec per loop
20000000 loops, best of 5: 16.8 nsec per loop

################################################################################
#### tb.tb_frame object.__getattr__ audit hook

# Testing tb.tb_frame impact (no audit hook installed)
./python.exe -m timeit -s "$(echo -e "try: a\nexcept Exception as e: tb = e.__traceback__")" -- 'tb.tb_frame'

with patch 2334a00c833874b7a2427e88abc9b51315bb010c
20000000 loops, best of 5: 19.2 nsec per loop
20000000 loops, best of 5: 18.9 nsec per loop
20000000 loops, best of 5: 18.9 nsec per loop

without patch 2334a00c833874b7a2427e88abc9b51315bb010c
20000000 loops, best of 5: 17 nsec per loop
20000000 loops, best of 5: 16.7 nsec per loop
20000000 loops, best of 5: 16.8 nsec per loop

# Testing tb.tb_frame impact (C audit hook installed)
./python.exe -m timeit -s "$(echo -e "import c_audit\ntry: a\nexcept Exception as e: tb = e.__traceback__")" -- 'tb.tb_frame'

with patch 2334a00c833874b7a2427e88abc9b51315bb010c
5000000 loops, best of 5: 64.8 nsec per loop
5000000 loops, best of 5: 64.8 nsec per loop
5000000 loops, best of 5: 64.8 nsec per loop

without patch 2334a00c833874b7a2427e88abc9b51315bb010c
20000000 loops, best of 5: 16.7 nsec per loop
20000000 loops, best of 5: 16.9 nsec per loop
20000000 loops, best of 5: 16.9 nsec per loop

# Testing tb.tb_frame impact (pure Python audit hook installed)
./python.exe -m timeit -s "$(echo -e "sys.addaudithook(lambda *a: None)\ntry: a\nexcept Exception as e: tb = e.__traceback__")" -- 'tb.tb_frame'

with patch 2334a00c833874b7a2427e88abc9b51315bb010c
500000 loops, best of 5: 1.04 usec per loop
500000 loops, best of 5: 1.02 usec per loop
500000 loops, best of 5: 1.04 usec per loop

without patch 2334a00c833874b7a2427e88abc9b51315bb010c
20000000 loops, best of 5: 16.9 nsec per loop
20000000 loops, best of 5: 16.9 nsec per loop
20000000 loops, best of 5: 17.2 nsec per loop

################################################################################
#### tb.tb_frame object.__getattr__ audit hook, traceback.format_tb()

# Testing tb.tb_frame impact on traceback.format_tb (no audit hook installed)
with patch 2334a00c833874b7a2427e88abc9b51315bb010c
100000 loops, best of 5: 3 usec per loop
100000 loops, best of 5: 3.03 usec per loop
100000 loops, best of 5: 3 usec per loop

without patch 2334a00c833874b7a2427e88abc9b51315bb010c
100000 loops, best of 5: 2.99 usec per loop
100000 loops, best of 5: 3.02 usec per loop
100000 loops, best of 5: 2.99 usec per loop

# Testing tb.tb_frame impact on traceback.format_tb (C audit hook installed)
./python.exe -m timeit -s "$(echo -e "import c_audit\nimport traceback\ntry: a\nexcept Exception as e: tb = e.__traceback__")" -- 'traceback.format_tb(tb)'

with patch 2334a00c833874b7a2427e88abc9b51315bb010c
100000 loops, best of 5: 3.13 usec per loop
100000 loops, best of 5: 3.13 usec per loop
100000 loops, best of 5: 3.12 usec per loop

without patch 2334a00c833874b7a2427e88abc9b51315bb010c
100000 loops, best of 5: 3.06 usec per loop
100000 loops, best of 5: 3.06 usec per loop
100000 loops, best of 5: 3.05 usec per loop

# Testing tb.tb_frame impact on traceback.format_tb (pure Python audit hook installed)
./python.exe -m timeit -s "$(echo -e "sys.addaudithook(lambda *a: None)\nimport traceback\ntry: a\nexcept Exception as e: tb = e.__traceback__")" -- 'traceback.format_tb(tb)'

with patch 2334a00c833874b7a2427e88abc9b51315bb010c
50000 loops, best of 5: 5.1 usec per loop
50000 loops, best of 5: 5.18 usec per loop
50000 loops, best of 5: 5.06 usec per loop

without patch 2334a00c833874b7a2427e88abc9b51315bb010c
100000 loops, best of 5: 3 usec per loop
100000 loops, best of 5: 3 usec per loop
100000 loops, best of 5: 3 usec per loop

----------
Added file: https://bugs.python.org/file49729/c_audit_ext.zip

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42800>
_______________________________________

From report at bugs.python.org  Sat Jan  9 00:50:57 2021
From: report at bugs.python.org (Robin Scheibler)
Date: Sat, 09 Jan 2021 05:50:57 +0000
Subject: [issue42850] Process hangs when calling urllib.request in a
 multiprocessing.Process with import of sounddevice package
In-Reply-To: <1610000036.98.0.246954881352.issue42850@roundup.psfhosted.org>
Message-ID: <1610171457.44.0.408822367421.issue42850@roundup.psfhosted.org>


Robin Scheibler <fakufaku at gmail.com> added the comment:

Thanks for the suggestion. I had indeed run into some issues with fork vs spawn before.

I have tested with 3.8.5 and 3.9.1 and the bug doesn't occur with these more recent versions.

Should I leave the bug open since 3.7 is still supported ?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42850>
_______________________________________

From report at bugs.python.org  Sat Jan  9 03:15:26 2021
From: report at bugs.python.org (Hong Xu)
Date: Sat, 09 Jan 2021 08:15:26 +0000
Subject: [issue42872] Inconsistent exception thrown by mkdir on different OSes
Message-ID: <1610180126.52.0.315552258683.issue42872@roundup.psfhosted.org>


New submission from Hong Xu <hong at topbug.net>:

Consider the following code:

-------------------------

import pathlib

def main():
    pathlib.Path('tmp').touch()
    pathlib.Path('tmp/tmp_sub').mkdir(parents=True)

main()

------------------------

Run the code above in an empty directory.

On Linux, it throws a `NotADirectory` exception:

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "main.py", line 5, in main
    pathlib.Path('tmp/tmp_sub').mkdir(parents=True)
  File "/usr/lib/python3.8/pathlib.py", line 1287, in mkdir
    self._accessor.mkdir(self, mode)
NotADirectoryError: [Errno 20] Not a directory: 'tmp/tmp_sub'

-----------------------------

On Windows, it throws a FileExistsError exception:

Traceback (most recent call last):
  File "C:\Users\hong\anaconda3\lib\pathlib.py", line 1284, in mkdir
    self._accessor.mkdir(self, mode)
FileNotFoundError: [WinError 3] The system cannot find the path specified: 'tmp\\tmp_sub'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 7, in <module>
    main()
  File "main.py", line 5, in main
    pathlib.Path('tmp/tmp_sub').mkdir(parents=True)
  File "C:\Users\hong\anaconda3\lib\pathlib.py", line 1288, in mkdir
    self.parent.mkdir(parents=True, exist_ok=True)
  File "C:\Users\hong\anaconda3\lib\pathlib.py", line 1284, in mkdir
    self._accessor.mkdir(self, mode)
FileExistsError: [WinError 183] Cannot create a file when that file already exists: 'tmp

----------
components: Library (Lib), Windows
messages: 384715
nosy: Hong Xu, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: Inconsistent exception thrown by mkdir on different OSes
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42872>
_______________________________________

From report at bugs.python.org  Sat Jan  9 03:17:22 2021
From: report at bugs.python.org (Hong Xu)
Date: Sat, 09 Jan 2021 08:17:22 +0000
Subject: [issue42872] Inconsistent exceptions thrown by mkdir on different OSes
In-Reply-To: <1610180126.52.0.315552258683.issue42872@roundup.psfhosted.org>
Message-ID: <1610180242.37.0.712950240982.issue42872@roundup.psfhosted.org>


Change by Hong Xu <hong at topbug.net>:


----------
title: Inconsistent exception thrown by mkdir on different OSes -> Inconsistent exceptions thrown by mkdir on different OSes

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42872>
_______________________________________

From report at bugs.python.org  Sat Jan  9 03:17:38 2021
From: report at bugs.python.org (Hong Xu)
Date: Sat, 09 Jan 2021 08:17:38 +0000
Subject: [issue42872] Inconsistent exceptions thrown by pathlib.Path.mkdir on
 different OSes
In-Reply-To: <1610180126.52.0.315552258683.issue42872@roundup.psfhosted.org>
Message-ID: <1610180258.7.0.221421579525.issue42872@roundup.psfhosted.org>


Change by Hong Xu <hong at topbug.net>:


----------
title: Inconsistent exceptions thrown by mkdir on different OSes -> Inconsistent exceptions thrown by pathlib.Path.mkdir on different OSes

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42872>
_______________________________________

From report at bugs.python.org  Sat Jan  9 04:27:41 2021
From: report at bugs.python.org (John McCabe)
Date: Sat, 09 Jan 2021 09:27:41 +0000
Subject: [issue42867] Entry Widget not editable on Windows 10,
 but is on Linux Ubuntu 16.04
In-Reply-To: <1610109973.36.0.703695549775.issue42867@roundup.psfhosted.org>
Message-ID: <1610184461.67.0.924122752859.issue42867@roundup.psfhosted.org>


John McCabe <john at mccabe.org.uk> added the comment:

Thank you all for your time. I hope you don't feel it has been wasted since, at the very least, it confirms an issue in tkinter usage, albeit that the actual cause of the issue is TK itself.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42867>
_______________________________________

From report at bugs.python.org  Sat Jan  9 06:26:02 2021
From: report at bugs.python.org (Berker Peksag)
Date: Sat, 09 Jan 2021 11:26:02 +0000
Subject: [issue24464] "sqlite3_enable_shared_cache" deprecation warning when
 compiling with macOS system SQLite3
In-Reply-To: <1434627103.24.0.34027869681.issue24464@psf.upfronthosting.co.za>
Message-ID: <1610191562.17.0.142855476002.issue24464@roundup.psfhosted.org>


Berker Peksag <berker.peksag at gmail.com> added the comment:


New changeset d16f6176abdecbb7ab231dc78beccfaa095beff6 by Erlend Egeberg Aasland in branch 'master':
bpo-24464: Fix sqlite3.enable_shared_cache() deprecation wrapper (GH-24170)
https://github.com/python/cpython/commit/d16f6176abdecbb7ab231dc78beccfaa095beff6


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24464>
_______________________________________

From report at bugs.python.org  Sat Jan  9 07:00:18 2021
From: report at bugs.python.org (Mark Dickinson)
Date: Sat, 09 Jan 2021 12:00:18 +0000
Subject: [issue42873] Exponential time and space requirements for compilation
 of nested try/finally blocks
Message-ID: <1610193618.87.0.555969864656.issue42873@roundup.psfhosted.org>


New submission from Mark Dickinson <dickinsm at gmail.com>:

tl;dr - contrived (but relatively short) code involving nested try/finally blocks can produce disproportionately large bytecode. I'm not expecting or suggesting any action here, but the situation seemed at least worth noting. Feel free to close this issue as a "well don't do that, then" (a.k.a. "wont fix")

Longer: Python 3.9 changed the way that bytecode was generated for try/finally (see #33387). For a "try" block body that can do any of raise, return or fall-off-the-end-of-the-block, the corresponding finally block gets three separate paths in the bytecode. If such trys are nested <n> times, we get 3^n separate paths in the bytecode.

Example code:

----------------
def f():
    try:
        if something(): return
    finally:
        try:
            if something(): return
        finally:
            try:
                if something(): return
            finally:
                try:
                    if something(): return
                finally:
                    try:
                        if something(): return
                    finally:
                        do_cleanup()


import dis
dis.dis(f)
----------------

On my machine, running this and counting the do_cleanup invocations gives, as expected, a result of 243 = 3**5

% python3.9 nested_finally.py | grep do_cleanup | wc -l 
     243

That's fairly benign, but if I scale up to 10 nested blocks, the dis.dis call takes over 10 minutes to complete (the compilation itself still only takes a fraction of a second). The bytecode object is correspondingly large:

>>> len(f.__code__.co_code)
1741356

With 15 levels of nesting, compilation takes several seconds, and
the generated code is (again as expected) a couple of orders of magnitude larger:

>>> len(f.__code__.co_code)
533859040

I didn't try pushing this further than 15 levels of nesting.

As I said above, it's not clear to me whether this is actually an issue that needs to be addressed in practice. It seems unlikely that "real code" :TM: would run into this, but the effect seemed worth noting.

----------
components: Interpreter Core
messages: 384718
nosy: Mark.Shannon, mark.dickinson
priority: normal
severity: normal
status: open
title: Exponential time and space requirements for compilation of nested try/finally blocks
type: performance
versions: Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42873>
_______________________________________

From report at bugs.python.org  Sat Jan  9 07:00:21 2021
From: report at bugs.python.org (Steve Dower)
Date: Sat, 09 Jan 2021 12:00:21 +0000
Subject: [issue42800] Traceback objects allow accessing frame objects without
 triggering audit hooks
In-Reply-To: <1609460218.67.0.01717828776.issue42800@roundup.psfhosted.org>
Message-ID: <1610193621.72.0.163411707445.issue42800@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

That's the same patch that I'd write, and I agree, we should hook this.

If the fields are documented anywhere, we should add the audit event data to get them into the table in the docs. Otherwise, that patch looks good to me.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42800>
_______________________________________

From report at bugs.python.org  Sat Jan  9 07:14:13 2021
From: report at bugs.python.org (Martin Wheatley)
Date: Sat, 09 Jan 2021 12:14:13 +0000
Subject: [issue42874] configure errors
Message-ID: <1610194453.5.0.66216438534.issue42874@roundup.psfhosted.org>


New submission from Martin Wheatley <martin.wheatley.home at gmail.com>:

I'm installin Python 3.91. on a Solaris 10 system (I known it's 'old' but I have a legacy installation to support).

Running ./configure the following errors are seen...

checking PROFILE_TASK... -m test --pgo
checking for --with-lto... no
checking for llvm-profdata... no
grep: illegal option -- q
Usage: grep -hblcnsviw pattern file . . .
checking for -Wextra... yes
checking whether /usr/sfw/bin/gcc accepts and needs -fno-strict-aliasing... yes
checking if we can turn off /usr/sfw/bin/gcc unused result warning... no
checking if we can turn off /usr/sfw/bin/gcc unused parameter warning... yes


and


checking aligned memory access is required... yes
checking for --with-hash-algorithm... default
checking for --with-tzpath... grep: illegal option -- q
grep: illegal option -- E
Usage: grep -hblcnsviw pattern file . . .
"/usr/share/zoneinfo:/usr/lib/zoneinfo:/usr/share/lib/zoneinfo:/etc/zoneinfo"
checking for --with-address-sanitizer... no
checking for --with-memory-sanitizer... no
checking for --with-undefined-behavior-sanitizer... no
checking for t_open in -lnsl... yes
checking for socket in -lsocket... yes

----------
components: Installation
messages: 384720
nosy: martin.wheatley.home
priority: normal
severity: normal
status: open
title: configure errors
type: enhancement
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42874>
_______________________________________

From report at bugs.python.org  Sat Jan  9 07:19:47 2021
From: report at bugs.python.org (Mark Dickinson)
Date: Sat, 09 Jan 2021 12:19:47 +0000
Subject: [issue42873] Exponential time and space requirements for compilation
 of nested try/finally blocks
In-Reply-To: <1610193618.87.0.555969864656.issue42873@roundup.psfhosted.org>
Message-ID: <1610194787.38.0.499632365338.issue42873@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

For extra fun, you can add `break` and `continue` paths into the mix to get a 5-fold instead of 3-fold  code size increase per level of nesting. It's still contrived code, though.

Example where do_cleanup() ends up with 5**4 = 625 paths:

----

def f():
    while True:
        try:
            if something(): break
            elif something_else(): continue
            elif yet_something_else(): return
        finally:
            try:
                if something(): break
                elif something_else(): continue
                elif yet_something_else(): return
            finally:
                try:
                    if something(): break
                    elif something_else(): continue
                    elif yet_something_else(): return
                finally:
                    try:
                        if something(): break
                        elif something_else(): continue
                        elif yet_something_else(): return
                    finally:
                        do_cleanup()
----

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42873>
_______________________________________

From report at bugs.python.org  Sat Jan  9 07:31:38 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 09 Jan 2021 12:31:38 +0000
Subject: [issue42873] Exponential time and space requirements for compilation
 of nested try/finally blocks
In-Reply-To: <1610193618.87.0.555969864656.issue42873@roundup.psfhosted.org>
Message-ID: <1610195498.11.0.690369363841.issue42873@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

And there may be more than one return/break/continue statement in the try block. It increases the base of the degree.

At least for "return" we perhaps can merge different cases. But it would complicate the compiler and cannot help in other cases.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42873>
_______________________________________

From report at bugs.python.org  Sat Jan  9 07:37:30 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 09 Jan 2021 12:37:30 +0000
Subject: [issue42872] Inconsistent exceptions thrown by pathlib.Path.mkdir on
 different OSes
In-Reply-To: <1610180126.52.0.315552258683.issue42872@roundup.psfhosted.org>
Message-ID: <1610195850.24.0.213310459951.issue42872@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Yes, some operations can raise instances of different OSError subclasses on different platforms, because the corresponding C function sets different errno. It is so, and we cannot do anything with this. It is just a part of the difference between plaforms.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42872>
_______________________________________

From report at bugs.python.org  Sat Jan  9 07:38:15 2021
From: report at bugs.python.org (Mark Shannon)
Date: Sat, 09 Jan 2021 12:38:15 +0000
Subject: [issue42873] Exponential time and space requirements for compilation
 of nested try/finally blocks
In-Reply-To: <1610193618.87.0.555969864656.issue42873@roundup.psfhosted.org>
Message-ID: <1610195895.73.0.37307081195.issue42873@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

I don't see what the problem is here.
People just don't write code like that, at least not if they do code review ;)

And even, in the *extremely* rare case that they do, the code executes correctly and reasonably quickly. It just uses a bit of extra memory.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42873>
_______________________________________

From report at bugs.python.org  Sat Jan  9 07:38:21 2021
From: report at bugs.python.org (Mark Dickinson)
Date: Sat, 09 Jan 2021 12:38:21 +0000
Subject: [issue42873] Exponential time and space requirements for compilation
 of nested try/finally blocks
In-Reply-To: <1610193618.87.0.555969864656.issue42873@roundup.psfhosted.org>
Message-ID: <1610195901.28.0.640825510805.issue42873@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

> And there may be more than one return/break/continue statement in the try block. It increases the base of the degree.

Ah, interesting. My understanding was that that can't happen, but I'll double check. In the control flow, all 'return' statements that leave a try block are going to the same place, so only one 'finally' branch needs to be generated no matter how many returns you have. And similarly for 'break' and 'continue'. IOW, what matters is the possible paths that can be taken when the finally block exits, and there are only up to 5 of those (for raise, return, break, continue, and leaving normally).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42873>
_______________________________________

From report at bugs.python.org  Sat Jan  9 07:42:13 2021
From: report at bugs.python.org (Mark Dickinson)
Date: Sat, 09 Jan 2021 12:42:13 +0000
Subject: [issue42873] Exponential time and space requirements for compilation
 of nested try/finally blocks
In-Reply-To: <1610193618.87.0.555969864656.issue42873@roundup.psfhosted.org>
Message-ID: <1610196133.18.0.17906106633.issue42873@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

> I don't see what the problem is here. People just don't write code like that.

Yes, agreed; as I said in the original post, I'm not expecting any action, but the effect did seem interesting enough to be worth noting in an issue (if only so that it can be recorded as a known "feature" and the resolution can be recorded for the future).

I'll close as won't fix.

----------
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42873>
_______________________________________

From report at bugs.python.org  Sat Jan  9 08:06:23 2021
From: report at bugs.python.org (Eryk Sun)
Date: Sat, 09 Jan 2021 13:06:23 +0000
Subject: [issue42872] Inconsistent exceptions thrown by pathlib.Path.mkdir on
 different OSes
In-Reply-To: <1610180126.52.0.315552258683.issue42872@roundup.psfhosted.org>
Message-ID: <1610197583.63.0.493292568979.issue42872@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

NT filesystems are specified to fail with STATUS_OBJECT_PATH_NOT_FOUND (0xC000003A) if a parent component in a path either does not exist or is not a directory. In the Windows API, this translates to ERROR_PATH_NOT_FOUND (3), which in the C runtime translates to ENOENT (2), which in Python is raised as FileNotFoundError.

The design of Path.mkdir() assumes POSIX behavior, which splits the above two cases respectively into ENOENT and ENOTDIR. Thus it assumes that FileNotFoundError means a parent component does not exist. This eliminates the race condition of having to test whether the parent path exists. In Windows, it's not possible to differentiate the two cases by error code alone, so unfortunately Path.mkdir() tries to create the parent path when it contains a non-directory component, and thus a nested FileExistsError exception is raised.

The design of os.makedirs() instead checks whether the parent exists before trying to create it, and ignores FileExitsError if creating the parent tree fails due to a race condition. This design behaves a bit more consistently across platforms, but it still fails with a different exception on Windows vs POSIX, i.e. FileNotFoundError vs NotADirectoryError.

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42872>
_______________________________________

From report at bugs.python.org  Sat Jan  9 08:29:22 2021
From: report at bugs.python.org (Johan Dahlin)
Date: Sat, 09 Jan 2021 13:29:22 +0000
Subject: [issue42115] Caching infrastructure for the evaluation loop:
 specialised opcodes
In-Reply-To: <1603336898.74.0.366564812208.issue42115@roundup.psfhosted.org>
Message-ID: <1610198962.23.0.946316979652.issue42115@roundup.psfhosted.org>


Change by Johan Dahlin <jdahlin at gmail.com>:


----------
nosy: +Johan Dahlin

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42115>
_______________________________________

From report at bugs.python.org  Sat Jan  9 09:34:59 2021
From: report at bugs.python.org (Pavel Ditenbir)
Date: Sat, 09 Jan 2021 14:34:59 +0000
Subject: [issue42875] argparse incorrectly shows help string on a new line in
 case of long command string
Message-ID: <1610202899.54.0.332342565241.issue42875@roundup.psfhosted.org>


New submission from Pavel Ditenbir <pavel.ditenbir at gmail.com>:

Steps to reproduce.

Run the attached script:
$ python3 argparse-indent-sample.py --help

The output is:
usage: argparse-indent-sample.py [-h] CMD ...

optional arguments:
  -h, --help           show this help message and exit

service:
  CMD                  command to use
    add                add something
    remove             remove something
    a-very-long-command
                       command that does something

Expected output is:
usage: argparse-indent-sample.py [-h] CMD ...

optional arguments:
  -h, --help           show this help message and exit

service:
  CMD                    command to use
    add                  add something
    remove               remove something
    a-very-long-command  command that does something

----------
components: Library (Lib)
files: argparse-indent-sample.py
messages: 384728
nosy: DiPaolo
priority: normal
severity: normal
status: open
title: argparse incorrectly shows help string on a new line in case of long command string
type: behavior
versions: Python 3.9
Added file: https://bugs.python.org/file49730/argparse-indent-sample.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42875>
_______________________________________

From report at bugs.python.org  Sat Jan  9 09:44:44 2021
From: report at bugs.python.org (CrouZ)
Date: Sat, 09 Jan 2021 14:44:44 +0000
Subject: [issue38822] Inconsistent os.stat behavior for directory with Access
 Denied
In-Reply-To: <1573928094.88.0.209131085868.issue38822@roundup.psfhosted.org>
Message-ID: <1610203484.28.0.572388275825.issue38822@roundup.psfhosted.org>


CrouZ <alfred.theorin at gmail.com> added the comment:

The problem exists in Python 3.8 as well, with the difference that ``os.path.isdir("D:\\System Volume Information\\")`` also returns False.

Tested with Python 3.8.2 and 3.8.7.

----------
versions: +Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38822>
_______________________________________

From report at bugs.python.org  Sat Jan  9 10:22:29 2021
From: report at bugs.python.org (Philippe Ombredanne)
Date: Sat, 09 Jan 2021 15:22:29 +0000
Subject: [issue4963] mimetypes.guess_extension result changes after
 mimetypes.init()
In-Reply-To: <1232107494.83.0.0570958889295.issue4963@psf.upfronthosting.co.za>
Message-ID: <1610205749.4.0.880904129747.issue4963@roundup.psfhosted.org>


Philippe Ombredanne <pombredanne at nexb.com> added the comment:

The changes introduced by this ticket in https://github.com/python/cpython/commit/9fc720e5e4f772598013ea48a3f0d22b2b6b04fa#r45794801 are problematic.

I discovered this from having tests failing when testing on Python 3.7 and up

The bug is that calling mimetypes.init(files) will NOT use my files, but instead use both my files and knownfiles.
This was not the case before as knownfiles would be ignored as expected when I provide my of files list.

This is a breaking API change IMHO and  introduces a buggy unstability : even if I want to ignore knownfiles by providing my list of of files, knownfiles will always be added and this results in erratic and buggy behaviour as the content of "knownfiles" is completely random based on the OS version and else. 

The code I am using is here https://github.com/nexB/typecode/blob/ba07c04d23441d3469dc5de911376d408514ebd8/src/typecode/contenttype.py#L308

I think we should reopen to fix (or create a new ticket)

----------
nosy: +pombredanne

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4963>
_______________________________________

From report at bugs.python.org  Sat Jan  9 10:29:27 2021
From: report at bugs.python.org (Philippe Ombredanne)
Date: Sat, 09 Jan 2021 15:29:27 +0000
Subject: [issue4963] mimetypes.guess_extension result changes after
 mimetypes.init()
In-Reply-To: <1232107494.83.0.0570958889295.issue4963@psf.upfronthosting.co.za>
Message-ID: <1610206167.75.0.153728965862.issue4963@roundup.psfhosted.org>


Philippe Ombredanne <pombredanne at nexb.com> added the comment:

Actually this is problematic on multiples counts:
1. the behaviour changes and this is a regression
2. even if that new buggy behaviour was the one to use, it should not give preference to knownfiles ovr init-provided files, but at least take the provided files first and knownfiles second.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4963>
_______________________________________

From report at bugs.python.org  Sat Jan  9 11:19:40 2021
From: report at bugs.python.org (Faisal Mahmood)
Date: Sat, 09 Jan 2021 16:19:40 +0000
Subject: [issue42861] ipaddress - add ability to get next closet network of
 any prefix size
In-Reply-To: <1610065851.06.0.929191666424.issue42861@roundup.psfhosted.org>
Message-ID: <1610209180.12.0.133914214217.issue42861@roundup.psfhosted.org>


Faisal Mahmood <fasial.mahmood94 at gmail.com> added the comment:

Updated the title and method naming, I previously mentioned the "next subnet" and called the method "next_subnet", but technically this is wrong.  What this method should be doing is finding the next closest network of prefix size n.

So I guess the method definition should be:
`next_network(self, next_network=None)`

----------
title: ipaddress - add ability to get next closet subnet of any prefix size -> ipaddress - add ability to get next closet network of any prefix size

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42861>
_______________________________________

From report at bugs.python.org  Sat Jan  9 11:32:45 2021
From: report at bugs.python.org (Ammar Askar)
Date: Sat, 09 Jan 2021 16:32:45 +0000
Subject: [issue42800] Traceback objects allow accessing frame objects without
 triggering audit hooks
In-Reply-To: <1609460218.67.0.01717828776.issue42800@roundup.psfhosted.org>
Message-ID: <1610209965.89.0.465839779286.issue42800@roundup.psfhosted.org>


Ammar Askar <ammar at ammaraskar.com> added the comment:

`tb_frame` is documented under https://docs.python.org/3/reference/datamodel.html

> Special read-only attributes: tb_frame points to the execution frame of the current level

`tb_code` can similarly be documented here and the note about the audit event can be added. Thanks for the patch Ryan, would you like to add the documentation change Steve suggested and create a pull request out of it and contribute it? (https://devguide.python.org/pullrequest/)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42800>
_______________________________________

From report at bugs.python.org  Sat Jan  9 12:04:35 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 09 Jan 2021 17:04:35 +0000
Subject: [issue42850] Process hangs when calling urllib.request in a
 multiprocessing.Process with import of sounddevice package
In-Reply-To: <1610000036.98.0.246954881352.issue42850@roundup.psfhosted.org>
Message-ID: <1610211875.25.0.066579488231.issue42850@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

No, let's leave 3.7 alone -- it's in security-fixes-only mode.

----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42850>
_______________________________________

From report at bugs.python.org  Sat Jan  9 12:19:18 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 09 Jan 2021 17:19:18 +0000
Subject: [issue42870] Document changed argparse output wrt optional arguments
 in What's new in Python 3.10
In-Reply-To: <1610149853.78.0.949568295376.issue42870@roundup.psfhosted.org>
Message-ID: <1610212758.45.0.758820943904.issue42870@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Quickest way to get that done is to send in a PR that updates whatsnew.

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42870>
_______________________________________

From report at bugs.python.org  Sat Jan  9 13:21:34 2021
From: report at bugs.python.org (Pavel Ditenbir)
Date: Sat, 09 Jan 2021 18:21:34 +0000
Subject: [issue42875] argparse incorrectly shows help string on a new line in
 case of long command string
In-Reply-To: <1610202899.54.0.332342565241.issue42875@roundup.psfhosted.org>
Message-ID: <1610216494.15.0.706178353705.issue42875@roundup.psfhosted.org>


Change by Pavel Ditenbir <pavel.ditenbir at gmail.com>:


----------
keywords: +patch
pull_requests: +23003
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24177

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42875>
_______________________________________

From report at bugs.python.org  Sat Jan  9 13:40:48 2021
From: report at bugs.python.org (Andreas Zeller)
Date: Sat, 09 Jan 2021 18:40:48 +0000
Subject: [issue42876] '''"""''' != '""""'
Message-ID: <1610217648.49.0.452941613308.issue42876@roundup.psfhosted.org>


New submission from Andreas Zeller <zeller at cispa.saarland>:

The following line of code fails in Python 3.6, which I find surprising.

>>> assert '''"""''' == '""""'  # Fails

Note that the following all pass as expected:

>>> assert """'''""" == "'''"  # Passes
>>> assert '''""''' == '""'  # Passes

----------
components: Interpreter Core
messages: 384736
nosy: andreas-zeller
priority: normal
severity: normal
status: open
title: '''"""''' != '""""'
type: behavior
versions: Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42876>
_______________________________________

From report at bugs.python.org  Sat Jan  9 13:42:06 2021
From: report at bugs.python.org (mattip)
Date: Sat, 09 Jan 2021 18:42:06 +0000
Subject: [issue42752] multiprocessing Queue leaks a file descriptor associated
 with the pipe writer (#33081 still a problem)
In-Reply-To: <1609023821.09.0.189504509221.issue42752@roundup.psfhosted.org>
Message-ID: <1610217726.77.0.728697349321.issue42752@roundup.psfhosted.org>


mattip <matti.picus at gmail.com> added the comment:

In the expert index https://devguide.python.org/experts/ it lists @davin, @pitrou as referrents for multiprocessing. Adding then to the Nosy list

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42752>
_______________________________________

From report at bugs.python.org  Sat Jan  9 14:11:00 2021
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 09 Jan 2021 19:11:00 +0000
Subject: [issue42877] TracebackException saves more data than it needs
Message-ID: <1610219460.26.0.944321944788.issue42877@roundup.psfhosted.org>


New submission from Irit Katriel <iritkatriel at yahoo.com>:

TracebackException saves both __cause__ and __context__ even though format() ignores the __context__ if there is __cause__.

If we change the constructor to save only what format() needs, it will save space and simplify the code.

----------
components: Library (Lib)
messages: 384738
nosy: iritkatriel
priority: normal
severity: normal
status: open
title: TracebackException saves more data than it needs
type: performance
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42877>
_______________________________________

From report at bugs.python.org  Sat Jan  9 14:14:18 2021
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 09 Jan 2021 19:14:18 +0000
Subject: [issue42877] TracebackException saves more data than it needs
In-Reply-To: <1610219460.26.0.944321944788.issue42877@roundup.psfhosted.org>
Message-ID: <1610219658.98.0.960300597432.issue42877@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
keywords: +patch
pull_requests: +23005
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24179

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42877>
_______________________________________

From report at bugs.python.org  Sat Jan  9 14:15:18 2021
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 09 Jan 2021 19:15:18 +0000
Subject: [issue42877] TracebackException saves more data than it needs
In-Reply-To: <1610219460.26.0.944321944788.issue42877@roundup.psfhosted.org>
Message-ID: <1610219718.35.0.61956672729.issue42877@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42877>
_______________________________________

From report at bugs.python.org  Sat Jan  9 14:20:54 2021
From: report at bugs.python.org (Eryk Sun)
Date: Sat, 09 Jan 2021 19:20:54 +0000
Subject: [issue42876] '''"""''' != '""""'
In-Reply-To: <1610217648.49.0.452941613308.issue42876@roundup.psfhosted.org>
Message-ID: <1610220054.59.0.610345767106.issue42876@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> assert '''"""''' == '""""'  # Fails

The left-hand side is a triple-quote string literal [1][2] that contains 3 double-quote characters. The right-hand side is a single-quote string literal that contains 4 double-quote characters. Use the interactive shell to check the values. For example:

    >>> list('''"""''')
    ['"', '"', '"']

    >>> list('""""')
    ['"', '"', '"', '"']

If you have difficulty understanding an aspect of the language syntax, please ask a question in an appropriate forum such as python-tutor, python-list, or Stack Overflow.

---

[1] https://docs.python.org/3/reference/lexical_analysis.html#string-and-bytes-literals
[2] https://docs.python.org/3/tutorial/introduction.html#strings

----------
nosy: +eryksun
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42876>
_______________________________________

From report at bugs.python.org  Sat Jan  9 14:36:24 2021
From: report at bugs.python.org (Faisal Mahmood)
Date: Sat, 09 Jan 2021 19:36:24 +0000
Subject: [issue42861] ipaddress - add ability to get next closet network of
 any prefix size
In-Reply-To: <1610065851.06.0.929191666424.issue42861@roundup.psfhosted.org>
Message-ID: <1610220984.62.0.713952884403.issue42861@roundup.psfhosted.org>


Change by Faisal Mahmood <fasial.mahmood94 at gmail.com>:


----------
keywords: +patch
pull_requests: +23006
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24180

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42861>
_______________________________________

From report at bugs.python.org  Sat Jan  9 15:31:09 2021
From: report at bugs.python.org (Yair Frid)
Date: Sat, 09 Jan 2021 20:31:09 +0000
Subject: [issue42766] urllib.request.HTTPPasswordMgr uses commonprefix instead
 of commonpath
In-Reply-To: <1609170153.96.0.504551551924.issue42766@roundup.psfhosted.org>
Message-ID: <1610224269.49.0.0616801033073.issue42766@roundup.psfhosted.org>


Change by Yair Frid <fridyair at gmail.com>:


----------
keywords: +patch
nosy: +Fongeme
nosy_count: 1.0 -> 2.0
pull_requests: +23007
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24181

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42766>
_______________________________________

From report at bugs.python.org  Sat Jan  9 16:23:37 2021
From: report at bugs.python.org (Yair Frid)
Date: Sat, 09 Jan 2021 21:23:37 +0000
Subject: [issue42878] urllib.request.HTTPPasswordMgr.is_suburi does not care
 about order
Message-ID: <1610227417.16.0.538971054996.issue42878@roundup.psfhosted.org>


New submission from Yair Frid <fridyair at gmail.com>:

In docs, it mentions that the function returns true if the base is a 'suburi' of test, but in reality, if is_suburi(base, test) then is_suburi(test, base) which is wrong in most cases (other than where base ~= test, meaning they are the same location)
I am unsure which versions of python are affected, but i suspect most of them (although we probably shouldn't backport this fix?)

----------
components: Library (Lib)
messages: 384741
nosy: Fongeme
priority: normal
pull_requests: 23009
severity: normal
status: open
title: urllib.request.HTTPPasswordMgr.is_suburi does not care about order

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42878>
_______________________________________

From report at bugs.python.org  Sat Jan  9 17:45:17 2021
From: report at bugs.python.org (Timothy Geiser)
Date: Sat, 09 Jan 2021 22:45:17 +0000
Subject: [issue33065] IDLE debugger: failure stepping through module loading
In-Reply-To: <1520917336.65.0.467229070634.issue33065@psf.upfronthosting.co.za>
Message-ID: <1610232317.38.0.00811342199429.issue33065@roundup.psfhosted.org>


Timothy Geiser <slimshady007 at inbox.lv> added the comment:

This issue is still open, 8.5 months after identifying the underlying cause.
What needs done to get a fix for this merged? Manual testing, or adding test cases? Anything I can do to help? I have 3.9.1 successfully built on a Raspberry Pi that I can reproduce the issue on, as well as reproduce the fix Terry suggested in msg366981.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33065>
_______________________________________

From report at bugs.python.org  Sat Jan  9 17:50:07 2021
From: report at bugs.python.org (Jason Oliver)
Date: Sat, 09 Jan 2021 22:50:07 +0000
Subject: [issue42879] SystemError from class 'int'
Message-ID: <1610232607.93.0.155495951465.issue42879@roundup.psfhosted.org>


New submission from Jason Oliver <jollyoliver657 at gmail.com>:

This is my first bug report so I hope that this is correctly formatted. I am learning how to use pygame and encountered the following error:
SystemError: <class 'int'> returned a result with an error set

I googled the error message and came across the following answer on stackoverflow:
https://stackoverflow.com/a/53796516

This stated that the problem could exist within the implementation of python and that I should file a bug report here.

I am using the following software installed through pip/pip3:
Python 3.8.4
pygame 2.0.1
OS Edition: Windows 10 Pro
OS Version: 20H2
OS build: 19042.685

The bug can be reproduced deterministically.

----------
files: Movement.py
messages: 384743
nosy: jollyoliver657
priority: normal
severity: normal
status: open
title: SystemError from class 'int'
versions: Python 3.8
Added file: https://bugs.python.org/file49731/Movement.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42879>
_______________________________________

From report at bugs.python.org  Sat Jan  9 17:52:14 2021
From: report at bugs.python.org (Jason R. Coombs)
Date: Sat, 09 Jan 2021 22:52:14 +0000
Subject: [issue42531] importlib.resources.path() raises TypeError for packages
 without __file__
In-Reply-To: <1606890702.39.0.177441013455.issue42531@roundup.psfhosted.org>
Message-ID: <1610232734.05.0.344436223876.issue42531@roundup.psfhosted.org>


Jason R. Coombs <jaraco at jaraco.com> added the comment:

> Regardless of whether PR 23611 is accepted, the test that it adds should be added to Python master to guard against regressions. I can submit that as a separate PR. Before I do that, do I need to create a new bpo ticket, or can I just reference this one?

For that, please submit a PR to importlib_resources and it will get synced to CPython later.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42531>
_______________________________________

From report at bugs.python.org  Sat Jan  9 18:21:01 2021
From: report at bugs.python.org (Jason R. Coombs)
Date: Sat, 09 Jan 2021 23:21:01 +0000
Subject: [issue42531] importlib.resources.path() raises TypeError for packages
 without __file__
In-Reply-To: <1606890702.39.0.177441013455.issue42531@roundup.psfhosted.org>
Message-ID: <1610234461.84.0.57947599526.issue42531@roundup.psfhosted.org>


Jason R. Coombs <jaraco at jaraco.com> added the comment:

Can you tell me more about the use-case that exhibited this undesirable behavior? That is, what loader is it that supports `open_binary` but not `is_resource` and doesn't have a `__origin__`?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42531>
_______________________________________

From report at bugs.python.org  Sat Jan  9 19:09:46 2021
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 10 Jan 2021 00:09:46 +0000
Subject: [issue42872] Inconsistent exceptions thrown by pathlib.Path.mkdir on
 different OSes
In-Reply-To: <1610180126.52.0.315552258683.issue42872@roundup.psfhosted.org>
Message-ID: <1610237386.8.0.972890116354.issue42872@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

See also issue41737.

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42872>
_______________________________________

From report at bugs.python.org  Sat Jan  9 20:13:33 2021
From: report at bugs.python.org (Robin Scheibler)
Date: Sun, 10 Jan 2021 01:13:33 +0000
Subject: [issue42850] Process hangs when calling urllib.request in a
 multiprocessing.Process with import of sounddevice package
In-Reply-To: <1610000036.98.0.246954881352.issue42850@roundup.psfhosted.org>
Message-ID: <1610241213.06.0.641936663163.issue42850@roundup.psfhosted.org>


Robin Scheibler <fakufaku at gmail.com> added the comment:

Thank you very much for your help!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42850>
_______________________________________

From report at bugs.python.org  Sat Jan  9 20:14:50 2021
From: report at bugs.python.org (Ryan Hileman)
Date: Sun, 10 Jan 2021 01:14:50 +0000
Subject: [issue42800] Traceback objects allow accessing frame objects without
 triggering audit hooks
In-Reply-To: <1609460218.67.0.01717828776.issue42800@roundup.psfhosted.org>
Message-ID: <1610241290.63.0.87158722131.issue42800@roundup.psfhosted.org>


Change by Ryan Hileman <lunixbochs at gmail.com>:


----------
keywords: +patch
pull_requests: +23010
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24182

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42800>
_______________________________________

From report at bugs.python.org  Sat Jan  9 20:17:47 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 10 Jan 2021 01:17:47 +0000
Subject: [issue42867] Entry Widget not editable on Windows 10,
 but is on Linux Ubuntu 16.04
In-Reply-To: <1610109973.36.0.703695549775.issue42867@roundup.psfhosted.org>
Message-ID: <1610241467.05.0.321757982311.issue42867@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

No problem.  While your failing example was 'too long', you *did* search and find the appropriate previous issue, with my inadequate response and incorrect resolution, even though closed.  I appreciate having my understanding fixed.

IDLE uses several entry boxes in dialogs.  I have partially replaced error message boxes with error messages in the dialog.  For example, Open Module (Alt-M at least on Windows) opens a dialog to open a module.  Enter a bad name and "Error: module not found" is printed in red below, leaving the cursor in the entry box so the user can correct it (or Cancel).  As is turn out, this avoids any possibility of running into this bug.  I might have run into it before I replaced most old dialog + error box uses, but I now know to watch out in those remaining.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42867>
_______________________________________

From report at bugs.python.org  Sat Jan  9 20:46:04 2021
From: report at bugs.python.org (Ryan Hileman)
Date: Sun, 10 Jan 2021 01:46:04 +0000
Subject: [issue42800] Traceback objects allow accessing frame objects without
 triggering audit hooks
In-Reply-To: <1609460218.67.0.01717828776.issue42800@roundup.psfhosted.org>
Message-ID: <1610243164.31.0.598948519852.issue42800@roundup.psfhosted.org>


Ryan Hileman <lunixbochs at gmail.com> added the comment:

PR submitted, waiting on CLA process.

I added documentation at the field sites, but the audit event table generation does not handle attributes or object.__getattr__ very well at all, so I'm not updating the audit table for now.

The `.. audit-event:: object.__getattr__ obj,name frame-objects` sphinx directive right now just inserts a canned string """Raises an :ref:`auditing event <auditing>` object.__getattr__ with arguments obj,name.""", which would need additional boilerplate to describe these attributes properly. It also only adds a footnote style link to the audit table under __getattr__, and even moves object.__getattribute__ from the first [1] link position to a later number which is IMO is more confusing than not even linking them.

I think to make attributes look good in the table we would need a special sphinx directive for audited object.__getattr__ attributes, for example by modifying the template generator to fit each attribute on its own line under  object.__getattr__ in the table.

For now I did not use the audit-event sphinx directive and manually inserted strings like this near the original attribute description in the docs: """Accessing ``f_code`` raises an :ref:`auditing event <auditing>` ``object.__getattr__`` with arguments ``obj`` and ``"f_code"``."""

I think audit table improvements should be handled in a separate issue, and by someone more familiar with that part of the doc generator, as cleaning it up looks like maybe a bigger scope than the current contribution.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42800>
_______________________________________

From report at bugs.python.org  Sat Jan  9 21:17:07 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 10 Jan 2021 02:17:07 +0000
Subject: [issue4963] mimetypes.guess_extension result changes after
 mimetypes.init()
In-Reply-To: <1232107494.83.0.0570958889295.issue4963@psf.upfronthosting.co.za>
Message-ID: <1610245027.47.0.292383517518.issue4963@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Phillipe: I was the first to comment, but had no futher involvement with this issue until now.  Multiple people, including coredevs, considered the old behavior to be buggy and multiple people, including coredevs, contributed to the fix.  You are unlikely to prevail arguing that the change is totally a mistake and should be totally reverted.

> the behaviour changes and this is a regression

Code bug fixes are supposed to change behavior.  We know that the change will break code that depends on the buggy behavior.  That is why we include an updated change log with each release.

The intended change is *not* a regression in itself.  A regression in a bug fix is an unintended change to some other behavior.  I don't believe (but could be mistaken) that you have argued or shown this.

Assuming that you are not asking for complete reversion, I suggest that you open a new issue, referencing this one, but taking the current behavior as the given.  Propose a revised behavior and argue that it is even better.  If you want to argue that the current behavior is buggy (compared to the current docs) so that your proposed revision should be backported, make that a separate argument.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4963>
_______________________________________

From report at bugs.python.org  Sat Jan  9 21:29:29 2021
From: report at bugs.python.org (Hong Xu)
Date: Sun, 10 Jan 2021 02:29:29 +0000
Subject: [issue42872] Inconsistent exceptions thrown by pathlib.Path.mkdir on
 different OSes
In-Reply-To: <1610180126.52.0.315552258683.issue42872@roundup.psfhosted.org>
Message-ID: <1610245769.93.0.265781044177.issue42872@roundup.psfhosted.org>


Hong Xu <hong at topbug.net> added the comment:

Should we update the document at least? The document doesn't mention NotADirectoryError or its super classes at all.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42872>
_______________________________________

From report at bugs.python.org  Sun Jan 10 01:35:11 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 10 Jan 2021 06:35:11 +0000
Subject: [issue33065] IDLE debugger: failure stepping through module loading
In-Reply-To: <1520917336.65.0.467229070634.issue33065@psf.upfronthosting.co.za>
Message-ID: <1610260511.04.0.856405459431.issue33065@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
keywords: +patch
pull_requests: +23011
stage: test needed -> patch review
pull_request: https://github.com/python/cpython/pull/24183

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33065>
_______________________________________

From report at bugs.python.org  Sun Jan 10 01:39:17 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 10 Jan 2021 06:39:17 +0000
Subject: [issue33065] IDLE debugger: failure stepping through module loading
In-Reply-To: <1520917336.65.0.467229070634.issue33065@psf.upfronthosting.co.za>
Message-ID: <1610260757.01.0.777539609498.issue33065@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

I am reluctant to make changes without adding tests, and until I focused again on how to do so, because of your ping, I had no idea how to do so.

The added test results in the same error, "AttributeError: 'BinData' object has no attribute 'length'" without the patch and passes with it.

----------
stage: patch review -> commit review
versions: +Python 3.10 -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33065>
_______________________________________

From report at bugs.python.org  Sun Jan 10 01:59:54 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 10 Jan 2021 06:59:54 +0000
Subject: [issue33065] IDLE debugger: failure stepping through module loading
In-Reply-To: <1520917336.65.0.467229070634.issue33065@psf.upfronthosting.co.za>
Message-ID: <1610261994.69.0.500003330776.issue33065@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset 81f87bbf9f65702062021a78abd9b8f82c98a414 by Terry Jan Reedy in branch 'master':
bpo-33065: Fix problem debugging user classes with __repr__ method (GH-24183)
https://github.com/python/cpython/commit/81f87bbf9f65702062021a78abd9b8f82c98a414


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33065>
_______________________________________

From report at bugs.python.org  Sun Jan 10 02:00:28 2021
From: report at bugs.python.org (miss-islington)
Date: Sun, 10 Jan 2021 07:00:28 +0000
Subject: [issue33065] IDLE debugger: failure stepping through module loading
In-Reply-To: <1520917336.65.0.467229070634.issue33065@psf.upfronthosting.co.za>
Message-ID: <1610262028.63.0.146517777256.issue33065@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 5.0 -> 6.0
pull_requests: +23012
stage: commit review -> patch review
pull_request: https://github.com/python/cpython/pull/24184

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33065>
_______________________________________

From report at bugs.python.org  Sun Jan 10 02:00:38 2021
From: report at bugs.python.org (miss-islington)
Date: Sun, 10 Jan 2021 07:00:38 +0000
Subject: [issue33065] IDLE debugger: failure stepping through module loading
In-Reply-To: <1520917336.65.0.467229070634.issue33065@psf.upfronthosting.co.za>
Message-ID: <1610262038.27.0.600560403527.issue33065@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +23013
pull_request: https://github.com/python/cpython/pull/24185

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33065>
_______________________________________

From report at bugs.python.org  Sun Jan 10 02:31:11 2021
From: report at bugs.python.org (miss-islington)
Date: Sun, 10 Jan 2021 07:31:11 +0000
Subject: [issue33065] IDLE debugger: failure stepping through module loading
In-Reply-To: <1520917336.65.0.467229070634.issue33065@psf.upfronthosting.co.za>
Message-ID: <1610263871.95.0.0469592531123.issue33065@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 5ded7efa6a7a232dd4a41e6e65e4dae47146514b by Miss Islington (bot) in branch '3.8':
bpo-33065: Fix problem debugging user classes with __repr__ method (GH-24183)
https://github.com/python/cpython/commit/5ded7efa6a7a232dd4a41e6e65e4dae47146514b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33065>
_______________________________________

From report at bugs.python.org  Sun Jan 10 02:31:11 2021
From: report at bugs.python.org (miss-islington)
Date: Sun, 10 Jan 2021 07:31:11 +0000
Subject: [issue33065] IDLE debugger: failure stepping through module loading
In-Reply-To: <1520917336.65.0.467229070634.issue33065@psf.upfronthosting.co.za>
Message-ID: <1610263871.68.0.504031235365.issue33065@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 799f8489d418b7f9207d333eac38214931bd7dcc by Miss Islington (bot) in branch '3.9':
bpo-33065: Fix problem debugging user classes with __repr__ method (GH-24183)
https://github.com/python/cpython/commit/799f8489d418b7f9207d333eac38214931bd7dcc


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33065>
_______________________________________

From report at bugs.python.org  Sun Jan 10 02:41:58 2021
From: report at bugs.python.org (Ziqiao Kong)
Date: Sun, 10 Jan 2021 07:41:58 +0000
Subject: [issue42880] ctypes: variadic function call still doesn't work on
 Apple Silicon
Message-ID: <1610264518.97.0.0227668442163.issue42880@roundup.psfhosted.org>


New submission from Ziqiao Kong <ziqiaokong at gmail.com>:

Hello! Thanks for your contribution on porting python to native Apple Silicon. I have noticed that there is an issue https://bugs.python.org/issue41100 and corresponding Github PR https://github.com/python/cpython/pull/22855 stating that variadic functions ABI has been corrected. However, during our test, it still doesn't work on Apple Silicon with brew-installed python 3.9.1 and python 3..10.0a4 built from sources. The details are as follows:

A x86_64 Mojave Macmini with python 3.8:
```
/tmp $ python3 --version
Python 3.8.6
/tmp $ uname -a
Darwin *** 18.7.0 Darwin Kernel Version 18.7.0: Mon Apr 27 20:09:39 PDT 2020; root:xnu-4903.278.35~1/RELEASE_X86_64 x86_64
/tmp $ cat main.c
#include <stdarg.h>
#include <stdio.h>
#include <stdint.h>
void test(uint64_t end, ...){
  int a;
  va_list valist;
  va_start(valist, end);
  a = va_arg(valist, int);
  va_end(valist);
  printf("%d\n", a);
  return;
}
/tmp $ cc -shared -g main.c -o ./main.dylib
/tmp $ cat test_main.py
from ctypes import *

d = CDLL("./main.dylib")
d.test.restype = None
d.test(c_uint64(12), c_int(34))
/tmp $ python3 test_main.py
34
/tmp $
```

An M1 Macbook Pro with brew-installed python 3.9.1
```
kabeor at kamino /tmp % python3 --version
Python 3.9.1
kabeor at kamino /tmp % cat main.c
#include <stdarg.h>
#include <stdio.h>
#include <stdint.h>
void test(uint64_t end, ...){
  int a;
  va_list valist;
  va_start(valist, end);
  a = va_arg(valist, int);
  va_end(valist);
  printf("%d\n", a);
  return;
}
kabeor at kamino /tmp % cc -shared -g main.c -o ./main.dylib
kabeor at kamino /tmp % cat test_main.py
from ctypes import *

d = CDLL("./main.dylib")
d.test.restype = None
d.test(c_uint64(12), c_int(34))
kabeor at kamino /tmp % python3 test_main.py
48144104
kabeor at kamino /tmp %
```

An M1 Macbook Pro with python 3.10.0a4 built from Github release tarball
```
kabeor at kamino cpython-3.10.0a4 % ./python.exe --version
Python 3.10.0a4
kabeor at kamino cpython-3.10.0a4 % cp /tmp/main.c ./
kabeor at kamino cpython-3.10.0a4 % cp /tmp/test_main.py ./
kabeor at kamino cpython-3.10.0a4 % ./python.exe --version
Python 3.10.0a4
kabeor at kamino cpython-3.10.0a4 % cat ./main.c
#include <stdarg.h>
#include <stdio.h>
#include <stdint.h>
void test(uint64_t end, ...){
  int a;
  va_list valist;
  va_start(valist, end);
  a = va_arg(valist, int);
  va_end(valist);
  printf("%d\n", a);
  return;
}
kabeor at kamino cpython-3.10.0a4 % cc -shared -g main.c -o ./main.dylib
kabeor at kamino cpython-3.10.0a4 % cat test_main.py
from ctypes import *

d = CDLL("./main.dylib")
d.test.restype = None
d.test(c_uint64(12), c_int(34))
kabeor at kamino cpython-3.10.0a4 % ./python.exe test_main.py
3
kabeor at kamino cpython-3.10.0a4 %
```

Thanks in advance!

----------
components: ctypes
messages: 384756
nosy: lawrence-danna-apple, lazymio
priority: normal
severity: normal
status: open
title: ctypes: variadic function call still doesn't work on Apple Silicon
versions: Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42880>
_______________________________________

From report at bugs.python.org  Sun Jan 10 02:43:30 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 10 Jan 2021 07:43:30 +0000
Subject: [issue33065] IDLE debugger: failure stepping through module loading
In-Reply-To: <1520917336.65.0.467229070634.issue33065@psf.upfronthosting.co.za>
Message-ID: <1610264610.01.0.170857947817.issue33065@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33065>
_______________________________________

From report at bugs.python.org  Sun Jan 10 03:51:29 2021
From: report at bugs.python.org (hai shi)
Date: Sun, 10 Jan 2021 08:51:29 +0000
Subject: [issue41798] [C API] Revisit usage of the PyCapsule C API with
 multi-phase initialization API
In-Reply-To: <1600265269.2.0.881235166904.issue41798@roundup.psfhosted.org>
Message-ID: <1610268689.6.0.0225762228968.issue41798@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
pull_requests: +23014
pull_request: https://github.com/python/cpython/pull/24186

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41798>
_______________________________________

From report at bugs.python.org  Sun Jan 10 05:07:19 2021
From: report at bugs.python.org (Ronald Oussoren)
Date: Sun, 10 Jan 2021 10:07:19 +0000
Subject: [issue42619] python 3.9.1 failed to create .so files as universal2
 (arm64, x86_64) on Mac
In-Reply-To: <1607682860.38.0.598588089863.issue42619@roundup.psfhosted.org>
Message-ID: <1610273239.69.0.273897281209.issue42619@roundup.psfhosted.org>


Change by Ronald Oussoren <ronaldoussoren at mac.com>:


----------
keywords: +patch
pull_requests: +23015
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24187

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42619>
_______________________________________

From report at bugs.python.org  Sun Jan 10 05:10:17 2021
From: report at bugs.python.org (Ronald Oussoren)
Date: Sun, 10 Jan 2021 10:10:17 +0000
Subject: [issue42619] python 3.9.1 failed to create .so files as universal2
 (arm64, x86_64) on Mac
In-Reply-To: <1607682860.38.0.598588089863.issue42619@roundup.psfhosted.org>
Message-ID: <1610273417.63.0.787585322192.issue42619@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

I've added a (draft) PR for this. The PR is a this time not tested on a 10.15 system.

Another change that might be needed: ensure that sysconfig.get_platform() does not return "universal2" as the binary architecture when the compiler does not support arm64.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42619>
_______________________________________

From report at bugs.python.org  Sun Jan 10 05:34:42 2021
From: report at bugs.python.org (Ronald Oussoren)
Date: Sun, 10 Jan 2021 10:34:42 +0000
Subject: [issue42619] python 3.9.1 failed to create .so files as universal2
 (arm64, x86_64) on Mac
In-Reply-To: <1607682860.38.0.598588089863.issue42619@roundup.psfhosted.org>
Message-ID: <1610274882.97.0.596013952014.issue42619@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

> Another change that might be needed: ensure that sysconfig.get_platform() 
> does not return "universal2" as the binary architecture when the compiler 
> does not support arm64.

Hmmm... _osx_support.get_platform_osx() contains the following comment:

        # Use the original CFLAGS value, if available, so that we
        # return the same machine type for the platform string.
        # Otherwise, distutils may consider this a cross-compiling
        # case and disallow installs.

That indicates that fixing the value of sysconfig.get_platform() when using a "universal2" python on a system that doesn't support arm64 might break distils. 

I haven't done further research on this. In general I'd prefer to create the correct platform tag, but not if that results in not being able to install extensions.

----------
versions: +Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42619>
_______________________________________

From report at bugs.python.org  Sun Jan 10 06:05:03 2021
From: report at bugs.python.org (Mark Dickinson)
Date: Sun, 10 Jan 2021 11:05:03 +0000
Subject: [issue42879] SystemError from class 'int'
In-Reply-To: <1610232607.93.0.155495951465.issue42879@roundup.psfhosted.org>
Message-ID: <1610276703.55.0.883898296048.issue42879@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

This is more likely to be a bug in Pygame than in Python itself. What's likely happening here is that some part of the Pygame machinery is setting an exception state but then returning a value as normal. (Generally, if some function in a C extension sets an exception, that function should return NULL or -1.) That then leaves things in an inconsistent state, and Python doesn't notice that inconsistent state until the "int" call happens.

Please could you report to the Pygame folks, if you haven't done so already? It certainly is *possible* that it's actually a core Python bug, but even then the first step would be to eliminate the Pygame component from the code-to-reproduce.

----------
nosy: +mark.dickinson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42879>
_______________________________________

From report at bugs.python.org  Sun Jan 10 06:29:52 2021
From: report at bugs.python.org (Larry Hastings)
Date: Sun, 10 Jan 2021 11:29:52 +0000
Subject: [issue42881] Should typing.get_type_hints change None annotations?
Message-ID: <1610278192.15.0.512262305909.issue42881@roundup.psfhosted.org>


New submission from Larry Hastings <larry at hastings.org>:

PEP 484 says:

    (Note that the return type of __init__ ought to be annotated
     with -> None. The reason for this is subtle. [...]

    https://www.python.org/dev/peps/pep-0484/#the-meaning-of-annotations

If you follow this advice, then call typing.get_type_hints() on your __init__ function, you'll find it has turned "None" into "type(None)".

git blame suggests get_type_hints' behavior was in the initial checkin of typing.py (46dbb7d1032c19163f37785509b8f5b3004416e8).  So it's always behaved this way.

Is "None" still considered the correct return annotation of an __init__?  If so, should typing.get_type_hints() really be changing it to type(None)?

----------
components: Library (Lib)
messages: 384760
nosy: eric.smith, gvanrossum, larry
priority: low
severity: normal
stage: test needed
status: open
title: Should typing.get_type_hints change None annotations?
type: behavior
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42881>
_______________________________________

From report at bugs.python.org  Sun Jan 10 08:00:18 2021
From: report at bugs.python.org (Yannick Jadoul)
Date: Sun, 10 Jan 2021 13:00:18 +0000
Subject: [issue42882] Restarting the interpreter causes UB on 3.10.0a4
Message-ID: <1610283618.64.0.475556781159.issue42882@roundup.psfhosted.org>


New submission from Yannick Jadoul <yannick.jadoul at gmail.com>:

Issue detected in the embedding tests of pybind11, running on the latest alpha of 3.10: https://github.com/pybind/pybind11/issues/2774

I have reduced the weird issue/crash to a minimal reproducer, which consistently reproduces the crash on my Linux machine:

```
#include <Python.h>

int main() {
    Py_InitializeEx(1);

    Py_Finalize();
    Py_InitializeEx(1);

    PyRun_SimpleString("class Widget: pass\n"
                       "class DerivedWidget(Widget):\n"
                       "    def __init__(self):\n"
                       "        super().__init__()\n");

    Py_Finalize();

    printf("Works\n");

    return 0;
}
```

Removing the two lines in the middle that restart the interpreter makes the example work.

I've also bisected CPython to find the issue (3.10.0a3 is fine, 3.10.0a4 is not), and arrived at https://github.com/python/cpython/pull/20058 (ba3d67c2fb04a7842741b1b6da5d67f22c579f33 being the first commit that breaks the example above). But I am not entirely sure where to start debugging.

The reproducing example above consistently crashes on my local machine (SIGABRT, exit code 134):

```
Fatal Python error: compiler_make_closure: lookup '__class__' in DerivedWidget 5 -1
freevars of __init__: ('__class__',)

Python runtime state: initialized

Current thread 0x00007f036485b680 (most recent call first):
<no Python frame>
Aborted (core dumped)
```

But note that in the pybind11 tests, the underlying issue causes a different error (Python throwing a weird, seemingly unrelated exception). So something seems to be messed up in the interpreter internals, and the above example just triggers it.

----------
components: Interpreter Core
messages: 384761
nosy: YannickJadoul
priority: normal
severity: normal
status: open
title: Restarting the interpreter causes UB on 3.10.0a4
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42882>
_______________________________________

From report at bugs.python.org  Sun Jan 10 08:45:21 2021
From: report at bugs.python.org (Jason Oliver)
Date: Sun, 10 Jan 2021 13:45:21 +0000
Subject: [issue42879] SystemError from class 'int'
In-Reply-To: <1610232607.93.0.155495951465.issue42879@roundup.psfhosted.org>
Message-ID: <1610286321.47.0.323633251993.issue42879@roundup.psfhosted.org>


Jason Oliver <jollyoliver657 at gmail.com> added the comment:

I will submit the bug report to the pygame bug tracker.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42879>
_______________________________________

From report at bugs.python.org  Sun Jan 10 09:04:58 2021
From: report at bugs.python.org (karl)
Date: Sun, 10 Jan 2021 14:04:58 +0000
Subject: [issue41748] HTMLParser: comma in attribute values with/without space
In-Reply-To: <1599602370.01.0.842812753139.issue41748@roundup.psfhosted.org>
Message-ID: <1610287498.01.0.497536332422.issue41748@roundup.psfhosted.org>


karl <karl+pythonbugs at la-grange.net> added the comment:

Status: The PR should be ready and completed
https://github.com/python/cpython/pull/24072
and eventually be merged at a point. 
Thanks to ezio.melotti for the wonderful guidance.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41748>
_______________________________________

From report at bugs.python.org  Sun Jan 10 09:33:00 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 10 Jan 2021 14:33:00 +0000
Subject: [issue42879] SystemError from class 'int'
In-Reply-To: <1610232607.93.0.155495951465.issue42879@roundup.psfhosted.org>
Message-ID: <1610289180.37.0.452546537733.issue42879@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

With debug build of Python I get a crash in other place:

$ ./python -Xdev Movement.py 
pygame 1.9.6
Hello from the pygame community. https://www.pygame.org/contribute.html
python: Objects/abstract.c:155: PyObject_GetItem: Assertion `(item != NULL) ^ (PyErr_Occurred() != NULL)' failed.
Fatal Python error: Aborted

Current thread 0x00007fc3d0b6e280 (most recent call first):
  File "Movement.py", line 47 in writeGridToSurface
  File "Movement.py", line 100 in <module>

It is very likely a bug in Pygame. Perhaps it was always here, just Python 3.8 is more strict to programming errors in extensions.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42879>
_______________________________________

From report at bugs.python.org  Sun Jan 10 09:36:26 2021
From: report at bugs.python.org (hai shi)
Date: Sun, 10 Jan 2021 14:36:26 +0000
Subject: [issue42875] argparse incorrectly shows help string on a new line in
 case of long command string
In-Reply-To: <1610202899.54.0.332342565241.issue42875@roundup.psfhosted.org>
Message-ID: <1610289386.57.0.972065576121.issue42875@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
nosy: +paul.j3, rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42875>
_______________________________________

From report at bugs.python.org  Sun Jan 10 09:43:44 2021
From: report at bugs.python.org (Haoyang)
Date: Sun, 10 Jan 2021 14:43:44 +0000
Subject: [issue42883] __init__ function may incur an incorrect behavior if
 passing a list as a parameter and set its default value as empty
Message-ID: <1610289824.57.0.574510344597.issue42883@roundup.psfhosted.org>


New submission from Haoyang <mahaoyang7777 at 163.com>:

Here is the bug-triggered code snippet in the file uploaded

class A:
    def __init__(self, b=[]):
        print('b = ', b)
        self.a = b 

for i in range(3):
    a = A()
    a.a.append(1)

    print(a.a)

It seems that when I pass a list "b" to __init__ function with default value empty list. Every time I create a new instance of this class and append one new variable to "self.a", the default value of "b" changed at the next time I create another instance of class A.

The outcome of this code snippet is 
a =  []
[1]
a =  [1]
[1, 1]
a =  [1, 1]
[1, 1, 1]

I am new to python. Is it a legal behavior in python? If yes, what is the principle beneath it? Thanks in advance!

----------
files: test.py
messages: 384765
nosy: haoyang9804
priority: normal
severity: normal
status: open
title: __init__  function may incur an incorrect behavior if passing a list as a parameter and set its default value as empty
type: behavior
versions: Python 3.9
Added file: https://bugs.python.org/file49732/test.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42883>
_______________________________________

From report at bugs.python.org  Sun Jan 10 09:58:42 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 10 Jan 2021 14:58:42 +0000
Subject: [issue42883] __init__ function may incur an incorrect behavior if
 passing a list as a parameter and set its default value as empty
In-Reply-To: <1610289824.57.0.574510344597.issue42883@roundup.psfhosted.org>
Message-ID: <1610290722.49.0.0935357861152.issue42883@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

https://docs.python.org/3/faq/programming.html#why-are-default-values-shared-between-objects

----------
nosy: +serhiy.storchaka
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42883>
_______________________________________

From report at bugs.python.org  Sun Jan 10 10:00:28 2021
From: report at bugs.python.org (Haoyang)
Date: Sun, 10 Jan 2021 15:00:28 +0000
Subject: [issue42883] __init__ function may incur an incorrect behavior if
 passing a list as a parameter and set its default value as empty
In-Reply-To: <1610289824.57.0.574510344597.issue42883@roundup.psfhosted.org>
Message-ID: <1610290828.86.0.706924159743.issue42883@roundup.psfhosted.org>


Haoyang <mahaoyang7777 at 163.com> added the comment:

Thanks!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42883>
_______________________________________

From report at bugs.python.org  Sun Jan 10 11:25:35 2021
From: report at bugs.python.org (Eric V. Smith)
Date: Sun, 10 Jan 2021 16:25:35 +0000
Subject: [issue42881] Should typing.get_type_hints change None annotations?
In-Reply-To: <1610278192.15.0.512262305909.issue42881@roundup.psfhosted.org>
Message-ID: <1610295935.07.0.23823996581.issue42881@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

Notice that this isn't just for __init__ or return types, it happens with any annotations (here, with 3.8):

>>> def g(i: None): pass
...
>>> g.__annotations__
{'i': None}
>>> get_type_hints(g)
{'i': <class 'NoneType'>}
>>>

I just noticed that PEP 484 also says:

https://www.python.org/dev/peps/pep-0484/#using-none

"When used in a type hint, the expression None is considered equivalent to type(None)."

But I find it odd that get_type_hints would make this determination for you.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42881>
_______________________________________

From report at bugs.python.org  Sun Jan 10 11:32:35 2021
From: report at bugs.python.org (Eric V. Smith)
Date: Sun, 10 Jan 2021 16:32:35 +0000
Subject: [issue42881] Should typing.get_type_hints change None annotations?
In-Reply-To: <1610278192.15.0.512262305909.issue42881@roundup.psfhosted.org>
Message-ID: <1610296355.44.0.225087591856.issue42881@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

See also https://github.com/python/mypy/issues/640 "Support type(None) as a type", which was closed with "I don't think anyone cares". Jukka's comment was "Or maybe we should update PEP 484 to not suggest that type(None) is valid as a type, and None is the only correct spelling? There should one -- and preferably only one -- obvious way to do it etc."

Despite the fact that I'd also like to see only one way to do things, other than tests that will break when using get_type_hints instead of looking at annotations directly, I'm not sure it makes much difference. People already need to treat type(None) as equivalent to None for annotations: we're late to the game for making a change.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42881>
_______________________________________

From report at bugs.python.org  Sun Jan 10 12:47:48 2021
From: report at bugs.python.org (Jason R. Coombs)
Date: Sun, 10 Jan 2021 17:47:48 +0000
Subject: [issue42129] Support resources in namespace packages
In-Reply-To: <1603469006.87.0.128715336786.issue42129@roundup.psfhosted.org>
Message-ID: <1610300868.57.0.56373394338.issue42129@roundup.psfhosted.org>


Jason R. Coombs <jaraco at jaraco.com> added the comment:

In [this commit](https://github.com/python/importlib_resources/commit/bd20d893f11f387d285c666bc99fd2d4a7c33ef8), I've reconciled and merged the changes from importlib_resources 3.2-5.0, mainly the namespace package support (https://importlib-resources.readthedocs.io/en/latest/history.html#v5-0-0).

Applying these changes to cpython and running the tests, there appear to be two emergent failure modes:

```
cpython master $ http --follow https://github.com/python/importlib_resources/archive/cpython.zip | bsdtar --strip-components 1 -x
$ ./python.exe Tools/scripts/run_tests.py test.test_importlib 2>&1 | gist -Pc
https://gist.github.com/dde7d5a951d92726380dced21503f843
```

In my estimation, the first two failures are due to the change in the abc.ResourceReader for contents to raise FileNotFoundError.

And the latter failures are seemingly due to the built-in NamespaceLoader not having a resource reader. I suspect the fix here is to add a .get_resource_reader() method to _NamespaceLoader to return a NamespaceReader. (hint: when updating _bootstrap_external.py, you'll need to run `make regen-importlib` or `make regen-all` and recompile).

Filipe, would you be interested in exploring these issues and propose some fixes and prepare the PR that applies the changes to CPython?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42129>
_______________________________________

From report at bugs.python.org  Sun Jan 10 12:49:48 2021
From: report at bugs.python.org (Ned Deily)
Date: Sun, 10 Jan 2021 17:49:48 +0000
Subject: [issue42880] ctypes: variadic function call still doesn't work on
 Apple Silicon
In-Reply-To: <1610264518.97.0.0227668442163.issue42880@roundup.psfhosted.org>
Message-ID: <1610300988.12.0.898682236477.issue42880@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
components: +macOS
nosy: +ned.deily, ronaldoussoren

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42880>
_______________________________________

From report at bugs.python.org  Sun Jan 10 13:01:31 2021
From: report at bugs.python.org (Ned Deily)
Date: Sun, 10 Jan 2021 18:01:31 +0000
Subject: [issue42880] ctypes: variadic function call still doesn't work on
 Apple Silicon
In-Reply-To: <1610264518.97.0.0227668442163.issue42880@roundup.psfhosted.org>
Message-ID: <1610301691.48.0.176256816881.issue42880@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

I tried your test programs on a M1 Mac running macOS 11.1 with the latest macOS universal2 Pythons available from python.org (https://www.python.org/downloads/), 3.9.1 and 3.10.0a4, and both produced the same (correct) result as in your 3.8 example.  Are you sure the brew Pythons are using the macOS 11 system libffi and not their own or older version?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42880>
_______________________________________

From report at bugs.python.org  Sun Jan 10 13:17:53 2021
From: report at bugs.python.org (Ned Deily)
Date: Sun, 10 Jan 2021 18:17:53 +0000
Subject: [issue42880] ctypes: variadic function call still doesn't work on
 Apple Silicon
In-Reply-To: <1610264518.97.0.0227668442163.issue42880@roundup.psfhosted.org>
Message-ID: <1610302673.7.0.159708845286.issue42880@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

(I also get *34* when building v3.10.0a4 from source on the M1 with 11.1 and Xcode 12.3.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42880>
_______________________________________

From report at bugs.python.org  Sun Jan 10 13:20:25 2021
From: report at bugs.python.org (Ziqiao Kong)
Date: Sun, 10 Jan 2021 18:20:25 +0000
Subject: [issue42880] ctypes: variadic function call still doesn't work on
 Apple Silicon
In-Reply-To: <1610302673.7.0.159708845286.issue42880@roundup.psfhosted.org>
Message-ID: <BY5PR01MB600449B9078208DA02018E2EF9AC0@BY5PR01MB6004.prod.exchangelabs.com>


Ziqiao Kong <ziqiaokong at gmail.com> added the comment:

Thanks for your reply. What shall I do to confirm the version of libffi? By otool?

________________________________
From: report=bugs.python.org at roundup.psfhosted.org <report=bugs.python.org at roundup.psfhosted.org> on behalf of Ned Deily <report at bugs.python.org>
Sent: Monday, January 11, 2021 2:17:53 AM
To: ziqiaokong at gmail.com <ziqiaokong at gmail.com>
Subject: [issue42880] ctypes: variadic function call still doesn't work on Apple Silicon

Ned Deily <nad at python.org> added the comment:

(I also get *34* when building v3.10.0a4 from source on the M1 with 11.1 and Xcode 12.3.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42880>
_______________________________________

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42880>
_______________________________________

From report at bugs.python.org  Sun Jan 10 13:24:32 2021
From: report at bugs.python.org (Ned Deily)
Date: Sun, 10 Jan 2021 18:24:32 +0000
Subject: [issue42880] ctypes: variadic function call still doesn't work on
 Apple Silicon
In-Reply-To: <1610264518.97.0.0227668442163.issue42880@roundup.psfhosted.org>
Message-ID: <1610303072.58.0.0673161139693.issue42880@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Yes, otool should work.  Something like:

$ otool -L $(python3.9 -c 'import _ctypes;print(_ctypes.__file__)')
/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/lib-dynload/_ctypes.cpython-39-darwin.so:
	/usr/lib/libffi.dylib (compatibility version 1.0.0, current version 27.0.0)
	/usr/lib/libSystem.B.dylib (compatibility version 1.0.0, current version 1292.0.0)
	/System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation (compatibility version 150.0.0, current version 1770.106.0)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42880>
_______________________________________

From report at bugs.python.org  Sun Jan 10 13:29:48 2021
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 10 Jan 2021 18:29:48 +0000
Subject: [issue42882] Restarting the interpreter causes UB on 3.10.0a4
In-Reply-To: <1610283618.64.0.475556781159.issue42882@roundup.psfhosted.org>
Message-ID: <1610303388.07.0.85228418.issue42882@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42882>
_______________________________________

From report at bugs.python.org  Sun Jan 10 13:30:29 2021
From: report at bugs.python.org (Ned Deily)
Date: Sun, 10 Jan 2021 18:30:29 +0000
Subject: [issue42874] running configure on Solaris 10 gives grep "illegal
 option" errors
In-Reply-To: <1610194453.5.0.66216438534.issue42874@roundup.psfhosted.org>
Message-ID: <1610303429.49.0.386694208295.issue42874@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
title: configure errors -> running configure on Solaris 10 gives grep "illegal option" errors

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42874>
_______________________________________

From report at bugs.python.org  Sun Jan 10 13:30:55 2021
From: report at bugs.python.org (Ned Deily)
Date: Sun, 10 Jan 2021 18:30:55 +0000
Subject: [issue42874] running configure on Solaris 10 gives grep "illegal
 option" errors
In-Reply-To: <1610194453.5.0.66216438534.issue42874@roundup.psfhosted.org>
Message-ID: <1610303455.35.0.729244630581.issue42874@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
components: +Build -Installation

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42874>
_______________________________________

From report at bugs.python.org  Sun Jan 10 14:51:50 2021
From: report at bugs.python.org (Daniel Nicorici)
Date: Sun, 10 Jan 2021 19:51:50 +0000
Subject: [issue42884] array.index() missing start and end
Message-ID: <1610308310.47.0.185082010282.issue42884@roundup.psfhosted.org>


New submission from Daniel Nicorici <daniel.nicorici at gmail.com>:

Add support for array.index(x [,start [,end]]). Adding start and end would allow to loop thru the entire array (and not start all the time from 0).


Currently, is array.index(x) (and it returns the smallest i such that i is the index of the first occurrence of x in the array). 


For example, bytearray.index() has start and end and list.index() has also start and end, but for some reason start and end are missing from array.index.

----------
messages: 384775
nosy: daniel.nicorici
priority: normal
severity: normal
status: open
title: array.index() missing start and end
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42884>
_______________________________________

From report at bugs.python.org  Sun Jan 10 14:53:22 2021
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 10 Jan 2021 19:53:22 +0000
Subject: [issue34804] Repetition of 'for example' in documentation
In-Reply-To: <1537939388.49.0.545547206417.issue34804@psf.upfronthosting.co.za>
Message-ID: <1610308402.78.0.122273538307.issue34804@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
keywords: +easy
versions: +Python 3.10 -Python 2.7, Python 3.4, Python 3.5, Python 3.6, Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34804>
_______________________________________

From report at bugs.python.org  Sun Jan 10 15:13:17 2021
From: report at bugs.python.org (=?utf-8?q?Filipe_La=C3=ADns?=)
Date: Sun, 10 Jan 2021 20:13:17 +0000
Subject: [issue42129] Support resources in namespace packages
In-Reply-To: <1603469006.87.0.128715336786.issue42129@roundup.psfhosted.org>
Message-ID: <1610309597.22.0.271455051406.issue42129@roundup.psfhosted.org>


Filipe La?ns <lains at riseup.net> added the comment:

Yes, I will look into it. Do we have a time schedule for when this should be ready, so that I can organize myself?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42129>
_______________________________________

From report at bugs.python.org  Sun Jan 10 15:15:05 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 10 Jan 2021 20:15:05 +0000
Subject: [issue42884] array.index() missing start and end
In-Reply-To: <1610308310.47.0.185082010282.issue42884@roundup.psfhosted.org>
Message-ID: <1610309705.41.0.841203621576.issue42884@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42884>
_______________________________________

From report at bugs.python.org  Sun Jan 10 15:44:30 2021
From: report at bugs.python.org (Zackery Spytz)
Date: Sun, 10 Jan 2021 20:44:30 +0000
Subject: [issue42884] array.index() missing start and end
In-Reply-To: <1610308310.47.0.185082010282.issue42884@roundup.psfhosted.org>
Message-ID: <1610311470.91.0.377764438189.issue42884@roundup.psfhosted.org>


Zackery Spytz <zspytz at gmail.com> added the comment:

This seems like a duplicate of bpo-31956.

----------
nosy: +ZackerySpytz

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42884>
_______________________________________

From report at bugs.python.org  Sun Jan 10 15:58:40 2021
From: report at bugs.python.org (Roland Hieber)
Date: Sun, 10 Jan 2021 20:58:40 +0000
Subject: [issue13501] Make libedit support more generic;
 port readline / libedit to FreeBSD
In-Reply-To: <1322579942.3.0.601983912656.issue13501@psf.upfronthosting.co.za>
Message-ID: <1610312320.64.0.981002547344.issue13501@roundup.psfhosted.org>


Change by Roland Hieber <rhi at pengutronix.de>:


----------
pull_requests: +23016
pull_request: https://github.com/python/cpython/pull/24189

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue13501>
_______________________________________

From report at bugs.python.org  Sun Jan 10 16:14:18 2021
From: report at bugs.python.org (John McCabe)
Date: Sun, 10 Jan 2021 21:14:18 +0000
Subject: [issue42867] Entry Widget not editable on Windows 10,
 but is on Linux Ubuntu 16.04
In-Reply-To: <1610109973.36.0.703695549775.issue42867@roundup.psfhosted.org>
Message-ID: <1610313258.29.0.996658636226.issue42867@roundup.psfhosted.org>


John McCabe <john at mccabe.org.uk> added the comment:

Fair point about being "too" long. Having seen a "short" example that, unfortunately, didn't actually exhibit the problem, I thought that providing a "smallish" example that definitely did exhibit the issue was quicker than, potentially, spending more time than necessary cutting it down.

However, for the record, hope the below example is better. As before, changing:

self.createWidgets()

to:

self.after_idle(self.createWidgets())

avoids the issue.

-----
#!/usr/bin/python3

import tkinter as tk
from tkinter import messagebox

class Application(tk.Frame):

    def __init__(self, master):
        super().__init__(master)
        self.master = master
        self.pack()
        self.createWidgets()

    def createWidgets(self):
        tk.messagebox.askquestion("Use An Existing File", "Do you want to load and use an existing file?")
        tk.Entry(self.master, width = 20).pack()

if __name__ == "__main__":
    root = tk.Tk()
    app = Application(root)
    app.mainloop()

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42867>
_______________________________________

From report at bugs.python.org  Sun Jan 10 16:16:39 2021
From: report at bugs.python.org (John McCabe)
Date: Sun, 10 Jan 2021 21:16:39 +0000
Subject: [issue42867] Entry Widget not editable on Windows 10,
 but is on Linux Ubuntu 16.04
In-Reply-To: <1610109973.36.0.703695549775.issue42867@roundup.psfhosted.org>
Message-ID: <1610313399.51.0.503424821586.issue42867@roundup.psfhosted.org>


John McCabe <john at mccabe.org.uk> added the comment:

Apologies, I couldn't find an edit button! That last comment should've said:

"As before, changing:

self.createWidgets()

to:

self.after_idle(self.createWidgets)

avoids the issue."

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42867>
_______________________________________

From report at bugs.python.org  Sun Jan 10 16:30:03 2021
From: report at bugs.python.org (Roland Hieber)
Date: Sun, 10 Jan 2021 21:30:03 +0000
Subject: [issue13501] Make libedit support more generic;
 port readline / libedit to FreeBSD
In-Reply-To: <1322579942.3.0.601983912656.issue13501@psf.upfronthosting.co.za>
Message-ID: <1610314203.06.0.18216808726.issue13501@roundup.psfhosted.org>


Roland Hieber <rhi at pengutronix.de> added the comment:

Okay, I've had a look at this, and it seems that all the heavy lifting is already included in 68669ef7883 (via #38634, PR 16986). The selection of libedit vs. readline still needs to be ported. I've prepared (and tested) PR 24189 for the rebase of this patch to the current master.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue13501>
_______________________________________

From report at bugs.python.org  Sun Jan 10 16:45:24 2021
From: report at bugs.python.org (Jason R. Coombs)
Date: Sun, 10 Jan 2021 21:45:24 +0000
Subject: [issue42129] Support resources in namespace packages
In-Reply-To: <1603469006.87.0.128715336786.issue42129@roundup.psfhosted.org>
Message-ID: <1610315124.97.0.673106083039.issue42129@roundup.psfhosted.org>


Jason R. Coombs <jaraco at jaraco.com> added the comment:

Thanks!

No rush, but ideally soon enough to be merged before the beta release of Python 3.10 (2021-05-03).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42129>
_______________________________________

From report at bugs.python.org  Sun Jan 10 16:58:21 2021
From: report at bugs.python.org (Arnim Rupp)
Date: Sun, 10 Jan 2021 21:58:21 +0000
Subject: [issue42885] Regex performance problem with ^ aka AT_BEGINNING
Message-ID: <1610315901.41.0.467379667553.issue42885@roundup.psfhosted.org>


New submission from Arnim Rupp <erich at rupp.de>:

The re lib needs 7 seconds to check if a billion As start with an x. So e.g. this statement takes this long:

re.search(r'^x', 'A' * 1000000000)

It takes longer, the longer the string is. The string handling is not the problem, checking if it starts which an A takes just 0.00014 seconds. See output and code below:

3.10.0a4+ (heads/master:d16f617, Jan  9 2021, 13:24:45) 
[GCC 7.5.0]
testing string len:  100000
re_test_false:  0.0008246829966083169
testing string len:  1000000000
re_test_false:  7.317708015005337
testing string len:  1000000000
re_test_true:   0.00014710200048284605


import re, timeit, functools, sys

def re_test_true(string):
    print("testing string len: ", len(string))
    re.search(r'^A', string)

def re_test_false(string):
    print("testing string len: ", len(string))
    re.search(r'^x', string)

print(sys.version)

huge_string = 'A' * 100000
print('re_test_false: ', timeit.timeit(functools.partial(re_test_false, huge_string), number=1))

huge_string = 'A' * 1000000000
print('re_test_false: ', timeit.timeit(functools.partial(re_test_false, huge_string), number=1))

print('re_test_true:  ', timeit.timeit(functools.partial(re_test_true, huge_string), number=1))

----------
components: Library (Lib)
files: regex_timeit.py
messages: 384782
nosy: another_try
priority: normal
severity: normal
status: open
title: Regex performance problem with ^ aka AT_BEGINNING
type: performance
versions: Python 3.10
Added file: https://bugs.python.org/file49733/regex_timeit.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42885>
_______________________________________

From report at bugs.python.org  Sun Jan 10 17:44:43 2021
From: report at bugs.python.org (Camion)
Date: Sun, 10 Jan 2021 22:44:43 +0000
Subject: [issue42886] math.log and math.log10 domain error on very large
 Fractions
Message-ID: <1610318683.55.0.0487505722004.issue42886@roundup.psfhosted.org>


New submission from Camion <camion_spam-pybugs at yahoo.com>:

Python is able to computer the logarithms of very large integers and fractions (by using log(num)-log(denom)), However the fractions.Fraction class fails to do it and raises a math domain error exception.

>>> import math, fractions
>>> f=fractions.Fraction(math.factorial(10000), math.factorial(20000)+1)
>>> math.log(f.numerator)-math.log(f.denominator)
-95966.69390038431
>>> math.log(f)
Traceback (most recent call last):
  File "<pyshell#30>", line 1, in <module>
    math.log(f)
ValueError: math domain error
>>> math.log10(f.numerator)-math.log10(f.denominator)
-41677.80560743537
>>> math.log10(f)
Traceback (most recent call last):
  File "<pyshell#32>", line 1, in <module>
    math.log10(f)
ValueError: math domain error

----------
components: Library (Lib)
messages: 384783
nosy: Camion
priority: normal
severity: normal
status: open
title: math.log and math.log10 domain error on very large Fractions
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42886>
_______________________________________

From report at bugs.python.org  Sun Jan 10 18:09:41 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 10 Jan 2021 23:09:41 +0000
Subject: [issue42886] math.log and math.log10 domain error on very large
 Fractions
In-Reply-To: <1610318683.55.0.0487505722004.issue42886@roundup.psfhosted.org>
Message-ID: <1610320181.77.0.718669371821.issue42886@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Internally, the math.log10() function only works on floats.  By way of the __float__() method, the input to the the math.log10() function is asked to convert itself to a float.  Fractions implement __float__() by just dividing the numerator and denominator.  In your example, the result is smaller than the smallest representable positive float (2**-1074), so the result gets rounded down to 0.0.  The log10() function isn't defined for zero:

    >>> f = Fraction(factorial(10000), factorial(20000)+1)
    >>> float(f)
    0.0
    >>> log10(f)
    Traceback (most recent call last):
      ...
    ValueError: math domain error

Short of adding a log10() method to the Fraction class, there isn't a straight forward way to accommodate getting this to work.

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42886>
_______________________________________

From report at bugs.python.org  Sun Jan 10 18:20:31 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 10 Jan 2021 23:20:31 +0000
Subject: [issue42867] Entry Widget not editable on Windows 10,
 but is on Linux Ubuntu 16.04
In-Reply-To: <1610109973.36.0.703695549775.issue42867@roundup.psfhosted.org>
Message-ID: <1610320831.27.0.0607767456286.issue42867@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

With a truly minimal but reproducible example, I was able to understand and experiment. As is, widget creation is done without the event loop running.  Displaying the message box shifts grabs the internal focus but also displays the unfocused tk window.  When the message box is dismissed and mainloop() is called, the root window is displayed apparently with focus but it is unresponsive to mouse click on the entry box, hence the entry box never gets focus and never gets keypresses.  This is a bug somewhere between tk and Windows window manager and focus management.

Adding after_idle delays the message box and entry creation until after the mainloop call, and clicking on the entry now works.  In this case, the (unfocused) root window is *not* displayed.


If the entry box is the proper default focused widget when the message box is dismissed, an even better fix, to me, is to bind the entry box and explicitly give it the focus.  According to the tk docs, focus_set should work.  But it does not on Windows (and I suspect that this is related to clicking not working).  focus_force does work.

Another solution is to add master.update() before createWidgets.  Clicking on then works.  Putting self.master.update() after the messagebox call does not work.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42867>
_______________________________________

From report at bugs.python.org  Sun Jan 10 18:47:32 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Sun, 10 Jan 2021 23:47:32 +0000
Subject: [issue42886] math.log and math.log10 domain error on very large
 Fractions
In-Reply-To: <1610318683.55.0.0487505722004.issue42886@roundup.psfhosted.org>
Message-ID: <1610322452.23.0.954489215514.issue42886@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

I guess another approach might be to change the math module so that all its functions support franctions (and decimal, and other esoteric number types). But that would require having __log__ and many others as methods on the numeric types.

Personally I wish we had kept the math module for C doubles (Python floats) only -- I fear that it has become a mash-up of such functions with random other things people may remember from their high school math classes such as factorial(). This is just asking for misunderstandings like this. :-(

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42886>
_______________________________________

From report at bugs.python.org  Sun Jan 10 18:51:43 2021
From: report at bugs.python.org (Camion)
Date: Sun, 10 Jan 2021 23:51:43 +0000
Subject: [issue42886] math.log and math.log10 domain error on very large
 Fractions
In-Reply-To: <1610318683.55.0.0487505722004.issue42886@roundup.psfhosted.org>
Message-ID: <1610322703.84.0.851430287132.issue42886@roundup.psfhosted.org>


Camion <camion_spam-pybugs at yahoo.com> added the comment:

math.log10 works perfectly on integers which are too large to be converted to floats. I see no reason why it couldn't work as well with fractions.

>>> math.log10(math.factorial(10000))
35659.45427452078
>>> math.log10(math.factorial(1000000))
5565708.917186718
>>> math.log10(float(math.factorial(10000)))
Traceback (most recent call last):
  File "<pyshell#36>", line 1, in <module>
    math.log10(float(math.factorial(10000)))
OverflowError: int too large to convert to float

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42886>
_______________________________________

From report at bugs.python.org  Sun Jan 10 18:58:50 2021
From: report at bugs.python.org (Camion)
Date: Sun, 10 Jan 2021 23:58:50 +0000
Subject: [issue42886] math.log and math.log10 domain error on very large
 Fractions
In-Reply-To: <1610318683.55.0.0487505722004.issue42886@roundup.psfhosted.org>
Message-ID: <1610323130.08.0.683485060684.issue42886@roundup.psfhosted.org>


Camion <camion_spam-pybugs at yahoo.com> added the comment:

A generic solution might be to consider all number as fractions (which they are) (floats have denominators being 2^n, decimals have denominators being 10^n, integers have denominators being 1, and fractions have denominators being integers... but this would be a heavy change.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42886>
_______________________________________

From report at bugs.python.org  Sun Jan 10 19:00:58 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Mon, 11 Jan 2021 00:00:58 +0000
Subject: [issue42881] Should typing.get_type_hints change None annotations?
In-Reply-To: <1610278192.15.0.512262305909.issue42881@roundup.psfhosted.org>
Message-ID: <1610323258.81.0.169145353452.issue42881@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

I agree this is a bit unfortunate, but I also think it's a bit late to change now.

However *if* we're going to change it we should do it now (in 3.10) or never. Given that we never *write* type(None) in annotations, it's unfortunate to get that back whenever we wrote None.

I personally don't care because I never use get_type_hints() -- I don't use annotations at runtime (which may also be how this snuck into  get_type_hints() in the first place -- some misguided idea that it should return a "type").

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42881>
_______________________________________

From report at bugs.python.org  Sun Jan 10 19:28:44 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Mon, 11 Jan 2021 00:28:44 +0000
Subject: [issue42878] urllib.request.HTTPPasswordMgr.is_suburi does not care
 about order
In-Reply-To: <1610227417.16.0.538971054996.issue42878@roundup.psfhosted.org>
Message-ID: <1610324924.75.0.598065076573.issue42878@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Cheryl, do you have time to review this?

----------
nosy: +cheryl.sabella, gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42878>
_______________________________________

From report at bugs.python.org  Sun Jan 10 19:50:46 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 11 Jan 2021 00:50:46 +0000
Subject: [issue42886] math.log and math.log10 domain error on very large
 Fractions
In-Reply-To: <1610318683.55.0.0487505722004.issue42886@roundup.psfhosted.org>
Message-ID: <1610326246.51.0.288196865288.issue42886@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

> math.log10 works perfectly on integers which are too large
> to be converted to floats. I see no reason why it couldn't 
> work as well with fractions.

This is tricky territory.  Mathematically, a common logarithm can and often will have a irrational result, so floats will enter the picture at some point.  Unlike Fractions which don't have size limits, floats are range limited, so some overflows and underflows will still happen regardless. 

> ... but this would be a heavy change.

There's the rub.  We could create a dunder method for every math function and require that every numeric type to support every dunder method.

That's a somewhat major design change and it's far above my pay grade to say whether that would be worth it ;-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42886>
_______________________________________

From report at bugs.python.org  Sun Jan 10 21:32:56 2021
From: report at bugs.python.org (Tim Peters)
Date: Mon, 11 Jan 2021 02:32:56 +0000
Subject: [issue42886] math.log and math.log10 domain error on very large
 Fractions
In-Reply-To: <1610318683.55.0.0487505722004.issue42886@roundup.psfhosted.org>
Message-ID: <1610332376.99.0.483885182279.issue42886@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

Any principled change costs more than it's worth :-(

I'm mostly sympathetic with Guido's view, and have long advocated a new `imath` module to hold the ever-growing number of functions that are really part of integer combinatorics.  But it's become nearly impossible to add a new module anymore:  python-ideas can't maintain any focus, python-dev has become an eternal circular debating society, and "put it on pyPI first to see whether it's adopted" has become a go-to bait-&-switch scam (e.g., witness Grant Jenks's `sortedcontainers` module, which is absolutely first rate, and widely used, but "why add it to the core? it's already on pyPI" has shut down any suggestion to fold it in - although I don't know that Grant would _want_ to fold it in).

OTOH, I don't agree `math` should be limited solely to floats.  It would be, e.g., pointlessly annoying for things like `pow(x, 4)` or `atan(1)` to blow up just because an argument is an int instead of a float.  I have no problem with limiting `math` functions to the simple scalar types that also work in C libm calls (where ints aren't a problem because the compiler inserts coercions to double). As a slight extension then, I have no problem either with log(1 << 1000000) working, because Python doesn't have C's distinctions between integer sizes.  So, overall, "floats or ints, but generally just the functions C's <math.h> defines".  Which is pretty much how `math` started.

But I don't see a realistic way to get there from here. Even though I'm retired now, I don't _want_ to spend 16 hours arguing every day for months - that's a major percentage of my remaining expected life ;-)

For other approaches, people doing serious work already solve it the obvious way. For example, the spiffy arbitrary-precision `mpmath` binary float module supplies its own versions of libm functions, that work on the numeric types it defines. It's not a real problem in real life that they don't also work on Fraction or Decimal. In fact, I'm glad they don't! It would usually be "an error" in my code if I tried to pass a Decimal to an mpmath function, because I'm using mpmath to begin with precisely because I _intend_ to work specifically and only with mpmath's numeric types for the duration.

So we can keep this report open forever waiting for a miracle, or yield to reality and close it as "sorry - won't fix" now ;-)

----------
nosy: +tim.peters

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42886>
_______________________________________

From report at bugs.python.org  Sun Jan 10 22:04:28 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 11 Jan 2021 03:04:28 +0000
Subject: [issue42886] math.log and math.log10 domain error on very large
 Fractions
In-Reply-To: <1610318683.55.0.0487505722004.issue42886@roundup.psfhosted.org>
Message-ID: <1610334268.01.0.137623009301.issue42886@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

> Any principled change costs more than it's worth :-(

For anyone wanting to go forward with this, here's a summary of the feature request:

    Given two non-zero same signed integers x and y,
    log10(Fraction(x, y)) does the same as log10(x / y).

    This works well unless the ratio of x to y is outside
    the range supported by floats.

    What is desired is that for extreme values of x and y,
    that log10() will treat the fraction differently and
    compute log10(x) - log10(y) instead of log10(x / y).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42886>
_______________________________________

From report at bugs.python.org  Sun Jan 10 22:33:35 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Mon, 11 Jan 2021 03:33:35 +0000
Subject: [issue42886] math.log and math.log10 domain error on very large
 Fractions
In-Reply-To: <1610318683.55.0.0487505722004.issue42886@roundup.psfhosted.org>
Message-ID: <1610336015.63.0.763238776883.issue42886@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

The problem with that formulation of the feature request is that it would require the math.log function to recognize rationals, or at least the Fraction type. Since the numeric tower and the fractions module are implemented in pure Python that would be somewhat problematic.

I think people who work a lot with fractions and want to compute their logarithm just need to use the formula that the OP gave.

----------
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42886>
_______________________________________

From report at bugs.python.org  Mon Jan 11 01:19:12 2021
From: report at bugs.python.org (Ziqiao Kong)
Date: Mon, 11 Jan 2021 06:19:12 +0000
Subject: [issue42880] ctypes: variadic function call still doesn't work on
 Apple Silicon
In-Reply-To: <1610264518.97.0.0227668442163.issue42880@roundup.psfhosted.org>
Message-ID: <1610345952.23.0.237413960568.issue42880@roundup.psfhosted.org>


Ziqiao Kong <ziqiaokong at gmail.com> added the comment:

Seems that we are getting the same libffi.dylib.

kabeor at kamino cpython-3.10.0a4 % otool -L $(./python.exe -c 'import _ctypes;print(_ctypes.__file__)')
/Users/kabeor/cpython-3.10.0a4/build/lib.macosx-11.0-arm64-3.10/_ctypes.cpython-310-darwin.so:
	/usr/lib/libffi.dylib (compatibility version 1.0.0, current version 27.0.0)
	/usr/lib/libSystem.B.dylib (compatibility version 1.0.0, current version 1292.60.1)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42880>
_______________________________________

From report at bugs.python.org  Mon Jan 11 01:24:26 2021
From: report at bugs.python.org (Ziqiao Kong)
Date: Mon, 11 Jan 2021 06:24:26 +0000
Subject: [issue42880] ctypes: variadic function call still doesn't work on
 Apple Silicon
In-Reply-To: <1610264518.97.0.0227668442163.issue42880@roundup.psfhosted.org>
Message-ID: <1610346266.68.0.194946542496.issue42880@roundup.psfhosted.org>


Ziqiao Kong <ziqiaokong at gmail.com> added the comment:

BTW, uname for the M1 MBP.

```
kabeor at kamino cpython-3.10.0a4 % uname -a
Darwin kamino.lan 20.1.0 Darwin Kernel Version 20.1.0: Sat Oct 31 00:07:10 PDT 2020; root:xnu-7195.50.7~2/RELEASE_ARM64_T8101 arm6464
```

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42880>
_______________________________________

From report at bugs.python.org  Mon Jan 11 02:38:04 2021
From: report at bugs.python.org (Xinmeng Xia)
Date: Mon, 11 Jan 2021 07:38:04 +0000
Subject: [issue42887] Multiple assignments of attribute "__sizeof__" will
 cause a segfault
Message-ID: <1610350684.08.0.491719857036.issue42887@roundup.psfhosted.org>


New submission from Xinmeng Xia <xiaxm at smail.nju.edu.cn>:

In the following program 1? method  "__sizeof__()" is called and assigned multiple times. The program can work well on Python 3.10. However if I change "__sizeof__()" to  "__sizeof__".  Then a segmentation fault is reported. I think something wrong for the parser when dealing build-in attribute assignment.



program 1: 
=========================
mystr  = "hello123"
for x in range(1000000):
    mystr = mystr.__sizeof__()
    print(mystr)
=========================
56
28
28
.......
28
28

Output: work well as expected.


program 2: 
==========================
mystr = "hello123"
for x in range(1000000):
        mystr = mystr.__sizeof__
        print(mystr)
==========================
<built-in method __sizeof__ of builtin_function_or_method object at 0x7f04d3e0c220>
......
<built-in method __sizeof__ of builtin_function_or_method object at 0x7f04d3e0c4f0>
<built-in method __sizeof__ of builtin_function_or_method object at 0x7f04d3e0c540>
Segmentation fault (core dumped)

Expected output: no segfault.

----------
components: Interpreter Core
messages: 384797
nosy: xxm
priority: normal
severity: normal
status: open
title: Multiple assignments of attribute "__sizeof__" will cause a segfault
type: crash
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42887>
_______________________________________

From report at bugs.python.org  Mon Jan 11 02:40:22 2021
From: report at bugs.python.org (Xinmeng Xia)
Date: Mon, 11 Jan 2021 07:40:22 +0000
Subject: =?utf-8?q?=5Bissue42888=5D_Not_installed_=E2=80=9Clibgcc=5Fs=2Eso=2E1?=
 =?utf-8?q?=E2=80=9D_causes_parser_crash=2E?=
Message-ID: <1610350822.34.0.431759793604.issue42888@roundup.psfhosted.org>


New submission from Xinmeng Xia <xiaxm at smail.nju.edu.cn>:

The following thread program will cause Python3.10 parser "core dump" due to missing ?libgcc_s.so.1?. "pthread_cancel" cannot work correctly. I am wondering is there any possible to install or link to libgcc_s.so.1 during Python installation?

===================================
import socket
from threading import Thread
class thread(Thread):
      def run(self):
          for res in socket.getaddrinfo('www.google.com',8080):
              sock = socket.socket()
              sock.connect(res[4])

for i in range(2000):
    thread().start()
====================================
Error message:
---------------------------------------------------------------
........
Exception in thread Thread-1346:
Traceback (most recent call last):
  File "/usr/local/python310/lib/python3.10/threading.py", line 960, in _bootstrap_inner
  File "/usr/local/python310/lib/python3.10/threading.py", line 960, in _bootstrap_inner
Exception in thread Thread-1172:
Traceback (most recent call last):
.......
Exception in thread Thread-1509:
Exception in thread Thread-1510:
libgcc_s.so.1 must be installed for pthread_cancel to work
Exception in thread Thread-1511:
Traceback (most recent call last):
Aborted (core dumped)
---------------------------------------------------------------

----------
components: Interpreter Core
messages: 384798
nosy: xxm
priority: normal
severity: normal
status: open
title: Not installed ?libgcc_s.so.1? causes parser crash.
type: crash
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42888>
_______________________________________

From report at bugs.python.org  Mon Jan 11 02:45:39 2021
From: report at bugs.python.org (Xinmeng Xia)
Date: Mon, 11 Jan 2021 07:45:39 +0000
Subject: [issue42889] Incorrect behavior of Python parser after ast node of
 test program being modified
Message-ID: <1610351139.91.0.540037450972.issue42889@roundup.psfhosted.org>


New submission from Xinmeng Xia <xiaxm at smail.nju.edu.cn>:

The following program will lead to a incorrect behavior of Python parser.  We change all variable to integer( forcely transformed to string) via ast.NodeTransformer. Then we compile the new code and execute it. It's surprising that code like "1=2; print(1)" can be compiled without error message. And more surprisingly, the execution result of "print(1)" is 2 ! !

====================================
import ast
class RewriteName(ast.NodeTransformer):
    def visit_Name(self, node):
        if node.id != "print":
            node.id = str(node.lineno)
        return node


code = "a = 2;print(a)"


myast = ast.parse(code)
transformer = RewriteName()
newast = transformer.visit(myast)

# print(ast.dump(newast))

print("new code:","------------")
print(ast.unparse(newast))
print("------------")

c = compile(newast,'','exec')
exec(c)
=================================

output result:
new code: ------------
1 = 2
print(1)
------------
2

Expected result: (1). Syntax error during compilation. "1" should not be the correct identifier of program, even if it's forcely transformed to string. (2). The output of execution should be "1"  , since the parameter of "print()" in the new code is string "1".  

This incorrect behaviors exists on all version of Python(from Python2 to Python 3).

----------
components: Interpreter Core
messages: 384799
nosy: xxm
priority: normal
severity: normal
status: open
title: Incorrect behavior of Python parser after ast node of test program  being modified
type: behavior
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42889>
_______________________________________

From report at bugs.python.org  Mon Jan 11 02:56:52 2021
From: report at bugs.python.org (Christian Heimes)
Date: Mon, 11 Jan 2021 07:56:52 +0000
Subject: =?utf-8?q?=5Bissue42888=5D_Not_installed_=E2=80=9Clibgcc=5Fs=2Eso=2E1?=
 =?utf-8?q?=E2=80=9D_causes_parser_crash=2E?=
In-Reply-To: <1610350822.34.0.431759793604.issue42888@roundup.psfhosted.org>
Message-ID: <1610351812.79.0.146706321153.issue42888@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

What's your platform and distribution?

----------
nosy: +christian.heimes

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42888>
_______________________________________

From report at bugs.python.org  Mon Jan 11 03:06:17 2021
From: report at bugs.python.org (Christian Heimes)
Date: Mon, 11 Jan 2021 08:06:17 +0000
Subject: [issue42887] Multiple assignments of attribute "__sizeof__" will
 cause a segfault
In-Reply-To: <1610350684.08.0.491719857036.issue42887@roundup.psfhosted.org>
Message-ID: <1610352377.47.0.0254149781332.issue42887@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

I can reproduce the issue. The stack trace is several hundred thousand (!) levels deep.

#0  _Py_DECREF (op=<built-in method __sizeof__ of builtin_function_or_method object at remote 0x7fffe60703b0>, lineno=514, filename=0x6570af "./Include/object.h")
    at ./Include/object.h:448
#1  _Py_XDECREF (op=<built-in method __sizeof__ of builtin_function_or_method object at remote 0x7fffe60703b0>) at ./Include/object.h:514
#2  meth_dealloc (m=0x7fffe6070470) at Objects/methodobject.c:170
#3  0x0000000000466a99 in _Py_Dealloc (op=<optimized out>) at Objects/object.c:2209
#4  0x00000000005da2fa in _Py_DECREF (op=<optimized out>, lineno=514, filename=0x6570af "./Include/object.h") at ./Include/object.h:448
#5  _Py_XDECREF (op=<optimized out>) at ./Include/object.h:514
#6  meth_dealloc (m=0x7fffe60704d0) at Objects/methodobject.c:170
#7  0x0000000000466a99 in _Py_Dealloc (op=<optimized out>) at Objects/object.c:2209
#8  0x00000000005da2fa in _Py_DECREF (op=<optimized out>, lineno=514, filename=0x6570af "./Include/object.h") at ./Include/object.h:448
#9  _Py_XDECREF (op=<optimized out>) at ./Include/object.h:514
#10 meth_dealloc (m=0x7fffe6070530) at Objects/methodobject.c:170
#11 0x0000000000466a99 in _Py_Dealloc (op=<optimized out>) at Objects/object.c:2209
#12 0x00000000005da2fa in _Py_DECREF (op=<optimized out>, lineno=514, filename=0x6570af "./Include/object.h") at ./Include/object.h:448
#13 _Py_XDECREF (op=<optimized out>) at ./Include/object.h:514
#14 meth_dealloc (m=0x7fffe6070590) at Objects/methodobject.c:170
#15 0x0000000000466a99 in _Py_Dealloc (op=<optimized out>) at Objects/object.c:2209
#16 0x00000000005da2fa in _Py_DECREF (op=<optimized out>, lineno=514, filename=0x6570af "./Include/object.h") at ./Include/object.h:448
#17 _Py_XDECREF (op=<optimized out>) at ./Include/object.h:514
#18 meth_dealloc (m=0x7fffe60705f0) at Objects/methodobject.c:170
#19 0x0000000000466a99 in _Py_Dealloc (op=<optimized out>) at Objects/object.c:2209
#20 0x00000000005da2fa in _Py_DECREF (op=<optimized out>, lineno=514, filename=0x6570af "./Include/object.h") at ./Include/object.h:448
#21 _Py_XDECREF (op=<optimized out>) at ./Include/object.h:514
#22 meth_dealloc (m=0x7fffe6070650) at Objects/methodobject.c:170
...
#509737 _Py_XDECREF (op=<optimized out>) at ./Include/object.h:514
#509738 meth_dealloc (m=0x7fffe54ca6b0) at Objects/methodobject.c:170
#509739 0x0000000000466a99 in _Py_Dealloc (op=<optimized out>) at Objects/object.c:2209
#509740 0x00000000005da2fa in _Py_DECREF (op=<optimized out>, lineno=514, filename=0x6570af "./Include/object.h") at ./Include/object.h:448
#509741 _Py_XDECREF (op=<optimized out>) at ./Include/object.h:514
#509742 meth_dealloc (m=0x7fffe54ca710) at Objects/methodobject.c:170
#509743 0x0000000000466a99 in _Py_Dealloc (op=<optimized out>) at Objects/object.c:2209
#509744 0x00000000005da2fa in _Py_DECREF (op=<optimized out>, lineno=514, filename=0x6570af "./Include/object.h") at ./Include/object.h:448
#509745 _Py_XDECREF (op=<optimized out>) at ./Include/object.h:514
#509746 meth_dealloc (m=0x7fffe54ca770) at Objects/methodobject.c:170

...

----------
nosy: +christian.heimes

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42887>
_______________________________________

From report at bugs.python.org  Mon Jan 11 03:17:41 2021
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 11 Jan 2021 08:17:41 +0000
Subject: [issue42887] Multiple assignments of attribute "__sizeof__" will
 cause a segfault
In-Reply-To: <1610350684.08.0.491719857036.issue42887@roundup.psfhosted.org>
Message-ID: <1610353061.04.0.92453154016.issue42887@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

This is a recursion problem, "mystr" will be equivalent to 'hello123'.__sizeof__.__sizeof__. ...(100K repetition)... .__sizeof__.  The dealloc of "mystr" will cause recursive calls to tp_dealloc along the entire chain and that can exhaust the C stack.

----------
nosy: +ronaldoussoren

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42887>
_______________________________________

From report at bugs.python.org  Mon Jan 11 03:22:38 2021
From: report at bugs.python.org (Mark Dickinson)
Date: Mon, 11 Jan 2021 08:22:38 +0000
Subject: [issue42886] math.log and math.log10 domain error on very large
 Fractions
In-Reply-To: <1610318683.55.0.0487505722004.issue42886@roundup.psfhosted.org>
Message-ID: <1610353358.18.0.522151834007.issue42886@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

@Camion: Can you say more about your use-case? One thing that's on my would-be-nice-to-do-one-day list is 'e', 'f' and 'g'-style decimal formatting for Fraction objects. Without that, it's often hard to get a quick sense of the magnitude of a Fraction without conversion to float. Would that formatting capability help at all with your use-case, or are you doing something entirely different?

----------
nosy: +mark.dickinson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42886>
_______________________________________

From report at bugs.python.org  Mon Jan 11 04:01:14 2021
From: report at bugs.python.org (Xinmeng Xia)
Date: Mon, 11 Jan 2021 09:01:14 +0000
Subject: =?utf-8?q?=5Bissue42888=5D_Not_installed_=E2=80=9Clibgcc=5Fs=2Eso=2E1?=
 =?utf-8?q?=E2=80=9D_causes_parser_crash=2E?=
In-Reply-To: <1610350822.34.0.431759793604.issue42888@roundup.psfhosted.org>
Message-ID: <1610355674.93.0.580283185413.issue42888@roundup.psfhosted.org>


Xinmeng Xia <xiaxm at smail.nju.edu.cn> added the comment:

>>python310 -V
Python 3.10.0a2

>>uname -v
#73~16.04.1-Ubuntu SMP Fri Sep 13 09:56:18 UTC 2019

Thank you!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42888>
_______________________________________

From report at bugs.python.org  Mon Jan 11 04:27:24 2021
From: report at bugs.python.org (Steven D'Aprano)
Date: Mon, 11 Jan 2021 09:27:24 +0000
Subject: [issue42885] Regex performance problem with ^ aka AT_BEGINNING
In-Reply-To: <1610315901.41.0.467379667553.issue42885@roundup.psfhosted.org>
Message-ID: <1610357244.89.0.141507859611.issue42885@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

I'm getting similar results in Python 3.9.

[steve ~]$ python3.9 -m timeit -s "a = 'A'*10000" -s "import re" "re.search('^x', a)"
5000 loops, best of 5: 67.3 usec per loop
[steve ~]$ python3.9 -m timeit -s "a = 'A'*100000" -s "import re" "re.search('^x', a)"
500 loops, best of 5: 639 usec per loop
[steve ~]$ python3.9 -m timeit -s "a = 'A'*1000000" -s "import re" "re.search('^x', a)"
50 loops, best of 5: 6.27 msec per loop
[steve ~]$ python3.9 -m timeit -s "a = 'A'*10000000" -s "import re" "re.search('^x', a)"
5 loops, best of 5: 62.8 msec per loop
[steve ~]$ python3.9 -m timeit -s "a = 'A'*100000000" -s "import re" "re.search('^x', a)"
1 loop, best of 5: 654 msec per loop


It looks like the time is roughly linear in the length of the string.

I get the same result as far back as Python 2.7 (I haven't tried older versions).

[steve ~]$ python2.7 -m timeit -s "a = 'A'*10000" -s "import re" "re.search('^x', a)"
10000 loops, best of 3: 75.7 usec per loop
[steve ~]$ python2.7 -m timeit -s "a = 'A'*10000000" -s "import re" "re.search('^x', a)"
10 loops, best of 3: 73.4 msec per loop


I would have expected essentially constant time, as in re.match:

[steve ~]$ python3.9 -m timeit -s "a = 'A'*10000" -s "import re" "re.match('x', a)"
500000 loops, best of 5: 560 nsec per loop
[steve ~]$ python3.9 -m timeit -s "a = 'A'*100000000" -s "import re" "re.match('x', a)"
500000 loops, best of 5: 561 nsec per loop

----------
nosy: +steven.daprano
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42885>
_______________________________________

From report at bugs.python.org  Mon Jan 11 04:49:08 2021
From: report at bugs.python.org (Steven D'Aprano)
Date: Mon, 11 Jan 2021 09:49:08 +0000
Subject: [issue42886] math.log and math.log10 domain error on very large
 Fractions
In-Reply-To: <1610318683.55.0.0487505722004.issue42886@roundup.psfhosted.org>
Message-ID: <1610358548.24.0.488067132841.issue42886@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

Guido wrote:

> it would require the math.log function to recognize rationals

I don't think it would. You don't need a type-check, you just need to check for a pair of numerator and denominator attributes.

So we could do something like this, except in C:

    try:
        return log(float(x))
    except DomainError:
        try:
            a = x.numerator
            b = x.denominator
        except AttributeError:
            pass
        else:
            return log(a) - log(b)
        raise

----------
nosy: +steven.daprano

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42886>
_______________________________________

From report at bugs.python.org  Mon Jan 11 05:26:19 2021
From: report at bugs.python.org (Wlodek)
Date: Mon, 11 Jan 2021 10:26:19 +0000
Subject: [issue42890] bug float to int
Message-ID: <1610360779.86.0.614039765509.issue42890@roundup.psfhosted.org>


New submission from Wlodek <wlodek at freenet.de>:

Python 3.8.5 (default, Jul 28 2020, 12:59:40) 
[GCC 9.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> f=0.1234/100
>>> f2= f*10**8
>>> i2= int(f2)
>>> print("float=%f, float_2=%f, int(float_2)=%d" % (f, f2, int(f2)))
float=0.001234, float_2=123400.000000, int(float_2)=123399

----------
components: Library (Lib)
messages: 384807
nosy: wlodek
priority: normal
severity: normal
status: open
title: bug float to int
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42890>
_______________________________________

From report at bugs.python.org  Mon Jan 11 05:27:51 2021
From: report at bugs.python.org (John McCabe)
Date: Mon, 11 Jan 2021 10:27:51 +0000
Subject: [issue42867] Entry Widget not editable on Windows 10,
 but is on Linux Ubuntu 16.04
In-Reply-To: <1610109973.36.0.703695549775.issue42867@roundup.psfhosted.org>
Message-ID: <1610360871.89.0.627559861462.issue42867@roundup.psfhosted.org>


John McCabe <john at mccabe.org.uk> added the comment:

Thank you for that information and analysis Terry. As you can see, at the end of the addNew() function in the original example, I'd added:

---
        if initialLeft is not None:
            rightBox.insert(tk.END, initialLeft)
        self.leftRightEntries.append((leftBox, rightBox))
        leftBox.focus_set()
---

and, as you've noticed, that makes no difference on Windows. I hadn't tried focus_force(), but will try to bear that in mind.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42867>
_______________________________________

From report at bugs.python.org  Mon Jan 11 07:09:08 2021
From: report at bugs.python.org (Christian Heimes)
Date: Mon, 11 Jan 2021 12:09:08 +0000
Subject: [issue42890] bug float to int
In-Reply-To: <1610360779.86.0.614039765509.issue42890@roundup.psfhosted.org>
Message-ID: <1610366948.99.0.0206249609484.issue42890@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

Rounding errors are to be expected. Python uses IEEE-754 double precision floats. See https://docs.python.org/3/tutorial/floatingpoint.html

----------
nosy: +christian.heimes
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42890>
_______________________________________

From report at bugs.python.org  Mon Jan 11 07:12:28 2021
From: report at bugs.python.org (Christian Heimes)
Date: Mon, 11 Jan 2021 12:12:28 +0000
Subject: =?utf-8?q?=5Bissue42888=5D_Not_installed_=E2=80=9Clibgcc=5Fs=2Eso=2E1?=
 =?utf-8?q?=E2=80=9D_causes_parser_crash=2E?=
In-Reply-To: <1610350822.34.0.431759793604.issue42888@roundup.psfhosted.org>
Message-ID: <1610367148.68.0.735615430441.issue42888@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

Please provide more information. What Linux distribution and distro version are you using? How did you install Python?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42888>
_______________________________________

From report at bugs.python.org  Mon Jan 11 07:17:54 2021
From: report at bugs.python.org (Christian Heimes)
Date: Mon, 11 Jan 2021 12:17:54 +0000
Subject: [issue42874] running configure on Solaris 10 gives grep "illegal
 option" errors
In-Reply-To: <1610194453.5.0.66216438534.issue42874@roundup.psfhosted.org>
Message-ID: <1610367474.48.0.878920371573.issue42874@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

Paul, please take a look. You added the code in commit 62972d9d73e.

----------
nosy: +christian.heimes, p-ganssle

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42874>
_______________________________________

From report at bugs.python.org  Mon Jan 11 07:22:36 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 11 Jan 2021 12:22:36 +0000
Subject: [issue42327] Add PyModule_Add()
In-Reply-To: <1605126914.46.0.774673816158.issue42327@roundup.psfhosted.org>
Message-ID: <1610367756.87.0.271316513336.issue42327@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Note for myself: I added PyModule_AddObjectRef() to https://github.com/pythoncapi/pythoncapi_compat If it's renamed, pythoncapi_compat must also be updated.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42327>
_______________________________________

From report at bugs.python.org  Mon Jan 11 07:50:19 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 11 Jan 2021 12:50:19 +0000
Subject: [issue41771] bdist_wininst doesn't execute postinstall script
In-Reply-To: <1599884205.28.0.064503063783.issue41771@roundup.psfhosted.org>
Message-ID: <1610369419.98.0.871412996115.issue41771@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The distutils bdist_wininst command has been removed in Python 3.10: see bpo-42802.

----------
nosy: +vstinner
resolution:  -> wont fix
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41771>
_______________________________________

From report at bugs.python.org  Mon Jan 11 07:50:49 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 11 Jan 2021 12:50:49 +0000
Subject: [issue809846] bdist_wininst doesn't clean up read-only files in build
 dir
Message-ID: <1610369449.59.0.16243775609.issue809846@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The distutils bdist_wininst command has been removed in Python 3.10: see bpo-42802.

----------
nosy: +vstinner
resolution:  -> wont fix
stage: test needed -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue809846>
_______________________________________

From report at bugs.python.org  Mon Jan 11 07:50:37 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 11 Jan 2021 12:50:37 +0000
Subject: [issue10945] bdist_wininst depends on MBCS codec,
 unavailable on non-Windows
In-Reply-To: <1295450896.02.0.86964827296.issue10945@psf.upfronthosting.co.za>
Message-ID: <1610369437.7.0.521739410307.issue10945@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The distutils bdist_wininst command has been removed in Python 3.10: see bpo-42802.

----------
resolution:  -> wont fix
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue10945>
_______________________________________

From report at bugs.python.org  Mon Jan 11 07:50:57 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 11 Jan 2021 12:50:57 +0000
Subject: [issue13123] bdist_wininst uninstaller does not remove pycache
 directories
In-Reply-To: <1318000960.21.0.140069466315.issue13123@psf.upfronthosting.co.za>
Message-ID: <1610369457.75.0.451938890868.issue13123@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The distutils bdist_wininst command has been removed in Python 3.10: see bpo-42802.

----------
nosy: +vstinner
resolution:  -> wont fix
stage: needs patch -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue13123>
_______________________________________

From report at bugs.python.org  Mon Jan 11 07:51:05 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 11 Jan 2021 12:51:05 +0000
Subject: [issue11598] missing afxres.h error when building bdist_wininst in
 Visual Studio 2008 Express
In-Reply-To: <1300472926.52.0.331223446631.issue11598@psf.upfronthosting.co.za>
Message-ID: <1610369465.56.0.334972449754.issue11598@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The distutils bdist_wininst command has been removed in Python 3.10: see bpo-42802.

----------
nosy: +vstinner
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue11598>
_______________________________________

From report at bugs.python.org  Mon Jan 11 07:51:21 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 11 Jan 2021 12:51:21 +0000
Subject: [issue13276] bdist_wininst-created installer does not run the
 postinstallation script when uninstalling
In-Reply-To: <1319729455.78.0.312367178712.issue13276@psf.upfronthosting.co.za>
Message-ID: <1610369481.38.0.178812101563.issue13276@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The distutils bdist_wininst command has been removed in Python 3.10: see bpo-42802.

----------
nosy: +vstinner
resolution:  -> wont fix
stage: test needed -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue13276>
_______________________________________

From report at bugs.python.org  Mon Jan 11 07:51:13 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 11 Jan 2021 12:51:13 +0000
Subject: [issue7833] bdist_wininst installers fail to load extensions built
 with Issue4120 patch
In-Reply-To: <1265062373.01.0.461114831555.issue7833@psf.upfronthosting.co.za>
Message-ID: <1610369473.08.0.780341241128.issue7833@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The distutils bdist_wininst command has been removed in Python 3.10: see bpo-42802.

----------
nosy: +vstinner
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue7833>
_______________________________________

From report at bugs.python.org  Mon Jan 11 07:51:28 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 11 Jan 2021 12:51:28 +0000
Subject: [issue9456] Apparent memory leak in PC/bdist_wininst/install.c
In-Reply-To: <1280781943.93.0.297912103498.issue9456@psf.upfronthosting.co.za>
Message-ID: <1610369488.63.0.877681009008.issue9456@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The distutils bdist_wininst command has been removed in Python 3.10: see bpo-42802.

----------
nosy: +vstinner
resolution:  -> wont fix
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue9456>
_______________________________________

From report at bugs.python.org  Mon Jan 11 07:51:35 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 11 Jan 2021 12:51:35 +0000
Subject: [issue26554] PC\bdist_wininst\install.c: Missing call to fclose()
In-Reply-To: <1457949701.38.0.834751371072.issue26554@psf.upfronthosting.co.za>
Message-ID: <1610369495.2.0.999445945173.issue26554@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The distutils bdist_wininst command has been removed in Python 3.10: see bpo-42802.

----------
nosy: +vstinner
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26554>
_______________________________________

From report at bugs.python.org  Mon Jan 11 07:51:41 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 11 Jan 2021 12:51:41 +0000
Subject: [issue8171] bdist_wininst builds wrongly for --plat-name=win-amd64
In-Reply-To: <1268913911.34.0.452575740724.issue8171@psf.upfronthosting.co.za>
Message-ID: <1610369501.8.0.548960711825.issue8171@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The distutils bdist_wininst command has been removed in Python 3.10: see bpo-42802.

----------
nosy: +vstinner
resolution:  -> wont fix
stage: test needed -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue8171>
_______________________________________

From report at bugs.python.org  Mon Jan 11 07:51:47 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 11 Jan 2021 12:51:47 +0000
Subject: [issue4480] bdist_msi and bdist_wininst are missing an uninstaller
 icon
In-Reply-To: <1228122344.22.0.401809698411.issue4480@psf.upfronthosting.co.za>
Message-ID: <1610369507.32.0.7488547965.issue4480@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The distutils bdist_wininst command has been removed in Python 3.10: see bpo-42802.

----------
nosy: +vstinner
resolution:  -> wont fix
stage: needs patch -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4480>
_______________________________________

From report at bugs.python.org  Mon Jan 11 07:51:55 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 11 Jan 2021 12:51:55 +0000
Subject: [issue13038] bdist_wininst installers should warn if target dir is
 read-only
In-Reply-To: <1316816072.59.0.865990615621.issue13038@psf.upfronthosting.co.za>
Message-ID: <1610369515.29.0.837454059445.issue13038@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The distutils bdist_wininst command has been removed in Python 3.10: see bpo-42802.

----------
nosy: +vstinner
resolution:  -> wont fix
stage: needs patch -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue13038>
_______________________________________

From report at bugs.python.org  Mon Jan 11 07:52:03 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 11 Jan 2021 12:52:03 +0000
Subject: [issue4878] post installer script's message is not shown to user with
 bdist_wininst
In-Reply-To: <1231407894.66.0.157123159421.issue4878@psf.upfronthosting.co.za>
Message-ID: <1610369523.0.0.691910802994.issue4878@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The distutils bdist_wininst command has been removed in Python 3.10: see bpo-42802.

----------
nosy: +vstinner
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4878>
_______________________________________

From report at bugs.python.org  Mon Jan 11 07:52:11 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 11 Jan 2021 12:52:11 +0000
Subject: [issue4636] bdist_wininst installer with install script raises
 exception
In-Reply-To: <1229030167.98.0.0716327891895.issue4636@psf.upfronthosting.co.za>
Message-ID: <1610369531.56.0.558561176395.issue4636@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The distutils bdist_wininst command has been removed in Python 3.10: see bpo-42802.

----------
nosy: +vstinner
resolution:  -> wont fix
stage: test needed -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4636>
_______________________________________

From report at bugs.python.org  Mon Jan 11 07:52:17 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 11 Jan 2021 12:52:17 +0000
Subject: [issue17419] bdist_wininst installer should allow install in user
 directory
In-Reply-To: <1363280284.95.0.229024940465.issue17419@psf.upfronthosting.co.za>
Message-ID: <1610369537.77.0.639369642997.issue17419@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The distutils bdist_wininst command has been removed in Python 3.10: see bpo-42802.

----------
nosy: +vstinner
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17419>
_______________________________________

From report at bugs.python.org  Mon Jan 11 07:52:38 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 11 Jan 2021 12:52:38 +0000
Subject: [issue12200] bdist_wininst install_script not run on uninstall
In-Reply-To: <1306548527.55.0.138367912737.issue12200@psf.upfronthosting.co.za>
Message-ID: <1610369558.64.0.948204079477.issue12200@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The distutils bdist_wininst command has been removed in Python 3.10: see bpo-42802.

----------
nosy: +vstinner
resolution:  -> wont fix
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue12200>
_______________________________________

From report at bugs.python.org  Mon Jan 11 07:52:43 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 11 Jan 2021 12:52:43 +0000
Subject: [issue1109963] bdist_wininst ignores build_lib from build command
Message-ID: <1610369563.82.0.394655782461.issue1109963@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The distutils bdist_wininst command has been removed in Python 3.10: see bpo-42802.

----------
nosy: +vstinner
resolution:  -> wont fix
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1109963>
_______________________________________

From report at bugs.python.org  Mon Jan 11 07:52:25 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 11 Jan 2021 12:52:25 +0000
Subject: [issue15321] bdist_wininst installers may terminate with "close
 failed in file object destructor:\nsys.excepthook is missing\nlost
 sys.stderr"
In-Reply-To: <1341965309.27.0.878027505194.issue15321@psf.upfronthosting.co.za>
Message-ID: <1610369545.74.0.592366882903.issue15321@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The distutils bdist_wininst command has been removed in Python 3.10: see bpo-42802.

----------
nosy: +vstinner
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue15321>
_______________________________________

From report at bugs.python.org  Mon Jan 11 07:52:32 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 11 Jan 2021 12:52:32 +0000
Subject: [issue14877] No option to run bdist_wininst against newer msvc
 versions on non-windows systems
In-Reply-To: <1337650583.73.0.740719723595.issue14877@psf.upfronthosting.co.za>
Message-ID: <1610369552.07.0.0388692905965.issue14877@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The distutils bdist_wininst command has been removed in Python 3.10: see bpo-42802.

----------
nosy: +vstinner
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue14877>
_______________________________________

From report at bugs.python.org  Mon Jan 11 07:53:38 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 11 Jan 2021 12:53:38 +0000
Subject: [issue42802] distutils: Remove bdist_wininst command
In-Reply-To: <1609511307.58.0.913169413627.issue42802@roundup.psfhosted.org>
Message-ID: <1610369618.87.0.207974033686.issue42802@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I closed the 19 open issues which contained "wininst" in their title as "wont fix" with the message:

"The distutils bdist_wininst command has been removed in Python 3.10: see bpo-42802."

You can simply search for closed issue which contains "wininst" in their title if you want to list them.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42802>
_______________________________________

From report at bugs.python.org  Mon Jan 11 08:22:48 2021
From: report at bugs.python.org (Xinmeng Xia)
Date: Mon, 11 Jan 2021 13:22:48 +0000
Subject: =?utf-8?q?=5Bissue42888=5D_Not_installed_=E2=80=9Clibgcc=5Fs=2Eso=2E1?=
 =?utf-8?q?=E2=80=9D_causes_parser_crash=2E?=
In-Reply-To: <1610350822.34.0.431759793604.issue42888@roundup.psfhosted.org>
Message-ID: <1610371368.77.0.285488949212.issue42888@roundup.psfhosted.org>


Xinmeng Xia <xiaxm at smail.nju.edu.cn> added the comment:

>>uname -a
Linux xxm-System-Product-Name 4.15.0-64-generic #73~16.04.1-Ubuntu SMP Fri Sep 13 09:56:18 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

>>uname -r
4.15.0-64-generic


>>lsb_release -a
No LSB modules are available.
Distributor ID:	Ubuntu
Description:	Ubuntu 16.04.3 LTS
Release:	16.04
Codename:	xenial

I download Python from https://www.python.org/downloads/. Then I extract it,run install command ./configure,make,sudo make install. I also try the versions of Python 3.5-3.10 and even cPython on GitHub. The results are the same. But when I try this program on Python 2, the program will not cause core dump. I think Python 2 is initially installed with the system, not by me. So I guess no link is referred to libgcc_s.so.1 when I install new version of Python.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42888>
_______________________________________

From report at bugs.python.org  Mon Jan 11 08:47:35 2021
From: report at bugs.python.org (Christian Heimes)
Date: Mon, 11 Jan 2021 13:47:35 +0000
Subject: =?utf-8?q?=5Bissue42888=5D_Not_installed_=E2=80=9Clibgcc=5Fs=2Eso=2E1?=
 =?utf-8?q?=E2=80=9D_causes_parser_crash=2E?=
In-Reply-To: <1610350822.34.0.431759793604.issue42888@roundup.psfhosted.org>
Message-ID: <1610372855.95.0.431764617363.issue42888@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

It might be a packaging or documentation issue. I'm assiging the ticket to Matthias. He is the Debian and Ubuntu package maintainer.

----------
assignee:  -> doko
nosy: +doko

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42888>
_______________________________________

From report at bugs.python.org  Mon Jan 11 09:02:38 2021
From: report at bugs.python.org (Mark Dickinson)
Date: Mon, 11 Jan 2021 14:02:38 +0000
Subject: [issue7833] bdist_wininst installers fail to load extensions built
 with Issue4120 patch
In-Reply-To: <1265062373.01.0.461114831555.issue7833@psf.upfronthosting.co.za>
Message-ID: <1610373758.46.0.000213687844675.issue7833@roundup.psfhosted.org>


Change by Mark Dickinson <dickinsm at gmail.com>:


----------
nosy:  -mark.dickinson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue7833>
_______________________________________

From report at bugs.python.org  Mon Jan 11 09:32:03 2021
From: report at bugs.python.org (=?utf-8?b?VG9tw6HFoSBIcm7EjWlhcg==?=)
Date: Mon, 11 Jan 2021 14:32:03 +0000
Subject: [issue42870] Document changed argparse output wrt optional arguments
 in What's new in Python 3.10
In-Reply-To: <1610149853.78.0.949568295376.issue42870@roundup.psfhosted.org>
Message-ID: <1610375523.2.0.0997976061457.issue42870@roundup.psfhosted.org>


Change by Tom?? Hrn?iar <tomas.hrnciar at me.com>:


----------
keywords: +patch
nosy: +hrnciar
nosy_count: 5.0 -> 6.0
pull_requests: +23017
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24190

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42870>
_______________________________________

From report at bugs.python.org  Mon Jan 11 09:46:31 2021
From: report at bugs.python.org (Xavier Hausherr)
Date: Mon, 11 Jan 2021 14:46:31 +0000
Subject: [issue33972] AttributeError in email.message.iter_attachments()
In-Reply-To: <1530024211.47.0.56676864532.issue33972@psf.upfronthosting.co.za>
Message-ID: <1610376391.78.0.866813583746.issue33972@roundup.psfhosted.org>


Xavier Hausherr <xavier at shipfix.com> added the comment:

The problem still occurs with the _find_body 
 method. The "part.is_attachment()" method can trigger an AttributeError too "AttributeError: 'str' object has no attribute 'is_attachment'"

https://github.com/python/cpython/blob/3.9/Lib/email/message.py#L978

----------
nosy: +xavier2
versions: +Python 3.9 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33972>
_______________________________________

From report at bugs.python.org  Mon Jan 11 09:48:27 2021
From: report at bugs.python.org (Amirouche Boubekki)
Date: Mon, 11 Jan 2021 14:48:27 +0000
Subject: [issue42891] segfault with gunicorn and a library made with cython
 bindings
Message-ID: <1610376507.28.0.240401298439.issue42891@roundup.psfhosted.org>


New submission from Amirouche Boubekki <amirouche.boubekki at gmail.com>:

Here is a simple way to reproduce:


from lsm import LSM


db = LSM('db.sqlite')

def app(environ, start_response):
    """Simplest possible application object"""

    for (index, (key, value)) in enumerate(db[b'\x00':b'\xFF']):
        pass

    start_response(b'200', {})
    return b''

db.close()


In my real program, if I add 'global db' in the function `app`, it does not segfault.


program: https://git.sr.ht/~amirouche/segfault
trace: https://wyz.fr/0I-MO

----------
messages: 384836
nosy: amirouche
priority: normal
severity: normal
status: open
title: segfault with gunicorn and a library made with cython bindings
type: crash
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42891>
_______________________________________

From report at bugs.python.org  Mon Jan 11 09:51:45 2021
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 11 Jan 2021 14:51:45 +0000
Subject: [issue33972] AttributeError in email.message.iter_attachments()
In-Reply-To: <1530024211.47.0.56676864532.issue33972@psf.upfronthosting.co.za>
Message-ID: <1610376705.86.0.658409340622.issue33972@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Xavier, I think it would be best if you could open a new issue for that, and also include code to reproduce the problem.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33972>
_______________________________________

From report at bugs.python.org  Mon Jan 11 09:55:47 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 11 Jan 2021 14:55:47 +0000
Subject: [issue42891] segfault with gunicorn and a library made with cython
 bindings
In-Reply-To: <1610376507.28.0.240401298439.issue42891@roundup.psfhosted.org>
Message-ID: <1610376947.12.0.438032511008.issue42891@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I put the code in a "bla.p" script and I ran it with Python 3.8 on Fedora 33:

python3.8 -m venv env
env/bin/python -m pip install lsm-db
env/bin/python bla.py 

It doesn't crash. Please provide a script reproducing the issue.

Note: lsm-db cannot be installed in Python 3.9 (errors about the removed PyTypeObject.tp_print member in C).

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42891>
_______________________________________

From report at bugs.python.org  Mon Jan 11 10:01:04 2021
From: report at bugs.python.org (Amirouche Boubekki)
Date: Mon, 11 Jan 2021 15:01:04 +0000
Subject: [issue42891] segfault with gunicorn and a library made with cython
 bindings
In-Reply-To: <1610376507.28.0.240401298439.issue42891@roundup.psfhosted.org>
Message-ID: <1610377264.56.0.730653513784.issue42891@roundup.psfhosted.org>


Amirouche Boubekki <amirouche.boubekki at gmail.com> added the comment:

You need to run the program with the following:

  python -X dev -c "from gunicorn.app.wsgiapp import run; run()" --workers=1 foobar:app

where foobar.py is the code from the previous message.

The crash happen when, the function `app` is executed, hence you need to call in another console:

curl http://localhost:8000

note: lsm package can be installed with pip install lsm-db
note2: lsm db can not be installed with py3.9

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42891>
_______________________________________

From report at bugs.python.org  Mon Jan 11 10:16:34 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 11 Jan 2021 15:16:34 +0000
Subject: [issue42891] segfault with gunicorn and a library made with cython
 bindings
In-Reply-To: <1610376507.28.0.240401298439.issue42891@roundup.psfhosted.org>
Message-ID: <1610378194.73.0.745880963671.issue42891@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I get a crash without any code, just by running gunicorn. It looks like a bug in gunicorn.

---
$ python3.8 -m venv env
$ env/bin/python -m pip install gunicorn
(..)
Successfully installed gunicorn-20.0.4

$ ./env/bin/python -X dev -c 'from gunicorn.app.wsgiapp import run; run()' foobar:app 
...)

[2021-01-11 16:14:11 +0100] [32107] [ERROR] Exception in worker process
Traceback (most recent call last):
  (...)
  File "/home/vstinner/z/env/lib64/python3.8/site-packages/gunicorn/app/wsgiapp.py", line 39, in load_wsgiapp
    return util.import_app(self.app_uri)
  File "/home/vstinner/z/env/lib64/python3.8/site-packages/gunicorn/util.py", line 358, in import_app
    mod = importlib.import_module(module)
  (...)
ModuleNotFoundError: No module named 'foobar'

[2021-01-11 16:14:11 +0100] [32107] [INFO] Worker exiting (pid: 32107)
sys:1: ResourceWarning: unclosed <socket.socket fd=5, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('127.0.0.1', 8000)>
ResourceWarning: Enable tracemalloc to get the object allocation traceback
Debug memory block at address p=0x55cfa92154a0: API '1'
    3271705103877500672 bytes originally requested
    The 7 pad bytes at p-7 are not all FORBIDDENBYTE (0xfd):
        at p-7: 0x00 *** OUCH
        at p-6: 0x00 *** OUCH
        at p-5: 0x00 *** OUCH
        at p-4: 0x00 *** OUCH
        at p-3: 0x00 *** OUCH
        at p-2: 0x00 *** OUCH
        at p-1: 0x00 *** OUCH
    Because memory is corrupted at the start, the count of bytes requested
       may be bogus, and checking the trailing pad bytes may segfault.
    The 8 pad bytes at tail=0x2d67c444d794c3a0 are [2021-01-11 16:14:11 +0100] [32113] [INFO] Booting worker with pid: 32113

(...)
---

You should report the issue to gunicorn: https://github.com/benoitc/gunicorn/issues

----------
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42891>
_______________________________________

From report at bugs.python.org  Mon Jan 11 10:18:15 2021
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 11 Jan 2021 15:18:15 +0000
Subject: [issue42848] asyncio produces an unexpected traceback with recursive
 __getattribute__
In-Reply-To: <1609985412.09.0.749639106788.issue42848@roundup.psfhosted.org>
Message-ID: <1610378295.55.0.974210860901.issue42848@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

I've simplified the format() code in the PR, based on the observation that only one chained exception is ever emitted. I think it's reasonably simple now.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42848>
_______________________________________

From report at bugs.python.org  Mon Jan 11 10:24:15 2021
From: report at bugs.python.org (Peixing Xin)
Date: Mon, 11 Jan 2021 15:24:15 +0000
Subject: [issue31904] Python should support VxWorks RTOS
In-Reply-To: <1509393393.78.0.213398074469.issue31904@psf.upfronthosting.co.za>
Message-ID: <1610378655.0.0.146369812153.issue31904@roundup.psfhosted.org>


Change by Peixing Xin <peixing.xin at windriver.com>:


----------
pull_requests: +23018
pull_request: https://github.com/python/cpython/pull/24191

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31904>
_______________________________________

From report at bugs.python.org  Mon Jan 11 10:39:41 2021
From: report at bugs.python.org (Amirouche Boubekki)
Date: Mon, 11 Jan 2021 15:39:41 +0000
Subject: [issue42891] segfault with gunicorn and a library made with cython
 bindings
In-Reply-To: <1610376507.28.0.240401298439.issue42891@roundup.psfhosted.org>
Message-ID: <1610379581.75.0.85530213621.issue42891@roundup.psfhosted.org>


Amirouche Boubekki <amirouche.boubekki at gmail.com> added the comment:

> ModuleNotFoundError: No module named 'foobar'

That is not a segfault. The problem I am reporting is a segfault.

It can be reproduced with uvicorn as follow:

from lsm import LSM


db = LSM('db.sqlite')


async def app(scope, receive, send):
    assert scope['type'] == 'http'
    global db
    for (index, (key, value)) in enumerate(db[b'\x00':b'\xFF']):
        pass

    await send({
        'type': 'http.response.start',
        'status': 200,
        'headers': [
            [b'content-type', b'text/plain'],
        ],
    })
    await send({
        'type': 'http.response.body',
        'body': b'Hello, world!',
    })

db.close()


Run the above program with: python -X dev -m uvicorn bobo:app

Then in another console: curl http://localhost:8000/

Here is the output:

$ python -X dev -m uvicorn bobo:app
INFO:     Started server process [3580316]
INFO:     Waiting for application startup.
INFO:     ASGI 'lifespan' protocol appears unsupported.
INFO:     Application startup complete.
INFO:     Uvicorn running on http://127.0.0.1:8000 (Press CTRL+C to quit)
Fatal Python error: Segmentation fault

Current thread 0x00007fbb6e49b740 (most recent call first):
  File "./bobo.py", line 10 in app
  File "/home/amirouche/.cache/pypoetry/virtualenvs/lsmdb-cTe2806J-py3.8/lib/python3.8/site-packages/uvicorn/middleware/proxy_headers.py", line 45 in __call__
  File "/home/amirouche/.cache/pypoetry/virtualenvs/lsmdb-cTe2806J-py3.8/lib/python3.8/site-packages/uvicorn/protocols/http/h11_impl.py", line 394 in run_asgi
  File "/usr/lib/python3.8/asyncio/events.py", line 81 in _run
  File "/usr/lib/python3.8/asyncio/base_events.py", line 1851 in _run_once
  File "/usr/lib/python3.8/asyncio/base_events.py", line 570 in run_forever
  File "/usr/lib/python3.8/asyncio/base_events.py", line 603 in run_until_complete
  File "/home/amirouche/.cache/pypoetry/virtualenvs/lsmdb-cTe2806J-py3.8/lib/python3.8/site-packages/uvicorn/server.py", line 48 in run
  File "/home/amirouche/.cache/pypoetry/virtualenvs/lsmdb-cTe2806J-py3.8/lib/python3.8/site-packages/uvicorn/main.py", line 386 in run
  File "/home/amirouche/.cache/pypoetry/virtualenvs/lsmdb-cTe2806J-py3.8/lib/python3.8/site-packages/uvicorn/main.py", line 362 in main
  File "/home/amirouche/.cache/pypoetry/virtualenvs/lsmdb-cTe2806J-py3.8/lib/python3.8/site-packages/click/core.py", line 610 in invoke
  File "/home/amirouche/.cache/pypoetry/virtualenvs/lsmdb-cTe2806J-py3.8/lib/python3.8/site-packages/click/core.py", line 1066 in invoke
  File "/home/amirouche/.cache/pypoetry/virtualenvs/lsmdb-cTe2806J-py3.8/lib/python3.8/site-packages/click/core.py", line 782 in main
  File "/home/amirouche/.cache/pypoetry/virtualenvs/lsmdb-cTe2806J-py3.8/lib/python3.8/site-packages/click/core.py", line 829 in __call__
  File "/home/amirouche/.cache/pypoetry/virtualenvs/lsmdb-cTe2806J-py3.8/lib/python3.8/site-packages/uvicorn/__main__.py", line 4 in <module>
  File "/usr/lib/python3.8/runpy.py", line 87 in _run_code
  File "/usr/lib/python3.8/runpy.py", line 194 in _run_module_as_main
Segmentation fault (core dumped)

----------
resolution: third party -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42891>
_______________________________________

From report at bugs.python.org  Mon Jan 11 11:10:47 2021
From: report at bugs.python.org (Ned Deily)
Date: Mon, 11 Jan 2021 16:10:47 +0000
Subject: [issue42880] ctypes: variadic function call still doesn't work on
 Apple Silicon
In-Reply-To: <1610264518.97.0.0227668442163.issue42880@roundup.psfhosted.org>
Message-ID: <1610381447.62.0.178180174006.issue42880@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

> Seems that we are getting the same libffi.dylib.

I suppose it is still possible that another libffi is being found first. To be absolutely sure, you could ask dyld to print the loaded libraries:

$ DYLD_PRINT_LIBRARIES=1 python3.9 test_main.py
[...]
dyld: loaded: <003A027D-9CE3-3794-A319-88495844662D> /usr/lib/system/libxpc.dylib
dyld: loaded: <7FBC5290-B2B3-3312-B69A-77378C539520> /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/lib-dynload/_ctypes.cpython-39-darwin.so
dyld: loaded: <943473A5-A82B-3E21-8EB3-0BBDF5E605AA> /usr/lib/libffi.dylib
dyld: loaded: <58910956-4F2F-363A-80E5-D5E1C71DD83E> /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/lib-dynload/_struct.cpython-39-darwin.so
dyld: loaded: <3444F392-DB43-3AEF-8596-2BFFBBD8EC0C> ./main.dylib
34

But, more importantly, the uname -a output for my M1 is:

Darwin ankl.local 20.2.0 Darwin Kernel Version 20.2.0: Wed Dec  2 20:40:21 PST 2020; root:xnu-7195.60.75~1/RELEASE_ARM64_T8101 x86_64

Perhaps you have not updated to macOS 11.1 yet?
 
By the way, in your original message's last example, is the output really "3"?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42880>
_______________________________________

From report at bugs.python.org  Mon Jan 11 11:22:17 2021
From: report at bugs.python.org (Amirouche Boubekki)
Date: Mon, 11 Jan 2021 16:22:17 +0000
Subject: [issue42891] segfault with gunicorn and a library made with cython
 bindings
In-Reply-To: <1610376507.28.0.240401298439.issue42891@roundup.psfhosted.org>
Message-ID: <1610382137.19.0.868080809927.issue42891@roundup.psfhosted.org>


Amirouche Boubekki <amirouche.boubekki at gmail.com> added the comment:

I tried to reduce the program by replacing gunicorn / uvicorn dependency with threading.Thread and multiprocess.Pool without success.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42891>
_______________________________________

From report at bugs.python.org  Mon Jan 11 11:37:33 2021
From: report at bugs.python.org (seb)
Date: Mon, 11 Jan 2021 16:37:33 +0000
Subject: [issue41116] build on macOS 11 (beta) does not find system-supplied
 third-party libraries
In-Reply-To: <1593100264.48.0.613850075185.issue41116@roundup.psfhosted.org>
Message-ID: <1610383053.89.0.838780897146.issue41116@roundup.psfhosted.org>


seb <s_rath at maxon.net> added the comment:

Thanks for the help! I tried the instructions, without success. I installed xz through homebrew (which needs to be installed on Silicon under /opt/homebrew). I can confirm the existance of: /opt/homebrew/Cellar/xz/5.2.5/include/lzma.h

I used CPPFLAGS and also modified the system_include_dirs variable in the setup.py file, in both cases lzma.h seems to be ignored.

> system_include_dirs = ['opt/homebrew/include', '/opt/homebrew/Cellar/xz/5.2.5/include']

Am I missing something obvious here? Thanks!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41116>
_______________________________________

From report at bugs.python.org  Mon Jan 11 11:45:57 2021
From: report at bugs.python.org (Xavier Hausherr)
Date: Mon, 11 Jan 2021 16:45:57 +0000
Subject: [issue42892] AttributeError in email.message.get_body()
Message-ID: <1610383557.89.0.290771399006.issue42892@roundup.psfhosted.org>


New submission from Xavier Hausherr <xavier at shipfix.com>:

Following this issue: https://bugs.python.org/issue33972

Same bug apply to email.message.get_body() with attached email example and the following code: 

        from email.policy import default
        import email

        with open('email_bad_formatted.eml', 'rb') as fp:
            msg = email.message_from_binary_file(fp, policy=default)
        body = msg.get_body()

> Result:
E       AttributeError: 'str' object has no attribute 'is_attachment'

/usr/local/lib/python3.9/email/message.py:978: AttributeError

----------
components: email
files: email_bad_formatted.eml
messages: 384847
nosy: barry, iritkatriel, r.david.murray, xavier2
priority: normal
severity: normal
status: open
title: AttributeError in email.message.get_body()
versions: Python 3.9
Added file: https://bugs.python.org/file49734/email_bad_formatted.eml

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42892>
_______________________________________

From report at bugs.python.org  Mon Jan 11 11:49:48 2021
From: report at bugs.python.org (Roundup Robot)
Date: Mon, 11 Jan 2021 16:49:48 +0000
Subject: [issue42892] AttributeError in email.message.get_body()
In-Reply-To: <1610383557.89.0.290771399006.issue42892@roundup.psfhosted.org>
Message-ID: <1610383788.21.0.346268300468.issue42892@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
keywords: +patch
nosy: +python-dev
nosy_count: 4.0 -> 5.0
pull_requests: +23019
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24192

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42892>
_______________________________________

From report at bugs.python.org  Mon Jan 11 11:52:14 2021
From: report at bugs.python.org (Xavier Hausherr)
Date: Mon, 11 Jan 2021 16:52:14 +0000
Subject: [issue42892] AttributeError in email.message.get_body()
In-Reply-To: <1610383557.89.0.290771399006.issue42892@roundup.psfhosted.org>
Message-ID: <1610383934.5.0.313561807244.issue42892@roundup.psfhosted.org>


Xavier Hausherr <xavier at shipfix.com> added the comment:

Attached PR fix the issue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42892>
_______________________________________

From report at bugs.python.org  Mon Jan 11 12:00:10 2021
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 11 Jan 2021 17:00:10 +0000
Subject: [issue41433] Logging libraries BufferingHandler flushed twice at
 shutdown
In-Reply-To: <1596002244.65.0.208232248615.issue41433@roundup.psfhosted.org>
Message-ID: <1610384410.23.0.915882975404.issue41433@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

I'm assuming the link solved your issue. If you are still having a problem please create a new issue, and include a code snippet to show what you are doing exactly.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41433>
_______________________________________

From report at bugs.python.org  Mon Jan 11 12:03:50 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 11 Jan 2021 17:03:50 +0000
Subject: [issue42882] Restarting the interpreter causes UB on 3.10.0a4
In-Reply-To: <1610283618.64.0.475556781159.issue42882@roundup.psfhosted.org>
Message-ID: <1610384630.58.0.382578410847.issue42882@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
keywords: +patch
pull_requests: +23020
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24193

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42882>
_______________________________________

From report at bugs.python.org  Mon Jan 11 12:05:18 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 11 Jan 2021 17:05:18 +0000
Subject: [issue42882] Restarting the interpreter causes UB on 3.10.0a4
In-Reply-To: <1610283618.64.0.475556781159.issue42882@roundup.psfhosted.org>
Message-ID: <1610384718.55.0.629763678103.issue42882@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Oh. In _PyUnicode_FromId(), I made the assumption that _PyRuntime is left unchanged when Py_Initialize()Py_Finalize() is called multiple times. But I was wrong, it is always reset to zero. So I wrote PR 24193 to explicitly save/restore _PyRuntime.unicode_ids.next_index value.

Using PR 24193, msg384761 example displays "Works" instead of failing with a Python fatal error.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42882>
_______________________________________

From report at bugs.python.org  Mon Jan 11 12:12:45 2021
From: report at bugs.python.org (robpats)
Date: Mon, 11 Jan 2021 17:12:45 +0000
Subject: [issue42893] Strange XPath search behavior of
 xml.etree.ElementTree.Element.find
Message-ID: <1610385165.69.0.550442509332.issue42893@roundup.psfhosted.org>


New submission from robpats <robotpats at gmail.com>:

Python 3.6.8 / 3.7.9 / 3.8.7

>>> import xml.etree.ElementTree
>>> e = xml.etree.ElementTree.fromstring('<html><div class="row"/><hr/><div/><hr/><div class="row"/><button/></html>')
>>> list(e)
[<Element 'div' at 0x00000000024CD220>, <Element 'hr' at 0x00000000024CD2C0>, <Element 'div' at 0x00000000024F90E0>, <Element 'hr' at 0x00000000024F9130>, <Element 'div' at 0x00000000024F9180>, <Element 'button' at 0x00000000024F91D0>]
>>> e.find("./div[1]")
<Element 'div' at 0x00000000024CD220>
>>> e.find("./div[2]")
<Element 'div' at 0x00000000024F90E0>
>>> e.find("./div[3]")
<Element 'div' at 0x00000000024F9180>
>>> e.find("./hr[1]")
<Element 'hr' at 0x00000000024CD2C0>
>>> e.find("./hr[2]")
<Element 'hr' at 0x00000000024F9130>



# The following different from XPath implementation in Firefox
# https://developer.mozilla.org/en-US/docs/Web/XPath/Snippets

>>> list(e.iterfind("./*"))
[<Element 'div' at 0x00000000024CD220>, <Element 'hr' at 0x00000000024CD2C0>, <Element 'div' at 0x00000000024F90E0>, <Element 'hr' at 0x00000000024F9130>, <Element 'div' at 0x00000000024F9180>, <Element 'button' at 0x00000000024F91D0>]
>>> e.find("./*[1]")
<Element 'div' at 0x00000000024CD220>
>>> e.find("./*[2]")
<Element 'div' at 0x00000000024F90E0>   <-- should be 'hr', same as e.find("./div[2]") instead of e[2]
>>> e.find("./*[3]")
<Element 'div' at 0x00000000024F9180>   <-- same as e.find("./div[3]") instead of e[3]
>>> e.find("./*[4]")


>>> list(e.iterfind("./*[@class='row']"))
[<Element 'div' at 0x00000000024CD220>, <Element 'div' at 0x00000000024F9180>]
>>> e.find("./*[@class='row'][1]")
<Element 'div' at 0x00000000024CD220>
>>> e.find("./*[@class='row'][2]")
>>> e.find("./*[@class='row'][3]")
<Element 'div' at 0x00000000024F9180>   <--- cannot find element at [2] but found at [3]

----------
components: Library (Lib)
messages: 384851
nosy: robpats
priority: normal
severity: normal
status: open
title: Strange XPath search behavior of xml.etree.ElementTree.Element.find
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42893>
_______________________________________

From report at bugs.python.org  Mon Jan 11 12:59:10 2021
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 11 Jan 2021 17:59:10 +0000
Subject: [issue42848] asyncio produces an unexpected traceback with recursive
 __getattribute__
In-Reply-To: <1609985412.09.0.749639106788.issue42848@roundup.psfhosted.org>
Message-ID: <1610387950.53.0.0746257291185.issue42848@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
nosy: +rbcollins

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42848>
_______________________________________

From report at bugs.python.org  Mon Jan 11 13:07:31 2021
From: report at bugs.python.org (Amirouche Boubekki)
Date: Mon, 11 Jan 2021 18:07:31 +0000
Subject: [issue42891] segfault with gunicorn and a library made with cython
 bindings
In-Reply-To: <1610376507.28.0.240401298439.issue42891@roundup.psfhosted.org>
Message-ID: <1610388451.68.0.658896896935.issue42891@roundup.psfhosted.org>


Amirouche Boubekki <amirouche.boubekki at gmail.com> added the comment:

The problem is prolly in lsm-db.

ref: https://github.com/coleifer/python-lsm-db/issues/20

Sorry for the noise.

----------
resolution:  -> third party
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42891>
_______________________________________

From report at bugs.python.org  Mon Jan 11 13:34:18 2021
From: report at bugs.python.org (Jeff Moguillansky)
Date: Mon, 11 Jan 2021 18:34:18 +0000
Subject: [issue42894] Debugging native Python modules on Windows with Visual
 Studio Toolchain
Message-ID: <1610390058.13.0.89065377446.issue42894@roundup.psfhosted.org>


New submission from Jeff Moguillansky <jmoguill2 at gmail.com>:

I have a question regarding debugging native Python modules on Windows, with Visual Studio toolchain:

Currently I have a native module (native C code), along with Python API bindings (via Cython), and finally Python code that invokes the native module.  I also use various third-party python modules like Pillow, etc.  

In order to debug on Windows, I have to use the following tricks:
1) Build the native module in Release Mode
2) Disable Compiler Optimization
3) Enable Debug symbols

I can't just use Python distutils out of the box, I have to manually modify the build commands to enable Debugging.

If I just try to build the native module in Debug mode, I get Visual Studio compile errors related to: not being able to mix code built with different C++ runtime libraries.  
Some of the 3rd-party Python modules are only available as Release builds (not Debug builds).

I'm wondering if anyone has encountered a similar issue, and what's your advice?  

On Linux, GNU toolchain, this isn't an issue.  The toolchain lets you mix release and debug libraries, no problem.

----------
components: C API
messages: 384853
nosy: jmoguill2
priority: normal
severity: normal
status: open
title: Debugging native Python modules on Windows with Visual Studio Toolchain
type: compile error
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42894>
_______________________________________

From report at bugs.python.org  Mon Jan 11 13:38:58 2021
From: report at bugs.python.org (JD-Veiga)
Date: Mon, 11 Jan 2021 18:38:58 +0000
Subject: [issue42895] Return multi-line list concatenation without parentheses
 returns only first operand
Message-ID: <1610390338.44.0.382360444411.issue42895@roundup.psfhosted.org>


New submission from JD-Veiga <jdveiga at gmail.com>:

I was trying to return the concatenation of several lists from a function but, inadvertently, forgot to surround the multi-line concatenation expression with parentheses. 

As a result, the function returns just the first operand and does not perform the concatenation at all. 


Basically, I am doing something like this:

```
def non_parens():
    return [
        1, 2, 3
    ]
    + [
        4, 5
    ]

print(non_parens())

```

which outputs: `[1, 2, 3]`


On the contrary, parenthesised version such as:

```
def with_parens():
    return (
        [
            1, 2, 3
        ]
        + [
            4, 5
        ]
    )

print(with_parens())

```

will output the "expected" result: `[1, 2, 3, 4, 5]`.


Even not breaking the line before the '+' operator:

```
def no_parens_without_newline_before_operator():
    return [
        1, 2, 3
    ] + [
        4, 5
    ]

print(no_parens_without_newline_before_operator())

```

prints `[1, 2, 3, 4, 5]`.



My hypothesis is that first function `non_parens()` does not work because the expression has some kind of error after

```
    return [
        1, 2, 3
    ]
```

and 

```
    + [
        4, 5
    ]
```

is never executed.


However, why does not the parser or the interpreter raise any error or warning about this malformed expression?


"Similar" expressions cause an error:

```
assert [
        1, 2, 3
    ]
    + [
        4, 5
    ]
```

raises: `IndentationError: unexpected indent`

and

```
[
    1, 2, 3
]
+ [
    4, 5
]
```

raises: `TypeError: bad operand type for unary +: 'list'`


What perplexes me the most about breaking lines in this case is that `] + [` works and `]<newline>+ [` does not (against PEP8 --of course, PEP8 is not the parser).


I am sure that I am missing something about expressions, line breaks, or lexical parsing.


I am using Python 3.8.7 and Python 3.9.1



Thank you a lot.

----------
components: Interpreter Core
messages: 384854
nosy: JD-Veiga
priority: normal
severity: normal
status: open
title: Return multi-line list concatenation without parentheses returns only first operand
type: behavior
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42895>
_______________________________________

From report at bugs.python.org  Mon Jan 11 13:42:40 2021
From: report at bugs.python.org (Yannick Jadoul)
Date: Mon, 11 Jan 2021 18:42:40 +0000
Subject: [issue42882] Restarting the interpreter causes UB on 3.10.0a4
In-Reply-To: <1610283618.64.0.475556781159.issue42882@roundup.psfhosted.org>
Message-ID: <1610390560.14.0.72414804704.issue42882@roundup.psfhosted.org>


Yannick Jadoul <yannick.jadoul at gmail.com> added the comment:

Wow, that was fast! Thanks!

I tried this out locally, and all pybind11's tests pass now. We can try again once there's a nightly build or new alpha :-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42882>
_______________________________________

From report at bugs.python.org  Mon Jan 11 13:55:17 2021
From: report at bugs.python.org (David Murphy)
Date: Mon, 11 Jan 2021 18:55:17 +0000
Subject: [issue42896] Solaris 11.4 crle output not handled correctly
Message-ID: <1610391317.65.0.0245738213738.issue42896@roundup.psfhosted.org>


New submission from David Murphy <damurphy at vmware.com>:

>From porting Python 3.7.8 to Solaris 11.4 (base open version) found that the handling of crle output has changed between Solaris 11.3 and 11.4 and accommodation has not been made for the change.

For example:
Solaris 11.3
root at sol11:~/sol_build/proto_salt# uname -a
SunOS sol11 5.11 11.3 i86pc i386 i86pc
root at sol11:~/sol_build/proto_salt# crle

Default configuration file (/var/ld/ld.config) not found
  Platform:	32-bit LSB 80386
  Default Library Path (ELF):	/lib:/usr/lib  (system default)
  Trusted Directories (ELF):	/lib/secure:/usr/lib/secure  (system default)
root at sol11:~/sol_build/proto_salt# crle -64

Default configuration file (/var/ld/64/ld.config) not found
  Platform:	64-bit LSB AMD64
  Default Library Path (ELF):	/lib/64:/usr/lib/64  (system default)
  Trusted Directories (ELF):	/lib/secure/64:/usr/lib/secure/64  (system default)
root at sol11:~/sol_build/proto_salt#


Solaris 11.4
root at sol114:/export/home/david/dev/dist/run# uname -a
SunOS sol114 5.11 11.4.0.15.0 i86pc i386 i86pc Solaris
root at sol114:/export/home/david/dev/dist/run# crle

Configuration file [version 5]: /var/ld/ld.config
    Platform:	32-bit LSB 80386
    Default Library Path:	/usr/local/openssl/lib:/usr/local/lib:/lib:/usr/lib
    Trusted Directories:	/lib/secure:/usr/lib/secure  (system default)

Command line:
    crle -c /var/ld/ld.config -l /usr/local/openssl/lib:/usr/local/lib:/lib:/usr/lib

root at sol114:/export/home/david/dev/dist/run# crle -64

Configuration file [version 5]: /var/ld/64/ld.config
    Platform:	64-bit LSB AMD64
    Default Library Path:	/usr/local/openssl/lib:/usr/local/lib:/lib/64:/usr/lib/64
    Trusted Directories:	/lib/secure/64:/usr/lib/secure/64  (system default)

Command line:
    crle -64 -c /var/ld/64/ld.config -l /usr/local/openssl/lib:/usr/local/lib:/lib/64:/usr/lib/64

root at sol114:/export/home/david/dev/dist/run#

Note: the missing '(ELF)' from the 'Default Library Path'


Simple fix is the following patch:
david at sol114:~/dev$ cat solaris11_crle.patch
--- util.py         2021-01-08 17:01:58.417014094 +0000
+++ util.py.new 2021-01-08 17:03:21.843483945 +0000
@@ -238,6 +238,10 @@
                     line = line.strip()
                     if line.startswith(b'Default Library Path (ELF):'):
                         paths = os.fsdecode(line).split()[4]
+                    elif line.startswith(b'Default Library Path:'):
+                        ## allow for Solaris 11.4 output
+                        paths = os.fsdecode(line).split()[3]
+            
 
             if not paths:
                 return None
david at sol114:~/dev$

----------
components: ctypes
files: solaris11_crle.patch
keywords: patch
messages: 384856
nosy: dmurphy18
priority: normal
severity: normal
status: open
title: Solaris 11.4 crle output not handled correctly
versions: Python 3.10, Python 3.7, Python 3.8, Python 3.9
Added file: https://bugs.python.org/file49735/solaris11_crle.patch

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42896>
_______________________________________

From report at bugs.python.org  Mon Jan 11 13:56:01 2021
From: report at bugs.python.org (David Murphy)
Date: Mon, 11 Jan 2021 18:56:01 +0000
Subject: [issue42896] Solaris 11.4 crle output not handled correctly
In-Reply-To: <1610391317.65.0.0245738213738.issue42896@roundup.psfhosted.org>
Message-ID: <1610391361.53.0.320212391254.issue42896@roundup.psfhosted.org>


David Murphy <damurphy at vmware.com> added the comment:

Forgive any process/workflow errors first time, submitting to Python

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42896>
_______________________________________

From report at bugs.python.org  Mon Jan 11 14:08:37 2021
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 11 Jan 2021 19:08:37 +0000
Subject: [issue24711] Document getpass.getpass behavior on ^C
In-Reply-To: <1437779531.88.0.954988782388.issue24711@psf.upfronthosting.co.za>
Message-ID: <1610392117.16.0.344727736019.issue24711@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Works for me on both linux and windows.

----------
stage:  -> resolved
status: pending -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24711>
_______________________________________

From report at bugs.python.org  Mon Jan 11 14:11:58 2021
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 11 Jan 2021 19:11:58 +0000
Subject: [issue17243] The changes made for issue 4074 should be documented
In-Reply-To: <1361305487.48.0.247163585293.issue17243@psf.upfronthosting.co.za>
Message-ID: <1610392318.22.0.387812807174.issue17243@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
stage: needs patch -> resolved
status: pending -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17243>
_______________________________________

From report at bugs.python.org  Mon Jan 11 14:45:01 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Mon, 11 Jan 2021 19:45:01 +0000
Subject: [issue42862] Use functools.lru_cache iso. _sqlite.Cache in sqlite3
 module
In-Reply-To: <1610066343.94.0.466682345605.issue42862@roundup.psfhosted.org>
Message-ID: <1610394301.41.0.175798261661.issue42862@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
keywords: +patch
pull_requests: +23021
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24135

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42862>
_______________________________________

From report at bugs.python.org  Mon Jan 11 14:49:16 2021
From: report at bugs.python.org (Camion)
Date: Mon, 11 Jan 2021 19:49:16 +0000
Subject: [issue42886] math.log and math.log10 domain error on very large
 Fractions
In-Reply-To: <1610318683.55.0.0487505722004.issue42886@roundup.psfhosted.org>
Message-ID: <1610394556.78.0.223322703785.issue42886@roundup.psfhosted.org>


Camion <camion_spam-pybugs at yahoo.com> added the comment:

@mark.dickinson, I fell on this problem in the reached precision evaluation, of a multiprecision algorithm designed to compute decimals of PI (using "John Machin like" formulas). 

The fact is that fractions module is really nice to implement this kind of multiprecision algorithm and math.log10 on each subsequent term of the series gives you an immediate evaluation of the current reached precision.

I agree that the solution I used work pretty well, but it makes me sad because it's far from beautifull.

I think one should consider that there are two cases with different objectives : floats and the likes which target speed, and those multiprecision types which target - well... precision. I wonder if the solution would not be to implement those functions in the fractions and decimal libraries (just calling log on integer for numerator and denominator).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42886>
_______________________________________

From report at bugs.python.org  Mon Jan 11 14:55:46 2021
From: report at bugs.python.org (Peter Van Sickel)
Date: Mon, 11 Jan 2021 19:55:46 +0000
Subject: [issue42897] Expose a way to determine if a process has been closed
 or not
Message-ID: <1610394945.99.0.114538503727.issue42897@roundup.psfhosted.org>


New submission from Peter Van Sickel <pvs at us.ibm.com>:

I have been using the multiprocessing Process class a good bit lately. I have a class that is managing the a given list of processes from launch to completion. 
Recently I started using Process close().  I found myself wanting to determine if a given process instance was closed or not before I did anything like check its exitcode or invoke any of the other methods that raise a ValueError if done so on a closed process.
As far as I can tell there is no exposed way to check if the process is closed.  The Process class has a _closed instance variable and a _check_closed() method, but those are not intended for direct use.
I created a simple wrapper class that has its own closed instance variable and wraps the close() method of Process so that the closed instance variable can be set to True when close() is called and then call super().close() to allow the normal close operation to complete.
It would be convenient if the Process class itself supported an is_closed() method or exposed a Boolean closed attribute to easily determine if a process instance has been closed.

----------
messages: 384860
nosy: petervansickel
priority: normal
severity: normal
status: open
title: Expose a way to determine if a process has been closed or not
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42897>
_______________________________________

From report at bugs.python.org  Mon Jan 11 15:11:04 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Mon, 11 Jan 2021 20:11:04 +0000
Subject: [issue42895] Return multi-line list concatenation without parentheses
 returns only first operand
In-Reply-To: <1610390338.44.0.382360444411.issue42895@roundup.psfhosted.org>
Message-ID: <1610395864.52.0.423323129524.issue42895@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

This is not a bug -- it is how it's supposed to work (for better or for worse).

Please see a use forum to help you understand what's going on here.

----------
nosy: +gvanrossum
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42895>
_______________________________________

From report at bugs.python.org  Mon Jan 11 15:12:32 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Mon, 11 Jan 2021 20:12:32 +0000
Subject: [issue42894] Debugging native Python modules on Windows with Visual
 Studio Toolchain
In-Reply-To: <1610390058.13.0.89065377446.issue42894@roundup.psfhosted.org>
Message-ID: <1610395952.15.0.99825183538.issue42894@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Steve, is there a better way?

----------
components: +Windows -C API
nosy: +gvanrossum, paul.moore, steve.dower, tim.golden, zach.ware

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42894>
_______________________________________

From report at bugs.python.org  Mon Jan 11 15:26:02 2021
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 11 Jan 2021 20:26:02 +0000
Subject: [issue20131] warnings module offers no documented,
 programmatic way to reset "seen-warning" flag
In-Reply-To: <1388925569.4.0.616104920228.issue20131@psf.upfronthosting.co.za>
Message-ID: <1610396762.85.0.578629504784.issue20131@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> duplicate
superseder:  -> warnings module offers no documented, programmatic way to reset "seen-warning" flag

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20131>
_______________________________________

From report at bugs.python.org  Mon Jan 11 15:34:21 2021
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 11 Jan 2021 20:34:21 +0000
Subject: [issue21865] Improve invalid category exception for
 warnings.filterwarnings
In-Reply-To: <1403654797.31.0.372707276339.issue21865@psf.upfronthosting.co.za>
Message-ID: <1610397261.82.0.364389710071.issue21865@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> duplicate
stage: patch review -> resolved
status: open -> closed
superseder:  -> Better warnings exception for bad category

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21865>
_______________________________________

From report at bugs.python.org  Mon Jan 11 15:37:16 2021
From: report at bugs.python.org (Steven D'Aprano)
Date: Mon, 11 Jan 2021 20:37:16 +0000
Subject: [issue42895] Return multi-line list concatenation without parentheses
 returns only first operand
In-Reply-To: <1610390338.44.0.382360444411.issue42895@roundup.psfhosted.org>
Message-ID: <1610397436.92.0.687316991046.issue42895@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

As Guido says, a full explanation will have to to a user-forum such as https://discuss.python.org/c/users/7 but consider this example and see if it gives you insight:

def demo():
    x = 1
    return (
        x - 1
        )
    print("This is not executed.")
    - (5 * x)

and remember that `+` can also be a unary operator.

----------
nosy: +steven.daprano

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42895>
_______________________________________

From report at bugs.python.org  Mon Jan 11 16:00:16 2021
From: report at bugs.python.org (William Schwartz)
Date: Mon, 11 Jan 2021 21:00:16 +0000
Subject: [issue42531] importlib.resources.path() raises TypeError for packages
 without __file__
In-Reply-To: <1606890702.39.0.177441013455.issue42531@roundup.psfhosted.org>
Message-ID: <1610398816.0.0.119807248287.issue42531@roundup.psfhosted.org>


William Schwartz <wkschwartz at gmail.com> added the comment:

> For that, please submit a PR to importlib_resources and it will get synced to CPython later.

Will do once PR 23611 gets in shape. 

> Can you tell me more about the use-case that exhibited this undesirable behavior?

Using the [PyOxidizer] "freezer". It compiles Python together with frozen Python code or byte code.

> That is, what loader is it that supports `open_binary` but not `is_resource` and doesn't have a `__origin__`?

PyOxidizer's [OxidizedImporter] importer. It [does not set `__file__`] (i.e., `__spec__.origin__ is None`). Its maintainer has resolved some ambiguities in the resources API contract (#36128) [differently from CPython], but I don't think that's related to the issue I ran into. The resource-related functionality of the importer is implemented here (extension module written in Rust): https://github.com/indygreg/PyOxidizer/blob/e86b2f46ed6b449bdb912900b0ac83576ad5ebe9/pyembed/src/importer.rs#L1078-L1269

[PyOxidizer]: https://pyoxidizer.readthedocs.io
[OxidizedImporter]: https://pyoxidizer.readthedocs.io/en/v0.10.3/oxidized_importer.html
[does not set `__file__`]: https://pyoxidizer.readthedocs.io/en/v0.10.3/oxidized_importer_behavior_and_compliance.html#file-and-cached-module-attributes
[unsure about `ResourceReader` semantics]: https://pyoxidizer.readthedocs.io/en/v0.10.3/oxidized_importer_resource_files.html#resource-reader-support

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42531>
_______________________________________

From report at bugs.python.org  Mon Jan 11 16:12:28 2021
From: report at bugs.python.org (Kale Kundert)
Date: Mon, 11 Jan 2021 21:12:28 +0000
Subject: [issue42898] pickle.loads() crashes interpreter on invalid input
Message-ID: <1610399547.98.0.314580970043.issue42898@roundup.psfhosted.org>


New submission from Kale Kundert <kale at thekunderts.net>:

I expect `pickle.loads()` to raise `_pickle.UnpicklingError` for any invalid input, but for the specific example shown below, the interpreter crashes after attempting to allocate >16GB of memory.  Note that this input does not have the pickle header (b'0x80'), so it should be easy to distinguish from valid input.

$ python
Python 3.8.2 (default, Apr 13 2020, 11:02:04) 
[Clang 9.0.1 ] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import pickle
>>> pickle.loads(b'January 11')
[1]    624227 killed     python3

----------
messages: 384865
nosy: kalekundert
priority: normal
severity: normal
status: open
title: pickle.loads() crashes interpreter on invalid input

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42898>
_______________________________________

From report at bugs.python.org  Mon Jan 11 16:13:06 2021
From: report at bugs.python.org (Kale Kundert)
Date: Mon, 11 Jan 2021 21:13:06 +0000
Subject: [issue42898] pickle.loads() crashes interpreter on invalid input
In-Reply-To: <1610399547.98.0.314580970043.issue42898@roundup.psfhosted.org>
Message-ID: <1610399586.95.0.672249096523.issue42898@roundup.psfhosted.org>


Change by Kale Kundert <kale at thekunderts.net>:


----------
type:  -> crash
versions: +Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42898>
_______________________________________

From report at bugs.python.org  Mon Jan 11 16:59:43 2021
From: report at bugs.python.org (Christian Heimes)
Date: Mon, 11 Jan 2021 21:59:43 +0000
Subject: [issue42898] pickle.loads() crashes interpreter on invalid input
In-Reply-To: <1610399547.98.0.314580970043.issue42898@roundup.psfhosted.org>
Message-ID: <1610402383.59.0.679256191602.issue42898@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

The pickle module is not safe against malicious or faulty data. Invalid data can cause code injects or even segfaults. It's a know and documented behavior, https://docs.python.org/3/library/pickle.html

----------
nosy: +christian.heimes
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42898>
_______________________________________

From report at bugs.python.org  Mon Jan 11 17:09:46 2021
From: report at bugs.python.org (Pavel Ditenbir)
Date: Mon, 11 Jan 2021 22:09:46 +0000
Subject: [issue42875] argparse incorrectly shows help string on a new line in
 case of long command string
In-Reply-To: <1610202899.54.0.332342565241.issue42875@roundup.psfhosted.org>
Message-ID: <1610402986.26.0.770383061714.issue42875@roundup.psfhosted.org>


Change by Pavel Ditenbir <pavel.ditenbir at gmail.com>:


----------
versions: +Python 3.10, Python 3.6, Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42875>
_______________________________________

From report at bugs.python.org  Mon Jan 11 17:17:23 2021
From: report at bugs.python.org (Pavel Ditenbir)
Date: Mon, 11 Jan 2021 22:17:23 +0000
Subject: [issue42875] argparse incorrectly shows help string on a new line in
 case of long command string
In-Reply-To: <1610202899.54.0.332342565241.issue42875@roundup.psfhosted.org>
Message-ID: <1610403443.6.0.902144637342.issue42875@roundup.psfhosted.org>


Change by Pavel Ditenbir <pavel.ditenbir at gmail.com>:


----------
versions:  -Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42875>
_______________________________________

From report at bugs.python.org  Mon Jan 11 17:26:53 2021
From: report at bugs.python.org (Steve Stagg)
Date: Mon, 11 Jan 2021 22:26:53 +0000
Subject: [issue42899] Possible regression introduced by bpo-42615
Message-ID: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>


New submission from Steve Stagg <stestagg at gmail.com>:

This was raised by Mats Wichmann <mats at python.org>  on the python-dev list.

Commit : c71581c7a4192e6ba9a79eccc583aaadab300efa
bpo-42615: Delete redundant jump instructions that only bypass empty blocks (GH-23733)

appears to have changed the behaviour of the following code:

class B:
     def __bool__(self):
         raise AttributeError("don't do that!")

b = B()
try:
   if b:
        pass
except AttributeError:
   print("HI")


Before the change, the output is:

bool(B)
GOT ERROR
Traceback (most recent call last):
  File "../test.py", line 8, in <module>
    if b:
  File "../test.py", line 4, in __bool__
    raise AttributeError("don't do that!")
AttributeError: don't do that!

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "../test.py", line 12, in <module>
    raise IndexError("Should GET THIS")
IndexError: Should GET THIS


After the change, just:

SHOULDN'T GET THIS

It seems like the entire branch is being eliminated prematurely, but maybe only when the statement is wrapped in a try-except?

----------
messages: 384867
nosy: Mark.Shannon, m, stestagg
priority: normal
severity: normal
status: open
title: Possible regression introduced by bpo-42615
type: behavior
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Mon Jan 11 17:35:19 2021
From: report at bugs.python.org (Steve Stagg)
Date: Mon, 11 Jan 2021 22:35:19 +0000
Subject: [issue42899] Possible regression introduced by bpo-42615
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610404519.53.0.728180640085.issue42899@roundup.psfhosted.org>


Steve Stagg <stestagg at gmail.com> added the comment:

Apologies, script should have read:
class B:
     def __bool__(self):
         print("bool(B)")
         raise AttributeError("don't do that!")

b = B()
try:
   if b:
        pass
except AttributeError:
   print("GOT ERROR")
   raise IndexError("Should GET THIS")

print("SHOULDN'T GET THIS")


---

The DIS before the change for this code is:
BEFORE:
  1           0 LOAD_BUILD_CLASS
              2 LOAD_CONST               0 (<code object B at 0x7ff45711e710, file "<dis>", line 1>)
              4 LOAD_CONST               1 ('B')
              6 MAKE_FUNCTION            0
              8 LOAD_CONST               1 ('B')
             10 CALL_FUNCTION            2
             12 STORE_NAME               0 (B)

  6          14 LOAD_NAME                0 (B)
             16 CALL_FUNCTION            0
             18 STORE_NAME               1 (b)

  7          20 SETUP_FINALLY            8 (to 30)

  8          22 LOAD_NAME                1 (b)
             24 POP_JUMP_IF_FALSE       26

  9     >>   26 POP_BLOCK
             28 JUMP_FORWARD            30 (to 60)

 10     >>   30 DUP_TOP
             32 LOAD_NAME                2 (AttributeError)
             34 JUMP_IF_NOT_EXC_MATCH    58
             36 POP_TOP
             38 POP_TOP
             40 POP_TOP

 11          42 LOAD_NAME                3 (print)
             44 LOAD_CONST               2 ('GOT ERROR')
             46 CALL_FUNCTION            1
             48 POP_TOP

 12          50 LOAD_NAME                4 (IndexError)
             52 LOAD_CONST               3 ('Should GET THIS')
             54 CALL_FUNCTION            1
             56 RAISE_VARARGS            1
        >>   58 RERAISE

 14     >>   60 LOAD_NAME                3 (print)
             62 LOAD_CONST               4 ("SHOULDN'T GET THIS")
             64 CALL_FUNCTION            1
             66 POP_TOP
             68 LOAD_CONST               5 (None)
             70 RETURN_VALUE

Disassembly of <code object B at 0x7ff45711e710, file "<dis>", line 1>:
  1           0 LOAD_NAME                0 (__name__)
              2 STORE_NAME               1 (__module__)
              4 LOAD_CONST               0 ('B')
              6 STORE_NAME               2 (__qualname__)

  2           8 LOAD_CONST               1 (<code object __bool__ at 0x7ff45711e660, file "<dis>", line 2>)
             10 LOAD_CONST               2 ('B.__bool__')
             12 MAKE_FUNCTION            0
             14 STORE_NAME               3 (__bool__)
             16 LOAD_CONST               3 (None)
             18 RETURN_VALUE

Disassembly of <code object __bool__ at 0x7ff45711e660, file "<dis>", line 2>:
  3           0 LOAD_GLOBAL              0 (print)
              2 LOAD_CONST               1 ('bool(B)')
              4 CALL_FUNCTION            1
              6 POP_TOP

  4           8 LOAD_GLOBAL              1 (AttributeError)
             10 LOAD_CONST               2 ("don't do that!")
             12 CALL_FUNCTION            1
             14 RAISE_VARARGS            1


----
Afterwards, tehre's a single change:

8 becomes:

8          22 LOAD_NAME                1 (b)
             24 POP_TOP

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Mon Jan 11 17:47:38 2021
From: report at bugs.python.org (Mark Shannon)
Date: Mon, 11 Jan 2021 22:47:38 +0000
Subject: [issue42899] Possible regression introduced by bpo-42615
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610405258.99.0.680070285141.issue42899@roundup.psfhosted.org>


Change by Mark Shannon <mark at hotpy.org>:


----------
assignee:  -> Mark.Shannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Mon Jan 11 17:58:22 2021
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 11 Jan 2021 22:58:22 +0000
Subject: [issue16081] Fix compile warnings in thread_pthread.h
In-Reply-To: <1348829357.7.0.760845781586.issue16081@psf.upfronthosting.co.za>
Message-ID: <1610405902.11.0.525703206172.issue16081@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This was resolved here: https://github.com/python/cpython/commit/56379c0d8fc17e717ac1ad73353b5991adae6832

----------
nosy: +iritkatriel
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue16081>
_______________________________________

From report at bugs.python.org  Mon Jan 11 18:02:52 2021
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 11 Jan 2021 23:02:52 +0000
Subject: [issue39690] Compiler warnings in unicodeobject.c
In-Reply-To: <1582140452.34.0.85531597667.issue39690@roundup.psfhosted.org>
Message-ID: <1610406172.9.0.98174164263.issue39690@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> PyUnicode_IsIdentifier has two if/thens that can be combined

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39690>
_______________________________________

From report at bugs.python.org  Mon Jan 11 18:25:12 2021
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 11 Jan 2021 23:25:12 +0000
Subject: [issue16845] warnings.simplefilter should validate input
In-Reply-To: <1357173726.64.0.0586309357998.issue16845@psf.upfronthosting.co.za>
Message-ID: <1610407512.94.0.706107836346.issue16845@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
keywords: +easy -patch
versions: +Python 3.10 -Python 3.5

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue16845>
_______________________________________

From report at bugs.python.org  Mon Jan 11 18:46:30 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Mon, 11 Jan 2021 23:46:30 +0000
Subject: [issue42889] Incorrect behavior of Python parser after ast node of
 test program being modified
In-Reply-To: <1610351139.91.0.540037450972.issue42889@roundup.psfhosted.org>
Message-ID: <1610408790.39.0.62322291355.issue42889@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

I don't think this is a bug, unless you can show an example where the bytecode compiler or the interpreter actually crashes. Basically you can change AST nodes in lots of ways that don't correspond to valid programs, and as long as you can't make CPython crash we don't care.

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42889>
_______________________________________

From report at bugs.python.org  Mon Jan 11 19:32:35 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 12 Jan 2021 00:32:35 +0000
Subject: [issue42812] @overload-ing method of parent class without actual
 implementation
In-Reply-To: <1609653092.18.0.893619520042.issue42812@roundup.psfhosted.org>
Message-ID: <1610411555.14.0.473170244977.issue42812@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

I hesitate to add anything because you are exposing so much confusion. May I suggest that you ask about this on a user group first before proposing a new feature? One place that makes sense given that this is a type system feature would be this Gitter channel: https://gitter.im/python/typing

----------
nosy:  -levkivskyi

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42812>
_______________________________________

From report at bugs.python.org  Mon Jan 11 19:41:43 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 12 Jan 2021 00:41:43 +0000
Subject: [issue42870] Document changed argparse output wrt optional arguments
 in What's new in Python 3.10
In-Reply-To: <1610149853.78.0.949568295376.issue42870@roundup.psfhosted.org>
Message-ID: <1610412103.46.0.332251643743.issue42870@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:


New changeset fb35fa49d192368e94ffec09c092260ed0fea2e1 by Tom?? Hrn?iar in branch 'master':
bpo-42870: Document change in argparse help output. (GH-24190)
https://github.com/python/cpython/commit/fb35fa49d192368e94ffec09c092260ed0fea2e1


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42870>
_______________________________________

From report at bugs.python.org  Mon Jan 11 19:42:22 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 12 Jan 2021 00:42:22 +0000
Subject: [issue42870] Document changed argparse output wrt optional arguments
 in What's new in Python 3.10
In-Reply-To: <1610149853.78.0.949568295376.issue42870@roundup.psfhosted.org>
Message-ID: <1610412142.91.0.0867024980505.issue42870@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Thanks for your fix!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42870>
_______________________________________

From report at bugs.python.org  Mon Jan 11 20:16:17 2021
From: report at bugs.python.org (Gregory P. Smith)
Date: Tue, 12 Jan 2021 01:16:17 +0000
Subject: [issue42899] Possible regression introduced by bpo-42615
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610414177.54.0.817151919606.issue42899@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
nosy: +gregory.p.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Mon Jan 11 20:16:11 2021
From: report at bugs.python.org (Gregory P. Smith)
Date: Tue, 12 Jan 2021 01:16:11 +0000
Subject: [issue42899] Possible regression introduced by bpo-42615
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610414171.08.0.353165467128.issue42899@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
priority: normal -> high

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Mon Jan 11 20:20:28 2021
From: report at bugs.python.org (Peter)
Date: Tue, 12 Jan 2021 01:20:28 +0000
Subject: [issue42900] Ternary operator precedence relative to bitwise or
Message-ID: <1610414428.66.0.949606114531.issue42900@roundup.psfhosted.org>


New submission from Peter <peter_dulimov at hotmail.com>:

Hello,

I expect the following code to run fine, but the assertion fails. dbg1 is 1, while dbg2 is 3.  I thought they would both be 3.
Note that the only difference between the expressions for dbg1 and dbg2 are the parentheses.
Please accept my apologies if this is expected behavior, but it came as a big surprise to me.


import json
if __name__ == "__main__":
    msg = '''
        {
        "Sync Setup Flags": {
            "Setup Sync": "Enable",
            "Generate Primary Sync": "Enable",
            "Backup Primary Sync": "Disable",
            "Follow Only": "Disable",
            "Use Local Clock": "Disable",
            "Set Active": "Disable"
        }
        }
        '''
    obj = json.loads(msg)
    dbg1 = \
        1 if obj["Sync Setup Flags"]["Setup Sync"] == "Enable" else 0 | \
        2 if obj["Sync Setup Flags"]["Generate Primary Sync"] == "Enable" else 0 | \
        4 if obj["Sync Setup Flags"]["Backup Primary Sync"] == "Enable" else 0 | \
        8 if obj["Sync Setup Flags"]["Follow Only"] == "Enable" else 0 | \
        16 if obj["Sync Setup Flags"]["Use Local Clock"] == "Enable" else 0 | \
        128 if obj["Sync Setup Flags"]["Set Active"] == "Enable" else 0
    dbg2 = \
        (1 if obj["Sync Setup Flags"]["Setup Sync"] == "Enable" else 0) | \
        (2 if obj["Sync Setup Flags"]["Generate Primary Sync"] == "Enable" else 0) | \
        (4 if obj["Sync Setup Flags"]["Backup Primary Sync"] == "Enable" else 0) | \
        (8 if obj["Sync Setup Flags"]["Follow Only"] == "Enable" else 0) | \
        (16 if obj["Sync Setup Flags"]["Use Local Clock"] == "Enable" else 0) | \
        (128 if obj["Sync Setup Flags"]["Set Active"] == "Enable" else 0)

    assert(dbg1 == dbg2)

----------
messages: 384874
nosy: amazingmo
priority: normal
severity: normal
status: open
title: Ternary operator precedence relative to bitwise or
type: behavior
versions: Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42900>
_______________________________________

From report at bugs.python.org  Mon Jan 11 20:27:28 2021
From: report at bugs.python.org (Ethan Furman)
Date: Tue, 12 Jan 2021 01:27:28 +0000
Subject: [issue42901] [Enum] move member creation to __set_name__ in order to
 support __init_subclass__
Message-ID: <1610414848.42.0.389708219553.issue42901@roundup.psfhosted.org>


New submission from Ethan Furman <ethan at stoneleaf.us>:

In discussions about moving the calls to `__set_name__` and `__init_subclass__`, Nick Coughlan made an observation:

Nick Coghlan:
> Both EnumMeta and ABCMeta should probably be relying on `__set_name__`
> for their per-member set up work these days, rather than deferring that
> work until after `__new__` returns.

By having `__set_name__` create the final members, they will be in place for the call to `__init_subclass__`.

----------
assignee: ethan.furman
components: Library (Lib)
messages: 384875
nosy: barry, eli.bendersky, ethan.furman
priority: high
severity: normal
stage: needs patch
status: open
title: [Enum] move member creation to __set_name__ in order to support __init_subclass__
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42901>
_______________________________________

From report at bugs.python.org  Mon Jan 11 20:29:46 2021
From: report at bugs.python.org (Ethan Furman)
Date: Tue, 12 Jan 2021 01:29:46 +0000
Subject: [issue42775] __init_subclass__ should be called in __init__
In-Reply-To: <1609211209.61.0.873859112725.issue42775@roundup.psfhosted.org>
Message-ID: <1610414986.6.0.155235696924.issue42775@roundup.psfhosted.org>


Ethan Furman <ethan at stoneleaf.us> added the comment:

Nick Coghlan made the observation that `__set_name__` should be doing what is currently the after-new work.

Tracking in #42901.

----------
keywords:  -patch
resolution:  -> rejected
stage: patch review -> resolved
status: open -> closed
superseder:  -> [Enum] move member creation to __set_name__ in order to support __init_subclass__

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42775>
_______________________________________

From report at bugs.python.org  Mon Jan 11 20:32:07 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 12 Jan 2021 01:32:07 +0000
Subject: [issue42775] __init_subclass__ should be called in __init__
In-Reply-To: <1609211209.61.0.873859112725.issue42775@roundup.psfhosted.org>
Message-ID: <1610415127.66.0.268568010028.issue42775@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Thanks, that's great! And thanks, Nick!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42775>
_______________________________________

From report at bugs.python.org  Mon Jan 11 20:33:54 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 12 Jan 2021 01:33:54 +0000
Subject: [issue42900] Ternary operator precedence relative to bitwise or
In-Reply-To: <1610414428.66.0.949606114531.issue42900@roundup.psfhosted.org>
Message-ID: <1610415234.31.0.388637975446.issue42900@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

You may be surprised, but it's not a bug -- '|' binds tighter than 'if'/'else'.

If you need more help, please contact a user forum.

----------
nosy: +gvanrossum
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42900>
_______________________________________

From report at bugs.python.org  Mon Jan 11 21:18:49 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 12 Jan 2021 02:18:49 +0000
Subject: [issue42899] Possible regression introduced by bpo-42615
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610417929.42.0.55552100043.issue42899@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Mon Jan 11 21:19:47 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 12 Jan 2021 02:19:47 +0000
Subject: [issue42899] Possible regression introduced by bpo-42615
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610417987.08.0.809584483378.issue42899@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
priority: high -> release blocker

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Mon Jan 11 22:18:07 2021
From: report at bugs.python.org (Xinmeng Xia)
Date: Tue, 12 Jan 2021 03:18:07 +0000
Subject: [issue42889] Incorrect behavior of Python parser after ast node of
 test program being modified
In-Reply-To: <1610351139.91.0.540037450972.issue42889@roundup.psfhosted.org>
Message-ID: <1610421487.76.0.321662384872.issue42889@roundup.psfhosted.org>


Xinmeng Xia <xiaxm at smail.nju.edu.cn> added the comment:

Sorry, my description is a little confusing. My points lie on function 'compile' and 'exec'. Yes, I agree. AST can be modified and don't correspond to valid programs.  But I don't think this invaild program can be compiled and exec without any check. It's dangerous.  

See the following program: For "compile" and "exec", no error is reported on Python 3.5-3.8 while error messages are reported on Python 3.9 and 3.10

======================================
import ast
class RewriteName(ast.NodeTransformer):
    def visit_Name(self, node):
        if node.id != "print":
            node.id = str(False)
            print(type(node.id))
        return node

code = "a = 2;print(a)"

myast = ast.parse(code)
transformer = RewriteName()
newast = transformer.visit(myast)

c = compile(newast,'','exec')
exec(c)
=====================================
Error message on Python 3.9  and 3.10.
-------------------------------------
<class 'str'>
<class 'str'>
Traceback (most recent call last):
  File "/home/xxm/Desktop/nameChanging/report/test1.py", line 574, in <module>
    c = compile(newast,'','exec')
ValueError: Name node can't be used with 'False' constant
-------------------------------------

In fact, in class RewriteName, when "node.id" is assigned, the parser will check whether the identifier is a "str". If not,"TypeError: AST identifier must be of type str" will be reported. However, it's not enough. In Python, identifier names have their own naming rules.  "str" could be "+","1","False", but these are not legally id. So the above error could be reported.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42889>
_______________________________________

From report at bugs.python.org  Mon Jan 11 22:37:38 2021
From: report at bugs.python.org (Ziqiao Kong)
Date: Tue, 12 Jan 2021 03:37:38 +0000
Subject: [issue42880] ctypes: variadic function call still doesn't work on
 Apple Silicon
In-Reply-To: <1610264518.97.0.0227668442163.issue42880@roundup.psfhosted.org>
Message-ID: <1610422658.82.0.208851329006.issue42880@roundup.psfhosted.org>


Ziqiao Kong <ziqiaokong at gmail.com> added the comment:

Sorry that our test machine failed to boot due to some firmware problem when upgrading to 11.1 yesterday. I will re-run my tests after the upgrade gets done.

Also, I'm sure the last output is "3" in my first message.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42880>
_______________________________________

From report at bugs.python.org  Mon Jan 11 22:41:55 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 12 Jan 2021 03:41:55 +0000
Subject: [issue42889] Incorrect behavior of Python parser after ast node of
 test program being modified
In-Reply-To: <1610351139.91.0.540037450972.issue42889@roundup.psfhosted.org>
Message-ID: <1610422915.48.0.267096082429.issue42889@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Hm, if your argument is just that you can make invalid identifiers this way, I still don't see why that's a big deal. You can do `x.__dict__["1"] = 1` and now you've given x an attribute that's not a valid identifier. You could also call the code object constructor directly with some valid identifiers. You have to do better than saying "it's dangerous". Can you demonstrate a segfault?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42889>
_______________________________________

From report at bugs.python.org  Mon Jan 11 22:58:43 2021
From: report at bugs.python.org (houjingyi)
Date: Tue, 12 Jan 2021 03:58:43 +0000
Subject: =?utf-8?q?=5Bissue42902=5D_a_python_embedded_program=C2=A0may_load_=22C?=
 =?utf-8?q?=3A=5CLib=5Cos=2Epy=22_on_windows_system?=
Message-ID: <1610423923.25.0.321902126582.issue42902@roundup.psfhosted.org>


New submission from houjingyi <houjingyi647 at gmail.com>:

environment: windows 10, python3.8.7 installed to "C:\Program Files\Python38".

datail info: According to https://docs.python.org/3/c-api/init.html: "Py_SetPath() set the default module search path. If this function is called before Py_Initialize(), then Py_GetPath() won?t attempt to compute a default search path but uses the one provided instead."
Write following code that only call Py_Initialize():

#include <iostream>
#include <Python.h>
#include <Windows.h>
using namespace std;
int main()
{
Py_Initialize();
} 

In visual studio add "C:\Program Files\Python38\include" to AdditionalIncludeDirectories, add "C:\Program Files\Python38\libs\python38.lib" to AdditionalDependencies to compile it to poc.exe. Copy "C:\Program Files\Python38\Lib" to "C:\Lib" and modify "C:\Lib\os.py" to execute any code we like. For example we can add "import os" and add "os.system(notepad)" in function "def _exists(name)". Now run poc.exe it will create notepad. 

impact: In my report I showed that a python embedded program?may load "C:\Lib\os.py" which?lower privileged?user can control. If this program runs as administrator then this may cause vertical privilege escalation,?low privileged user gets higher privilege;?If this program do not run as administrator then this may cause vertical privilege escalation,?low privileged user can execute code as others(https://en.wikipedia.org/wiki/Privilege_escalation). In either case, the access control of the windows system is broken.

notice: The report was sent to security at python.org before and they suggested it can be reported publicly.

----------
components: C API
messages: 384882
nosy: houjingyi233
priority: normal
severity: normal
status: open
title: a python embedded program?may load "C:\Lib\os.py" on windows system
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42902>
_______________________________________

From report at bugs.python.org  Mon Jan 11 23:17:03 2021
From: report at bugs.python.org (Pandu E POLUAN)
Date: Tue, 12 Jan 2021 04:17:03 +0000
Subject: [issue27820] Possible bug in smtplib when initial_response_ok=False
In-Reply-To: <1471739698.94.0.271523306415.issue27820@psf.upfronthosting.co.za>
Message-ID: <1610425023.48.0.0269103392641.issue27820@roundup.psfhosted.org>


Change by Pandu E POLUAN <pepoluan at gmail.com>:


----------
components: +Tests

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27820>
_______________________________________

From report at bugs.python.org  Mon Jan 11 23:31:59 2021
From: report at bugs.python.org (Eugene Toder)
Date: Tue, 12 Jan 2021 04:31:59 +0000
Subject: [issue42903] optimize lru_cache for functions with no arguments
Message-ID: <1610425919.12.0.56212738564.issue42903@roundup.psfhosted.org>


New submission from Eugene Toder <eltoder at gmail.com>:

It's convenient to use @lru_cache on functions with no arguments to delay doing some work until the first time it is needed. Since @lru_cache is implemented in C, it is already faster than manually caching in a closure variable. However, it can be made even faster and more memory efficient by not using the dict at all and caching just the one result that the function returns.

Here are my timing results. Before my changes:

$ ./python -m timeit -s "import functools; f = functools.lru_cache()(lambda: 1)" "f()"
5000000 loops, best of 5: 42.2 nsec per loop
$ ./python -m timeit -s "import functools; f = functools.lru_cache(None)(lambda: 1)" "f()"
5000000 loops, best of 5: 38.9 nsec per loop

After my changes:

$ ./python -m timeit -s "import functools; f = functools.lru_cache()(lambda: 1)" "f()"
10000000 loops, best of 5: 22.6 nsec per loop

So we get improvement of about 80% compared to the default maxsize and about 70% compared to maxsize=None.

----------
components: Library (Lib)
messages: 384883
nosy: eltoder, serhiy.storchaka, vstinner
priority: normal
severity: normal
status: open
title: optimize lru_cache for functions with no arguments
type: performance
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42903>
_______________________________________

From report at bugs.python.org  Mon Jan 11 23:38:09 2021
From: report at bugs.python.org (Ethan Furman)
Date: Tue, 12 Jan 2021 04:38:09 +0000
Subject: [issue42901] [Enum] move member creation to __set_name__ in order to
 support __init_subclass__
In-Reply-To: <1610414848.42.0.389708219553.issue42901@roundup.psfhosted.org>
Message-ID: <1610426289.31.0.927015934636.issue42901@roundup.psfhosted.org>


Change by Ethan Furman <ethan at stoneleaf.us>:


----------
keywords: +patch
pull_requests: +23022
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/24196

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42901>
_______________________________________

From report at bugs.python.org  Mon Jan 11 23:49:30 2021
From: report at bugs.python.org (Dustin Rodrigues)
Date: Tue, 12 Jan 2021 04:49:30 +0000
Subject: [issue41116] build on macOS 11 (beta) does not find system-supplied
 third-party libraries
In-Reply-To: <1593100264.48.0.613850075185.issue41116@roundup.psfhosted.org>
Message-ID: <1610426970.78.0.372164621946.issue41116@roundup.psfhosted.org>


Dustin Rodrigues <dust.rod at gmail.com> added the comment:

If your 'brew --prefix' is /opt/homebrew, then setting

CFLAGS="-I/opt/homebrew/include" CPPFLAGS="-I/opt/homebrew/include" LDFLAGS="-L/opt/homebrew/lib"

when running ./configure appears to be sufficient to build the interpreter with lzma support once you've already done 'brew install xz'.

----------
nosy: +dtrodrigues

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41116>
_______________________________________

From report at bugs.python.org  Mon Jan 11 23:50:11 2021
From: report at bugs.python.org (Roundup Robot)
Date: Tue, 12 Jan 2021 04:50:11 +0000
Subject: [issue42903] optimize lru_cache for functions with no arguments
In-Reply-To: <1610425919.12.0.56212738564.issue42903@roundup.psfhosted.org>
Message-ID: <1610427011.02.0.193724119356.issue42903@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
keywords: +patch
nosy: +python-dev
nosy_count: 3.0 -> 4.0
pull_requests: +23023
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24197

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42903>
_______________________________________

From report at bugs.python.org  Tue Jan 12 00:00:15 2021
From: report at bugs.python.org (Paul Bryan)
Date: Tue, 12 Jan 2021 05:00:15 +0000
Subject: [issue42904] get_type_hints does not provide localns for classes
Message-ID: <1610427615.24.0.000795612365541.issue42904@roundup.psfhosted.org>


New submission from Paul Bryan <pbryan at anode.ca>:

According to PEP 563:

> The get_type_hints() function automatically resolves the correct value of globalns for functions and classes. It also automatically provides the correct localns for classes.

This statement about providing correct localns for classes does not appear to be true.

Guido suggested this should be treated as a bug.

----------
components: Library (Lib)
messages: 384885
nosy: gvanrossum, pbryan
priority: normal
severity: normal
status: open
title: get_type_hints does not provide localns for classes
type: behavior
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42904>
_______________________________________

From report at bugs.python.org  Tue Jan 12 00:00:59 2021
From: report at bugs.python.org (Paul Bryan)
Date: Tue, 12 Jan 2021 05:00:59 +0000
Subject: [issue42904] get_type_hints does not provide localns for classes
In-Reply-To: <1610427615.24.0.000795612365541.issue42904@roundup.psfhosted.org>
Message-ID: <1610427659.0.0.209346013799.issue42904@roundup.psfhosted.org>


Change by Paul Bryan <pbryan at anode.ca>:


----------
nosy: +larry

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42904>
_______________________________________

From report at bugs.python.org  Tue Jan 12 00:02:03 2021
From: report at bugs.python.org (Pandu E POLUAN)
Date: Tue, 12 Jan 2021 05:02:03 +0000
Subject: [issue41868] SMTPLIB integrate or provide option to use "logging"
In-Reply-To: <1601146265.03.0.468460712956.issue41868@roundup.psfhosted.org>
Message-ID: <1610427723.24.0.302097794481.issue41868@roundup.psfhosted.org>


Pandu E POLUAN <pepoluan at gmail.com> added the comment:

Will patching smtplib.SMTP._print_debug do?

You can subclass from smtplib.SMTP this way:

class MySMTPClient(smtplib.SMTP):
    def __init__(self, *args, logger=None, **kwargs):
        super().__init__(*args, **kwargs)
        self.logger = logger
    def _print_debug(self, *args):
        if self.logger:
            self.logger.debug(" ".join(args))
        super()._print_debug(*args)

----------
nosy: +pepoluan

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41868>
_______________________________________

From report at bugs.python.org  Tue Jan 12 00:12:27 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 12 Jan 2021 05:12:27 +0000
Subject: [issue42904] get_type_hints does not provide localns for classes
In-Reply-To: <1610427615.24.0.000795612365541.issue42904@roundup.psfhosted.org>
Message-ID: <1610428347.24.0.330334392769.issue42904@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Fidget-Spinner, are you interested in taking this?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42904>
_______________________________________

From report at bugs.python.org  Tue Jan 12 00:13:26 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 12 Jan 2021 05:13:26 +0000
Subject: [issue42904] get_type_hints does not provide localns for classes
In-Reply-To: <1610427615.24.0.000795612365541.issue42904@roundup.psfhosted.org>
Message-ID: <1610428406.52.0.324542384128.issue42904@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

It's apparently a bug in all versions that support `from __future__ import annotations` (and only when that is used). Though perhaps we should only fix in in 3.10.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42904>
_______________________________________

From report at bugs.python.org  Tue Jan 12 00:26:19 2021
From: report at bugs.python.org (JD-Veiga)
Date: Tue, 12 Jan 2021 05:26:19 +0000
Subject: [issue42895] Return multi-line list concatenation without parentheses
 returns only first operand
In-Reply-To: <1610390338.44.0.382360444411.issue42895@roundup.psfhosted.org>
Message-ID: <1610429179.23.0.723353706349.issue42895@roundup.psfhosted.org>


JD-Veiga <jdveiga at gmail.com> added the comment:

What a shame. I forget that + is also a unary operator. That produces a new logical line with correct identation though never executed. Sorry for the inconvenience.?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42895>
_______________________________________

From report at bugs.python.org  Tue Jan 12 00:31:37 2021
From: report at bugs.python.org (Alexey Izbyshev)
Date: Tue, 12 Jan 2021 05:31:37 +0000
Subject: =?utf-8?q?=5Bissue42888=5D_Not_installed_=E2=80=9Clibgcc=5Fs=2Eso=2E1?=
 =?utf-8?q?=E2=80=9D_causes_parser_crash=2E?=
In-Reply-To: <1610350822.34.0.431759793604.issue42888@roundup.psfhosted.org>
Message-ID: <1610429497.7.0.693871822191.issue42888@roundup.psfhosted.org>


Alexey Izbyshev <izbyshev at ispras.ru> added the comment:

I've encountered this issue too. My use case was a 32-bit Python on a 64-bit CentOS system, and my understanding of the issue was that 64-bit libgcc_s is somehow counted as a "provider" of libgcc_s for 32-bit libc by the package manager, so 32-bit libgcc_s is never installed even when "yum install glibc.i686" is used because everything seems "already OK":

$ yum deplist glibc

...
  dependency: libgcc
   provider: libgcc.x86_64 4.1.2-55.el5
   provider: libgcc.i386 4.1.2-55.el5
...

(The above is for CentOS 5, but at the time I tested 6 and 7 as well, with the same result).

But I suggest not to dismiss this issue as a packaging bug. Glibc needs libgcc_s for pthread_exit() because it's implemented in terms of pthread_cancel(), and the latter wants to do stack unwinding (probably to cleanup resources for each stack frame). But the code for unwinding lives in libgcc_s. The non-intuitive thing here is that glibc tried to optimize this dependency by dlopen'ing libgcc_s when pthread_cancel() is called instead of making it a startup dependency. Many people consider this a terrible design choice since your program can now fail at an arbitrary moment due to dlopen() failure (and missing libgcc_s is not the only possible reason[1]).

Since CPython doesn't use pthread_cancel() directly, I propose a simple solution  -- just `return NULL` from thread functions instead of calling pthread_exit(). The last time I looked, pthread_exit() in CPython is only called from top frames of the threads, so a direct `return` should suffice. If the top-level thread function simply returns, no stack unwinding is needed, so glibc never uses its cancellation machinery.

I've tested that this solution worked at the time (for 3.8 I think), and the test suite passed. If there is interest in going this way, I can test again.

[1] https://www.sourceware.org/bugzilla/show_bug.cgi?id=13119

----------
nosy: +izbyshev

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42888>
_______________________________________

From report at bugs.python.org  Tue Jan 12 00:40:32 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 12 Jan 2021 05:40:32 +0000
Subject: [issue42903] optimize lru_cache for functions with no arguments
In-Reply-To: <1610425919.12.0.56212738564.issue42903@roundup.psfhosted.org>
Message-ID: <1610430032.15.0.426289662968.issue42903@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Just use the new @cache decorator.?  It's cleaner looking in code and already sets maxsize to None, making it perfect for your application.

With respect to the proposed optimization, I'm sorry but further optimization of this already fast special case isn't worth the added complexity.  It is almost certain that these few nanoseconds won't ever matter in a real application.  The @cache decorator is already faster than calling an empty function, "def f(): return None".

? https://docs.python.org/3/library/functools.html#functools.cache

----------
nosy: +rhettinger
resolution:  -> rejected
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42903>
_______________________________________

From report at bugs.python.org  Tue Jan 12 00:45:12 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 12 Jan 2021 05:45:12 +0000
Subject: [issue42862] Use functools.lru_cache iso. _sqlite.Cache in sqlite3
 module
In-Reply-To: <1610066343.94.0.466682345605.issue42862@roundup.psfhosted.org>
Message-ID: <1610430312.71.0.644657575786.issue42862@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

+1 This seems reasonable to me.

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42862>
_______________________________________

From report at bugs.python.org  Tue Jan 12 01:12:22 2021
From: report at bugs.python.org (Eugene Toder)
Date: Tue, 12 Jan 2021 06:12:22 +0000
Subject: [issue42903] optimize lru_cache for functions with no arguments
In-Reply-To: <1610425919.12.0.56212738564.issue42903@roundup.psfhosted.org>
Message-ID: <1610431942.94.0.279506047858.issue42903@roundup.psfhosted.org>


Eugene Toder <eltoder at gmail.com> added the comment:

As you can see in my original post, the difference between @cache (aka @lru_cache(None)) and just @lru_cache() is negligible in this case. The optimization in this PR makes a much bigger difference. At the expense of some lines of code, that's true.

Also, function calls in Python are quite slow, so being faster than a function call is not a high bar.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42903>
_______________________________________

From report at bugs.python.org  Tue Jan 12 01:20:36 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 12 Jan 2021 06:20:36 +0000
Subject: [issue42903] optimize lru_cache for functions with no arguments
In-Reply-To: <1610425919.12.0.56212738564.issue42903@roundup.psfhosted.org>
Message-ID: <1610432436.98.0.923190324839.issue42903@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Some other thoughts:

* A zero argument function that returns a constant is unlikely to ever be used in a tight loop. That would be pointless.

* The @cache decorator is already 30% faster than calling an empty function. It's very cheap.

* We really don't want the cache logic to get into the business of trying to deduce the arity of the function being cached.  That is a can of worms that we would regret opening.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42903>
_______________________________________

From report at bugs.python.org  Tue Jan 12 01:29:10 2021
From: report at bugs.python.org (Ammar Askar)
Date: Tue, 12 Jan 2021 06:29:10 +0000
Subject: [issue42903] optimize lru_cache for functions with no arguments
In-Reply-To: <1610425919.12.0.56212738564.issue42903@roundup.psfhosted.org>
Message-ID: <1610432950.86.0.171929428897.issue42903@roundup.psfhosted.org>


Ammar Askar <ammar at ammaraskar.com> added the comment:

Additional discussion on the same topic on discourse: https://discuss.python.org/t/reduce-the-overhead-of-functools-lru-cache-for-functions-with-no-parameters/3956

----------
nosy: +ammar2

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42903>
_______________________________________

From report at bugs.python.org  Tue Jan 12 01:39:41 2021
From: report at bugs.python.org (Eugene Toder)
Date: Tue, 12 Jan 2021 06:39:41 +0000
Subject: [issue42903] optimize lru_cache for functions with no arguments
In-Reply-To: <1610425919.12.0.56212738564.issue42903@roundup.psfhosted.org>
Message-ID: <1610433581.25.0.37998564346.issue42903@roundup.psfhosted.org>


Eugene Toder <eltoder at gmail.com> added the comment:

Ammar, thank you for the link.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42903>
_______________________________________

From report at bugs.python.org  Tue Jan 12 02:04:57 2021
From: report at bugs.python.org (Christian Heimes)
Date: Tue, 12 Jan 2021 07:04:57 +0000
Subject: =?utf-8?q?=5Bissue42902=5D_a_python_embedded_program=C2=A0may_load_=22C?=
 =?utf-8?q?=3A=5CLib=5Cos=2Epy=22_on_windows_system?=
In-Reply-To: <1610423923.25.0.321902126582.issue42902@roundup.psfhosted.org>
Message-ID: <1610435097.77.0.462999770635.issue42902@roundup.psfhosted.org>


Change by Christian Heimes <lists at cheimes.de>:


----------
components: +Interpreter Core, Windows -C API
nosy: +paul.moore, steve.dower, tim.golden, vstinner, zach.ware
type: behavior -> security

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42902>
_______________________________________

From report at bugs.python.org  Tue Jan 12 02:05:09 2021
From: report at bugs.python.org (Christian Heimes)
Date: Tue, 12 Jan 2021 07:05:09 +0000
Subject: =?utf-8?q?=5Bissue42902=5D_a_python_embedded_program=C2=A0may_load_=22C?=
 =?utf-8?q?=3A=5CLib=5Cos=2Epy=22_on_windows_system?=
In-Reply-To: <1610423923.25.0.321902126582.issue42902@roundup.psfhosted.org>
Message-ID: <1610435109.88.0.778439641384.issue42902@roundup.psfhosted.org>


Change by Christian Heimes <lists at cheimes.de>:


----------
nosy: +christian.heimes

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42902>
_______________________________________

From report at bugs.python.org  Tue Jan 12 02:33:58 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 12 Jan 2021 07:33:58 +0000
Subject: [issue42903] optimize lru_cache for functions with no arguments
In-Reply-To: <1610425919.12.0.56212738564.issue42903@roundup.psfhosted.org>
Message-ID: <1610436838.79.0.219929452935.issue42903@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

FYI: The @cache decorator was added as a result of that discussion and the related on python-ideas.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42903>
_______________________________________

From report at bugs.python.org  Tue Jan 12 02:37:11 2021
From: report at bugs.python.org (Sachit Murarka)
Date: Tue, 12 Jan 2021 07:37:11 +0000
Subject: [issue42905] Issue while installing numba
Message-ID: <1610437031.96.0.463158276595.issue42905@roundup.psfhosted.org>


New submission from Sachit Murarka <connectsachit at gmail.com>:

I am having Python 3.8
I am installing fastparquet.

It is giving following error. 

I am doing it in Centos

running build_ext
  building 'numba._dynfunc' extension
  Warning: Can't read registry to find the necessary compiler setting
  Make sure that Python modules winreg, win32api or win32con are installed.
  C compiler: gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -fPIC

  creating build/temp.linux-x86_64-3.8
  creating build/temp.linux-x86_64-3.8/numba
  compile options: '-I/usr/local/include/python3.8 -c'
  gcc: numba/_dynfuncmod.c
  gcc -pthread -shared build/temp.linux-x86_64-3.8/numba/_dynfuncmod.o -o build/lib.linux-x86_64-3.8/numba/_dynfunc.cpython-38-x86_64-linux-gnu.so
  building 'numba._dispatcher' extension
  C compiler: gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -fPI

----------
components: Library (Lib)
messages: 384898
nosy: connectsachit
priority: normal
severity: normal
status: open
title: Issue while installing numba
type: compile error
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42905>
_______________________________________

From report at bugs.python.org  Tue Jan 12 02:37:44 2021
From: report at bugs.python.org (Sachit Murarka)
Date: Tue, 12 Jan 2021 07:37:44 +0000
Subject: [issue42905] Issue while installing numba inside fastparquet
In-Reply-To: <1610437031.96.0.463158276595.issue42905@roundup.psfhosted.org>
Message-ID: <1610437064.37.0.138934703301.issue42905@roundup.psfhosted.org>


Change by Sachit Murarka <connectsachit at gmail.com>:


----------
title: Issue while installing numba -> Issue while installing numba inside fastparquet

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42905>
_______________________________________

From report at bugs.python.org  Tue Jan 12 03:00:33 2021
From: report at bugs.python.org (Xinmeng Xia)
Date: Tue, 12 Jan 2021 08:00:33 +0000
Subject: [issue42889] Incorrect behavior of Python parser after ast node of
 test program being modified
In-Reply-To: <1610351139.91.0.540037450972.issue42889@roundup.psfhosted.org>
Message-ID: <1610438433.18.0.928156683855.issue42889@roundup.psfhosted.org>


Xinmeng Xia <xiaxm at smail.nju.edu.cn> added the comment:

Nice suggestion! I change the argument and I can' find segfault program in transforming ast.Name.  But I do find a segfault program in transforming ast.BinOp!

Seeing the following example, this program will cause a segmentation fault on Python 3.10. No error will be reported during tranforming of node, but Python crashes during compiling the modified AST.

====================================
import ast
class RewriteName(ast.NodeTransformer):
    def visit_BinOp(self, node):
        if node.left.value == 1:
            node.left = node
        return node

code = """
mystr  = 1 + (2+3)
"""

myast = ast.parse(code)

transformer = RewriteName()
newast = transformer.visit(myast)

c = compile(newast,'<test>','exec')
exec(c)
===================================

I really think we should add a checker before compiling modified ast node or cancel the function of compiling AST object. An illegal AST of a program should not throw into "compile" function directly.

----------
type: behavior -> crash

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42889>
_______________________________________

From report at bugs.python.org  Tue Jan 12 03:10:58 2021
From: report at bugs.python.org (Ziqiao Kong)
Date: Tue, 12 Jan 2021 08:10:58 +0000
Subject: [issue42880] ctypes: variadic function call still doesn't work on
 Apple Silicon
In-Reply-To: <1610264518.97.0.0227668442163.issue42880@roundup.psfhosted.org>
Message-ID: <1610439058.87.0.507550145286.issue42880@roundup.psfhosted.org>


Ziqiao Kong <ziqiaokong at gmail.com> added the comment:

Hello, we do a clean reinstallation of Big Sur 11.1. The problem still exists:

with brew-installed python3.9
```
qiling at kamino /tmp % DYLD_PRINT_LIBRARIES=1 python3.9 test_main.py
[...]
dyld: loaded: <52918C9B-7E0B-3852-AB19-F74846BCAAF8> /Users/qiling/brew/Cellar/python at 3.9/3.9.1_6/Frameworks/Python.framework/Versions/3.9/lib/python3.9/lib-dynload/_heapq.cpython-39-darwin.so
dyld: loaded: <A53A85D2-2C36-32E5-A44A-3B7C061CE7BE> /Users/qiling/brew/Cellar/python at 3.9/3.9.1_6/Frameworks/Python.framework/Versions/3.9/lib/python3.9/lib-dynload/_ctypes.cpython-39-darwin.so
dyld: loaded: <EFF19129-E929-3E58-A6C4-16FB9F26120C> /usr/lib/libffi.dylib
dyld: loaded: <656F7BE5-2BA6-3FE9-BD31-77ED659B6194> /Users/qiling/brew/Cellar/python at 3.9/3.9.1_6/Frameworks/Python.framework/Versions/3.9/lib/python3.9/lib-dynload/_struct.cpython-39-darwin.so
dyld: loaded: <C23349E3-BDF1-3964-A151-947F47728CC0> ./main.dylib
50900232
qiling at kamino /tmp % DYLD_PRINT_LIBRARIES=1 python3.9 test_main.py
[...]
dyld: loaded: <52918C9B-7E0B-3852-AB19-F74846BCAAF8> /Users/qiling/brew/Cellar/python at 3.9/3.9.1_6/Frameworks/Python.framework/Versions/3.9/lib/python3.9/lib-dynload/_heapq.cpython-39-darwin.so
dyld: loaded: <A53A85D2-2C36-32E5-A44A-3B7C061CE7BE> /Users/qiling/brew/Cellar/python at 3.9/3.9.1_6/Frameworks/Python.framework/Versions/3.9/lib/python3.9/lib-dynload/_ctypes.cpython-39-darwin.so
dyld: loaded: <EFF19129-E929-3E58-A6C4-16FB9F26120C> /usr/lib/libffi.dylib
dyld: loaded: <656F7BE5-2BA6-3FE9-BD31-77ED659B6194> /Users/qiling/brew/Cellar/python at 3.9/3.9.1_6/Frameworks/Python.framework/Versions/3.9/lib/python3.9/lib-dynload/_struct.cpython-39-darwin.so
dyld: loaded: <C23349E3-BDF1-3964-A151-947F47728CC0> ./main.dylib
86961416
```

even the output differs between different runs...

uname -a

```
Darwin kamino.lan 20.2.0 Darwin Kernel Version 20.2.0: Wed Dec  2 20:40:21 PST 2020; root:xnu-7195.60.75~1/RELEASE_ARM64_T8101 arm64
```

btw, the python 3.10.0a4 built from sources:

```
qiling at kamino cpython-3.10.0a4 % DYLD_PRINT_LIBRARIES=1 ./python.exe test_main.py
dyld: loaded: <483C8366-9BE1-3A03-B41A-4A526F6A6F91> /Users/qiling/cpython-3.10.0a4/./python.exe
[...]
dyld: loaded: <97E08C95-0A13-3030-AC8D-3330CB10AD0B> /Users/qiling/cpython-3.10.0a4/build/lib.macosx-11.1-arm64-3.10/_ctypes.cpython-310-darwin.so
dyld: loaded: <EFF19129-E929-3E58-A6C4-16FB9F26120C> /usr/lib/libffi.dylib
dyld: loaded: <9CA1E334-8C96-362A-B21F-9A2C43ACF58D> /Users/qiling/cpython-3.10.0a4/build/lib.macosx-11.1-arm64-3.10/_struct.cpython-310-darwin.so
dyld: loaded: <AF35C7F2-8D8D-3D1B-A52D-9A37263161BA> ./main.dylib
3
qiling at kamino cpython-3.10.0a4 % DYLD_PRINT_LIBRARIES=1 ./python.exe test_main.py
dyld: loaded: <483C8366-9BE1-3A03-B41A-4A526F6A6F91> /Users/qiling/cpython-3.10.0a4/./python.exe
[...]
dyld: loaded: <97E08C95-0A13-3030-AC8D-3330CB10AD0B> /Users/qiling/cpython-3.10.0a4/build/lib.macosx-11.1-arm64-3.10/_ctypes.cpython-310-darwin.so
dyld: loaded: <EFF19129-E929-3E58-A6C4-16FB9F26120C> /usr/lib/libffi.dylib
dyld: loaded: <9CA1E334-8C96-362A-B21F-9A2C43ACF58D> /Users/qiling/cpython-3.10.0a4/build/lib.macosx-11.1-arm64-3.10/_struct.cpython-310-darwin.so
dyld: loaded: <AF35C7F2-8D8D-3D1B-A52D-9A37263161BA> ./main.dylib
3
qiling at kamino cpython-3.10.0a4 %
```

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42880>
_______________________________________

From report at bugs.python.org  Tue Jan 12 04:00:10 2021
From: report at bugs.python.org (Ronald Oussoren)
Date: Tue, 12 Jan 2021 09:00:10 +0000
Subject: [issue42880] ctypes: variadic function call still doesn't work on
 Apple Silicon
In-Reply-To: <1610264518.97.0.0227668442163.issue42880@roundup.psfhosted.org>
Message-ID: <1610442010.7.0.0974140013118.issue42880@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

AFAIK you should specify the types of the fixed arguments for variadic functions. The ABI for the M1 has a different calling convention of the variadic arguments, the ctypes implementation counts how many variadic arguments there are based on the specified number of fixed arguments.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42880>
_______________________________________

From report at bugs.python.org  Tue Jan 12 04:09:39 2021
From: report at bugs.python.org (Ziqiao Kong)
Date: Tue, 12 Jan 2021 09:09:39 +0000
Subject: [issue42880] ctypes: variadic function call still doesn't work on
 Apple Silicon
In-Reply-To: <1610264518.97.0.0227668442163.issue42880@roundup.psfhosted.org>
Message-ID: <1610442579.73.0.190673316262.issue42880@roundup.psfhosted.org>


Ziqiao Kong <ziqiaokong at gmail.com> added the comment:

I retry my cases with types specified and it works indeed. Maybe the documents should be updated for this case.

Thanks a lot!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42880>
_______________________________________

From report at bugs.python.org  Tue Jan 12 04:26:04 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 12 Jan 2021 09:26:04 +0000
Subject: [issue42899] Regression __bool__ if AttributeError is raised
 (Possible regression introduced by bpo-42615)
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610443564.85.0.86072174638.issue42899@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
title: Possible regression introduced by bpo-42615 -> Regression __bool__ if AttributeError is raised (Possible regression introduced by bpo-42615)

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Tue Jan 12 04:28:20 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 12 Jan 2021 09:28:20 +0000
Subject: [issue42903] optimize lru_cache for functions with no arguments
In-Reply-To: <1610425919.12.0.56212738564.issue42903@roundup.psfhosted.org>
Message-ID: <1610443700.29.0.273382117536.issue42903@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42903>
_______________________________________

From report at bugs.python.org  Tue Jan 12 04:30:16 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 12 Jan 2021 09:30:16 +0000
Subject: [issue42882] Restarting the interpreter causes UB on 3.10.0a4
In-Reply-To: <1610283618.64.0.475556781159.issue42882@roundup.psfhosted.org>
Message-ID: <1610443816.5.0.0745009182624.issue42882@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 44bf57aca627bd11a08b12fe4e4b6a0e1d268862 by Victor Stinner in branch 'master':
bpo-42882: _PyRuntimeState_Init() leaves unicode next_index unchanged (GH-24193)
https://github.com/python/cpython/commit/44bf57aca627bd11a08b12fe4e4b6a0e1d268862


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42882>
_______________________________________

From report at bugs.python.org  Tue Jan 12 04:48:48 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 12 Jan 2021 09:48:48 +0000
Subject: [issue42882] Restarting the interpreter causes UB on 3.10.0a4
In-Reply-To: <1610283618.64.0.475556781159.issue42882@roundup.psfhosted.org>
Message-ID: <1610444928.53.0.243144385718.issue42882@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +23024
pull_request: https://github.com/python/cpython/pull/24198

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42882>
_______________________________________

From report at bugs.python.org  Tue Jan 12 04:49:45 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 12 Jan 2021 09:49:45 +0000
Subject: [issue42882] Restarting the interpreter causes UB on 3.10.0a4
In-Reply-To: <1610283618.64.0.475556781159.issue42882@roundup.psfhosted.org>
Message-ID: <1610444985.54.0.120073501799.issue42882@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Thanks for your bug report, and thanks for testing alpha versions of Python! It's now fixed.

But I didn't feel comfortable without a regression test. So I wrote PR 24198 to add an unit test on _PyUnicode_FromId() with multiple Python initializations.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42882>
_______________________________________

From report at bugs.python.org  Tue Jan 12 04:59:55 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 12 Jan 2021 09:59:55 +0000
Subject: =?utf-8?q?=5Bissue42902=5D_a_python_embedded_program=C2=A0may_load_=22C?=
 =?utf-8?q?=3A=5CLib=5Cos=2Epy=22_on_windows_system?=
In-Reply-To: <1610423923.25.0.321902126582.issue42902@roundup.psfhosted.org>
Message-ID: <1610445595.4.0.0630744780603.issue42902@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The reference documentation for the Python Path Configuration can be found at:
https://docs.python.org/dev/c-api/init_config.html#python-path-configuration

Currently, Py_SetPath(path) indirectly sets the following PyConfig members:

* prefix = ""
* exec_prefix = ""
* module_search_paths = 'path' parameter, string split at DELIM delimiter (";" character on Windows)
* module_search_paths_set = 1

If you want to get the current Python Path Configuration, you can use:
---
import _testinternalcapi
import pprint
pprint.pprint(_testinternalcapi.get_configs())
---

Example with Python 3.10 (extract):
---
{'config': {...
            'argv': ['x.py'],
            ...
            'base_exec_prefix': '/usr/local',
            'base_executable': '/home/vstinner/python/master/python',
            'base_prefix': '/usr/local',
            ...
            'exec_prefix': '/usr/local',
            'executable': '/home/vstinner/python/master/python',
            ...
            'home': None,
            ...
            'module_search_paths': ['/usr/local/lib/python310.zip',
                                    '/home/vstinner/python/master/Lib',
                                    '/home/vstinner/python/master/build/lib.linux-x86_64-3.10-pydebug'],
            'module_search_paths_set': 1,
            ...
            'orig_argv': ['./python', 'x.py'],
            'parse_argv': 2,
            ...
            'pathconfig_warnings': 1,
            'platlibdir': 'lib',
            'prefix': '/usr/local',
            'program_name': './python',
            ...},
 ...,
 'path_config': {'exec_prefix': '/usr/local',
                 'home': None,
                 'module_search_path': '/usr/local/lib/python310.zip:/home/vstinner/python/master/Lib:/home/vstinner/python/master/build/lib.linux-x86_64-3.10-pydebug',
                 'prefix': '/usr/local',
                 'program_full_path': '/home/vstinner/python/master/python',
                 'program_name': './python'},
 ...}
---

See also bpo-42260: "[C API] Add PyInterpreterState_SetConfig(): reconfigure an interpreter" which aims to rewrite the code to configure the Python Path Configuration from C to Python.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42902>
_______________________________________

From report at bugs.python.org  Tue Jan 12 05:00:46 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 12 Jan 2021 10:00:46 +0000
Subject: [issue42899] Regression __bool__ if AttributeError is raised
 (Possible regression introduced by bpo-42615)
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610445646.68.0.591634693473.issue42899@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

I am not sure that it should be fixed.

We already cut corners in similar cases and did this for years, and it always was okay. In the following example bool(a) is only called once:

    if a and b:
        f()

  1           0 LOAD_NAME                0 (a)
              2 POP_JUMP_IF_FALSE       14
              4 LOAD_NAME                1 (b)
              6 POP_JUMP_IF_FALSE       14

  2           8 LOAD_NAME                2 (f)
             10 CALL_FUNCTION            0
             12 POP_TOP
        >>   14 LOAD_CONST               0 (None)
             16 RETURN_VALUE

It differs from the case of using temporary variable (optimization does not work here):

    t = a and b
    if t:
        f()

  1           0 LOAD_NAME                0 (a)
              2 JUMP_IF_FALSE_OR_POP     6
              4 LOAD_NAME                1 (b)
        >>    6 STORE_NAME               2 (t)

  2           8 LOAD_NAME                2 (t)
             10 POP_JUMP_IF_FALSE       18

  3          12 LOAD_NAME                3 (f)
             14 CALL_FUNCTION            0
             16 POP_TOP
        >>   18 LOAD_CONST               0 (None)
             20 RETURN_VALUE

(BTW, Python 3.10 produces less optimal code for that examples)

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Tue Jan 12 05:04:02 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 12 Jan 2021 10:04:02 +0000
Subject: =?utf-8?q?=5Bissue42902=5D_a_python_embedded_program=C2=A0may_load_=22C?=
 =?utf-8?q?=3A=5CLib=5Cos=2Epy=22_on_windows_system?=
In-Reply-To: <1610423923.25.0.321902126582.issue42902@roundup.psfhosted.org>
Message-ID: <1610445842.35.0.626446754432.issue42902@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Python has an unit test on Py_SetPath(): test_embed.test_init_setpath.

> Write following code that only call Py_Initialize(): (...)

Do you mean that on Windows Python looks for modules in C:\Lib\ just by calling Py_Initialize()? 


> According to https://docs.python.org/3/c-api/init.html: "Py_SetPath() set the default module search path.

I don't understand. Do you have your issue with and without calling Py_SetPath()? Can you please provide an example of code reproducing the issue?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42902>
_______________________________________

From report at bugs.python.org  Tue Jan 12 05:05:52 2021
From: report at bugs.python.org (Paul Moore)
Date: Tue, 12 Jan 2021 10:05:52 +0000
Subject: =?utf-8?q?=5Bissue42902=5D_a_python_embedded_program=C2=A0may_load_=22C?=
 =?utf-8?q?=3A=5CLib=5Cos=2Epy=22_on_windows_system?=
In-Reply-To: <1610423923.25.0.321902126582.issue42902@roundup.psfhosted.org>
Message-ID: <1610445952.47.0.354853128506.issue42902@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:

I thought that *all* versions of Python located the standard library by searching for os.py...

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42902>
_______________________________________

From report at bugs.python.org  Tue Jan 12 05:24:58 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 12 Jan 2021 10:24:58 +0000
Subject: =?utf-8?q?=5Bissue42902=5D_a_python_embedded_program=C2=A0may_load_=22C?=
 =?utf-8?q?=3A=5CLib=5Cos=2Epy=22_on_windows_system?=
In-Reply-To: <1610423923.25.0.321902126582.issue42902@roundup.psfhosted.org>
Message-ID: <1610447098.58.0.941152875592.issue42902@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> I thought that *all* versions of Python located the standard library by searching for os.py...

The current implementation of the Python Path Configuration can be found in:

* Windows: PC/getpathp.c
* Unix: Modules/getpath.c

It should be skipped if Py_SetPath() is used, but I recommend to only rely on PyConfig and its documentation:
https://docs.python.org/dev/c-api/init_config.html#python-path-configuration

If the documentation is wrong, it must be fixed ;-)

I still don't understand if the issue involves Py_SetPath() or not.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42902>
_______________________________________

From report at bugs.python.org  Tue Jan 12 05:26:59 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 12 Jan 2021 10:26:59 +0000
Subject: [issue42882] Restarting the interpreter causes UB on 3.10.0a4
In-Reply-To: <1610283618.64.0.475556781159.issue42882@roundup.psfhosted.org>
Message-ID: <1610447219.32.0.948846454939.issue42882@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 11d13e83abedabba12b28773317f1a365113e7af by Victor Stinner in branch 'master':
bpo-42882: Add test_embed.test_unicode_id_init() (GH-24198)
https://github.com/python/cpython/commit/11d13e83abedabba12b28773317f1a365113e7af


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42882>
_______________________________________

From report at bugs.python.org  Tue Jan 12 05:33:20 2021
From: report at bugs.python.org (Steve Stagg)
Date: Tue, 12 Jan 2021 10:33:20 +0000
Subject: [issue42762] infinite loop resulted by "yield"
In-Reply-To: <1609130295.32.0.912620547313.issue42762@roundup.psfhosted.org>
Message-ID: <1610447600.83.0.189518988559.issue42762@roundup.psfhosted.org>


Steve Stagg <stestagg at gmail.com> added the comment:

I don't believe this is a bug.

You've discovered a nasty corner-case, but I think it's expected behaviour.  There is a PEP open to make this behaviour a bit nicer:  https://www.python.org/dev/peps/pep-0533/

The fact that older Python 3.5/6 versions don't get the infinite loop could be considered a bug, but this was fixed a while ago (bpo-25612), and it seems unlikely that this fix would be back-ported.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42762>
_______________________________________

From report at bugs.python.org  Tue Jan 12 05:34:04 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 12 Jan 2021 10:34:04 +0000
Subject: [issue42882] Restarting the interpreter causes UB on 3.10.0a4
In-Reply-To: <1610283618.64.0.475556781159.issue42882@roundup.psfhosted.org>
Message-ID: <1610447644.78.0.0525866105106.issue42882@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Ok, now I can safely close the issue ;-)

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42882>
_______________________________________

From report at bugs.python.org  Tue Jan 12 05:39:43 2021
From: report at bugs.python.org (Stijn van Drongelen)
Date: Tue, 12 Jan 2021 10:39:43 +0000
Subject: [issue42906] python3 -m doctest test.py tests the stdlib "time"
 module instead
Message-ID: <1610447982.97.0.137318779169.issue42906@roundup.psfhosted.org>


New submission from Stijn van Drongelen <stijnvandrongelen at gmail.com>:

I have two files, named time.py and time_.py, with the same contents:

    def foo():
        """Returns 1.

        >>> foo()
        1
        """
        return 1

When I run

    python3 -m doctest -v time_.py

I see the expected behaviour:

    Trying:
        foo()
    Expecting:
        1
    ok
    1 items had no tests:
        time_
    1 items passed all tests:
       1 tests in time_.foo
    1 tests in 2 items.
    1 passed and 0 failed.
    Test passed.

However, when I run

    python3 -m doctest -v time_.py

it seems like doctest is testing the standard library 'time' module, while I expected it to have similar output as seen above:

        30 items had no tests:
        time
        time.asctime
      (... skipped 24 lines for the bug report ...)
        time.time_ns
        time.tzset
    0 tests in 30 items.
    0 passed and 0 failed.
    Test passed.

The same happens when I provide a path with slashes in it.

----------
components: Library (Lib)
messages: 384913
nosy: stijnvandrongelen
priority: normal
severity: normal
status: open
title: python3 -m doctest test.py tests the stdlib "time" module instead
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42906>
_______________________________________

From report at bugs.python.org  Tue Jan 12 05:48:34 2021
From: report at bugs.python.org (Stijn van Drongelen)
Date: Tue, 12 Jan 2021 10:48:34 +0000
Subject: [issue42906] python3 -m doctest test.py tests the stdlib "time"
 module instead
In-Reply-To: <1610447982.97.0.137318779169.issue42906@roundup.psfhosted.org>
Message-ID: <1610448514.57.0.780398251866.issue42906@roundup.psfhosted.org>


Stijn van Drongelen <stijnvandrongelen at gmail.com> added the comment:

Reproducible in Python 3.8.7 and 3.9.1.

----------
versions: +Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42906>
_______________________________________

From report at bugs.python.org  Tue Jan 12 06:12:25 2021
From: report at bugs.python.org (Dimo Yordanov)
Date: Tue, 12 Jan 2021 11:12:25 +0000
Subject: [issue42907] Division betwen float and 100 not giving corect result
Message-ID: <1610449945.05.0.326021023645.issue42907@roundup.psfhosted.org>


New submission from Dimo Yordanov <dimo.yordanov669 at gmail.com>:

To replicate what i think is a bug you need a python interpreter in any version. I think. When i type 2.7/100 it returns 0.027000000000000003, but it actually is 0.027 and 2.8/100 returns 0.027999999999999997. And i don't know why

----------
components: Interpreter Core
messages: 384915
nosy: DimoY
priority: normal
severity: normal
status: open
title: Division betwen float and 100 not giving corect result
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42907>
_______________________________________

From report at bugs.python.org  Tue Jan 12 06:15:30 2021
From: report at bugs.python.org (Dimo Yordanov)
Date: Tue, 12 Jan 2021 11:15:30 +0000
Subject: [issue42907] Division betwen float and 100 not giving corect result
In-Reply-To: <1610449945.05.0.326021023645.issue42907@roundup.psfhosted.org>
Message-ID: <1610450130.77.0.509515110263.issue42907@roundup.psfhosted.org>


Dimo Yordanov <dimo.yordanov669 at gmail.com> added the comment:

And it appears that these are the only numbers (2.8 and 2.7) that behave like this

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42907>
_______________________________________

From report at bugs.python.org  Tue Jan 12 06:18:05 2021
From: report at bugs.python.org (Christian Heimes)
Date: Tue, 12 Jan 2021 11:18:05 +0000
Subject: [issue42907] Division betwen float and 100 not giving corect result
In-Reply-To: <1610449945.05.0.326021023645.issue42907@roundup.psfhosted.org>
Message-ID: <1610450285.12.0.86797184787.issue42907@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

This is the expected behavior for float. Python's floats are IEEE 754 double precision floats, not arbitrary preciscion floats. See https://docs.python.org/3/tutorial/floatingpoint.html

----------
nosy: +christian.heimes
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42907>
_______________________________________

From report at bugs.python.org  Tue Jan 12 06:20:53 2021
From: report at bugs.python.org (Dimo Yordanov)
Date: Tue, 12 Jan 2021 11:20:53 +0000
Subject: [issue42907] Division betwen float and 100 not giving corect result
In-Reply-To: <1610449945.05.0.326021023645.issue42907@roundup.psfhosted.org>
Message-ID: <1610450453.3.0.184486620042.issue42907@roundup.psfhosted.org>


Dimo Yordanov <dimo.yordanov669 at gmail.com> added the comment:

understandable. have a great day

----------
components:  -Interpreter Core
resolution: not a bug -> 
status: closed -> open
versions:  -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42907>
_______________________________________

From report at bugs.python.org  Tue Jan 12 06:22:31 2021
From: report at bugs.python.org (Mark Shannon)
Date: Tue, 12 Jan 2021 11:22:31 +0000
Subject: [issue42899] Is it legal to eliminate tests of a value,
 when that test has no effect on control flow?
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610450551.07.0.179356143953.issue42899@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

The issue here is:

Is it legal to convert
   if x: pass
into
   pass
?

The explicit effect of the code is unchanged, BUT the implicit effect (of calling x.__bool__) is changed.

The examples Serhiy gives are similar. If `bool(a)` evaluates to False, then `bool(a and b)` must be False, so we skip testing `a and b`.
However, we do not know that `bool(a and b)` cannot have a side-effect, so the optimization could be incorrect w.r.t. side effects.

----------
title: Regression __bool__ if AttributeError is raised (Possible regression introduced by bpo-42615) -> Is it legal to eliminate tests of a value, when that test has no effect on control flow?

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Tue Jan 12 06:25:20 2021
From: report at bugs.python.org (Mark Shannon)
Date: Tue, 12 Jan 2021 11:25:20 +0000
Subject: [issue42908] Incorrect line numbers at end of try-except and with
 statements containing if False: pass
Message-ID: <1610450720.62.0.32697426383.issue42908@roundup.psfhosted.org>


New submission from Mark Shannon <mark at hotpy.org>:

The following examples produce incorrect line numbers, due to cleanup code not being marked as artificial

def f():
    try:
        if False:
            pass
    except:
        X
        
def g(a):
    with a:
         if False:
             pass

----------
assignee: Mark.Shannon
messages: 384920
nosy: Mark.Shannon
priority: high
severity: normal
status: open
title: Incorrect line numbers at end of try-except and with statements containing if False: pass

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42908>
_______________________________________

From report at bugs.python.org  Tue Jan 12 06:28:40 2021
From: report at bugs.python.org (Christian Heimes)
Date: Tue, 12 Jan 2021 11:28:40 +0000
Subject: [issue42907] Division betwen float and 100 not giving corect result
In-Reply-To: <1610449945.05.0.326021023645.issue42907@roundup.psfhosted.org>
Message-ID: <1610450920.11.0.558393446431.issue42907@roundup.psfhosted.org>


Change by Christian Heimes <lists at cheimes.de>:


----------
resolution:  -> not a bug
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42907>
_______________________________________

From report at bugs.python.org  Tue Jan 12 06:39:27 2021
From: report at bugs.python.org (Steve Stagg)
Date: Tue, 12 Jan 2021 11:39:27 +0000
Subject: [issue42899] Is it legal to eliminate tests of a value,
 when that test has no effect on control flow?
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610451567.64.0.514419364033.issue42899@roundup.psfhosted.org>


Steve Stagg <stestagg at gmail.com> added the comment:

To be super pedantic, as per my understanding of:

"6.11 ... The expression x and y first evaluates x; if x is false, its value is returned; otherwise, y is evaluated and the resulting value is returned."

The only corner that was previously cut is that in this statement:

if a and b:
    ...


The evalution should be roughly equivalent to:

bool(a) if bool(a) else bool(b) # <- where bool(b) is never called

instead it's more like:

_x if _x := bool(a) else bool(b) # <- where bool(b) is never called

so, the runtime is eliding a repeated call to bool(a).

This obviously causes problems if bool(a) has per-call side-effects, but this seems to me like a reasonable corner to cut.

Totally eliding the if clause feels to me (subjectively) like a much more risky proposition, and perhaps one that should be documented if kept in?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Tue Jan 12 06:41:29 2021
From: report at bugs.python.org (Steve Stagg)
Date: Tue, 12 Jan 2021 11:41:29 +0000
Subject: [issue42899] Is it legal to eliminate tests of a value,
 when that test has no effect on control flow?
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610451689.33.0.942799079057.issue42899@roundup.psfhosted.org>


Steve Stagg <stestagg at gmail.com> added the comment:

I got my and/or logic inverted, but believe the point still stands

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Tue Jan 12 06:59:04 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Tue, 12 Jan 2021 11:59:04 +0000
Subject: [issue42862] Use functools.lru_cache iso. _sqlite.Cache in sqlite3
 module
In-Reply-To: <1610066343.94.0.466682345605.issue42862@roundup.psfhosted.org>
Message-ID: <1610452744.3.0.881560018121.issue42862@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

I can throw up the PoC branch as a draft PR after GH-24135 is merged. We can just close the PR if this is uninteresting or something we want to postpone.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42862>
_______________________________________

From report at bugs.python.org  Tue Jan 12 07:23:48 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 12 Jan 2021 12:23:48 +0000
Subject: [issue42899] Is it legal to eliminate tests of a value,
 when that test has no effect on control flow?
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610454228.78.0.583279629608.issue42899@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Thank you Steve. Yes, this is what I meant. "if a and b" is so common that we sacrifice literal translation for the sake of performance.

"if" with an empty block looks pretty uncommon to me. It is not worth to optimize this case specially (especially if it changes semantic). What are real world examples for which it makes sense to replace POP_JUMP_IF_FALSE with POP_TOP?

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Tue Jan 12 07:33:43 2021
From: report at bugs.python.org (Ken Jin)
Date: Tue, 12 Jan 2021 12:33:43 +0000
Subject: [issue42904] get_type_hints does not provide localns for classes
In-Reply-To: <1610427615.24.0.000795612365541.issue42904@roundup.psfhosted.org>
Message-ID: <1610454823.45.0.697473454912.issue42904@roundup.psfhosted.org>


Ken Jin <kenjin4096 at gmail.com> added the comment:

> Fidget-Spinner, are you interested in taking this?

Sure thing! Please give me some time to look at it - I don't really use the runtime type validation stuff from typing (I usually defer that to 3rd party libraries), so I need to familiarize myself first.

----------
nosy: +kj

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42904>
_______________________________________

From report at bugs.python.org  Tue Jan 12 07:43:49 2021
From: report at bugs.python.org (Berker Peksag)
Date: Tue, 12 Jan 2021 12:43:49 +0000
Subject: [issue42862] Use functools.lru_cache iso. _sqlite.Cache in sqlite3
 module
In-Reply-To: <1610066343.94.0.466682345605.issue42862@roundup.psfhosted.org>
Message-ID: <1610455429.34.0.838145638647.issue42862@roundup.psfhosted.org>


Berker Peksag <berker.peksag at gmail.com> added the comment:

I don't see any reason to merge GH-24135 if we are going to remove cache.[ch] in this issue.

I was -0 before but since Raymond gave his +1, you can count me as +1 too.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42862>
_______________________________________

From report at bugs.python.org  Tue Jan 12 07:51:55 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Tue, 12 Jan 2021 12:51:55 +0000
Subject: [issue42862] Use functools.lru_cache iso. _sqlite.Cache in sqlite3
 module
In-Reply-To: <1610066343.94.0.466682345605.issue42862@roundup.psfhosted.org>
Message-ID: <1610455915.54.0.0644040223266.issue42862@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

> I don't see any reason to merge GH-24135 if we are going to remove cache.[ch] in this issue.

Yes, I've thought about that myself. A small argument pro merging GH-24135 would be that if we for some reason decide to revert this change, then cache.[ch] would still be prepared for module state (which is needed for multi-phase init).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42862>
_______________________________________

From report at bugs.python.org  Tue Jan 12 07:54:24 2021
From: report at bugs.python.org (Berker Peksag)
Date: Tue, 12 Jan 2021 12:54:24 +0000
Subject: [issue42862] Use functools.lru_cache iso. _sqlite.Cache in sqlite3
 module
In-Reply-To: <1610066343.94.0.466682345605.issue42862@roundup.psfhosted.org>
Message-ID: <1610456064.15.0.135310258255.issue42862@roundup.psfhosted.org>


Berker Peksag <berker.peksag at gmail.com> added the comment:

We can always reopen GH-24135 and merge it even if we revert this one for some reason :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42862>
_______________________________________

From report at bugs.python.org  Tue Jan 12 07:56:09 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Tue, 12 Jan 2021 12:56:09 +0000
Subject: [issue42862] Use functools.lru_cache iso. _sqlite.Cache in sqlite3
 module
In-Reply-To: <1610066343.94.0.466682345605.issue42862@roundup.psfhosted.org>
Message-ID: <1610456169.0.0.678322969226.issue42862@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

True that :) I'll close GH-24135 for now and open a PR for this later today.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42862>
_______________________________________

From report at bugs.python.org  Tue Jan 12 08:05:23 2021
From: report at bugs.python.org (Julien Palard)
Date: Tue, 12 Jan 2021 13:05:23 +0000
Subject: [issue41490] Update bundled pip to 20.2.1 and setuptools to 49.2.1
In-Reply-To: <1596662779.45.0.341157838113.issue41490@roundup.psfhosted.org>
Message-ID: <1610456723.09.0.258760302895.issue41490@roundup.psfhosted.org>


Julien Palard <julien+python at palard.fr> added the comment:

Question: Why do we keep setuptools?

According to PEP453:

> Once pip is able to run pip install --upgrade pip without needing setuptools installed first, then the private copy of setuptools will be removed from ensurepip in subsequent CPython releases.

Which looks like to be the fact now:

    $ python3.9 -m venv .venv
    $ source .venv/bin/activate
    $ pip uninstall setuptools
    [...]
    Successfully uninstalled setuptools-49.2.1
    $ pip install --upgrade pip
    [...]
    Successfully installed pip-20.3.3

----------
nosy: +mdk

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41490>
_______________________________________

From report at bugs.python.org  Tue Jan 12 08:13:10 2021
From: report at bugs.python.org (robin)
Date: Tue, 12 Jan 2021 13:13:10 +0000
Subject: [issue42909] Email header with ; ; ; ;
 stuffing takes very long to parse
Message-ID: <1610457190.97.0.487967910026.issue42909@roundup.psfhosted.org>


New submission from robin <robin.eriksson at f-secure.com>:

Attached please find a script which takes on the order of 1 minute to parse even though the embedded message is reasonably trivial.  The main flaw is that the Content-Type: header has a long string of redundant ;;;; which is something some spammers apparently use to bypass some content filters or analyzers.

The script is short enough to inline here for what I hope is convenience for most visitors.


from email import message_from_bytes
#from email.parser import BytesParser
from email.policy import default
##from cProfile import run as cprun

b = (b'''From: me <self at example.com>
To: you <recipient at example.net>
Subject: sample with ;;;;;;;;; stuffing in MIME Content-Type: header
Content-type: text/plain''' + b';' * 54 + b'\n' +
               36 * (b' ' + b';' * 990 + b'\n') + b'''\
Content-transfer-encoding: 7bit
MIME-Version: 1.0

Hello.
''')
## cprun('message_from_bytes(b, policy=default)', sort=1)

m = message_from_bytes(b, policy=default)
#m = BytesParser(policy=default).parsebytes(b)

print(m.as_string())


I have commented out two sets of changes; the ones with a single # demonstrate that the same error happens with BytesParser, and the ones with ## are for profiling the code.

For what it's worth, profiling consistently indicates that it gets stuck in builtins.sum while attempting to parse the message.  Here is a partial cProfile result from Python 3.7.2:

 
         2148205 function calls (2004560 primitive calls) in 34.533 seconds

   Ordered by: internal time

   ncalls  tottime  percall  cumtime  percall filename:lineno(function)
    160/4   32.356    0.202   32.728    8.182 {built-in method builtins.sum}
        4    0.560    0.140    1.661    0.415 _header_value_parser.py:2380(parse_mime_parameters)
   142772    0.230    0.000    0.230    0.000 {method 'format' of 'str' objects}
   142932    0.203    0.000    0.203    0.000 _header_value_parser.py:866(all_defects)
   142772    0.197    0.000    0.288    0.000 errors.py:84(__init__)
143248/24    0.167    0.000   32.727    1.364 _header_value_parser.py:126(<genexpr>)
   142772    0.151    0.000    0.456    0.000 _header_value_parser.py:2126(get_attribute)
   285848    0.146    0.000    0.146    0.000 _header_value_parser.py:109(__init__)
   142772    0.102    0.000    0.631    0.000 _header_value_parser.py:2241(get_parameter)
   142772    0.091    0.000    0.091    0.000 errors.py:36(__init__)
   143076    0.088    0.000    0.153    0.000 _header_value_parser.py:854(__new__)
   143080    0.065    0.000    0.065    0.000 {built-in method __new__ of type object at 0x101c20640}
       12    0.044    0.004    0.086    0.007 _header_value_parser.py:716(params)
   285839    0.042    0.000    0.042    0.000 {method 'endswith' of 'str' objects}
        3    0.030    0.010   27.512    9.171 message.py:588(get_content_maintype)
   286482    0.029    0.000    0.029    0.000 {method 'append' of 'list' objects}
        2    0.014    0.007    0.014    0.007 <frozen importlib._bootstrap_external>:914(get_data)
        6    0.008    0.001   25.369    4.228 feedparser.py:218(_parsegen)
        4    0.001    0.000    0.001    0.000 {method 'split' of 're.Pattern' objects}
    160/4    0.001    0.000   32.728    8.182 _header_value_parser.py:124(all_defects)
      288    0.001    0.000    0.002    0.000 _header_value_parser.py:1000(get_fws)
      288    0.001    0.000    0.003    0.000 _header_value_parser.py:1217(get_cfws)



Starting the code and doing a KeyboardInterrupt after a few, or many, seconds tends to get a traceback like this, which also points to roughly the same culprit:


^CTraceback (most recent call last):
  File "repro.py", line 18, in <module>
    m = message_from_bytes(b, policy=default)
  File "/Users/eriker/.pyenv/versions/3.7.2/lib/python3.7/email/__init__.py", line 46, in message_from_bytes
    return BytesParser(*args, **kws).parsebytes(s)
  File "/Users/eriker/.pyenv/versions/3.7.2/lib/python3.7/email/parser.py", line 124, in parsebytes
    return self.parser.parsestr(text, headersonly)
  File "/Users/eriker/.pyenv/versions/3.7.2/lib/python3.7/email/parser.py", line 68, in parsestr
    return self.parse(StringIO(text), headersonly=headersonly)
  File "/Users/eriker/.pyenv/versions/3.7.2/lib/python3.7/email/parser.py", line 57, in parse
    feedparser.feed(data)
  File "/Users/eriker/.pyenv/versions/3.7.2/lib/python3.7/email/feedparser.py", line 176, in feed
    self._call_parse()
  File "/Users/eriker/.pyenv/versions/3.7.2/lib/python3.7/email/feedparser.py", line 180, in _call_parse
    self._parse()
  File "/Users/eriker/.pyenv/versions/3.7.2/lib/python3.7/email/feedparser.py", line 256, in _parsegen
    if self._cur.get_content_type() == 'message/delivery-status':
  File "/Users/eriker/.pyenv/versions/3.7.2/lib/python3.7/email/message.py", line 578, in get_content_type
    value = self.get('content-type', missing)
  File "/Users/eriker/.pyenv/versions/3.7.2/lib/python3.7/email/message.py", line 471, in get
    return self.policy.header_fetch_parse(k, v)
  File "/Users/eriker/.pyenv/versions/3.7.2/lib/python3.7/email/policy.py", line 162, in header_fetch_parse
    return self.header_factory(name, value)
  File "/Users/eriker/.pyenv/versions/3.7.2/lib/python3.7/email/headerregistry.py", line 589, in __call__
    return self[name](name, value)
  File "/Users/eriker/.pyenv/versions/3.7.2/lib/python3.7/email/headerregistry.py", line 197, in __new__
    cls.parse(value, kwds)
  File "/Users/eriker/.pyenv/versions/3.7.2/lib/python3.7/email/headerregistry.py", line 448, in parse
    kwds['defects'].extend(parse_tree.all_defects)
  File "/Users/eriker/.pyenv/versions/3.7.2/lib/python3.7/email/_header_value_parser.py", line 126, in all_defects
    return sum((x.all_defects for x in self), self.defects)
  File "/Users/eriker/.pyenv/versions/3.7.2/lib/python3.7/email/_header_value_parser.py", line 126, in <genexpr>
    return sum((x.all_defects for x in self), self.defects)
  File "/Users/eriker/.pyenv/versions/3.7.2/lib/python3.7/email/_header_value_parser.py", line 126, in all_defects
    return sum((x.all_defects for x in self), self.defects)
  File "/Users/eriker/.pyenv/versions/3.7.2/lib/python3.7/email/_header_value_parser.py", line 126, in <genexpr>
    return sum((x.all_defects for x in self), self.defects)
KeyboardInterrupt


I have been able to repro on Python 3.9 and 3.10rc as well by way of the official Docker images rc-buster and 3.9-slim.

----------
components: email
files: repro.py
messages: 384931
nosy: barry, eriker, r.david.murray
priority: normal
severity: normal
status: open
title: Email header with ;;;; stuffing takes very long to parse
type: resource usage
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9
Added file: https://bugs.python.org/file49736/repro.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42909>
_______________________________________

From report at bugs.python.org  Tue Jan 12 08:16:18 2021
From: report at bugs.python.org (Steve Stagg)
Date: Tue, 12 Jan 2021 13:16:18 +0000
Subject: [issue42905] Issue while installing numba inside fastparquet
In-Reply-To: <1610437031.96.0.463158276595.issue42905@roundup.psfhosted.org>
Message-ID: <1610457378.57.0.962968650927.issue42905@roundup.psfhosted.org>


Steve Stagg <stestagg at gmail.com> added the comment:

Hi Sachit

I see you raised this issue with the numba library here:
https://github.com/numba/numba/issues/6630

I would recommend sticking with the numba issue unless they can confirm there is an issue with core python

----------
nosy: +stestagg

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42905>
_______________________________________

From report at bugs.python.org  Tue Jan 12 08:17:28 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 12 Jan 2021 13:17:28 +0000
Subject: [issue42905] Issue while installing numba inside fastparquet
In-Reply-To: <1610437031.96.0.463158276595.issue42905@roundup.psfhosted.org>
Message-ID: <1610457448.06.0.9380177189.issue42905@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Neither numba nor fastparquet are parts of the standard Python library. Please use corresponding bug trackers.

----------
nosy: +serhiy.storchaka
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42905>
_______________________________________

From report at bugs.python.org  Tue Jan 12 08:27:23 2021
From: report at bugs.python.org (Ronald Oussoren)
Date: Tue, 12 Jan 2021 13:27:23 +0000
Subject: [issue42880] ctypes: variadic function call still doesn't work on
 Apple Silicon
In-Reply-To: <1610264518.97.0.0227668442163.issue42880@roundup.psfhosted.org>
Message-ID: <1610458043.01.0.317339135476.issue42880@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

I agree that this should be mentioned in the documentation for ctypes.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42880>
_______________________________________

From report at bugs.python.org  Tue Jan 12 08:27:45 2021
From: report at bugs.python.org (Ronald Oussoren)
Date: Tue, 12 Jan 2021 13:27:45 +0000
Subject: [issue42880] ctypes: variadic function call still doesn't work on
 Apple Silicon
In-Reply-To: <1610264518.97.0.0227668442163.issue42880@roundup.psfhosted.org>
Message-ID: <1610458065.58.0.350753582103.issue42880@roundup.psfhosted.org>


Change by Ronald Oussoren <ronaldoussoren at mac.com>:


----------
assignee:  -> docs at python
components: +Documentation
nosy: +docs at python

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42880>
_______________________________________

From report at bugs.python.org  Tue Jan 12 08:32:42 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 12 Jan 2021 13:32:42 +0000
Subject: [issue42862] Use functools.lru_cache iso. _sqlite.Cache in sqlite3
 module
In-Reply-To: <1610066343.94.0.466682345605.issue42862@roundup.psfhosted.org>
Message-ID: <1610458362.99.0.022718698874.issue42862@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

I do not like using _functools._lru_cache_wrapper. It is a deep implementation detail, private function of private module. Use functools.lru_cache. If it is few nanoseconds slower, that cost is only added at connection creation time. It is insignificant in any real application in comparison with IO and any real work with data. Thousands of short-living in-memory DB instances are only created in tests.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42862>
_______________________________________

From report at bugs.python.org  Tue Jan 12 08:38:20 2021
From: report at bugs.python.org (robin)
Date: Tue, 12 Jan 2021 13:38:20 +0000
Subject: [issue25235] EmailMessage.add_attachment() creates parts with
 spurious MIME-Version header.
In-Reply-To: <1443210448.87.0.407287169878.issue25235@psf.upfronthosting.co.za>
Message-ID: <1610458700.75.0.281680074165.issue25235@roundup.psfhosted.org>


robin <robin.eriksson at f-secure.com> added the comment:

Duplicate of https://bugs.python.org/issue11021 but this one is more current and has a patch.

----------
nosy: +eriker

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue25235>
_______________________________________

From report at bugs.python.org  Tue Jan 12 08:39:17 2021
From: report at bugs.python.org (robin)
Date: Tue, 12 Jan 2021 13:39:17 +0000
Subject: [issue11021] email MIME-Version headers for each part in multipart
 message
In-Reply-To: <1296085645.01.0.978524639714.issue11021@psf.upfronthosting.co.za>
Message-ID: <1610458757.18.0.0921776793756.issue11021@roundup.psfhosted.org>


robin <robin.eriksson at f-secure.com> added the comment:

Propose to close as duplicate of https://bugs.python.org/issue25235

----------
nosy: +eriker

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue11021>
_______________________________________

From report at bugs.python.org  Tue Jan 12 08:58:13 2021
From: report at bugs.python.org (robin)
Date: Tue, 12 Jan 2021 13:58:13 +0000
Subject: [issue42909] Email header with ; ; ; ;
 stuffing takes very long to parse
In-Reply-To: <1610457190.97.0.487967910026.issue42909@roundup.psfhosted.org>
Message-ID: <1610459893.95.0.812744184793.issue42909@roundup.psfhosted.org>


robin <robin.eriksson at f-secure.com> added the comment:

python -mtrace -t repro.py reveals a long string of these:


 --- modulename: errors, funcname: __init__
errors.py(85):         super().__init__(*args, **kw)
 --- modulename: errors, funcname: __init__
errors.py(37):         if line is not None:
errors.py(38):             super().__init__(line)
errors.py(39):         self.line = line
_header_value_parser.py(2417):         if value and value[0] != ';':
_header_value_parser.py(2426):         if value:
_header_value_parser.py(2428):             mime_parameters.append(ValueTerminal(';', 'parameter-separator'))
 --- modulename: _header_value_parser, funcname: __new__
_header_value_parser.py(855):         self = super().__new__(cls, value)
_header_value_parser.py(856):         self.token_type = token_type
_header_value_parser.py(857):         self.defects = []
_header_value_parser.py(858):         return self
_header_value_parser.py(2429):             value = value[1:]
_header_value_parser.py(2394):     while value:
_header_value_parser.py(2395):         try:
_header_value_parser.py(2396):             token, value = get_parameter(value)
 --- modulename: _header_value_parser, funcname: get_parameter
_header_value_parser.py(2252):     param = Parameter()
 --- modulename: _header_value_parser, funcname: __init__
_header_value_parser.py(110):         super().__init__(*args, **kw)
_header_value_parser.py(111):         self.defects = []
_header_value_parser.py(2253):     token, value = get_attribute(value)
 --- modulename: _header_value_parser, funcname: get_attribute
_header_value_parser.py(2135):     attribute = Attribute()
 --- modulename: _header_value_parser, funcname: __init__
_header_value_parser.py(110):         super().__init__(*args, **kw)
_header_value_parser.py(111):         self.defects = []
_header_value_parser.py(2136):     if value and value[0] in CFWS_LEADER:
_header_value_parser.py(2139):     if value and value[0] in ATTRIBUTE_ENDS:
_header_value_parser.py(2140):         raise errors.HeaderParseError(
_header_value_parser.py(2141):             "expected token but found '{}'".format(value))
_header_value_parser.py(2398):         except errors.HeaderParseError as err:
_header_value_parser.py(2399):             leader = None
_header_value_parser.py(2400):             if value[0] in CFWS_LEADER:
_header_value_parser.py(2402):             if not value:
_header_value_parser.py(2405):             if value[0] == ';':
_header_value_parser.py(2406):                 if leader is not None:
_header_value_parser.py(2408):                 mime_parameters.defects.append(errors.InvalidHeaderDefect(
_header_value_parser.py(2409):                     "parameter entry with no content"))


... which would make sense as such, except at the end, the list of defects is empty.  And, of course, it should not take so long.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42909>
_______________________________________

From report at bugs.python.org  Tue Jan 12 09:02:14 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Tue, 12 Jan 2021 14:02:14 +0000
Subject: [issue42843] What min_sphinx for Python 3.10
In-Reply-To: <1609951966.97.0.867485424131.issue42843@roundup.psfhosted.org>
Message-ID: <1610460134.95.0.0272718065994.issue42843@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na at python.org>:


----------
nosy: +corona10, vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42843>
_______________________________________

From report at bugs.python.org  Tue Jan 12 09:05:00 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Tue, 12 Jan 2021 14:05:00 +0000
Subject: [issue28937] str.split(): allow removing empty strings (when sep is
 not None)
In-Reply-To: <1481469102.15.0.255147638686.issue28937@psf.upfronthosting.co.za>
Message-ID: <1610460300.52.0.0846285679213.issue28937@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na at python.org>:


----------
nosy: +corona10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28937>
_______________________________________

From report at bugs.python.org  Tue Jan 12 09:18:13 2021
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 12 Jan 2021 14:18:13 +0000
Subject: [issue25077] Compiler warnings: initialization from incompatible
 pointer type
In-Reply-To: <1442042610.13.0.957335882034.issue25077@psf.upfronthosting.co.za>
Message-ID: <1610461093.4.0.43522942121.issue25077@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Issues 22038 and 23085 seem to have fixed all these warnings between them.

----------
nosy: +iritkatriel
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue25077>
_______________________________________

From report at bugs.python.org  Tue Jan 12 09:34:24 2021
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 12 Jan 2021 14:34:24 +0000
Subject: [issue16615] gcc 4.7 unused-but-set warnings
In-Reply-To: <1354715109.8.0.920033612812.issue16615@psf.upfronthosting.co.za>
Message-ID: <1610462064.96.0.24809559391.issue16615@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Is this about the pre-version 3.3 warnings? If so it can be closed.

----------
nosy: +iritkatriel
status: open -> pending

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue16615>
_______________________________________

From report at bugs.python.org  Tue Jan 12 09:36:34 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 12 Jan 2021 14:36:34 +0000
Subject: [issue16615] gcc 4.7 unused-but-set warnings
In-Reply-To: <1354715109.8.0.920033612812.issue16615@psf.upfronthosting.co.za>
Message-ID: <1610462194.49.0.431247753212.issue16615@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

We are now dealing with GCC 11 warnings, I close this issue. Moreover, the GCC warnings are not mentioned.

----------
nosy: +vstinner
resolution:  -> out of date
stage:  -> resolved
status: pending -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue16615>
_______________________________________

From report at bugs.python.org  Tue Jan 12 09:37:24 2021
From: report at bugs.python.org (Mark Shannon)
Date: Tue, 12 Jan 2021 14:37:24 +0000
Subject: [issue42899] Is it legal to eliminate tests of a value,
 when that test has no effect on control flow?
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610462244.65.0.996212865169.issue42899@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

The question still stands.

Is converting `if x: pass` to `pass` legal?

And, if it is not, is converting 

if a and b:
    body

to

if a:
    if b:
        body

a legal transformation?
(ignoring line numbers)


If the first transformation is not allowed but the second is, why?


B.T.W it is trivial to change the behavior, once we've decided what's correct.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Tue Jan 12 09:43:43 2021
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 12 Jan 2021 14:43:43 +0000
Subject: [issue41994] Refcount issues in import
In-Reply-To: <1602328488.44.0.393274794411.issue41994@roundup.psfhosted.org>
Message-ID: <1610462623.93.0.657772578991.issue41994@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:


New changeset 4db8988420e0a122d617df741381b0c385af032c by Serhiy Storchaka in branch 'master':
bpo-41994: Fix refcount issues in Python/import.c (GH-22632)
https://github.com/python/cpython/commit/4db8988420e0a122d617df741381b0c385af032c


----------
nosy: +petr.viktorin

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41994>
_______________________________________

From report at bugs.python.org  Tue Jan 12 09:43:59 2021
From: report at bugs.python.org (Casuall)
Date: Tue, 12 Jan 2021 14:43:59 +0000
Subject: [issue42910] Wrong code appears in the type alias introduction
Message-ID: <1610462639.95.0.034878546746.issue42910@roundup.psfhosted.org>


New submission from Casuall <Smile_zjk at qq.com>:

I learned about type aliases on the page?https://docs.python.org/3/library/typing.html?, and I found that following the code (Vector = list[float])in the tutorial, an error occurred (NameError: name 'typing' is not defined) when running.

The following code has the same problem?
  ConnectionOptions = dict[str, str]
  Address = tuple[str, int]
  Server = tuple[Address, ConnectionOptions]

I searched through google and found the correct code?
  from typing import List
  Vector = List[float]

  from typing import Dict, Tuple, Sequence
 
  ConnectionOptions = Dict[str, str]
  Address = Tuple[str, int]
  Server = Tuple[Address, ConnectionOptions]

----------
assignee: docs at python
components: Documentation
messages: 384944
nosy: Smile-zjk, docs at python
priority: normal
severity: normal
status: open
title: Wrong code appears in the type alias introduction

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42910>
_______________________________________

From report at bugs.python.org  Tue Jan 12 09:45:12 2021
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 12 Jan 2021 14:45:12 +0000
Subject: [issue40052] Incorrect pointer alignment in _PyVectorcall_Function()
 of cpython/abstract.h
In-Reply-To: <1585033092.63.0.928625583781.issue40052@roundup.psfhosted.org>
Message-ID: <1610462712.52.0.101214420608.issue40052@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:


New changeset 187f76def8a5bd0af7ab512575cad30cfe624b05 by Petr Viktorin in branch '3.8':
[3.8] bpo-40052: Fix alignment issue in PyVectorcall_Function() (GH-23999) (GH-24120)
https://github.com/python/cpython/commit/187f76def8a5bd0af7ab512575cad30cfe624b05


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40052>
_______________________________________

From report at bugs.python.org  Tue Jan 12 09:46:05 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 12 Jan 2021 14:46:05 +0000
Subject: [issue42899] Is it legal to eliminate tests of a value,
 when that test has no effect on control flow?
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610462765.8.0.580071703388.issue42899@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

For the latter, it was decided that it is legal a long time ago. It has a benefit and we did not have any complains for all these years. The absent of this optimization would encourage writing less readable code for performance.

For the former, what is the benefit?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Tue Jan 12 09:47:15 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 12 Jan 2021 14:47:15 +0000
Subject: [issue41994] Refcount issues in import
In-Reply-To: <1602328488.44.0.393274794411.issue41994@roundup.psfhosted.org>
Message-ID: <1610462835.74.0.387047951859.issue41994@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Thank you Petr!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41994>
_______________________________________

From report at bugs.python.org  Tue Jan 12 09:50:48 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 12 Jan 2021 14:50:48 +0000
Subject: [issue42910] Wrong code appears in the type alias introduction
In-Reply-To: <1610462639.95.0.034878546746.issue42910@roundup.psfhosted.org>
Message-ID: <1610463048.37.0.271519991214.issue42910@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

What version of Python did you use? This is a documentation for Python 3.9.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42910>
_______________________________________

From report at bugs.python.org  Tue Jan 12 09:52:20 2021
From: report at bugs.python.org (Jurjen N.E. Bos)
Date: Tue, 12 Jan 2021 14:52:20 +0000
Subject: [issue42911] Addition chains for pow saves 10 % time!
Message-ID: <1610463140.75.0.177431925065.issue42911@roundup.psfhosted.org>


New submission from Jurjen N.E. Bos <jneb at users.sourceforge.net>:

When looking at the code of pow() with integer exponent, I noticed there is a hard boundary between the binary and "fiveary" (actually 32-ary) computations. Also, the fiveary wasn't really optimal.

So I wrote a proof of concept version of long_pow that dynamically uses addition chains!
It does save over 10 % of multiplications for exponents from 20 to a few hundred bits, and then the saving go down to a few percent for very long numbers. It does not take much more memory nor time for any argument combination I checked.
I tested it on 3.8rc1, but I am planning to port it to 3.10. This is a bit difficult, since *lots* of code around it changed, and I only have Windows 7. However, I'll keep you posted.
See https://github.com/jneb/cpython/tree/38_fast_pow

----------
components: Interpreter Core
files: longobject.c
messages: 384949
nosy: jneb
priority: normal
severity: normal
status: open
title: Addition chains for pow saves 10 % time!
type: performance
versions: Python 3.10
Added file: https://bugs.python.org/file49737/longobject.c

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42911>
_______________________________________

From report at bugs.python.org  Tue Jan 12 09:57:01 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 12 Jan 2021 14:57:01 +0000
Subject: [issue42843] What min_sphinx for Python 3.10
In-Reply-To: <1609951966.97.0.867485424131.issue42843@roundup.psfhosted.org>
Message-ID: <1610463421.15.0.2674153441.issue42843@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> Some distribs may want/need to ship Python 3.10 along with Sphinx 2?

In my experience, Linux distributions prefer to only ship a single Sphinx version. The question is more which Linux distributions are stuck at Sphinx 2 only?

If there is a short list of Linux distributions which cannot use Sphinx 3, even just to build the Python documentation, would it be acceptable for them to stop shipping the Python documentation?

In Fedora, the Python documentation is a separated package. For example, it allows us to upgrade Python while Fedora Rawhide was upgrade to Sphinx 3 but the Python documentation was not compatible with Sphinx 3 (fixed in bpo-40204).

If you ask *me*: I mostly care about Fedora which already uses Sphinx 3.2, so I'm fine with requiring Sphinx 3.2 (the Python documentation is *not* compatible with Sphinx 3.0 and 3.1: see bpo-40204).

If the minimum required Sphinx version changes, please document it properly at:
https://docs.python.org/dev/whatsnew/3.10.html#build-changes

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42843>
_______________________________________

From report at bugs.python.org  Tue Jan 12 10:04:45 2021
From: report at bugs.python.org (Paul Ganssle)
Date: Tue, 12 Jan 2021 15:04:45 +0000
Subject: [issue42874] running configure on Solaris 10 gives grep "illegal
 option" errors
In-Reply-To: <1610194453.5.0.66216438534.issue42874@roundup.psfhosted.org>
Message-ID: <1610463885.68.0.182183498364.issue42874@roundup.psfhosted.org>


Change by Paul Ganssle <p.ganssle at gmail.com>:


----------
keywords: +patch
pull_requests: +23025
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24200

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42874>
_______________________________________

From report at bugs.python.org  Tue Jan 12 10:11:12 2021
From: report at bugs.python.org (Paul Ganssle)
Date: Tue, 12 Jan 2021 15:11:12 +0000
Subject: [issue42874] running configure on Solaris 10 gives grep "illegal
 option" errors
In-Reply-To: <1610194453.5.0.66216438534.issue42874@roundup.psfhosted.org>
Message-ID: <1610464272.48.0.572439780461.issue42874@roundup.psfhosted.org>


Paul Ganssle <p.ganssle at gmail.com> added the comment:

This particular grep statement is used to validate the `tzpath` variable. Apparently it is easy enough to achieve what I was going for using vanilla grep with no options, so I've created GH-24200 to fix the issue.

I notice that there are other uses of `-q` and `-E` in the configure file, but presumably those are on more optional paths.

@martin.wheatley.home: Can you check to see if GH-24200 fixes your issue?

Also, can you clarify whether this happens with a plain `./configure` invocation, or are you specifying `./configure --with-tzpath='/usr/share/zoneinfo:/usr/lib/zoneinfo:/usr/share/lib/zoneinfo:/etc/zoneinfo'` yourself?

----------
versions: +Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42874>
_______________________________________

From report at bugs.python.org  Tue Jan 12 10:22:13 2021
From: report at bugs.python.org (Ken Jin)
Date: Tue, 12 Jan 2021 15:22:13 +0000
Subject: [issue42904] get_type_hints does not provide localns for classes
In-Reply-To: <1610427615.24.0.000795612365541.issue42904@roundup.psfhosted.org>
Message-ID: <1610464933.08.0.895936936081.issue42904@roundup.psfhosted.org>


Change by Ken Jin <kenjin4096 at gmail.com>:


----------
keywords: +patch
pull_requests: +23026
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24201

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42904>
_______________________________________

From report at bugs.python.org  Tue Jan 12 10:28:29 2021
From: report at bugs.python.org (Eugene Toder)
Date: Tue, 12 Jan 2021 15:28:29 +0000
Subject: [issue42903] optimize lru_cache for functions with no arguments
In-Reply-To: <1610425919.12.0.56212738564.issue42903@roundup.psfhosted.org>
Message-ID: <1610465309.07.0.430706414469.issue42903@roundup.psfhosted.org>


Eugene Toder <eltoder at gmail.com> added the comment:

@cache does not address the problem or any of the concerns brought up in the thread. Thread-safe @once is a nice idea, but more work of course.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42903>
_______________________________________

From report at bugs.python.org  Tue Jan 12 10:28:54 2021
From: report at bugs.python.org (Martin Wheatley)
Date: Tue, 12 Jan 2021 15:28:54 +0000
Subject: [issue42874] running configure on Solaris 10 gives grep "illegal
 option" errors
In-Reply-To: <1610464272.48.0.572439780461.issue42874@roundup.psfhosted.org>
Message-ID: <CAMRFudy2bCR1zOaW_-dmpfym=OEuX3LQEjWn_XcK6FG9c3=9FA@mail.gmail.com>


Martin Wheatley <martin.wheatley.home at gmail.com> added the comment:

I'll do the test

it happens with a plain ./configure

Many thanks
Martin

On Tue, 12 Jan 2021 at 15:11, Paul Ganssle <report at bugs.python.org> wrote:

>
> Paul Ganssle <p.ganssle at gmail.com> added the comment:
>
> This particular grep statement is used to validate the `tzpath` variable.
> Apparently it is easy enough to achieve what I was going for using vanilla
> grep with no options, so I've created GH-24200 to fix the issue.
>
> I notice that there are other uses of `-q` and `-E` in the configure file,
> but presumably those are on more optional paths.
>
> @martin.wheatley.home: Can you check to see if GH-24200 fixes your issue?
>
> Also, can you clarify whether this happens with a plain `./configure`
> invocation, or are you specifying `./configure
> --with-tzpath='/usr/share/zoneinfo:/usr/lib/zoneinfo:/usr/share/lib/zoneinfo:/etc/zoneinfo'`
> yourself?
>
> ----------
> versions: +Python 3.10
>
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue42874>
> _______________________________________
>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42874>
_______________________________________

From report at bugs.python.org  Tue Jan 12 10:30:32 2021
From: report at bugs.python.org (Casuall)
Date: Tue, 12 Jan 2021 15:30:32 +0000
Subject: [issue42910] Wrong code appears in the type alias introduction
In-Reply-To: <1610463048.37.0.271519991214.issue42910@roundup.psfhosted.org>
Message-ID: <tencent_8B29109D5104E5663F802E266B3EE6088705@qq.com>


Casuall <Smile_zjk at qq.com> added the comment:

I am using python3.8, it turned out to be a version issue, sorry

------------------&nbsp;????&nbsp;------------------
???:                                                                                                                        "Python tracker"                                                                                    <report at bugs.python.org&gt;;
????:&nbsp;2021?1?12?(???) ??10:50
???:&nbsp;"????"<Smile_zjk at qq.com&gt;;

??:&nbsp;[issue42910] Wrong code appears in the type alias introduction

Serhiy Storchaka <storchaka+cpython at gmail.com&gt; added the comment:

What version of Python did you use? This is a documentation for Python 3.9.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org&gt;
<https://bugs.python.org/issue42910&gt;
_______________________________________

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42910>
_______________________________________

From report at bugs.python.org  Tue Jan 12 10:31:38 2021
From: report at bugs.python.org (Martin Wheatley)
Date: Tue, 12 Jan 2021 15:31:38 +0000
Subject: [issue42874] running configure on Solaris 10 gives grep "illegal
 option" errors
In-Reply-To: <1610464272.48.0.572439780461.issue42874@roundup.psfhosted.org>
Message-ID: <CAMRFudw9d-dj-zCeEZLZ-bf+tcNsuOkRGtPFgmTPDZABTxssGw@mail.gmail.com>


Martin Wheatley <martin.wheatley.home at gmail.com> added the comment:

I'll do the test

it happens with a plain ./configure

Many thanks
Martin

On Tue, 12 Jan 2021 at 15:11, Paul Ganssle <report at bugs.python.org> wrote:

>
> Paul Ganssle <p.ganssle at gmail.com> added the comment:
>
> This particular grep statement is used to validate the `tzpath` variable.
> Apparently it is easy enough to achieve what I was going for using vanilla
> grep with no options, so I've created GH-24200 to fix the issue.
>
> I notice that there are other uses of `-q` and `-E` in the configure file,
> but presumably those are on more optional paths.
>
> @martin.wheatley.home: Can you check to see if GH-24200 fixes your issue?
>
> Also, can you clarify whether this happens with a plain `./configure`
> invocation, or are you specifying `./configure
> --with-tzpath='/usr/share/zoneinfo:/usr/lib/zoneinfo:/usr/share/lib/zoneinfo:/etc/zoneinfo'`
> yourself?
>
> ----------
> versions: +Python 3.10
>
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue42874>
> _______________________________________
>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42874>
_______________________________________

From report at bugs.python.org  Tue Jan 12 10:32:53 2021
From: report at bugs.python.org (Casuall)
Date: Tue, 12 Jan 2021 15:32:53 +0000
Subject: [issue42910] Wrong code appears in the type alias introduction
In-Reply-To: <1610462639.95.0.034878546746.issue42910@roundup.psfhosted.org>
Message-ID: <1610465573.09.0.239046110027.issue42910@roundup.psfhosted.org>


Change by Casuall <Smile_zjk at qq.com>:


----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42910>
_______________________________________

From report at bugs.python.org  Tue Jan 12 10:33:52 2021
From: report at bugs.python.org (Mark Shannon)
Date: Tue, 12 Jan 2021 15:33:52 +0000
Subject: [issue42908] Incorrect line numbers at end of try-except and with
 statements containing if False: pass
In-Reply-To: <1610450720.62.0.32697426383.issue42908@roundup.psfhosted.org>
Message-ID: <1610465632.18.0.180749018285.issue42908@roundup.psfhosted.org>


Change by Mark Shannon <mark at hotpy.org>:


----------
keywords: +patch
pull_requests: +23027
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24202

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42908>
_______________________________________

From report at bugs.python.org  Tue Jan 12 10:43:40 2021
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 12 Jan 2021 15:43:40 +0000
Subject: [issue24650] Error in yield expression documentation
In-Reply-To: <1437116019.06.0.685229534138.issue24650@psf.upfronthosting.co.za>
Message-ID: <1610466220.19.0.0807373655337.issue24650@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
keywords: +easy
versions: +Python 3.10 -Python 3.3, Python 3.4, Python 3.5, Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24650>
_______________________________________

From report at bugs.python.org  Tue Jan 12 10:47:39 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 12 Jan 2021 15:47:39 +0000
Subject: [issue42899] Is it legal to eliminate tests of a value,
 when that test has no effect on control flow?
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610466459.51.0.135663607558.issue42899@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Can we translate 'if x: pass' into 'pass'? No, because calling its __bool__ method may have a side effect (as we saw at the start of this thread).

Can we eliminate a lone 'x'? Only if it's a local variable and we're *sure* (because of control flow analysis) that it's got a value. For globals and class variables we must execute the load because there could always be an exception (or the dict could have a trap for lookups).

Can we eliminate e.g. 'x.y'? Never, because it can have a side effect.

In general, eliminating this kind of thing seems silly -- in code that the user intends to be fast such things don't occur, and in test the user probably has a reason to write odd code.


On the other question, I don't see how there's any possible difference in evaluation and side effects between

if a and b: ...

and

if a:
    if b:
        ...

so I have no problem with that (in fact that is what it *means*).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Tue Jan 12 10:50:54 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 12 Jan 2021 15:50:54 +0000
Subject: [issue42911] Addition chains for pow saves 10 % time!
In-Reply-To: <1610463140.75.0.177431925065.issue42911@roundup.psfhosted.org>
Message-ID: <1610466654.32.0.299991345602.issue42911@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
nosy: +mark.dickinson, tim.peters

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42911>
_______________________________________

From report at bugs.python.org  Tue Jan 12 10:54:01 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 12 Jan 2021 15:54:01 +0000
Subject: [issue42889] Incorrect behavior of Python parser after ast node of
 test program being modified
In-Reply-To: <1610351139.91.0.540037450972.issue42889@roundup.psfhosted.org>
Message-ID: <1610466841.49.0.723713631046.issue42889@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Yeah, there's supposed to be a checker.

----------
nosy: +lys.nikolaou, serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42889>
_______________________________________

From report at bugs.python.org  Tue Jan 12 11:02:15 2021
From: report at bugs.python.org (Mark Shannon)
Date: Tue, 12 Jan 2021 16:02:15 +0000
Subject: [issue42899] Is it legal to eliminate tests of a value,
 when that test has no effect on control flow?
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610467335.76.0.512387606053.issue42899@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

They aren't quite the same. If `a` is falsey, and bool(a) has a side-effect, then that side-effect should occur twice in:

if a and b:
    ...

but only once in
if a:
    if b:
        ...

It gets more interesting (silly), if `a.__bool__()` alternated between True and False.

If we say that such behavior is illegal, and can be ignored by the optimizer, then 3.10 is correct (as it stands).

My example was wrong though, as you've pointed out.
`if x: pass` it transformed to `x`. It is the test that is eliminated, not the evaluation of `x`.

----------
priority: release blocker -> normal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Tue Jan 12 11:15:04 2021
From: report at bugs.python.org (Mark Shannon)
Date: Tue, 12 Jan 2021 16:15:04 +0000
Subject: [issue42899] Is it legal to eliminate tests of a value,
 when that test has no effect on control flow?
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610468104.75.0.198093198207.issue42899@roundup.psfhosted.org>


Change by Mark Shannon <mark at hotpy.org>:


----------
priority: normal -> release blocker

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Tue Jan 12 11:23:59 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 12 Jan 2021 16:23:59 +0000
Subject: [issue42843] What min_sphinx for Python 3.10
In-Reply-To: <1609951966.97.0.867485424131.issue42843@roundup.psfhosted.org>
Message-ID: <1610468639.24.0.297858372373.issue42843@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Ah, the issue is also being discussed in PR 24142 comments.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42843>
_______________________________________

From report at bugs.python.org  Tue Jan 12 11:28:22 2021
From: report at bugs.python.org (Ethan Furman)
Date: Tue, 12 Jan 2021 16:28:22 +0000
Subject: [issue42899] Is it legal to eliminate tests of a value,
 when that test has no effect on control flow?
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610468902.07.0.622068678107.issue42899@roundup.psfhosted.org>


Ethan Furman <ethan at stoneleaf.us> added the comment:

If an optimization changes semantics it's not an optimization.

In  `if x: pass` how do we know `x` is falsely without calling `bool()` on it?

---

On a slightly different note, in the code:

    if a and b:
       ...

why is `bool(a)` called twice?

----------
nosy: +ethan.furman

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Tue Jan 12 11:29:33 2021
From: report at bugs.python.org (seb)
Date: Tue, 12 Jan 2021 16:29:33 +0000
Subject: [issue41116] build on macOS 11 (beta) does not find system-supplied
 third-party libraries
In-Reply-To: <1593100264.48.0.613850075185.issue41116@roundup.psfhosted.org>
Message-ID: <1610468973.99.0.377636006756.issue41116@roundup.psfhosted.org>


seb <s_rath at maxon.net> added the comment:

I tried that before, also with your command, without success. I saw that the CFLAGS includes weren't forwarded to the compiler - I don't know if that is only an issue here on my system. So instead I modified the setup.py and added the directory manually. It now works. Thanks for your help!!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41116>
_______________________________________

From report at bugs.python.org  Tue Jan 12 11:36:23 2021
From: report at bugs.python.org (Mark Shannon)
Date: Tue, 12 Jan 2021 16:36:23 +0000
Subject: [issue42899] Is it legal to eliminate tests of a value,
 when that test has no effect on control flow?
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610469383.24.0.886633417817.issue42899@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

It's clearer if you rewrite

if a and b:
    ...

as

tmp = a and b
if tmp:
    ...

if a is falsey then bool(a) gets called in `tmp = a and b` and `a` is assigned to `tmp`. Then in `if tmp`, bool(a) is called again.

I agree with you about it not being an optimization if it changes the semantics. But only within agreed semantics.
Optimizations are allow to make fewer calls to __hash__() in a dictionary, or change race conditions, because those are outside of the language specification.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Tue Jan 12 11:38:07 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 12 Jan 2021 16:38:07 +0000
Subject: [issue42843] What min_sphinx for Python 3.10
In-Reply-To: <1609951966.97.0.867485424131.issue42843@roundup.psfhosted.org>
Message-ID: <1610469487.84.0.197122676186.issue42843@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

* Fedora 33 (stable) ships python3-sphinx 3.2.1-1 and python3.10 version 3.10.0~a3-1 (the alpha4 is under tests).
* Debian Buster (stable) ships python3-sphinx 1.8.4-1 and python3 version 3.7.3-1
* Debian Sid (unstable) ships python3-sphinx 3.4.3-1 and python3 version 3.9.1-1.
* Ubuntu Groovy (stable) ships python3-sphinx 3.2.1-1 and python3 version 3.8.6-0ubuntu1
* Ubuntu Hirsute (dev) ships python3-sphinx 3.3.1-1 and python3 version 3.9.0-3ubuntu1

In this list, requiring Sphinx 3.2+ to build Python 3.10 documentation would only be an issue on Debian Buster.

I didn't check Red Hat RHEL or SUSE SLE. If they want to ship Python 3.10 but only have an old Sphinx, they can either use a newer Sphinx to build the doc, or ship Python 3.10 with no doc (since it would not be the "system Python", it may be an acceptable tradeoff).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42843>
_______________________________________

From report at bugs.python.org  Tue Jan 12 11:39:25 2021
From: report at bugs.python.org (Mark Shannon)
Date: Tue, 12 Jan 2021 16:39:25 +0000
Subject: [issue42899] Is it legal to eliminate tests of a value,
 when that test has no effect on control flow?
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610469565.56.0.666488247152.issue42899@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

> How do we know `x` is falsey without calling `bool()` on it?

We don't, but in `if x: pass`, it doesn't matter.
Discounting side-effects in __bool__, the code does nothing regardless of the value of `x`.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Tue Jan 12 11:46:43 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 12 Jan 2021 16:46:43 +0000
Subject: [issue42843] What min_sphinx for Python 3.10
In-Reply-To: <1609951966.97.0.867485424131.issue42843@roundup.psfhosted.org>
Message-ID: <1610470003.26.0.353371059818.issue42843@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
versions: +Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42843>
_______________________________________

From report at bugs.python.org  Tue Jan 12 11:46:39 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 12 Jan 2021 16:46:39 +0000
Subject: [issue42843] What min_sphinx for Python 3.10
In-Reply-To: <1609951966.97.0.867485424131.issue42843@roundup.psfhosted.org>
Message-ID: <1610469999.51.0.190514583255.issue42843@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

There is a PPA on Ubuntu for Python 3.10. The PPA maintainer considers the drop the documentation, see discussion at:
https://github.com/python/cpython/pull/23620#issuecomment-755423140

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42843>
_______________________________________

From report at bugs.python.org  Tue Jan 12 12:03:00 2021
From: report at bugs.python.org (Eryk Sun)
Date: Tue, 12 Jan 2021 17:03:00 +0000
Subject: =?utf-8?q?=5Bissue42902=5D_a_python_embedded_program=C2=A0may_load_=22C?=
 =?utf-8?q?=3A=5CLib=5Cos=2Epy=22_on_windows_system?=
In-Reply-To: <1610423923.25.0.321902126582.issue42902@roundup.psfhosted.org>
Message-ID: <1610470980.87.0.542132978087.issue42902@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> I still don't understand if the issue involves Py_SetPath() or not.

It seems to me that this issue is concerned with the default behavior that looks for the "lib/os.py" landmark via search_for_prefix() in PC/getpathp.c. Starting at the image path, it searches for the landmark up to the root directory. Any authenticated user can create a "C:/Lib" directory.

That said, I don't think the normal Python distribution is intended to be a base installation for embedding applications, as opposed to using a private copy of the embedded distribution. So in practice there may be no issue here.

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42902>
_______________________________________

From report at bugs.python.org  Tue Jan 12 12:24:20 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 12 Jan 2021 17:24:20 +0000
Subject: =?utf-8?q?=5Bissue42902=5D_a_python_embedded_program=C2=A0may_load_=22C?=
 =?utf-8?q?=3A=5CLib=5Cos=2Epy=22_on_windows_system?=
In-Reply-To: <1610423923.25.0.321902126582.issue42902@roundup.psfhosted.org>
Message-ID: <1610472260.37.0.511249806819.issue42902@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Hum. The code in Python 3.8 is complicated. When Py_SetPath() is called, Python starts by computing the Python Path Configuration because of:

    /* Getting the program full path calls pathconfig_global_init() */
    wchar_t *program_full_path = _PyMem_RawWcsdup(Py_GetProgramFullPath());

The result is stored info _Py_path_config. Then Py_SetPath() overrides program_full_path, prefix, exec_prefix and module_search_path of _Py_path_config.

When Python reachs Py_Initialize(), PyConfig_Read() does not compute the Python Path Configuration, but copies what comes from _Py_path_config.

--

I changed the code a lot of Python 3.10 to make it more deterministic and simpler. For example, Py_SetPath() no longer computes the Python Path Configuration.

commit ace3f9a0ce7b9fe8ae757fdd614f1e7a171f92b0
Author: Victor Stinner <vstinner at python.org>
Date:   Tue Nov 10 21:10:22 2020 +0100

    bpo-42260: Fix _PyConfig_Read() if compute_path_config=0 (GH-23220)
    
    Fix _PyConfig_Read() if compute_path_config=0: use values set by
    Py_SetPath(), Py_SetPythonHome() and Py_SetProgramName(). Add
    compute_path_config parameter to _PyConfig_InitPathConfig().
    
    The following functions now return NULL if called before
    Py_Initialize():
    
    * Py_GetExecPrefix()
    * Py_GetPath()
    * Py_GetPrefix()
    * Py_GetProgramFullPath()
    * Py_GetProgramName()
    * Py_GetPythonHome()
    
    These functions no longer automatically computes the Python Path
    Configuration. Moreover, Py_SetPath() no longer computes
    program_full_path.

This change is a little bit backward incompatible, even I would not recommend to call Py_GetXXX() functions before Py_Initialize() in Python 3.8 or 3.9.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42902>
_______________________________________

From report at bugs.python.org  Tue Jan 12 12:52:56 2021
From: report at bugs.python.org (Gregory P. Smith)
Date: Tue, 12 Jan 2021 17:52:56 +0000
Subject: [issue42899] Is it legal to eliminate tests of a value,
 when that test has no effect on control flow?
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610473976.91.0.735748264987.issue42899@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

If the body of a conditional does nothing, it seems fine to optimize the condition out to me.  But I see code from a low level compiled language perspective where that is clearly what would happen.  In reality, who ever meaningfully writes code where the body of a conditional does nothing?

 * Placeholder code with a # TODO perhaps.  [fine to optimize out]
 * Unit tests attempting to test the behavior of __bool__().  [an annoying behavior change]

Are there others?  Are we expecting this odd "not quite a no-op because we're so high level" pattern to ever appear in a performance critical situation?

The workaround for the latter would be to explicitly `if bool(x):` instead of `if x:` when the body is a no-op.  Or not make the body a no-op.  I expect unittest of __bool__() code owners would be fine with that so long as we call it out clearly in What's New docs, it's just that it could be an annoying change for them to make.

Ideally we'd also provide a lib2to3 fixer to detect and fixup code exhibiting that pattern.

The easiest answer is just not to optimize this out if it isn't actually providing us anything deemed important.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Tue Jan 12 13:04:50 2021
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 12 Jan 2021 18:04:50 +0000
Subject: [issue33066] raise an exception from multiple positions break the
 traceback frames
In-Reply-To: <1520932782.62.0.467229070634.issue33066@psf.upfronthosting.co.za>
Message-ID: <1610474690.88.0.201152440495.issue33066@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

See this documentation of with_traceback() regarding an API to set the traceback on an exception object.
 https://docs.python.org/3/library/exceptions.html#BaseException.with_traceback

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33066>
_______________________________________

From report at bugs.python.org  Tue Jan 12 13:09:13 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 12 Jan 2021 18:09:13 +0000
Subject: [issue42899] Is it legal to eliminate tests of a value,
 when that test has no effect on control flow?
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610474953.15.0.916420769997.issue42899@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Hm, I hadn't realized the issue of bool(a) being evaluated once or twice.

The most important side effect that bool(a) can have is raising (as e.g. numpy arrays do), not producing random results. Another important side effect might be loading some value into a cache.

So I think dropping an *extra* call is fine, while dropping the *only* call is not.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Tue Jan 12 13:10:46 2021
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 12 Jan 2021 18:10:46 +0000
Subject: [issue41620] Python Unittest does not return results object when the
 test is skipped
In-Reply-To: <1598205044.1.0.669094685419.issue41620@roundup.psfhosted.org>
Message-ID: <1610475046.84.0.325251434758.issue41620@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

The justification on the PR is: 

"The problem is that when I'm trying to collect test results if one of the tests is being skipped the error below pops up because test_result object is None.
AttributeError: 'NoneType' object has no attribute 'testsRun'"

which can be worked around with a simple "is not None" check. 

There will be cases where someone wants to know that a test was not executed, and inspecting a TestResult object to see that it actually represents Nothing is not as natural.

I'm -1 on this change.

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41620>
_______________________________________

From report at bugs.python.org  Tue Jan 12 13:18:04 2021
From: report at bugs.python.org (miss-islington)
Date: Tue, 12 Jan 2021 18:18:04 +0000
Subject: [issue42874] running configure on Solaris 10 gives grep "illegal
 option" errors
In-Reply-To: <1610194453.5.0.66216438534.issue42874@roundup.psfhosted.org>
Message-ID: <1610475484.22.0.847813961612.issue42874@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 0f66498fd8ee8644be6df963b86a1523f6069ddd by Paul Ganssle in branch 'master':
bpo-42874: Remove grep -qE options for Solaris 10 compatibility (GH-24200)
https://github.com/python/cpython/commit/0f66498fd8ee8644be6df963b86a1523f6069ddd


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42874>
_______________________________________

From report at bugs.python.org  Tue Jan 12 13:22:19 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 12 Jan 2021 18:22:19 +0000
Subject: [issue42906] python3 -m doctest test.py tests the stdlib "time"
 module instead
In-Reply-To: <1610447982.97.0.137318779169.issue42906@roundup.psfhosted.org>
Message-ID: <1610475739.29.0.151849169769.issue42906@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Sorry, this is not a bug. The builtin time module takes precedence in this case because the current directory is not put at the front of the module search path (sys.path).

As a workaround you could exportPYTHONPATH=.

----------
nosy: +gvanrossum
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42906>
_______________________________________

From report at bugs.python.org  Tue Jan 12 13:22:32 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 12 Jan 2021 18:22:32 +0000
Subject: [issue42906] python3 -m doctest test.py tests the stdlib "time"
 module instead
In-Reply-To: <1610447982.97.0.137318779169.issue42906@roundup.psfhosted.org>
Message-ID: <1610475752.63.0.329049592229.issue42906@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Whoops, I meant

export PYTHONPATH=.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42906>
_______________________________________

From report at bugs.python.org  Tue Jan 12 13:26:21 2021
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 12 Jan 2021 18:26:21 +0000
Subject: [issue15373] copy.copy() does not properly copy os.environment
In-Reply-To: <1342454937.95.0.386630033182.issue15373@psf.upfronthosting.co.za>
Message-ID: <1610475981.07.0.0292593560403.issue15373@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
components: +Library (Lib)
versions: +Python 3.10 -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue15373>
_______________________________________

From report at bugs.python.org  Tue Jan 12 13:56:31 2021
From: report at bugs.python.org (Jurjen N.E. Bos)
Date: Tue, 12 Jan 2021 18:56:31 +0000
Subject: [issue42911] Addition chains for pow saves 10 % time!
In-Reply-To: <1610463140.75.0.177431925065.issue42911@roundup.psfhosted.org>
Message-ID: <1610477791.0.0.213498568866.issue42911@roundup.psfhosted.org>


Jurjen N.E. Bos <jneb at users.sourceforge.net> added the comment:

Some more information for the interested:
The algorithm I made tries to smoothly change the"chunk size" with growing length of the exponent. So the exponents that win the most (up to 14% fewer multiplication) are the long exponents that are just shorter than the FIVEARY_CUTOFF.
But, I worked hard to make an algorithm that also saves multiplications for shorter numbers. Numbers of up to about 20 bits will be using the optimal chunk size.
And, of course, the decision must be made quickly because for some frequently occurring parameters (e.g., 3**25), the routine doesn't take that long anyway.
This is obtained by checking two properties of the exponent that strongly influence the addition chain: the higher four bits, and (surprise!) the number of pairs of bits with distance 2: in other words, (n&n>>2).bit_count().
After days of trying out all kinds of heuristics, and days of crunching,I measured the optimal parameters. I added the code I used to do that.
Guido may remember that I wrote a chapter in my Ph.D. on the subject of addition chains. The interesting thing is that I then used Python for that too: that was almost 30 years ago!
When implementing, I discovered that lots of the code around it had been in flux, so I didn't manage to "cherry pick" it into 3.10 yet. (One example: the bit_length and bit_count routines were renamed and moved around). And, I don't have windows 10:-(
But anyway, have a look and let me hear what you think of it. I'll also want to test and measure it a bit more, but I am sure it is quite stable.

----------
Added file: https://bugs.python.org/file49738/longobject.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42911>
_______________________________________

From report at bugs.python.org  Tue Jan 12 15:43:32 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 12 Jan 2021 20:43:32 +0000
Subject: [issue42911] Addition chains for pow saves 10 % time!
In-Reply-To: <1610463140.75.0.177431925065.issue42911@roundup.psfhosted.org>
Message-ID: <1610484212.98.0.414746698358.issue42911@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42911>
_______________________________________

From report at bugs.python.org  Tue Jan 12 15:52:02 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Tue, 12 Jan 2021 20:52:02 +0000
Subject: [issue42862] Use functools.lru_cache iso. _sqlite.Cache in sqlite3
 module
In-Reply-To: <1610066343.94.0.466682345605.issue42862@roundup.psfhosted.org>
Message-ID: <1610484722.55.0.379187787006.issue42862@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

> I do not like using _functools._lru_cache_wrapper. It is a deep implementation detail, private function of private module. Use functools.lru_cache.

All right, thanks.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42862>
_______________________________________

From report at bugs.python.org  Tue Jan 12 16:14:29 2021
From: report at bugs.python.org (Kevin Chen)
Date: Tue, 12 Jan 2021 21:14:29 +0000
Subject: [issue42912] enum.Flag ~ bitwise negation is very slow
Message-ID: <1610486069.95.0.26867920726.issue42912@roundup.psfhosted.org>


Change by Kevin Chen <kevinjchen94 at gmail.com>:


----------
nosy: aspin2
priority: normal
severity: normal
status: open
title: enum.Flag ~ bitwise negation is very slow
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42912>
_______________________________________

From report at bugs.python.org  Tue Jan 12 16:18:45 2021
From: report at bugs.python.org (Kevin Chen)
Date: Tue, 12 Jan 2021 21:18:45 +0000
Subject: [issue42912] enum.Flag ~ bitwise negation is very slow
Message-ID: <1610486325.32.0.555941057097.issue42912@roundup.psfhosted.org>


New submission from Kevin Chen <kevinjchen94 at gmail.com>:

Ignore this, opened issue by accident

----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42912>
_______________________________________

From report at bugs.python.org  Tue Jan 12 16:36:18 2021
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 12 Jan 2021 21:36:18 +0000
Subject: [issue1635741] Py_Finalize() doesn't clear all Python objects at exit
Message-ID: <1610487378.15.0.537550036469.issue1635741@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

In GH-23598, PyModule_AddObjectRef was added as EXPORT_DATA. Shouldn't it be EXPORT_FUNC?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1635741>
_______________________________________

From report at bugs.python.org  Tue Jan 12 16:43:53 2021
From: report at bugs.python.org (Michel Hidalgo)
Date: Tue, 12 Jan 2021 21:43:53 +0000
Subject: [issue42913] asyncio.ProactorEventLoop mishandles signal wakeup file
 descriptor
Message-ID: <1610487833.61.0.883604582572.issue42913@roundup.psfhosted.org>


New submission from Michel Hidalgo <hid.michel at gmail.com>:

asyncio.ProactorEventLoop uses a socket.socketpair and signal.set_wakeup_fd to wake up a loop that's polling I/O. However it does so with no consideration for file descriptors previously set (i.e. no signal number forwarding). Either by user code or by another instance of asyncio.ProactorEventLoop.

The following snippet is enough for the above to cause the loop to hang forever:

import asyncio
import gc

asyncio.set_event_loop(asyncio.ProactorEventLoop())
asyncio.set_event_loop(asyncio.ProactorEventLoop())
gc.collect()
asyncio.get_event_loop().run_forever()


The first asyncio.ProactorEventLoop instance sets a signal wakeup file descriptor on construction (see https://github.com/python/cpython/blob/187f76def8a5bd0af7ab512575cad30cfe624b05/Lib/asyncio/proactor_events.py#L632). The second instances does the same, dropping the file descriptor set by the first one (not good, not necessarily bad). When the garbage collector purges the first instance, signal wakeups are disabled completely (see https://github.com/python/cpython/blob/187f76def8a5bd0af7ab512575cad30cfe624b05/Lib/asyncio/proactor_events.py#L679). The loop cannot be interrupted with Ctrl+C anymore (bad).

----------
components: Windows, asyncio
messages: 384979
nosy: asvetlov, hidmic, paul.moore, steve.dower, tim.golden, yselivanov, zach.ware
priority: normal
severity: normal
status: open
title: asyncio.ProactorEventLoop mishandles signal wakeup file descriptor
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42913>
_______________________________________

From report at bugs.python.org  Tue Jan 12 17:14:35 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 12 Jan 2021 22:14:35 +0000
Subject: [issue42848] asyncio produces an unexpected traceback with recursive
 __getattribute__
In-Reply-To: <1609985412.09.0.749639106788.issue42848@roundup.psfhosted.org>
Message-ID: <1610489675.36.0.237298440201.issue42848@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:


New changeset 6dfd1734f5b230bb8fbd2a9df806c1333b6652a8 by Irit Katriel in branch 'master':
bpo-42848: remove recursion from TracebackException (GH-24158)
https://github.com/python/cpython/commit/6dfd1734f5b230bb8fbd2a9df806c1333b6652a8


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42848>
_______________________________________

From report at bugs.python.org  Tue Jan 12 18:16:45 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 12 Jan 2021 23:16:45 +0000
Subject: [issue37324] collections: remove deprecated aliases to ABC classes
In-Reply-To: <1560803912.16.0.0813723259969.issue37324@roundup.psfhosted.org>
Message-ID: <1610493405.59.0.735833988347.issue37324@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset c47c78b878ff617164b2b94ff711a6103e781753 by Hugo van Kemenade in branch 'master':
bpo-37324: Remove ABC aliases from collections (GH-23754)
https://github.com/python/cpython/commit/c47c78b878ff617164b2b94ff711a6103e781753


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37324>
_______________________________________

From report at bugs.python.org  Tue Jan 12 18:21:21 2021
From: report at bugs.python.org (Felipe)
Date: Tue, 12 Jan 2021 23:21:21 +0000
Subject: [issue42914] pprint numbers with underscore
Message-ID: <1610493681.29.0.683565759752.issue42914@roundup.psfhosted.org>


New submission from Felipe <felipe.nospam.ochoa at gmail.com>:

It would be nice if pprint learned to insert underscores in long numbers

Current behavior:

>>> pprint.pprint(int(1e9))
1000000000

Desired behavior

>>> pprint.pprint(int(1e9))
1_000_000_000

Wikipedia tells me that "groups of 3" is the international standard to be followed here [1][2]

[1] https://en.wikipedia.org/wiki/ISO_31-0#Numbers
[2] https://en.wikipedia.org/wiki/Decimal_separator#Digit_grouping

----------
components: Library (Lib)
messages: 384982
nosy: fov
priority: normal
severity: normal
status: open
title: pprint numbers with underscore
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42914>
_______________________________________

From report at bugs.python.org  Tue Jan 12 18:24:57 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Tue, 12 Jan 2021 23:24:57 +0000
Subject: [issue42862] Use functools.lru_cache iso. _sqlite.Cache in sqlite3
 module
In-Reply-To: <1610066343.94.0.466682345605.issue42862@roundup.psfhosted.org>
Message-ID: <1610493897.24.0.800675073395.issue42862@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
pull_requests: +23028
pull_request: https://github.com/python/cpython/pull/24203

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42862>
_______________________________________

From report at bugs.python.org  Tue Jan 12 18:31:13 2021
From: report at bugs.python.org (Kevin Chen)
Date: Tue, 12 Jan 2021 23:31:13 +0000
Subject: [issue42915] enum.Flag ~ bitwise negation is very slow and can't be
 defined as a Flag value
Message-ID: <1610494273.49.0.733516574302.issue42915@roundup.psfhosted.org>


New submission from Kevin Chen <kevinjchen94 at gmail.com>:

Here's a code sample:

```
import time
from enum import Flag, auto


class MyFlag(Flag):
    NONE = 0
    FLAG_1 = auto()
    FLAG_2 = auto()
    FLAG_3 = auto()
    FLAG_4 = auto()
    FLAG_5 = auto()
    FLAG_6 = auto()
    #
    # NOT_FLAG_1_OR_2 = ~FLAG_1 & ~FLAG_2


def test_flag():
    f = MyFlag.NONE
    inverted = (
        ~MyFlag.FLAG_1
        & ~MyFlag.FLAG_2
        & ~MyFlag.FLAG_3
        & ~MyFlag.FLAG_4
        & ~MyFlag.FLAG_5
        & ~MyFlag.FLAG_6
    )
    return f & inverted


INVERTED = (
    ~MyFlag.FLAG_1
    & ~MyFlag.FLAG_2
    & ~MyFlag.FLAG_3
    & ~MyFlag.FLAG_4
    & ~MyFlag.FLAG_5
    & ~MyFlag.FLAG_6
)


def test_flag_cached():
    f = MyFlag.NONE
    return f & INVERTED


if __name__ == "__main__":
    start_time = time.time()
    for _ in range(10_000):
        test_flag()

    elapsed = time.time() - start_time
    print(f"Took normal {elapsed:2f} seconds.")

    start_time = time.time()
    for _ in range(10_000):
        test_flag_cached()

    elapsed = time.time() - start_time
    print(f"Took cached {elapsed:2f} seconds.")
```

And its outputs:
```
Took normal 1.799731 seconds.
Took cached 0.009488 seconds.
```

Basically, bitwise negation is very very slow. From what I can tell, it seems that a lot of time is spent here computing powers of two. I've read elsewhere that flag values are cached, and it looks like negated Flag values can't be cached? This seems related to the second issue, which is that any negated Flag value being defined results in `RecursionError: maximum recursion depth exceeded` as it searches for a good name for Flag.

Obviously, the simple workaround is just to define a constant variable elsewhere with the negated value, but it isn't very obvious anywhere that this is necessary, and I wanted to raise this to see if anyone has knowledge of the implementation details of Flag for possibly resolving this in the class itself.

----------
messages: 384983
nosy: aspin2
priority: normal
severity: normal
status: open
title: enum.Flag ~ bitwise negation is very slow and can't be defined as a Flag value
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42915>
_______________________________________

From report at bugs.python.org  Tue Jan 12 18:39:07 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 12 Jan 2021 23:39:07 +0000
Subject: [issue25988] collections.abc.Indexable
In-Reply-To: <1451686739.56.0.219134772531.issue25988@psf.upfronthosting.co.za>
Message-ID: <1610494747.23.0.231471714762.issue25988@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

New changeset c47c78b878ff617164b2b94ff711a6103e781753 by Hugo van Kemenade in branch 'master':
bpo-37324: Remove ABC aliases from collections (GH-23754)
https://github.com/python/cpython/commit/c47c78b878ff617164b2b94ff711a6103e781753

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue25988>
_______________________________________

From report at bugs.python.org  Tue Jan 12 18:50:25 2021
From: report at bugs.python.org (Felipe)
Date: Tue, 12 Jan 2021 23:50:25 +0000
Subject: [issue42914] pprint numbers with underscore
In-Reply-To: <1610493681.29.0.683565759752.issue42914@roundup.psfhosted.org>
Message-ID: <1610495425.15.0.409826232795.issue42914@roundup.psfhosted.org>


Felipe <felipe.nospam.ochoa at gmail.com> added the comment:

Here is an implementation of the safe repr for numbers if helpful:

```
def safe_repr_int(object):
    sign = ''
    if object < 0:
        sign = '-'
        object  = -object
    r = repr(object)
    if len(r) <= 4:
        return sign + r
    parts = [sign]
    left = len(r) % 3
    if left:
        parts.append(r[0:left])
        parts.append('_')
        r = r[left:]
    parts.append(r[0:3])
    for i in range(3, len(r), 3):
        parts.append('_')
        parts.append(r[i:i + 3])
    return ''.join(parts)
```

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42914>
_______________________________________

From report at bugs.python.org  Tue Jan 12 18:57:54 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 12 Jan 2021 23:57:54 +0000
Subject: [issue41036] Visit the type of instance of heap types if tp_traverse
 is not implemented
In-Reply-To: <1592575501.27.0.818244173351.issue41036@roundup.psfhosted.org>
Message-ID: <1610495874.94.0.539120248999.issue41036@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I created a thread on python-dev:
"Heap types (PyType_FromSpec) must fully implement the GC protocol"
https://mail.python.org/archives/list/python-dev at python.org/thread/C4ILXGPKBJQYUN5YDMTJOEOX7RHOD4S3/

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41036>
_______________________________________

From report at bugs.python.org  Tue Jan 12 19:04:13 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 13 Jan 2021 00:04:13 +0000
Subject: [issue1635741] Py_Finalize() doesn't clear all Python objects at exit
Message-ID: <1610496253.41.0.109393876662.issue1635741@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> In GH-23598, PyModule_AddObjectRef was added as EXPORT_DATA. Shouldn't it be EXPORT_FUNC?

Oh, I didn't notice that there was EXPORT_DATA. Right, EXPORT_FUNC must be used.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1635741>
_______________________________________

From report at bugs.python.org  Tue Jan 12 19:10:55 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 13 Jan 2021 00:10:55 +0000
Subject: [issue42800] Traceback objects allow accessing frame objects without
 triggering audit hooks
In-Reply-To: <1609460218.67.0.01717828776.issue42800@roundup.psfhosted.org>
Message-ID: <1610496655.97.0.0252383148666.issue42800@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Aaaah, PR 24182 doesn't add a hook to object.__getattr__, but to the C getter functions on traceback and frame. That sounds more acceptable to me :-) These operations are uncommon and should not be part of "hot code" (critical for performance) unless you're doing something crazy :-p

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42800>
_______________________________________

From report at bugs.python.org  Tue Jan 12 19:28:47 2021
From: report at bugs.python.org (Charles Law)
Date: Wed, 13 Jan 2021 00:28:47 +0000
Subject: [issue42916] Support for DICOM image file format in imghdr module
Message-ID: <1610497726.98.0.199039272928.issue42916@roundup.psfhosted.org>


New submission from Charles Law <charles.law at gmail.com>:

DICOM is a file format used frequently in medical imaging (it is also a communications protocol). It has been used since the 80's, and is still widely used by modern medical equipment.

It has a well defined format: http://dicom.nema.org/dicom/2013/output/chtml/part10/chapter_7.html

This proposal is for the addiction of a check to imghdr module to detect DICOM files, with imghdr.what() and return 'dicom' if a dicom file is found.

----------
components: Library (Lib)
messages: 384989
nosy: claw
priority: normal
severity: normal
status: open
title: Support for DICOM image file format in imghdr module
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42916>
_______________________________________

From report at bugs.python.org  Tue Jan 12 19:35:43 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 13 Jan 2021 00:35:43 +0000
Subject: [issue42848] asyncio produces an unexpected traceback with recursive
 __getattribute__
In-Reply-To: <1609985412.09.0.749639106788.issue42848@roundup.psfhosted.org>
Message-ID: <1610498143.88.0.879577999032.issue42848@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Will be fixed in 3.10.

I prefer not to backport the solution (Irit, do you agree?)

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42848>
_______________________________________

From report at bugs.python.org  Tue Jan 12 20:54:09 2021
From: report at bugs.python.org (Thomas Anderson)
Date: Wed, 13 Jan 2021 01:54:09 +0000
Subject: [issue42917] Block stack size for frame objects should be dynamically
 sizable
Message-ID: <1610502849.77.0.30833881241.issue42917@roundup.psfhosted.org>


New submission from Thomas Anderson <tomkpz at gmail.com>:

Currently the block stack size is hardcoded to 20.  Similar to how the value stack is dynamically sizable, we should make the block stack dynamically sizable.  This will reduce space on average (since the typical number of blocks for a function is well below 20) and allow code generators to generate code with more deep nesting.  Note: the motivation is not necessarily to reduce memory usage, but to make L1 cache misses less likely for stack objects.

----------
components: Interpreter Core
messages: 384991
nosy: tomkpz
priority: normal
severity: normal
status: open
title: Block stack size for frame objects should be dynamically sizable
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42917>
_______________________________________

From report at bugs.python.org  Tue Jan 12 21:07:40 2021
From: report at bugs.python.org (Roundup Robot)
Date: Wed, 13 Jan 2021 02:07:40 +0000
Subject: [issue42917] Block stack size for frame objects should be dynamically
 sizable
In-Reply-To: <1610502849.77.0.30833881241.issue42917@roundup.psfhosted.org>
Message-ID: <1610503660.64.0.306366945553.issue42917@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
keywords: +patch
nosy: +python-dev
nosy_count: 1.0 -> 2.0
pull_requests: +23029
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24204

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42917>
_______________________________________

From report at bugs.python.org  Tue Jan 12 22:35:29 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Wed, 13 Jan 2021 03:35:29 +0000
Subject: [issue42914] pprint numbers with underscore
In-Reply-To: <1610493681.29.0.683565759752.issue42914@roundup.psfhosted.org>
Message-ID: <1610508929.82.0.0120360998358.issue42914@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

> It would be nice if pprint learned to insert underscores in long numbers

+1 but I would make this optional.


> Here is an implementation of the safe repr for numbers if helpful

I suggest using the existing string formatting tools as a foundation

    >>> format(10**9, ',d').replace(',', '_')
    '1_000_000_000'

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42914>
_______________________________________

From report at bugs.python.org  Tue Jan 12 22:54:18 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 13 Jan 2021 03:54:18 +0000
Subject: [issue42915] enum.Flag ~ bitwise negation is very slow and can't be
 defined as a Flag value
In-Reply-To: <1610494273.49.0.733516574302.issue42915@roundup.psfhosted.org>
Message-ID: <1610510058.59.0.393079893862.issue42915@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
nosy: +ethan.furman

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42915>
_______________________________________

From report at bugs.python.org  Tue Jan 12 23:52:26 2021
From: report at bugs.python.org (Josh Rosenberg)
Date: Wed, 13 Jan 2021 04:52:26 +0000
Subject: [issue15373] copy.copy() does not properly copy os.environment
In-Reply-To: <1342454937.95.0.386630033182.issue15373@psf.upfronthosting.co.za>
Message-ID: <1610513546.85.0.273336957249.issue15373@roundup.psfhosted.org>


Josh Rosenberg <shadowranger+python at gmail.com> added the comment:

Would we remove the functionality of os.environ.copy()? It seems very odd for types to have a .copy() method that works, while not supporting copy.copy, especially when there is zero documentation, on the web or the docstring, to even hint at the difference.

I'm strongly in favor of silently doing the right thing and behaving the same way the .copy() method already behaves; if you want a "copy" of os.environ that still modifies the environment, that's just aliasing it (envalias = os.environ), not copying at all. If you're trying to make a shallow copy, not an alias, you're trying to separate it from the parent, which every other dict-like thing does (assuming immutable values), where os.environ is a very weird exception (for copy.copy, but not the .copy() method).

Can someone give an example where you'd want copy.copy to produce a "shallow copy" that acts like an alias, not an actual independent copy?

----------
nosy: +josh.r

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue15373>
_______________________________________

From report at bugs.python.org  Wed Jan 13 00:07:10 2021
From: report at bugs.python.org (Josh Rosenberg)
Date: Wed, 13 Jan 2021 05:07:10 +0000
Subject: [issue42899] Is it legal to eliminate tests of a value,
 when that test has no effect on control flow?
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610514430.14.0.689694429657.issue42899@roundup.psfhosted.org>


Josh Rosenberg <shadowranger+python at gmail.com> added the comment:

Gregory: Even in a low-level compiled language (say, C++), pretty sure the compiler can't automatically optimize out:

    if (x) { }

unless it has sure knowledge of the implementation of operator bool; if operator bool's implementation isn't in the header file, and link time optimization isn't involved, it has to call it to ensure any side-effects it might have are invoked.

It can only bypass the call if it knows the implementation of operator bool and can verify it has no observable side-effects (as-if rule). There are exceptions to the as-if rule for optimizations in special cases (copy elision), but I'm pretty sure operator bool isn't one of them; if the optimizer doesn't know the implementation of operator bool, it must call it just in case it does something weird but critical to the program logic.

Point is, I agree that:

if x:
     pass

must evaluate non-constant-literal x for truthiness, no matter how silly that seems (not a huge loss, given very little code should ever actually do that).

----------
nosy: +josh.r

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Wed Jan 13 01:01:57 2021
From: report at bugs.python.org (Xinmeng Xia)
Date: Wed, 13 Jan 2021 06:01:57 +0000
Subject: [issue42918] Nested multi-line expression will lead to "compile()"
 fails
Message-ID: <1610517717.73.0.740461753555.issue42918@roundup.psfhosted.org>


New submission from Xinmeng Xia <xiaxm at smail.nju.edu.cn>:

For build-in function compile() in mode 'single',  only single statement can be well compiled. If we compile multiple statements,  the parser will raise a syntaxError. Seeing the following two programs,  In program 1, 2 statement are compiled. So the parser raises a Syntax error. It's the expected output. However, if we insert a nested multi-line assignment in this code(see program 2), 3 statements are compiled. We expect the parser also raise a Sytax error. But it' not.

Program 1 ( with expected results)
===================================
code1 = """
a = 1
b = 2
"""
c = compile(code1, "", "single")
===================================
Traceback (most recent call last):
  File "/home/xxm/Desktop/nameChanging/report/test1.py", line 641, in <module>
    c = compile(code1, "", "single")
  File "", line 2
    a = 1
         ^
SyntaxError: multiple statements found while compiling a single statement


Program 2 (with unexpected results)
=================================
code2 = """
c ='''
d=1
'''
a = 1
b = 2
"""
c = compile(code2, "", "single")
=================================


Expected out for program 2: Raise a syntaxError too? But it's not.

>> python -V
Python 3.10.0a2
>>uname -a
Linux xxm-System-Product-Name 4.15.0-64-generic #73~16.04.1-Ubuntu SMP Fri Sep 13 09:56:18 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

----------
messages: 384995
nosy: xxm
priority: normal
severity: normal
status: open
title: Nested multi-line expression will lead to "compile()" fails
type: compile error
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42918>
_______________________________________

From report at bugs.python.org  Wed Jan 13 01:05:45 2021
From: report at bugs.python.org (Xinmeng Xia)
Date: Wed, 13 Jan 2021 06:05:45 +0000
Subject: =?utf-8?q?=5Bissue42919=5D_Blank_in_multiline_=E2=80=9Cif_expressions?=
 =?utf-8?q?=E2=80=9D_will_lead_to_EOF_errors?=
Message-ID: <1610517945.87.0.376741027563.issue42919@roundup.psfhosted.org>


New submission from Xinmeng Xia <xiaxm at smail.nju.edu.cn>:

In build-in function compile() of mode 'single',  single statement can be well compiled. (see program 1 and program 2). However,  if we leave 4 blank spaces before the end of triple-quotation mark of "if expression",(see program 3), The parser will raise syntax error. This is not the expected output.  Spaces in the end of multi-line expression should not affect the compilation results. No error should be reported in this case.


program 1 (expected)
===============================
snippet ="""
a = 1
     """
compile(snippet, "", "single")
===============================

program 2 (expected)
===============================
snippet ="""
if True:
     a = 1
"""
compile(snippet, "", "single")
===============================

program 3 (unexpected)
===========================
snippet ="""
if True:
     a = 1
     """
compile(snippet, "", "single")
===========================
Traceback (most recent call last):
     File "/home/xxm/Desktop/nameChanging/report/test1.py", line 1, in <module>
         compile(snippet, "", "single")
     File "", line 4
SyntaxError: unexpected EOF while parsing

Expected output: No error reported (like program1 and program2)


>> python -V
Python 3.10.0a2
>>uname -a
Linux xxm-System-Product-Name 4.15.0-64-generic #73~16.04.1-Ubuntu SMP Fri Sep 13 09:56:18 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

----------
components: Interpreter Core
messages: 384996
nosy: xxm
priority: normal
severity: normal
status: open
title: Blank in multiline ?if expressions? will lead to EOF errors
type: compile error
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42919>
_______________________________________

From report at bugs.python.org  Wed Jan 13 01:05:59 2021
From: report at bugs.python.org (Xinmeng Xia)
Date: Wed, 13 Jan 2021 06:05:59 +0000
Subject: [issue42918] Nested multi-line expression will lead to "compile()"
 fails
In-Reply-To: <1610517717.73.0.740461753555.issue42918@roundup.psfhosted.org>
Message-ID: <1610517959.46.0.367997403179.issue42918@roundup.psfhosted.org>


Change by Xinmeng Xia <xiaxm at smail.nju.edu.cn>:


----------
components: +Interpreter Core

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42918>
_______________________________________

From report at bugs.python.org  Wed Jan 13 01:14:20 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 13 Jan 2021 06:14:20 +0000
Subject: [issue21895] signal.pause() and signal handlers don't react to
 SIGCHLD in non-main thread
In-Reply-To: <1404208895.06.0.521807683184.issue21895@psf.upfronthosting.co.za>
Message-ID: <1610518460.97.0.62152205529.issue21895@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

When I removed myself from the nosy list I did mean to stop working on this bug, just that I am unlikely to be of any help. :-)

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21895>
_______________________________________

From report at bugs.python.org  Wed Jan 13 01:14:57 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Wed, 13 Jan 2021 06:14:57 +0000
Subject: [issue1635741] Py_Finalize() doesn't clear all Python objects at exit
Message-ID: <1610518497.32.0.166693778587.issue1635741@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na at python.org>:


----------
pull_requests: +23031
pull_request: https://github.com/python/cpython/pull/24205

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1635741>
_______________________________________

From report at bugs.python.org  Wed Jan 13 01:26:33 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 13 Jan 2021 06:26:33 +0000
Subject: [issue42913] asyncio.ProactorEventLoop mishandles signal wakeup file
 descriptor
In-Reply-To: <1610487833.61.0.883604582572.issue42913@roundup.psfhosted.org>
Message-ID: <1610519193.85.0.668509204906.issue42913@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Looks this was not tested or thought through with multiple loops and signals (admittedly, using signals is never fun, and even less so on Windows).

Can you send a PR with a fix?

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42913>
_______________________________________

From report at bugs.python.org  Wed Jan 13 01:28:27 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 13 Jan 2021 06:28:27 +0000
Subject: =?utf-8?q?=5Bissue42919=5D_Blank_in_multiline_=E2=80=9Cif_expressions?=
 =?utf-8?q?=E2=80=9D_will_lead_to_EOF_errors?=
In-Reply-To: <1610517945.87.0.376741027563.issue42919@roundup.psfhosted.org>
Message-ID: <1610519307.27.0.193029996722.issue42919@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
nosy: +lys.nikolaou

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42919>
_______________________________________

From report at bugs.python.org  Wed Jan 13 01:32:59 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 13 Jan 2021 06:32:59 +0000
Subject: [issue42918] Nested multi-line expression will lead to "compile()"
 fails
In-Reply-To: <1610517717.73.0.740461753555.issue42918@roundup.psfhosted.org>
Message-ID: <1610519579.22.0.106315467191.issue42918@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
nosy: +lys.nikolaou

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42918>
_______________________________________

From report at bugs.python.org  Wed Jan 13 01:35:45 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 13 Jan 2021 06:35:45 +0000
Subject: [issue42918] Nested multi-line expression will lead to "compile()"
 fails
In-Reply-To: <1610517717.73.0.740461753555.issue42918@roundup.psfhosted.org>
Message-ID: <1610519745.23.0.483464910954.issue42918@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

What does the bytecode for c in program 2 look like?

Also, how do you find all these bugs? Are you developing a new fuzzier?

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42918>
_______________________________________

From report at bugs.python.org  Wed Jan 13 02:04:43 2021
From: report at bugs.python.org (Xinmeng Xia)
Date: Wed, 13 Jan 2021 07:04:43 +0000
Subject: [issue42918] Nested multi-line expression will lead to "compile()"
 fails
In-Reply-To: <1610517717.73.0.740461753555.issue42918@roundup.psfhosted.org>
Message-ID: <1610521483.12.0.583342936034.issue42918@roundup.psfhosted.org>


Xinmeng Xia <xiaxm at smail.nju.edu.cn> added the comment:

The bytecode of c is as following:

              0 LOAD_CONST               0 (1)
              2 STORE_NAME               0 (d)
              4 LOAD_CONST               1 (None)
              6 RETURN_VALUE
===============================================

Yes, my team is working on developing a new fuzzier for the CPython.

Also, we are trying to apply it on the newest version of CPython. 

We will carefully analyze all bugs before reporting them on the tracker.

Hope our work does not bother you too much.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42918>
_______________________________________

From report at bugs.python.org  Wed Jan 13 02:11:01 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 13 Jan 2021 07:11:01 +0000
Subject: [issue42918] Nested multi-line expression will lead to "compile()"
 fails
In-Reply-To: <1610517717.73.0.740461753555.issue42918@roundup.psfhosted.org>
Message-ID: <1610521861.37.0.156847782925.issue42918@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

It?s good work! Is it open source?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42918>
_______________________________________

From report at bugs.python.org  Wed Jan 13 02:18:44 2021
From: report at bugs.python.org (Aviral Srivastava)
Date: Wed, 13 Jan 2021 07:18:44 +0000
Subject: [issue42920] How to add end_lineno in pyclbr?
Message-ID: <1610522324.61.0.549863868319.issue42920@roundup.psfhosted.org>


New submission from Aviral Srivastava <avi.srivastava254084 at gmail.com>:

I created a PR a year ago, https://github.com/python/cpython/pull/16466/files, and now the source code is completely changed. How do I create another PR or if there is another way through which I can get an end line for each object (class and function) as stated here(https://stackoverflow.com/questions/58142456/how-to-get-the-scope-of-a-class-in-terms-of-starting-line-and-end-line-in-python).

----------
components: Library (Lib)
messages: 385002
nosy: kebab-mai-haddi
priority: normal
severity: normal
status: open
title: How to add end_lineno in pyclbr?
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42920>
_______________________________________

From report at bugs.python.org  Wed Jan 13 02:30:24 2021
From: report at bugs.python.org (Xinmeng Xia)
Date: Wed, 13 Jan 2021 07:30:24 +0000
Subject: [issue42918] Nested multi-line expression will lead to "compile()"
 fails
In-Reply-To: <1610517717.73.0.740461753555.issue42918@roundup.psfhosted.org>
Message-ID: <1610523024.31.0.450518468669.issue42918@roundup.psfhosted.org>


Xinmeng Xia <xiaxm at smail.nju.edu.cn> added the comment:

For sure! As soon as we validate this technique, we will open source it on GitHub.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42918>
_______________________________________

From report at bugs.python.org  Wed Jan 13 02:42:09 2021
From: report at bugs.python.org (Ethan Furman)
Date: Wed, 13 Jan 2021 07:42:09 +0000
Subject: [issue42915] enum.Flag ~ bitwise negation is very slow and can't be
 defined as a Flag value
In-Reply-To: <1610494273.49.0.733516574302.issue42915@roundup.psfhosted.org>
Message-ID: <1610523729.66.0.914796779849.issue42915@roundup.psfhosted.org>


Ethan Furman <ethan at stoneleaf.us> added the comment:

I just finished a rewrite of Flag for 3.10.  Using your test below I was able to tweak the rewrite so the final numbers are:

Took normal 0.148092 seconds.
Took cached 0.017438 seconds.

Your original post had a ratio of nearly 200 -- it is now 8.7ish.

----------
assignee:  -> ethan.furman

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42915>
_______________________________________

From report at bugs.python.org  Wed Jan 13 02:48:07 2021
From: report at bugs.python.org (Joseph Perez)
Date: Wed, 13 Jan 2021 07:48:07 +0000
Subject: [issue42921] Inferred Optional type of wrapper function arguments
Message-ID: <1610524087.97.0.666044800779.issue42921@roundup.psfhosted.org>


New submission from Joseph Perez <joperez at hotmail.fr>:

`typing.get_type_hints` gives a different result for a wrapper created with `functools.wraps` in case of inferred `Optional` arguments (when the default value of the argument is None)

```python
from functools import wraps
from typing import get_type_hints

def foo(bar: int = None): ...

@wraps(foo)
def foo2(*args, **kwargs): ...

print(get_type_hints(foo))  # {'bar': typing.Optional[int]}
print(get_type_hints(foo2))  # {'bar': <class 'int'>}
```

This is because `get_type_hints` use the defauts of the wrapper (`foo2`) and not those of the wrapped function (`foo`).
This is not consistent with some other tools like `inspect.signature` which gives the same signature (and thus same default argument) for the wrapped function and its wrapper.

I think this case has simply been forgotten in the resolution of https://bugs.python.org/issue37838 (fixing `get_type_hints` not taking `wraps` in account at all), because inferred `Optional` is a kind deprecated feature (https://github.com/python/typing/issues/275).

----------
messages: 385005
nosy: joperez
priority: normal
severity: normal
status: open
title: Inferred Optional type of wrapper function arguments
type: behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42921>
_______________________________________

From report at bugs.python.org  Wed Jan 13 02:48:08 2021
From: report at bugs.python.org (Ethan Furman)
Date: Wed, 13 Jan 2021 07:48:08 +0000
Subject: [issue42901] [Enum] move member creation to __set_name__ in order to
 support __init_subclass__
In-Reply-To: <1610414848.42.0.389708219553.issue42901@roundup.psfhosted.org>
Message-ID: <1610524088.41.0.376063690344.issue42901@roundup.psfhosted.org>


Ethan Furman <ethan at stoneleaf.us> added the comment:


New changeset c314e60388282d9829762fb6c30b12e2807caa19 by Ethan Furman in branch 'master':
bpo-42901: [Enum] move member creation to `__set_name__` (GH-24196)
https://github.com/python/cpython/commit/c314e60388282d9829762fb6c30b12e2807caa19


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42901>
_______________________________________

From report at bugs.python.org  Wed Jan 13 03:11:22 2021
From: report at bugs.python.org (Jose MONTES PEREZ)
Date: Wed, 13 Jan 2021 08:11:22 +0000
Subject: =?utf-8?q?=5Bissue42922=5D_Enlace_a_descripci=C3=B3n_de_funci=C3=B3n_=27d?=
 =?utf-8?q?ir=27_faltante?=
Message-ID: <1610525482.8.0.875772925154.issue42922@roundup.psfhosted.org>


New submission from Jose MONTES PEREZ <jmontesp.informatica at gmail.com>:

En la tabla de enlaces a funciones de la p?gina:
https://docs.python.org/es/3/library/functions.html 
no existe un link a la funci?n 'dir' tal como:
https://docs.python.org/es/3/library/functions.html#dir
en su lugar est? duplicado el enlace a la funci?n 'any'

----------
assignee: docs at python
components: Documentation
messages: 385007
nosy: docs at python, jmontesp.informatica
priority: normal
severity: normal
status: open
title: Enlace a descripci?n de funci?n 'dir' faltante
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42922>
_______________________________________

From report at bugs.python.org  Wed Jan 13 03:38:49 2021
From: report at bugs.python.org (Irit Katriel)
Date: Wed, 13 Jan 2021 08:38:49 +0000
Subject: [issue42848] asyncio produces an unexpected traceback with recursive
 __getattribute__
In-Reply-To: <1609985412.09.0.749639106788.issue42848@roundup.psfhosted.org>
Message-ID: <1610527129.34.0.754288486185.issue42848@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Yes, I agree this is more of a refactor than a bugfix.

----------
versions: +Python 3.10 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42848>
_______________________________________

From report at bugs.python.org  Wed Jan 13 04:05:51 2021
From: report at bugs.python.org (Mark Dickinson)
Date: Wed, 13 Jan 2021 09:05:51 +0000
Subject: [issue42879] SystemError from class 'int'
In-Reply-To: <1610232607.93.0.155495951465.issue42879@roundup.psfhosted.org>
Message-ID: <1610528751.84.0.858339934156.issue42879@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

Downstream issue is here: https://github.com/pygame/pygame/issues/2442

I'll close this here, since that report indicates a bug in Pygame.

----------
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42879>
_______________________________________

From report at bugs.python.org  Wed Jan 13 04:34:34 2021
From: report at bugs.python.org (Irit Katriel)
Date: Wed, 13 Jan 2021 09:34:34 +0000
Subject: [issue42289] Found a secret/private key in code.
In-Reply-To: <1604813228.45.0.0225910221233.issue42289@roundup.psfhosted.org>
Message-ID: <1610530474.39.0.793894986949.issue42289@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
status: pending -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42289>
_______________________________________

From report at bugs.python.org  Wed Jan 13 05:15:49 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Wed, 13 Jan 2021 10:15:49 +0000
Subject: [issue1635741] Py_Finalize() doesn't clear all Python objects at exit
Message-ID: <1610532949.34.0.0213455117433.issue1635741@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:


New changeset 2396614b8958ad202378fd71a598eb4106ac5896 by Dong-hee Na in branch 'master':
bpo-1635741: Fix PyModule_AddObjectRef to use EXPORT_FUNC (GH-24205)
https://github.com/python/cpython/commit/2396614b8958ad202378fd71a598eb4106ac5896


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1635741>
_______________________________________

From report at bugs.python.org  Wed Jan 13 05:32:02 2021
From: report at bugs.python.org (Christian Heimes)
Date: Wed, 13 Jan 2021 10:32:02 +0000
Subject: [issue42893] Strange XPath search behavior of
 xml.etree.ElementTree.Element.find
In-Reply-To: <1610385165.69.0.550442509332.issue42893@roundup.psfhosted.org>
Message-ID: <1610533922.32.0.210779002483.issue42893@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

etree's find method supports a limited subset of XPath, https://docs.python.org/3/library/xml.etree.elementtree.html#supported-xpath-syntax . e.find("./*[2]") seems to trigger undefined behavior. The limited XPath syntax for positions is documented as "position predicates must be preceded by a tag name".

lxml behaves the same. Its find() method returns the same value and its xpath() method your expected value:

>>> import lxml.etree
>>> e = lxml.etree.fromstring('<html><div class="row"/><hr/><div/><hr/><div class="row"/><button/></html>')
>>> e.find("./*[2]")
<Element div at 0x7fe4d777b6c0>
>>> e.xpath("./*[2]")
[<Element hr at 0x7fe4d777b2c0>]

----------
nosy: +christian.heimes, scoder

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42893>
_______________________________________

From report at bugs.python.org  Wed Jan 13 05:32:24 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Wed, 13 Jan 2021 10:32:24 +0000
Subject: [issue40956] Use Argument Clinic in sqlite3
In-Reply-To: <1591956335.72.0.553737405887.issue40956@roundup.psfhosted.org>
Message-ID: <1610533944.59.0.930331131769.issue40956@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

GH-24007 introduced a regression:

>>> import sqlite3
>>> help(sqlite3)
Traceback (most recent call last):
  File "Lib/inspect.py", line 2049, in wrap_value
    value = eval(s, module_dict)
  File "<string>", line 1, in <module>
NameError: name 'cursor' is not defined

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "Lib/inspect.py", line 2052, in wrap_value
    value = eval(s, sys_module_dict)
  File "<string>", line 1, in <module>
NameError: name 'cursor' is not defined

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "Lib/_sitebuiltins.py", line 103, in __call__
    return pydoc.help(*args, **kwds)
  File "Lib/pydoc.py", line 2000, in __call__
    self.help(request)
  File "Lib/pydoc.py", line 2059, in help
    else: doc(request, 'Help on %s:', output=self._output)
  File "Lib/pydoc.py", line 1779, in doc
    pager(render_doc(thing, title, forceload))
  File "Lib/pydoc.py", line 1772, in render_doc
    return title % desc + '\n\n' + renderer.document(object, name)
  File "Lib/pydoc.py", line 472, in document
    if inspect.ismodule(object): return self.docmodule(*args)
  File "Lib/pydoc.py", line 1267, in docmodule
    contents.append(self.document(value, key, name))
  File "Lib/pydoc.py", line 473, in document
    if inspect.isclass(object): return self.docclass(*args)
  File "Lib/pydoc.py", line 1433, in docclass
    attrs = spill("Methods %s:\n" % tag, attrs,
  File "Lib/pydoc.py", line 1382, in spill
    push(self.document(value,
  File "Lib/pydoc.py", line 474, in document
    if inspect.isroutine(object): return self.docroutine(*args)
  File "Lib/pydoc.py", line 1492, in docroutine
    signature = inspect.signature(object)
  File "Lib/inspect.py", line 3129, in signature
    return Signature.from_callable(obj, follow_wrapped=follow_wrapped,
  File "Lib/inspect.py", line 2877, in from_callable
    return _signature_from_callable(obj, sigcls=cls,
  File "Lib/inspect.py", line 2351, in _signature_from_callable
    return _signature_from_builtin(sigcls, obj,
  File "Lib/inspect.py", line 2164, in _signature_from_builtin
    return _signature_fromstr(cls, func, s, skip_bound_arg)
  File "Lib/inspect.py", line 2102, in _signature_fromstr
    p(name, default)
  File "Lib/inspect.py", line 2084, in p
    default_node = RewriteSymbolics().visit(default_node)
  File "Lib/ast.py", line 410, in visit
    return visitor(node)
  File "Lib/inspect.py", line 2071, in visit_Attribute
    return wrap_value(value)
  File "Lib/inspect.py", line 2054, in wrap_value
    raise RuntimeError()
RuntimeError

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40956>
_______________________________________

From report at bugs.python.org  Wed Jan 13 05:50:13 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 13 Jan 2021 10:50:13 +0000
Subject: [issue42923] Py_FatalError(): dump the list of extension modules
Message-ID: <1610535013.1.0.942204365805.issue42923@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at python.org>:

When Python cannot report an error and its is not possible to recover from the error, Py_FatalError() displays an error message and exit immediately Python.

It's common that Python crashes are coming from third party extension modules, rather than Python itself. Recent example: bpo-42891 crash reported in Python, but it was a bug in lsm-db third party extension module.

I propose to enhance Py_FatalError() to attempt to dump the list of extension modules, to ease debugging.

I'm working on a PR.

----------
components: Interpreter Core
messages: 385013
nosy: vstinner
priority: normal
severity: normal
status: open
title: Py_FatalError(): dump the list of extension modules
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42923>
_______________________________________

From report at bugs.python.org  Wed Jan 13 05:55:35 2021
From: report at bugs.python.org (Steve Stagg)
Date: Wed, 13 Jan 2021 10:55:35 +0000
Subject: [issue42899] Inconsistent elimination of empty blocks by optimizer
 causes __bool__calls to be skipped in some exception handling scenarios
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610535335.81.0.878058773539.issue42899@roundup.psfhosted.org>


Steve Stagg <stestagg at gmail.com> added the comment:

I re-read the change that introduced this, and the situation is slightly more complex.

While the wording is understandably slightly ambiguous, the change talks about the following example:

if a:
  pass
else:
  <do stuff>

In this scenario, the compiler is trying to eliminate the <pass> block, because it's redundant, and this seems totally fine to me.  The condition is still evaluated, but it's changing how the empty branch is handled.

Taking the example given in the ticket:
```
while True:
  if a:
     pass
  else:
     break
```

Before the change, the DIS is:

  2           0 NOP

  3     >>    2 LOAD_NAME                0 (a)
              4 POP_JUMP_IF_FALSE       10

  4           6 JUMP_FORWARD             0 (to 8)

  2     >>    8 JUMP_ABSOLUTE            2

  6     >>   10 LOAD_CONST               1 (None)
             12 RETURN_VALUE

  2          14 LOAD_CONST               1 (None)
             16 RETURN_VALUE

After the change, the DIS is:

  2           0 NOP

  3     >>    2 LOAD_NAME                0 (a)
              4 POP_JUMP_IF_FALSE       10

  4           6 NOP

  2           8 JUMP_ABSOLUTE            2

  6     >>   10 LOAD_CONST               1 (None)
             12 RETURN_VALUE

  2          14 LOAD_CONST               1 (None)
             16 RETURN_VALUE

Point being, the POP_JUMP_IF_FALSE is still invoked in the intended scenario, just some jumps are removed (OmG asserts this is faster).


So, If we test the simple case on MASTER, the following code still does the 'right thing'(tm) by evaluating bool(a):

```
class A:
    def __bool__(self):
        print("BOOL")
        return False

a = A()
if a:
   pass
```
prints "BOOL"

It seems like the issue is encountered when the "if" statement is mixed with (some other control flow scenarios, for example) exception handling:

```
class A:
    def __bool__(self):
        print("BOOL")
        return False

a = A()

try:
  if a:
     pass
except:
    raise
``
prints nothing


So, ignoring the larger discussion about if it's allowed to elide bool calls etc, this feels like an unintended side-effect of an otherwise non-contentious branch optimization, and we should either really understand the situation in-depth (all possible situations where this might happen), or just treat this as a bug and fix ti

----------
title: Is it legal to eliminate tests of a value, when that test has no effect on control flow? -> Inconsistent elimination of empty blocks by optimizer causes __bool__calls to be skipped in some exception handling scenarios

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Wed Jan 13 05:55:50 2021
From: report at bugs.python.org (Jurjen N.E. Bos)
Date: Wed, 13 Jan 2021 10:55:50 +0000
Subject: [issue42911] Addition chains for pow saves 10 % time!
In-Reply-To: <1610463140.75.0.177431925065.issue42911@roundup.psfhosted.org>
Message-ID: <1610535350.88.0.692355384602.issue42911@roundup.psfhosted.org>


Change by Jurjen N.E. Bos <jneb at users.sourceforge.net>:


----------
keywords: +patch
pull_requests: +23032
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24206

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42911>
_______________________________________

From report at bugs.python.org  Wed Jan 13 06:00:51 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Wed, 13 Jan 2021 11:00:51 +0000
Subject: [issue40956] Use Argument Clinic in sqlite3
In-Reply-To: <1591956335.72.0.553737405887.issue40956@roundup.psfhosted.org>
Message-ID: <1610535651.07.0.0219746215739.issue40956@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

Looks like this is the culprit: https://github.com/python/cpython/blob/2396614b8958ad202378fd71a598eb4106ac5896/Modules/_sqlite/cursor.c#L825

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40956>
_______________________________________

From report at bugs.python.org  Wed Jan 13 06:22:09 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 13 Jan 2021 11:22:09 +0000
Subject: [issue42923] Py_FatalError(): dump the list of extension modules
In-Reply-To: <1610535013.1.0.942204365805.issue42923@roundup.psfhosted.org>
Message-ID: <1610536929.26.0.995429367893.issue42923@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
keywords: +patch
pull_requests: +23034
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24207

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42923>
_______________________________________

From report at bugs.python.org  Wed Jan 13 06:23:09 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 13 Jan 2021 11:23:09 +0000
Subject: [issue42923] Py_FatalError(): dump the list of extension modules
In-Reply-To: <1610535013.1.0.942204365805.issue42923@roundup.psfhosted.org>
Message-ID: <1610536989.12.0.810138653715.issue42923@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Example using PR 24207, the new part the "Extension modules:" list at the end:
---------------
$ ./python -X faulthandler
Python 3.10.0a4+ (heads/master-dirty:2396614b89, Jan 13 2021, 12:09:15) 
>>> import ctypes
>>> ctypes.string_at(0)
Fatal Python error: Segmentation fault

Current thread 0x00007f0aabd09740 (most recent call first):
  File "/home/vstinner/python/master/Lib/ctypes/__init__.py", line 517 in string_at
  File "<stdin>", line 1 in <module>

Extension modules:
 * sys
 * builtins
 * _imp
 * _thread
 * _warnings
 * _weakref
 * _io
 * marshal
 * posix
 * time
 * faulthandler
 * _codecs
 * _signal
 * _abc
 * _stat
 * readline
 * atexit
 * itertools
 * _operator
 * _collections
 * _functools
 * _opcode
 * _sre
 * _locale
 * _ctypes
 * _struct
---------------

Here you can see that the _ctypes module is loaded.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42923>
_______________________________________

From report at bugs.python.org  Wed Jan 13 06:26:55 2021
From: report at bugs.python.org (tholl)
Date: Wed, 13 Jan 2021 11:26:55 +0000
Subject: [issue42924] bytearray_repeat copies from ob_bytes instead of ob_start
Message-ID: <1610537215.58.0.240765902048.issue42924@roundup.psfhosted.org>


New submission from tholl <py at any.tholl.xyz>:

`bytearray_repeat` uses `ob_bytes` rather than `ob_start` as its source data for copying, leading to incorrect results in some edge cases where the two are distinct. It should probably use `PyByteArray_AS_STRING(self)` just like `bytearray_irepeat` and basically all the other functions.

As far as I can see, these edge cases occur pretty much only after `bytearray_setslice_linear`, where `ob_start` can be adjusted without changing `ob_bytes`. 

A simple example (also attached as poc.py):

>>> ba = bytearray(b'0123456789abcdef')
>>> ba[:10] = b'test'
>>> print(ba)
bytearray(b'testabcdef')
>>> print(ba * 1)
bytearray(b'012345test')

I'll try to submit a PR for this later today.

----------
components: Interpreter Core
files: poc.py
messages: 385017
nosy: tholl
priority: normal
severity: normal
status: open
title: bytearray_repeat copies from ob_bytes instead of ob_start
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9
Added file: https://bugs.python.org/file49739/poc.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42924>
_______________________________________

From report at bugs.python.org  Wed Jan 13 06:27:04 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 13 Jan 2021 11:27:04 +0000
Subject: [issue42879] SystemError from class 'int'
In-Reply-To: <1610232607.93.0.155495951465.issue42879@roundup.psfhosted.org>
Message-ID: <1610537224.06.0.428359692253.issue42879@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> I'll close this here, since that report indicates a bug in Pygame.

FYI I created bpo-42923 "Py_FatalError(): dump the list of extension modules" to help users to understand that the error can come from third party C extensions rather than Python itself.

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42879>
_______________________________________

From report at bugs.python.org  Wed Jan 13 06:28:04 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Wed, 13 Jan 2021 11:28:04 +0000
Subject: [issue40956] Use Argument Clinic in sqlite3
In-Reply-To: <1591956335.72.0.553737405887.issue40956@roundup.psfhosted.org>
Message-ID: <1610537284.05.0.336174377275.issue40956@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

I don't see how to easily solve this in AC: we want the arraysize of the cursor instance, but I don't see how I'm going to get this via the AC namespace/context. Using a "bogus" default value works:

size as maxrows: int(c_default='self->arraysize') = 1

Is there a better way?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40956>
_______________________________________

From report at bugs.python.org  Wed Jan 13 06:28:58 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 13 Jan 2021 11:28:58 +0000
Subject: [issue42923] Py_FatalError(): dump the list of extension modules
In-Reply-To: <1610535013.1.0.942204365805.issue42923@roundup.psfhosted.org>
Message-ID: <1610537338.22.0.414667586258.issue42923@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> It's common that Python crashes are coming from third party extension modules, rather than Python itself. Recent example: bpo-42891 crash (...)

Another recent example: bpo-42879 "python: Objects/abstract.c:155: PyObject_GetItem: Assertion `(item != NULL) ^ (PyErr_Occurred() != NULL)' failed." was a bug in pygame.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42923>
_______________________________________

From report at bugs.python.org  Wed Jan 13 06:30:12 2021
From: report at bugs.python.org (Matthias Klose)
Date: Wed, 13 Jan 2021 11:30:12 +0000
Subject: [issue42843] What min_sphinx for Python 3.10
In-Reply-To: <1609951966.97.0.867485424131.issue42843@roundup.psfhosted.org>
Message-ID: <1610537412.13.0.188858123607.issue42843@roundup.psfhosted.org>


Matthias Klose <doko at debian.org> added the comment:

Ubuntu 20.04 LTS still sees subminor Python 3.8 version updates, and needs to use sphinx 1.8.5.

----------
nosy: +doko

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42843>
_______________________________________

From report at bugs.python.org  Wed Jan 13 07:05:52 2021
From: report at bugs.python.org (Mark Shannon)
Date: Wed, 13 Jan 2021 12:05:52 +0000
Subject: [issue42908] Incorrect line numbers at end of try-except and with
 statements containing if False: pass
In-Reply-To: <1610450720.62.0.32697426383.issue42908@roundup.psfhosted.org>
Message-ID: <1610539552.87.0.821714716513.issue42908@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:


New changeset 3bd6035b6baf1a7d51b7cc2c6bb2c81886236b67 by Mark Shannon in branch 'master':
bpo-42908: Mark cleanup code at end of try-except and with artificial (#24202)
https://github.com/python/cpython/commit/3bd6035b6baf1a7d51b7cc2c6bb2c81886236b67


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42908>
_______________________________________

From report at bugs.python.org  Wed Jan 13 07:13:57 2021
From: report at bugs.python.org (Mark Shannon)
Date: Wed, 13 Jan 2021 12:13:57 +0000
Subject: [issue42908] Incorrect line numbers at end of try-except and with
 statements containing if False: pass
In-Reply-To: <1610450720.62.0.32697426383.issue42908@roundup.psfhosted.org>
Message-ID: <1610540037.21.0.449179908844.issue42908@roundup.psfhosted.org>


Change by Mark Shannon <mark at hotpy.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42908>
_______________________________________

From report at bugs.python.org  Wed Jan 13 07:57:56 2021
From: report at bugs.python.org (ChenXuan)
Date: Wed, 13 Jan 2021 12:57:56 +0000
Subject: [issue42925] Error trace of else inside class
Message-ID: <1610542676.59.0.693705484765.issue42925@roundup.psfhosted.org>


New submission from ChenXuan <522169030 at qq.com>:

Hi, python3.10 seems to give wrong trace here:
class A:
   if 3 < 9:
      a = 1
   else:
      a = 2

result:
    2: class A:
    1:    if 3 < 9:
    1:       a = 1
          else:
    1:       a = 2
       

command: python3.10 -m trace --count -C . a1.py
environment: Linux 5.8.0-36-generic #40~20.04.1-Ubuntu SMP
version: python3.10.0a4

----------
files: a1.py
messages: 385023
nosy: ChenXuan
priority: normal
severity: normal
status: open
title: Error trace of else inside class
versions: Python 3.10
Added file: https://bugs.python.org/file49740/a1.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42925>
_______________________________________

From report at bugs.python.org  Wed Jan 13 08:15:28 2021
From: report at bugs.python.org (Roundup Robot)
Date: Wed, 13 Jan 2021 13:15:28 +0000
Subject: [issue42924] bytearray_repeat copies from ob_bytes instead of ob_start
In-Reply-To: <1610537215.58.0.240765902048.issue42924@roundup.psfhosted.org>
Message-ID: <1610543728.8.0.210701539528.issue42924@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
keywords: +patch
nosy: +python-dev
nosy_count: 1.0 -> 2.0
pull_requests: +23035
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24208

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42924>
_______________________________________

From report at bugs.python.org  Wed Jan 13 08:23:05 2021
From: report at bugs.python.org (ChenXuan)
Date: Wed, 13 Jan 2021 13:23:05 +0000
Subject: [issue42925] Error trace of else inside class
In-Reply-To: <1610542676.59.0.693705484765.issue42925@roundup.psfhosted.org>
Message-ID: <1610544185.72.0.622887907185.issue42925@roundup.psfhosted.org>


ChenXuan <522169030 at qq.com> added the comment:

another example:
if 1 < 10:
    b = 1
    if 0:
        a = 1
else:
    a = 1
output:
    1: if 1 < 10:
    1:     b = 1
    1:     if 0:
    1:         a = 1
       else:
           a = 1
Is this a bug or feature?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42925>
_______________________________________

From report at bugs.python.org  Wed Jan 13 08:37:23 2021
From: report at bugs.python.org (Eric V. Smith)
Date: Wed, 13 Jan 2021 13:37:23 +0000
Subject: [issue42914] pprint numbers with underscore
In-Reply-To: <1610493681.29.0.683565759752.issue42914@roundup.psfhosted.org>
Message-ID: <1610545043.64.0.1673156574.issue42914@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

+1 also. I agree with Raymond it should be optional.

----------
nosy: +eric.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42914>
_______________________________________

From report at bugs.python.org  Wed Jan 13 08:37:25 2021
From: report at bugs.python.org (tholl)
Date: Wed, 13 Jan 2021 13:37:25 +0000
Subject: [issue42924] bytearray_repeat copies from ob_bytes instead of ob_start
In-Reply-To: <1610537215.58.0.240765902048.issue42924@roundup.psfhosted.org>
Message-ID: <1610545045.17.0.700338610164.issue42924@roundup.psfhosted.org>


Change by tholl <py at any.tholl.xyz>:


----------
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42924>
_______________________________________

From report at bugs.python.org  Wed Jan 13 09:01:51 2021
From: report at bugs.python.org (Irit Katriel)
Date: Wed, 13 Jan 2021 14:01:51 +0000
Subject: [issue42877] TracebackException saves more data than it needs for
 format
In-Reply-To: <1610219460.26.0.944321944788.issue42877@roundup.psfhosted.org>
Message-ID: <1610546511.92.0.355303815012.issue42877@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
title: TracebackException saves more data than it needs -> TracebackException saves more data than it needs for format

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42877>
_______________________________________

From report at bugs.python.org  Wed Jan 13 09:27:54 2021
From: report at bugs.python.org (Mariatta)
Date: Wed, 13 Jan 2021 14:27:54 +0000
Subject: =?utf-8?q?=5Bissue42922=5D_Enlace_a_descripci=C3=B3n_de_funci=C3=B3n_=27d?=
 =?utf-8?q?ir=27_faltante?=
In-Reply-To: <1610525482.8.0.875772925154.issue42922@roundup.psfhosted.org>
Message-ID: <1610548074.2.0.527722677665.issue42922@roundup.psfhosted.org>


Mariatta <mariatta at python.org> added the comment:

Hi, the Spanish translation for Python docs is managed at  https://github.com/python/python-docs-es

Can you please open the issue there? Thanks you. Really sorry that I don't speak Spanish :( so I'm replying in English.

----------
nosy: +Mariatta
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42922>
_______________________________________

From report at bugs.python.org  Wed Jan 13 09:37:49 2021
From: report at bugs.python.org (Mark Shannon)
Date: Wed, 13 Jan 2021 14:37:49 +0000
Subject: [issue42908] Incorrect line numbers at end of try-except and with
 statements containing if False: pass
In-Reply-To: <1610450720.62.0.32697426383.issue42908@roundup.psfhosted.org>
Message-ID: <1610548669.35.0.303619617528.issue42908@roundup.psfhosted.org>


Change by Mark Shannon <mark at hotpy.org>:


----------
pull_requests: +23036
pull_request: https://github.com/python/cpython/pull/24209

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42908>
_______________________________________

From report at bugs.python.org  Wed Jan 13 09:43:25 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 13 Jan 2021 14:43:25 +0000
Subject: [issue42856] ensurepip: add configure --with-wheel-pkg-dir=PATH to
 get wheel packages from a system directory
In-Reply-To: <1610018466.49.0.695886938784.issue42856@roundup.psfhosted.org>
Message-ID: <1610549005.13.0.277994009029.issue42856@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +23037
pull_request: https://github.com/python/cpython/pull/24210

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42856>
_______________________________________

From report at bugs.python.org  Wed Jan 13 09:50:41 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 13 Jan 2021 14:50:41 +0000
Subject: [issue42856] ensurepip: add configure --with-wheel-pkg-dir=PATH to
 get wheel packages from a system directory
In-Reply-To: <1610018466.49.0.695886938784.issue42856@roundup.psfhosted.org>
Message-ID: <1610549441.35.0.469502240469.issue42856@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> For simplicity, I would avoid mixing wheels from 2 different directories.

Right. I wrote PR 24210 which is simpler. It either uses bundled wheels, or wheels from the directory.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42856>
_______________________________________

From report at bugs.python.org  Wed Jan 13 09:51:09 2021
From: report at bugs.python.org (Irit Katriel)
Date: Wed, 13 Jan 2021 14:51:09 +0000
Subject: [issue33809] Expose `capture_locals` parameter in `traceback`
 convenience functions
In-Reply-To: <1528473140.44.0.592728768989.issue33809@psf.upfronthosting.co.za>
Message-ID: <1610549469.68.0.331202927375.issue33809@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

I don't understand this request. If you ask TracebackExceptions to capture_locals then the FrameSummary object gets a dict of the reprs of the locals, which can be introspected and participate in __eq__ checks but nothing else happens with them. What would the convenience functions do with this parameter?

Ulrich, can you explain the use case or how you see this working?

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33809>
_______________________________________

From report at bugs.python.org  Wed Jan 13 09:51:56 2021
From: report at bugs.python.org (Matej Cepl)
Date: Wed, 13 Jan 2021 14:51:56 +0000
Subject: [issue42856] ensurepip: add configure --with-wheel-pkg-dir=PATH to
 get wheel packages from a system directory
In-Reply-To: <1610018466.49.0.695886938784.issue42856@roundup.psfhosted.org>
Message-ID: <1610549516.28.0.876469378165.issue42856@roundup.psfhosted.org>


Change by Matej Cepl <mcepl at cepl.eu>:


----------
nosy: +mcepl

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42856>
_______________________________________

From report at bugs.python.org  Wed Jan 13 09:53:49 2021
From: report at bugs.python.org (Irit Katriel)
Date: Wed, 13 Jan 2021 14:53:49 +0000
Subject: [issue33809] Expose `capture_locals` parameter in `traceback`
 convenience functions
In-Reply-To: <1528473140.44.0.592728768989.issue33809@psf.upfronthosting.co.za>
Message-ID: <1610549629.38.0.252361095184.issue33809@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Sorry, I spoke too soon - see now that the locals are use in the StackSummary.format().

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33809>
_______________________________________

From report at bugs.python.org  Wed Jan 13 09:57:29 2021
From: report at bugs.python.org (Irit Katriel)
Date: Wed, 13 Jan 2021 14:57:29 +0000
Subject: [issue33809] Expose `capture_locals` parameter in `traceback`
 convenience functions
In-Reply-To: <1528473140.44.0.592728768989.issue33809@psf.upfronthosting.co.za>
Message-ID: <1610549849.57.0.232666946077.issue33809@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

That said, you can always use 

TracebackException.from_exception(exc, capture_locals=True).format()

which is not much longer than 

print_exception(exc, capture_locals=True)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33809>
_______________________________________

From report at bugs.python.org  Wed Jan 13 09:58:19 2021
From: report at bugs.python.org (Matej Cepl)
Date: Wed, 13 Jan 2021 14:58:19 +0000
Subject: [issue42856] ensurepip: add configure --with-wheel-pkg-dir=PATH to
 get wheel packages from a system directory
In-Reply-To: <1610018466.49.0.695886938784.issue42856@roundup.psfhosted.org>
Message-ID: <1610549899.46.0.567314129324.issue42856@roundup.psfhosted.org>


Matej Cepl <mcepl at cepl.eu> added the comment:

We (SUSE) have updated versions of the wheels as special Sources, and then this in the %prep stage of our SPEC file:

    # Replace bundled wheels with the updates ones
    rm -v Lib/ensurepip/_bundled/*.whl
    cp -v %{SOURCE20} %{SOURCE21} Lib/ensurepip/_bundled/
    STVER=$(basename %{SOURCE20}|cut -d- -f2)
    PIPVER=$(basename %{SOURCE21}|cut -d- -f2)
    sed -E -i -e "s/^(\s*_SETUPTOOLS_VERSION\s+=\s+)\"[0-9.]+\"/\1\"${STVER}\"/" \
              -e "s/^(\s*_PIP_VERSION\s+=\s+)\"[0-9.]+\"/\1\"${PIPVER}\"/" \
        Lib/ensurepip/__init__.py

A bit of manual work required, but it doesn't lead to so incredible convoluted constructs as I see in Fedora (nothing against it, but our build system is already convoluted enough).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42856>
_______________________________________

From report at bugs.python.org  Wed Jan 13 10:00:44 2021
From: report at bugs.python.org (=?utf-8?q?Miro_Hron=C4=8Dok?=)
Date: Wed, 13 Jan 2021 15:00:44 +0000
Subject: [issue42856] ensurepip: add configure --with-wheel-pkg-dir=PATH to
 get wheel packages from a system directory
In-Reply-To: <1610018466.49.0.695886938784.issue42856@roundup.psfhosted.org>
Message-ID: <1610550044.9.0.796150512656.issue42856@roundup.psfhosted.org>


Miro Hron?ok <miro at hroncok.cz> added the comment:

In Fedora, we update the wheels independently without rebuilding Python.

What incredible convoluted constructs do you have in mind in particular?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42856>
_______________________________________

From report at bugs.python.org  Wed Jan 13 10:03:24 2021
From: report at bugs.python.org (Mark Shannon)
Date: Wed, 13 Jan 2021 15:03:24 +0000
Subject: [issue42926] Split compiler into code-gen, optimizer and assembler.
Message-ID: <1610550204.0.0.923150494092.issue42926@roundup.psfhosted.org>


New submission from Mark Shannon <mark at hotpy.org>:

Currently the compiler operates in three main passes:

Code-gen
Optimize
Assemble

The problem is that these passes use the same basic-block based CFG, leading to unnecessary coupling and inefficiencies.
A basic block CFG is awkward and error-prone for the code-gen, but not very efficient for the optimizer and assembler.

A better design would be for the code-gen to create a single linear sequence of instructions. The optimizer would take this and produce a list of extended-blocks for the assembler to consume.

code-gen -> (list of instructions) -> optimizer
optimizer -> (list of extended blocks) -> assembler

(Extended blocks have a single entry and multiple exits, unlike basic blocks which have a single entry and single exit)

This would:
1. Reduce memory use considerably (the size of instruction and block data structures would be about 60% of current)
2. Be faster (Less CFG management).
3. Produce better code (extended blocks are a better unit for optimization that basic blocks).
4. Be easier to maintain:
  a) Code-gen wouldn't have to worry about creating a correct CFG.
  b) The optimizer wouldn't need to handle empty blocks and track which basic blocks form an extended block.


Apart from the changes to the compiler, it would help if we made all branch instructions absolute (or have a backward dual) to accommodate free reordering of blocks in the optimizer.

----------
messages: 385033
nosy: Mark.Shannon
priority: normal
severity: normal
status: open
title: Split compiler into code-gen, optimizer and assembler.

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42926>
_______________________________________

From report at bugs.python.org  Wed Jan 13 10:04:56 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 13 Jan 2021 15:04:56 +0000
Subject: [issue42914] pprint numbers with underscore
In-Reply-To: <1610493681.29.0.683565759752.issue42914@roundup.psfhosted.org>
Message-ID: <1610550296.19.0.889176729442.issue42914@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

>>> format(10**9, '_d')
'1_000_000_000'

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42914>
_______________________________________

From report at bugs.python.org  Wed Jan 13 10:11:11 2021
From: report at bugs.python.org (Mark Shannon)
Date: Wed, 13 Jan 2021 15:11:11 +0000
Subject: [issue39934] Fatal Python error "XXX block stack overflow" when
 exception stacks >10
In-Reply-To: <1583933092.46.0.675431384436.issue39934@roundup.psfhosted.org>
Message-ID: <1610550671.38.0.476723407771.issue39934@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

Does this need backporting to 3.8, or is 3.9 sufficient?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39934>
_______________________________________

From report at bugs.python.org  Wed Jan 13 10:12:33 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 13 Jan 2021 15:12:33 +0000
Subject: [issue40956] Use Argument Clinic in sqlite3
In-Reply-To: <1591956335.72.0.553737405887.issue40956@roundup.psfhosted.org>
Message-ID: <1610550753.96.0.412912677308.issue40956@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Use NULL.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40956>
_______________________________________

From report at bugs.python.org  Wed Jan 13 10:14:36 2021
From: report at bugs.python.org (Irit Katriel)
Date: Wed, 13 Jan 2021 15:14:36 +0000
Subject: [issue39934] Fatal Python error "XXX block stack overflow" when
 exception stacks >10
In-Reply-To: <1583933092.46.0.675431384436.issue39934@roundup.psfhosted.org>
Message-ID: <1610550876.14.0.623692389847.issue39934@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

There were additional merge conflicts when I tried to create a manual 3.8 backport, more significant than the 3.9 ones IIRC.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39934>
_______________________________________

From report at bugs.python.org  Wed Jan 13 10:29:21 2021
From: report at bugs.python.org (Mark Shannon)
Date: Wed, 13 Jan 2021 15:29:21 +0000
Subject: [issue42899] Is it legal to eliminate tests of a value,
 when that test has no effect on control flow
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610551761.44.0.680008074442.issue42899@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

Steve,
Please don't change the title of the issue.

Sure, the optimizer is "inconsistent".
Optimizations are applied in some cases, and not in others.
That's just how compilers work.

The issue here is whether the optimizer is allowed to skip the call to __bool__() if the result doesn't effect the observable effect of running the program.

----------
title: Inconsistent elimination of empty blocks by optimizer causes __bool__calls to be skipped in some exception handling scenarios -> Is it legal to eliminate tests of a value, when that test has no effect on control flow

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Wed Jan 13 10:29:48 2021
From: report at bugs.python.org (Mark Shannon)
Date: Wed, 13 Jan 2021 15:29:48 +0000
Subject: [issue42899] Is it legal to eliminate tests of a value,
 when that test has no effect on control flow?
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610551788.26.0.0539042900636.issue42899@roundup.psfhosted.org>


Change by Mark Shannon <mark at hotpy.org>:


----------
title: Is it legal to eliminate tests of a value, when that test has no effect on control flow -> Is it legal to eliminate tests of a value, when that test has no effect on control flow?

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Wed Jan 13 10:41:57 2021
From: report at bugs.python.org (Mark Shannon)
Date: Wed, 13 Jan 2021 15:41:57 +0000
Subject: [issue39934] Fatal Python error "XXX block stack overflow" when
 exception stacks >10
In-Reply-To: <1583933092.46.0.675431384436.issue39934@roundup.psfhosted.org>
Message-ID: <1610552517.29.0.84715516201.issue39934@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

Pablo, are you OK closing this without a 3.8 backport?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39934>
_______________________________________

From report at bugs.python.org  Wed Jan 13 10:42:59 2021
From: report at bugs.python.org (Steve Stagg)
Date: Wed, 13 Jan 2021 15:42:59 +0000
Subject: [issue42899] Is it legal to eliminate tests of a value,
 when that test has no effect on control flow?
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610552579.03.0.187739808354.issue42899@roundup.psfhosted.org>


Steve Stagg <stestagg at gmail.com> added the comment:

Oops, sorry, didn't realise there were such rules.  

The reasoning for me making the change to the title is that that the original PR didn't mention skipping actual condition logic, but does mention skipping unreachable blocks, with the examples provided (either by accident or intent) showing cases where the condition was still included.

I thus assumed the change that has been implemented had bad unintended side-effects (a bug), so wanted to capture that and, if any consensus on allowing the optimizer to skip bool() calls is ever reached on the mailing list, an explicit issue would be raised to cover that change.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Wed Jan 13 10:49:33 2021
From: report at bugs.python.org (Mark Shannon)
Date: Wed, 13 Jan 2021 15:49:33 +0000
Subject: [issue42693] "if 0:" lines are traced; they didn't use to be
In-Reply-To: <1608498368.47.0.692310939381.issue42693@roundup.psfhosted.org>
Message-ID: <1610552973.03.0.718132163552.issue42693@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

Unless anyone objects, I'm going to close this issue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42693>
_______________________________________

From report at bugs.python.org  Wed Jan 13 10:51:16 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 13 Jan 2021 15:51:16 +0000
Subject: [issue39934] Fatal Python error "XXX block stack overflow" when
 exception stacks >10
In-Reply-To: <1583933092.46.0.675431384436.issue39934@roundup.psfhosted.org>
Message-ID: <1610553076.49.0.730054192709.issue39934@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> Pablo, are you OK closing this without a 3.8 backport?

I would be supportive, but we should check with ?ukasz as he is the release manager of 3.8

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39934>
_______________________________________

From report at bugs.python.org  Wed Jan 13 10:52:32 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 13 Jan 2021 15:52:32 +0000
Subject: [issue42926] Split compiler into code-gen, optimizer and assembler.
In-Reply-To: <1610550204.0.0.923150494092.issue42926@roundup.psfhosted.org>
Message-ID: <1610553152.21.0.954997505476.issue42926@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

SGTM. But I?m not the one who has to work with it.

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42926>
_______________________________________

From report at bugs.python.org  Wed Jan 13 10:54:30 2021
From: report at bugs.python.org (Mark Shannon)
Date: Wed, 13 Jan 2021 15:54:30 +0000
Subject: [issue2506] Add mechanism to disable optimizations
In-Reply-To: <1206797921.05.0.258043023613.issue2506@psf.upfronthosting.co.za>
Message-ID: <1610553270.13.0.0537461181664.issue2506@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

In general, it is hard to define what is an optimization, and what is part of the compiler.

The original request was to disable optimizations that changed observable behavior w.r.t. line numbers.

All optimizations now respect line numbers, so proposed mechanism would be pointless.

----------
resolution:  -> rejected
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue2506>
_______________________________________

From report at bugs.python.org  Wed Jan 13 10:56:28 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 13 Jan 2021 15:56:28 +0000
Subject: [issue42899] Is it legal to eliminate tests of a value,
 when that test has no effect on control flow?
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610553388.62.0.992056353948.issue42899@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Is anyone still in favor of eliminating the __bool__ call from ?if p: pass??

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Wed Jan 13 11:17:03 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 13 Jan 2021 16:17:03 +0000
Subject: [issue42924] bytearray_repeat copies from ob_bytes instead of ob_start
In-Reply-To: <1610537215.58.0.240765902048.issue42924@roundup.psfhosted.org>
Message-ID: <1610554623.07.0.326810829417.issue42924@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 61d8c54f43a7871d016f98b38f86858817d927d5 by Tobias Holl in branch 'master':
bpo-42924: Fix incorrect copy in bytearray_repeat (GH-24208)
https://github.com/python/cpython/commit/61d8c54f43a7871d016f98b38f86858817d927d5


----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42924>
_______________________________________

From report at bugs.python.org  Wed Jan 13 11:17:19 2021
From: report at bugs.python.org (miss-islington)
Date: Wed, 13 Jan 2021 16:17:19 +0000
Subject: [issue42924] bytearray_repeat copies from ob_bytes instead of ob_start
In-Reply-To: <1610537215.58.0.240765902048.issue42924@roundup.psfhosted.org>
Message-ID: <1610554639.59.0.263447758918.issue42924@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 3.0 -> 4.0
pull_requests: +23038
pull_request: https://github.com/python/cpython/pull/24211

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42924>
_______________________________________

From report at bugs.python.org  Wed Jan 13 11:17:29 2021
From: report at bugs.python.org (miss-islington)
Date: Wed, 13 Jan 2021 16:17:29 +0000
Subject: [issue42924] bytearray_repeat copies from ob_bytes instead of ob_start
In-Reply-To: <1610537215.58.0.240765902048.issue42924@roundup.psfhosted.org>
Message-ID: <1610554649.25.0.12536304246.issue42924@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +23039
pull_request: https://github.com/python/cpython/pull/24212

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42924>
_______________________________________

From report at bugs.python.org  Wed Jan 13 11:20:06 2021
From: report at bugs.python.org (Mark Shannon)
Date: Wed, 13 Jan 2021 16:20:06 +0000
Subject: [issue34705] Python 3.8 changes how returns through finally clauses
 are traced
In-Reply-To: <1537103756.04.0.956365154283.issue34705@psf.upfronthosting.co.za>
Message-ID: <1610554806.04.0.382211886357.issue34705@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

In master, the sequence of events is:

1 call
2 line
3 line
returning
4 line
6 line
finally
6 return

which is the same as 3.7.
I now believe this is the correct trace, as the language spec states:

When a return, break or continue statement is executed in the try suite of a try?finally statement, the finally clause is also executed ?on the way out.?

So line 6 should be last line traced.

----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34705>
_______________________________________

From report at bugs.python.org  Wed Jan 13 11:21:31 2021
From: report at bugs.python.org (Mark Shannon)
Date: Wed, 13 Jan 2021 16:21:31 +0000
Subject: [issue39934] Fatal Python error "XXX block stack overflow" when
 exception stacks >10
In-Reply-To: <1583933092.46.0.675431384436.issue39934@roundup.psfhosted.org>
Message-ID: <1610554891.93.0.617242351947.issue39934@roundup.psfhosted.org>


Change by Mark Shannon <mark at hotpy.org>:


----------
nosy: +lukasz.langa

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39934>
_______________________________________

From report at bugs.python.org  Wed Jan 13 11:47:49 2021
From: report at bugs.python.org (Mark Shannon)
Date: Wed, 13 Jan 2021 16:47:49 +0000
Subject: [issue42899] Is it legal to eliminate tests of a value,
 when that test has no effect on control flow?
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610556469.6.0.100918596866.issue42899@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

The problem with using a specific syntax example, is that the optimizer doesn't work that way. It works on the CFG.

Any specification needs to be phrased in terms of general control flow, as other optimizations can enable this transformation.
e.g. 

if x or True:
    do_something()

is (in master) transformed to:

x
do_something()

I think your earlier suggestion of
"So I think dropping an *extra* call is fine, while dropping the *only* call is not."
is the best way to preserve 3.9 behavior.
It can be formalised as:
"The implementation is allowed to skip any boolean tests of a value, when it has effect on the flow of the program and at least one test has already been performed on that value."

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Wed Jan 13 11:50:35 2021
From: report at bugs.python.org (Mark Shannon)
Date: Wed, 13 Jan 2021 16:50:35 +0000
Subject: [issue42899] Is it legal to eliminate tests of a value,
 when that test has no effect on control flow?
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610556635.47.0.720400350528.issue42899@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

I missed a "no" in the above, which somewhat changed the meaning!

It should have read:

"The implementation is allowed to skip any boolean test of a value, when it has *no* effect on the flow of the program and at least one test has already been performed on that value."

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Wed Jan 13 12:33:59 2021
From: report at bugs.python.org (Steve Stagg)
Date: Wed, 13 Jan 2021 17:33:59 +0000
Subject: [issue42899] Is it legal to eliminate tests of a value,
 when that test has no effect on control flow?
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610559239.46.0.0918953527951.issue42899@roundup.psfhosted.org>


Steve Stagg <stestagg at gmail.com> added the comment:

Sounds great to me (with my approximately zero optimizer experience)

At risk of taking this too far, you /could/ add something like:

"skip any boolean test of a value _immediately_ following another boolean test, when it has no ..."

to this spec/guidance/whatever it is.

Just to prevent the risk of the `if` block being removed in future in ridiculous code like the following:

try:
  while True:
    a = x or y
    a.pop()
    if a:
      pass
except XIsEmptyError:
  ...

(I'm guessing we're pretty far from being able to rewrite enough for this to be a remotely credible optimization candidate anytime soon anyway)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Wed Jan 13 14:18:17 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 13 Jan 2021 19:18:17 +0000
Subject: [issue42899] Is it legal to eliminate tests of a value,
 when that test has no effect on control flow?
In-Reply-To: <1610404013.09.0.265713602389.issue42899@roundup.psfhosted.org>
Message-ID: <1610565497.72.0.985475153892.issue42899@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

> "The implementation is allowed to skip any boolean test of a value, when it has *no* effect on the flow of the program and at least one test has already been performed on that value."

+1

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42899>
_______________________________________

From report at bugs.python.org  Wed Jan 13 14:40:50 2021
From: report at bugs.python.org (Irit Katriel)
Date: Wed, 13 Jan 2021 19:40:50 +0000
Subject: [issue28146] Confusing error messages in str.format()
In-Reply-To: <1473851555.69.0.998405869153.issue28146@psf.upfronthosting.co.za>
Message-ID: <1610566850.85.0.738425421437.issue28146@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
keywords: +patch
nosy: +iritkatriel
nosy_count: 4.0 -> 5.0
pull_requests: +23040
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24213

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28146>
_______________________________________

From report at bugs.python.org  Wed Jan 13 14:42:01 2021
From: report at bugs.python.org (Irit Katriel)
Date: Wed, 13 Jan 2021 19:42:01 +0000
Subject: [issue28146] Confusing error messages in str.format()
In-Reply-To: <1473851555.69.0.998405869153.issue28146@psf.upfronthosting.co.za>
Message-ID: <1610566921.02.0.657283722468.issue28146@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

My PR fixes the second case ('{: }') and Serhiy's PR on Issue27772 fixes the first case ('{:04}').

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28146>
_______________________________________

From report at bugs.python.org  Wed Jan 13 15:34:18 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Wed, 13 Jan 2021 20:34:18 +0000
Subject: [issue40956] Use Argument Clinic in sqlite3
In-Reply-To: <1591956335.72.0.553737405887.issue40956@roundup.psfhosted.org>
Message-ID: <1610570058.17.0.276435082001.issue40956@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

Thanks, but I prefer the following:

size as maxrows: int(c_default='self->arraysize', py_default='<unrepresentable>') = 1

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40956>
_______________________________________

From report at bugs.python.org  Wed Jan 13 15:38:13 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Wed, 13 Jan 2021 20:38:13 +0000
Subject: [issue40956] Use Argument Clinic in sqlite3
In-Reply-To: <1591956335.72.0.553737405887.issue40956@roundup.psfhosted.org>
Message-ID: <1610570293.5.0.708297026194.issue40956@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
pull_requests: +23041
pull_request: https://github.com/python/cpython/pull/24214

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40956>
_______________________________________

From report at bugs.python.org  Wed Jan 13 16:01:04 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 13 Jan 2021 21:01:04 +0000
Subject: [issue42925] Error trace of else inside class
In-Reply-To: <1610542676.59.0.693705484765.issue42925@roundup.psfhosted.org>
Message-ID: <1610571664.58.0.817175486659.issue42925@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
nosy: +Mark.Shannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42925>
_______________________________________

From report at bugs.python.org  Wed Jan 13 16:27:32 2021
From: report at bugs.python.org (Kevin Chen)
Date: Wed, 13 Jan 2021 21:27:32 +0000
Subject: [issue42915] enum.Flag ~ bitwise negation is very slow and can't be
 defined as a Flag value
In-Reply-To: <1610494273.49.0.733516574302.issue42915@roundup.psfhosted.org>
Message-ID: <1610573252.5.0.105757252965.issue42915@roundup.psfhosted.org>


Kevin Chen <kevinjchen94 at gmail.com> added the comment:

Awesome thanks! Does the rewrite fix the issue with creating negated flags as well?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42915>
_______________________________________

From report at bugs.python.org  Wed Jan 13 16:52:36 2021
From: report at bugs.python.org (Ulrich Petri)
Date: Wed, 13 Jan 2021 21:52:36 +0000
Subject: [issue33809] Expose `capture_locals` parameter in `traceback`
 convenience functions
In-Reply-To: <1528473140.44.0.592728768989.issue33809@psf.upfronthosting.co.za>
Message-ID: <1610574756.14.0.97244493856.issue33809@roundup.psfhosted.org>


Ulrich Petri <python at ulo.pe> added the comment:

Functionally equivalent code would be:

print("".join(TracebackException.from_exception(ex, capture_locals=True).format()))

vs. (hypothetically)

print_exc(capture_locals=True)

Which is quite a significant difference IMO.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33809>
_______________________________________

From report at bugs.python.org  Wed Jan 13 17:21:06 2021
From: report at bugs.python.org (Irit Katriel)
Date: Wed, 13 Jan 2021 22:21:06 +0000
Subject: [issue33809] Expose `capture_locals` parameter in `traceback`
 convenience functions
In-Reply-To: <1528473140.44.0.592728768989.issue33809@psf.upfronthosting.co.za>
Message-ID: <1610576466.6.0.632400813207.issue33809@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

I?m not sure I agree that it?s a big win.
You can always add such a utility function in your code.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33809>
_______________________________________

From report at bugs.python.org  Wed Jan 13 17:52:22 2021
From: report at bugs.python.org (Ethan Furman)
Date: Wed, 13 Jan 2021 22:52:22 +0000
Subject: [issue42915] enum.Flag ~ bitwise negation is very slow and can't be
 defined as a Flag value
In-Reply-To: <1610494273.49.0.733516574302.issue42915@roundup.psfhosted.org>
Message-ID: <1610578342.73.0.921356145963.issue42915@roundup.psfhosted.org>


Ethan Furman <ethan at stoneleaf.us> added the comment:

Yes.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42915>
_______________________________________

From report at bugs.python.org  Wed Jan 13 18:17:47 2021
From: report at bugs.python.org (Berker Peksag)
Date: Wed, 13 Jan 2021 23:17:47 +0000
Subject: [issue40956] Use Argument Clinic in sqlite3
In-Reply-To: <1591956335.72.0.553737405887.issue40956@roundup.psfhosted.org>
Message-ID: <1610579867.52.0.69878370522.issue40956@roundup.psfhosted.org>


Berker Peksag <berker.peksag at gmail.com> added the comment:


New changeset a330365ca5ae836075f306334ab648bf23471481 by Erlend Egeberg Aasland in branch 'master':
bpo-40956: Fix sqlite3.Cursor.fetchmany() default value (GH-24214)
https://github.com/python/cpython/commit/a330365ca5ae836075f306334ab648bf23471481


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40956>
_______________________________________

From report at bugs.python.org  Wed Jan 13 18:54:38 2021
From: report at bugs.python.org (Jason R. Coombs)
Date: Wed, 13 Jan 2021 23:54:38 +0000
Subject: [issue41490] Update bundled pip to 20.2.1 and setuptools to 49.2.1
In-Reply-To: <1596662779.45.0.341157838113.issue41490@roundup.psfhosted.org>
Message-ID: <1610582078.8.0.81064991525.issue41490@roundup.psfhosted.org>


Jason R. Coombs <jaraco at jaraco.com> added the comment:

> Why do we keep setuptools?

I agree; would be good to remove it if possible.

There are many packages that fail to build without Setuptools being present or --use-pep517 indicated. It would be nice if pip could make --use-pep517 the default, update that in Python, and then remove Setuptools. I would expect that approach will cause a great deal less turmoil in the ecosystem.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41490>
_______________________________________

From report at bugs.python.org  Wed Jan 13 19:44:32 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Thu, 14 Jan 2021 00:44:32 +0000
Subject: [issue42923] Py_FatalError(): dump the list of extension modules
In-Reply-To: <1610535013.1.0.942204365805.issue42923@roundup.psfhosted.org>
Message-ID: <1610585072.83.0.648225303034.issue42923@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na at python.org>:


----------
nosy: +corona10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42923>
_______________________________________

From report at bugs.python.org  Wed Jan 13 20:26:05 2021
From: report at bugs.python.org (Ethan Furman)
Date: Thu, 14 Jan 2021 01:26:05 +0000
Subject: [issue32218] add __iter__ to enum.Flag members
In-Reply-To: <1512445452.31.0.213398074469.issue32218@psf.upfronthosting.co.za>
Message-ID: <1610587565.91.0.243472815877.issue32218@roundup.psfhosted.org>


Ethan Furman <ethan at stoneleaf.us> added the comment:

Final outcome:

`Flag` has been redesigned such that any flag comprised of a single bit is canonical; flags comprised of multiple bits are considered aliases.  During iteration only canonical flags are returned.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32218>
_______________________________________

From report at bugs.python.org  Wed Jan 13 20:32:44 2021
From: report at bugs.python.org (Xinmeng Xia)
Date: Thu, 14 Jan 2021 01:32:44 +0000
Subject: [issue42762] infinite loop resulted by "yield"
In-Reply-To: <1609130295.32.0.912620547313.issue42762@roundup.psfhosted.org>
Message-ID: <1610587964.24.0.0286162210244.issue42762@roundup.psfhosted.org>


Xinmeng Xia <xiaxm at smail.nju.edu.cn> added the comment:

I see,Thank you!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42762>
_______________________________________

From report at bugs.python.org  Wed Jan 13 20:32:53 2021
From: report at bugs.python.org (Ethan Furman)
Date: Thu, 14 Jan 2021 01:32:53 +0000
Subject: [issue38250] enum.Flag should be more set-like
In-Reply-To: <1569150842.66.0.799345616323.issue38250@roundup.psfhosted.org>
Message-ID: <1610587973.4.0.3778961225.issue38250@roundup.psfhosted.org>


Change by Ethan Furman <ethan at stoneleaf.us>:


----------
pull_requests: +23042
pull_request: https://github.com/python/cpython/pull/24215

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38250>
_______________________________________

From report at bugs.python.org  Wed Jan 13 23:20:53 2021
From: report at bugs.python.org (Ethan Furman)
Date: Thu, 14 Jan 2021 04:20:53 +0000
Subject: [issue38250] enum.Flag should be more set-like
In-Reply-To: <1569150842.66.0.799345616323.issue38250@roundup.psfhosted.org>
Message-ID: <1610598053.86.0.091798144936.issue38250@roundup.psfhosted.org>


Ethan Furman <ethan at stoneleaf.us> added the comment:

The code sample:

    class Color(IntFlag):
        BLACK = 0
        RED = 1
        GREEN = 2
        BLUE = 4
        PURPLE = RED | BLUE
        WHITE = RED | GREEN | BLUE

Here's the summary of the changes:

- single-bit flags are canonical
- multi-bit and zero-bit flags are aliases
+ only canonical flags are returned during iteration

    >>> list(Color.WHITE)
    [<Color.RED: 1>, <Color.GREEN: 2>, <Color.BLUE: 4>]

- negating a flag or flag set returns a new flag/flag set with the
  corresponding positive integer value

    >> Color.GREEN
    <Color.GREEN: 2>

    >> ~Color.GREEN
    <Color.PURPLE: 5>

- `name`s of pseudo-flags are constructed from their members' names

    >>> (Color.RED | Color.GREEN).name
    'RED|GREEN'

- multi-bit flags, aka aliases, can be returned from operations

    >>> Color.RED | Color.BLUE
    <Color.PURPLE: 5>

    >>> Color(7)  # or Color(-1)
    <Color.WHITE: 7>

- membership / containment checking has changed slightly -- zero valued flags
  are never considered to be contained:

    >>> Color.BLACK in Color.WHITE
    False

  otherwise, if all bits of one flag are in the other flag, True is returned:

    >>> Color.PURPLE in Color.WHITE
    True

There is a new boundary mechanism that controls how out-of-range / invalid bits are handled: `STRICT`, `CONFORM`, `EJECT', and `KEEP':

  STRICT --> raises an exception when presented with invalid values
  CONFORM --> discards any invalid bits
  EJECT --> lose Flag status and become a normal int with the given value
  KEEP --> keep the extra bits
           - keeps Flag status and extra bits
           - they don't show up in iteration
           - they do show up in repr() and str()

The default for Flag is STRICT, the default for IntFlag is DISCARD, and the default for _convert_ is KEEP (see ssl.Options for an example of when KEEP is needed).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38250>
_______________________________________

From report at bugs.python.org  Wed Jan 13 23:45:09 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Thu, 14 Jan 2021 04:45:09 +0000
Subject: [issue42927] Inline cache for slots
Message-ID: <1610599509.18.0.893371992468.issue42927@roundup.psfhosted.org>


New submission from Guido van Rossum <guido at python.org>:

I've been thinking about Python performance improvements, and I played around with an inline cache enhancement that supports slots. The results on a very simple benchmark look promising (30% speedup) but I'm terrible with our benchmarking tools, and this should be considered *very* carefully before we go ahead with it, since it could potentially pessimize the inline cache for standard attributes.

I'll attach a PR in a minute.

----------
messages: 385063
nosy: gvanrossum, pablogsal, yselivanov
priority: normal
severity: normal
stage: test needed
status: open
title: Inline cache for slots
type: performance
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42927>
_______________________________________

From report at bugs.python.org  Wed Jan 13 23:54:48 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Thu, 14 Jan 2021 04:54:48 +0000
Subject: [issue42927] Inline cache for slots
In-Reply-To: <1610599509.18.0.893371992468.issue42927@roundup.psfhosted.org>
Message-ID: <1610600088.35.0.241385774114.issue42927@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
keywords: +patch
pull_requests: +23043
stage: test needed -> patch review
pull_request: https://github.com/python/cpython/pull/24216

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42927>
_______________________________________

From report at bugs.python.org  Thu Jan 14 04:14:16 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 14 Jan 2021 09:14:16 +0000
Subject: [issue42927] Inline cache for slots
In-Reply-To: <1610599509.18.0.893371992468.issue42927@roundup.psfhosted.org>
Message-ID: <1610615656.53.0.342648784766.issue42927@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Slot means so many different things in Python. Here it's about data descriptors created when you set __slots__ in the class definition.

It is amazing that so large speed up can be achieved for such base operation.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42927>
_______________________________________

From report at bugs.python.org  Thu Jan 14 04:40:36 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 14 Jan 2021 09:40:36 +0000
Subject: [issue39273] ncurses does not include BUTTON5_* constants
In-Reply-To: <1578553141.45.0.141104357774.issue39273@roundup.psfhosted.org>
Message-ID: <1610617236.26.0.737195200796.issue39273@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 14cfa325c298ceb9eaf6b585a3cdcabf6c6378a9 by Zackery Spytz in branch 'master':
bpo-39273: Expose BUTTON5_* constants in the curses module if available (GH-17996)
https://github.com/python/cpython/commit/14cfa325c298ceb9eaf6b585a3cdcabf6c6378a9


----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39273>
_______________________________________

From report at bugs.python.org  Thu Jan 14 04:40:58 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 14 Jan 2021 09:40:58 +0000
Subject: [issue39273] ncurses does not include BUTTON5_* constants
In-Reply-To: <1578553141.45.0.141104357774.issue39273@roundup.psfhosted.org>
Message-ID: <1610617258.3.0.616970818797.issue39273@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.10 -Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39273>
_______________________________________

From report at bugs.python.org  Thu Jan 14 05:32:47 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 14 Jan 2021 10:32:47 +0000
Subject: [issue42927] Inline cache for slots
In-Reply-To: <1610599509.18.0.893371992468.issue42927@roundup.psfhosted.org>
Message-ID: <1610620367.34.0.82700080947.issue42927@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

I will try to run today the pyperformance test suite to see if there is any impact on standard attribute access

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42927>
_______________________________________

From report at bugs.python.org  Thu Jan 14 06:06:39 2021
From: report at bugs.python.org (=?utf-8?q?David_Luke=C5=A1?=)
Date: Thu, 14 Jan 2021 11:06:39 +0000
Subject: [issue29842] Make Executor.map work with infinite/large inputs
 correctly
In-Reply-To: <1489800776.56.0.575396558681.issue29842@psf.upfronthosting.co.za>
Message-ID: <1610622399.29.0.495500140745.issue29842@roundup.psfhosted.org>


David Luke? <dafydd.lukes at gmail.com> added the comment:

Any updates on this? Making Executor.map lazier would indeed be more consistent and very useful, it would be a shame if the PR went to waste :) It's a feature I keep wishing for in comparison with the older and process-only multiprocessing API. And eventually, yielding results in the order that tasks complete, like multiprocessing.Pool.imap_unordered, could be added on top of this, which would be really neat. (I know there's concurrent.futures.as_completed, but again, that one doesn't handle infinite iterables.)

----------
nosy: +David Luke?

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29842>
_______________________________________

From report at bugs.python.org  Thu Jan 14 07:19:39 2021
From: report at bugs.python.org (Petr Viktorin)
Date: Thu, 14 Jan 2021 12:19:39 +0000
Subject: [issue40052] Incorrect pointer alignment in _PyVectorcall_Function()
 of cpython/abstract.h
In-Reply-To: <1585033092.63.0.928625583781.issue40052@roundup.psfhosted.org>
Message-ID: <1610626779.78.0.39917484093.issue40052@roundup.psfhosted.org>


Change by Petr Viktorin <encukou at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40052>
_______________________________________

From report at bugs.python.org  Thu Jan 14 07:45:05 2021
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 14 Jan 2021 12:45:05 +0000
Subject: [issue33757] Failed separate
 test_pdb_next_command_in_generator_for_loop in test_pdb
In-Reply-To: <1528040605.03.0.592728768989.issue33757@psf.upfronthosting.co.za>
Message-ID: <1610628305.3.0.290088252491.issue33757@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This will be resolved once we push PR 21989, which resets the breakpoints before the test so the breakpoint number here is always 1.

----------
nosy: +iritkatriel, taleinat
versions: +Python 3.10 -Python 3.6, Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33757>
_______________________________________

From report at bugs.python.org  Thu Jan 14 10:53:34 2021
From: report at bugs.python.org (John Brearley)
Date: Thu, 14 Jan 2021 15:53:34 +0000
Subject: [issue42928] adafruit_ads1x15.ads1115 not comaptible with
 globals()[pkg_trunc] = importlib.import_module(pkg_trunc)
Message-ID: <1610639614.07.0.761554562908.issue42928@roundup.psfhosted.org>


New submission from John Brearley <brearley at bell.net>:

The first attached script ada_dbg1.py.txt which uses simple hardcoded import statements, the creation of ads1115 objects work fine. The second attached script ada_dbg2.py.txt uses a loop to import a variable list of packages, which allows for more graceful error handling & messaging.

globals()[pkg_trunc] = importlib.import_module(pkg_trunc)

The high level observation is that board, busio & adafruit_extended_bus objects continue to be correctly created after the import loop is done. Its just adafruit_ads1x15.ads1115 that does not like this import method.

The same line of code creating ads10 gets error:
Traceback (most recent call last):
File "ada_dbg2.py", line 33, in
ads10 = adafruit_ads1x15.ads1115.ADS1115(i2c_1, address=0x48)
AttributeError: module 'adafruit_ads1x15' has no attribute 'ads1115'

When I look at the global variables, from ads_dbg1.py, I see:
'adafruit_ads1x15': <module 'adafruit_ads1x15' from '/home/pi/.local/lib/python3.7/site-packages/adafruit_ads1x15/init.py'>,

When I look at the global variables, from ads_dbg2.py, I see:
'adafruit_ads1x15.ads1115': <module 'adafruit_ads1x15.ads1115' from '/home/pi/.local/lib/python3.7/site-packages/adafruit_ads1x15/ads1115.py'>,

So I tried doing the import without the .ads1115 appended, & got:
'adafruit_ads1x15': <module 'adafruit_ads1x15' from '/home/pi/.local/lib/python3.7/site-packages/adafruit_ads1x15/init.py'>,

But I still get an error.
Traceback (most recent call last):
File "ada_dbg2.py", line 33, in
ads10 = adafruit_ads1x15.ads1115.ADS1115(i2c_1, address=0x48)
AttributeError: module 'adafruit_ads1x15' has no attribute 'ads1115'

I went through all 8 permutations of with/without the .ads1115 in the importlib.import_module statement, no luck.

Comments?

----------
components: Interpreter Core
files: ada_dbg1.py
messages: 385069
nosy: jbrearley
priority: normal
severity: normal
status: open
title: adafruit_ads1x15.ads1115 not comaptible with globals()[pkg_trunc] = importlib.import_module(pkg_trunc)
type: behavior
versions: Python 3.9
Added file: https://bugs.python.org/file49741/ada_dbg1.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42928>
_______________________________________

From report at bugs.python.org  Thu Jan 14 10:54:40 2021
From: report at bugs.python.org (John Brearley)
Date: Thu, 14 Jan 2021 15:54:40 +0000
Subject: [issue42928] adafruit_ads1x15.ads1115 not comaptible with
 globals()[pkg_trunc] = importlib.import_module(pkg_trunc)
In-Reply-To: <1610639614.07.0.761554562908.issue42928@roundup.psfhosted.org>
Message-ID: <1610639680.62.0.797393673678.issue42928@roundup.psfhosted.org>


Change by John Brearley <brearley at bell.net>:


Added file: https://bugs.python.org/file49742/ada_dbg2.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42928>
_______________________________________

From report at bugs.python.org  Thu Jan 14 10:55:39 2021
From: report at bugs.python.org (John Brearley)
Date: Thu, 14 Jan 2021 15:55:39 +0000
Subject: [issue42928] adafruit_ads1x15.ads1115 not comaptible with
 globals()[pkg_trunc] = importlib.import_module(pkg_trunc)
In-Reply-To: <1610639614.07.0.761554562908.issue42928@roundup.psfhosted.org>
Message-ID: <1610639739.39.0.607135898936.issue42928@roundup.psfhosted.org>


Change by John Brearley <brearley at bell.net>:


Added file: https://bugs.python.org/file49743/print_data.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42928>
_______________________________________

From report at bugs.python.org  Thu Jan 14 11:03:10 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Thu, 14 Jan 2021 16:03:10 +0000
Subject: [issue42928] adafruit_ads1x15.ads1115 not comaptible with
 globals()[pkg_trunc] = importlib.import_module(pkg_trunc)
In-Reply-To: <1610639614.07.0.761554562908.issue42928@roundup.psfhosted.org>
Message-ID: <1610640190.11.0.600315352255.issue42928@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Sorry, this is not a help forum. Please try a user forum. Probably you have to find one with people using the Adafruit modules (and CircuitPython?).

----------
nosy: +gvanrossum
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42928>
_______________________________________

From report at bugs.python.org  Thu Jan 14 11:21:23 2021
From: report at bugs.python.org (John Brearley)
Date: Thu, 14 Jan 2021 16:21:23 +0000
Subject: [issue42928] adafruit_ads1x15.ads1115 not comaptible with
 globals()[pkg_trunc] = importlib.import_module(pkg_trunc)
In-Reply-To: <1610640190.11.0.600315352255.issue42928@roundup.psfhosted.org>
Message-ID: <3A3994B9E73F42CFA01283D754DCADCD@JRB3>


John Brearley <brearley at bell.net> added the comment:

Hi Guido: So the Adafruit CircuitPython forum has already said they aren't really sure this is their issue or not, see: https://github.com/adafruit/Adafruit_CircuitPython_ADS1x15/issues/66

What else would I need to do to get this looked at by people knowledgeable in importlib.import_module?

Regards, John Brearley
613-259-5622 (Home)

From: Guido van Rossum 
Sent: 2021-01-14 11:03 AM
To: brearley at bell.net 
Subject: [issue42928] adafruit_ads1x15.ads1115 not comaptible with globals()[pkg_trunc] = importlib.import_module(pkg_trunc)

Guido van Rossum <guido at python.org> added the comment:

Sorry, this is not a help forum. Please try a user forum. Probably you have to find one with people using the Adafruit modules (and CircuitPython?).

----------
nosy: +gvanrossum
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42928>
_______________________________________

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42928>
_______________________________________

From report at bugs.python.org  Thu Jan 14 13:09:29 2021
From: report at bugs.python.org (Mark Shannon)
Date: Thu, 14 Jan 2021 18:09:29 +0000
Subject: [issue42925] Error trace of else inside class
In-Reply-To: <1610542676.59.0.693705484765.issue42925@roundup.psfhosted.org>
Message-ID: <1610647769.83.0.680337502648.issue42925@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

It's a bug.

----------
assignee:  -> Mark.Shannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42925>
_______________________________________

From report at bugs.python.org  Thu Jan 14 13:27:34 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Thu, 14 Jan 2021 18:27:34 +0000
Subject: [issue42928] adafruit_ads1x15.ads1115 not comaptible with
 globals()[pkg_trunc] = importlib.import_module(pkg_trunc)
In-Reply-To: <1610639614.07.0.761554562908.issue42928@roundup.psfhosted.org>
Message-ID: <1610648854.24.0.0982475208973.issue42928@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

They did not imply it was a bug, just that they don't know enough about Python to be able help you.

As I said, this tracker is not a help forum (you're taking valuable time away from core developers). Try this forum: https://discuss.python.org/c/users/7 .

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42928>
_______________________________________

From report at bugs.python.org  Thu Jan 14 14:09:29 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Thu, 14 Jan 2021 19:09:29 +0000
Subject: [issue42920] How to add end_lineno in pyclbr?
In-Reply-To: <1610522324.61.0.549863868319.issue42920@roundup.psfhosted.org>
Message-ID: <1610651369.73.0.477858956197.issue42920@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Hopefully Batuhan (who changed this code ~2 months ago) or Cheryl (who reviewed your previous patch) can help you. You can just close your existing PR and create a new one, still linking to your original issue 38307.

----------
nosy: +BTaskaya, cheryl.sabella, gvanrossum
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42920>
_______________________________________

From report at bugs.python.org  Thu Jan 14 14:12:27 2021
From: report at bugs.python.org (Batuhan Taskaya)
Date: Thu, 14 Jan 2021 19:12:27 +0000
Subject: [issue42920] How to add end_lineno in pyclbr?
In-Reply-To: <1610522324.61.0.549863868319.issue42920@roundup.psfhosted.org>
Message-ID: <1610651547.29.0.257354369066.issue42920@roundup.psfhosted.org>


Batuhan Taskaya <isidentical at gmail.com> added the comment:

It is actually much easier now, considering that we are operating on the AST instead of the token stream. You probably only have to add a new field to Function/Class classes for end_lineno and access .end_lineno attribute here just like how we do for .lineno 
https://github.com/python/cpython/blob/971235827754eee6c0d9f7d39b52fecdfd4cb7b4/Lib/pyclbr.py#L212-L214

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42920>
_______________________________________

From report at bugs.python.org  Thu Jan 14 14:17:28 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 14 Jan 2021 19:17:28 +0000
Subject: [issue42927] Inline cache for slots
In-Reply-To: <1610599509.18.0.893371992468.issue42927@roundup.psfhosted.org>
Message-ID: <1610651848.22.0.656945076655.issue42927@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

These are the results:

venv ? python -m pyperf compare_to json_old/* -G --min-speed=2 --table
+---------------------+--------------------------------------+------------------------------------------+
| Benchmark           | 2021-01-14_09-40-master-14cfa325c298 | 2021-01-14_10-39-slotscache-9123a84ad8d4 |
+=====================+======================================+==========================================+
| float               | 148 ms                               | 133 ms: 1.11x faster                     |
+---------------------+--------------------------------------+------------------------------------------+
| pidigits            | 265 ms                               | 252 ms: 1.05x faster                     |
+---------------------+--------------------------------------+------------------------------------------+
| scimark_monte_carlo | 130 ms                               | 126 ms: 1.03x faster                     |
+---------------------+--------------------------------------+------------------------------------------+
| spectral_norm       | 168 ms                               | 164 ms: 1.03x faster                     |
+---------------------+--------------------------------------+------------------------------------------+
| logging_silent      | 221 ns                               | 216 ns: 1.02x faster                     |
+---------------------+--------------------------------------+------------------------------------------+
| sympy_expand        | 598 ms                               | 585 ms: 1.02x faster                     |
+---------------------+--------------------------------------+------------------------------------------+
| regex_v8            | 31.9 ms                              | 32.6 ms: 1.02x slower                    |
+---------------------+--------------------------------------+------------------------------------------+
| deltablue           | 8.93 ms                              | 9.16 ms: 1.03x slower                    |
+---------------------+--------------------------------------+------------------------------------------+
| unpickle            | 17.0 us                              | 17.7 us: 1.04x slower                    |
+---------------------+--------------------------------------+------------------------------------------+
| Geometric mean      | (ref)                                | 1.00x faster                             |
+---------------------+--------------------------------------+------------------------------------------+

Benchmark hidden because not significant (50): sympy_sum, sqlalchemy_imperative, sympy_str, sympy_integrate, dulwich_log, scimark_fft, genshi_text, tornado_http, regex_dna, sqlalchemy_declarative, mako, meteor_contest, unpickle_pure_python, xml_etree_parse, genshi_xml, scimark_sor, sqlite_synth, pickle_pure_python, nbody, pickle_dict, pyflate, regex_effbot, xml_etree_process, logging_simple, python_startup, 2to3, fannkuch, python_startup_no_site, raytrace, go, hexiom, scimark_lu, json_dumps, richards, logging_format, xml_etree_generate, chaos, telco, pickle_list, unpack_sequence, regex_compile, django_template, json_loads, crypto_pyaes, xml_etree_iterparse, unpickle_list, nqueens, chameleon, scimark_sparse_mat_mult, pickle
Ignored benchmarks (1) of json_old/2021-01-14_09-40-master-14cfa325c298.json.gz: pathlib


I uploaded the pyperf result data to bpo as well

----------
Added file: https://bugs.python.org/file49744/result2.zip

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42927>
_______________________________________

From report at bugs.python.org  Thu Jan 14 14:17:59 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 14 Jan 2021 19:17:59 +0000
Subject: [issue42927] Inline cache for slots
In-Reply-To: <1610599509.18.0.893371992468.issue42927@roundup.psfhosted.org>
Message-ID: <1610651879.15.0.597765930229.issue42927@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

So it seems that everything is in the noise range except the "float" benchmark that is 1.11x faster

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42927>
_______________________________________

From report at bugs.python.org  Thu Jan 14 14:20:43 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 14 Jan 2021 19:20:43 +0000
Subject: [issue42927] Inline cache for slots
In-Reply-To: <1610599509.18.0.893371992468.issue42927@roundup.psfhosted.org>
Message-ID: <1610652043.54.0.57438455043.issue42927@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Some microbenchmarks:

CURRENT MASTER:

Variable and attribute read access:
   4.5 ns       read_local
   5.8 ns       read_nonlocal
   7.8 ns       read_global
   7.8 ns       read_builtin
  21.2 ns       read_classvar_from_class
  19.1 ns       read_classvar_from_instance
  16.4 ns       read_instancevar
  23.6 ns       read_instancevar_slots
  20.2 ns       read_namedtuple
  40.5 ns       read_boundmethod

PR 24216

Variable and attribute read access:
   4.5 ns       read_local
   5.8 ns       read_nonlocal
   7.8 ns       read_global
   8.2 ns       read_builtin
  21.4 ns       read_classvar_from_class
  19.0 ns       read_classvar_from_instance
  16.6 ns       read_instancevar
  10.2 ns       read_instancevar_slots
  20.5 ns       read_namedtuple
  42.9 ns       read_boundmethod

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42927>
_______________________________________

From report at bugs.python.org  Thu Jan 14 14:21:18 2021
From: report at bugs.python.org (Yury Selivanov)
Date: Thu, 14 Jan 2021 19:21:18 +0000
Subject: [issue42927] Inline cache for slots
In-Reply-To: <1610599509.18.0.893371992468.issue42927@roundup.psfhosted.org>
Message-ID: <1610652078.88.0.801661875318.issue42927@roundup.psfhosted.org>


Yury Selivanov <yselivanov at gmail.com> added the comment:

> So it seems that everything is in the noise range except the "float" benchmark that is 1.11x faster

Yeah, this is why. https://github.com/python/pyperformance/blob/master/pyperformance/benchmarks/bm_float.py#L12

This is a great result, IMO. I'm +1 to merge this.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42927>
_______________________________________

From report at bugs.python.org  Thu Jan 14 14:21:48 2021
From: report at bugs.python.org (Yury Selivanov)
Date: Thu, 14 Jan 2021 19:21:48 +0000
Subject: [issue42927] Inline cache for slots
In-Reply-To: <1610599509.18.0.893371992468.issue42927@roundup.psfhosted.org>
Message-ID: <1610652108.1.0.448092467145.issue42927@roundup.psfhosted.org>


Yury Selivanov <yselivanov at gmail.com> added the comment:

> Some microbenchmarks:


Can you add a new one `read_slots`?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42927>
_______________________________________

From report at bugs.python.org  Thu Jan 14 14:24:12 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 14 Jan 2021 19:24:12 +0000
Subject: [issue42927] Inline cache for slots
In-Reply-To: <1610599509.18.0.893371992468.issue42927@roundup.psfhosted.org>
Message-ID: <1610652252.3.0.233244163624.issue42927@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> This is a great result, IMO. I'm +1 to merge this.

Same here. It would be good if Inada-san could confirm the benchmarks.

> Can you add a new one `read_slots`?

That should be "read_instancevar_slots". Or you refer to some other check?

----------
nosy: +methane

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42927>
_______________________________________

From report at bugs.python.org  Thu Jan 14 14:59:04 2021
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 14 Jan 2021 19:59:04 +0000
Subject: [issue42877] TracebackException saves more data than it needs for
 format
In-Reply-To: <1610219460.26.0.944321944788.issue42877@roundup.psfhosted.org>
Message-ID: <1610654344.66.0.662677345416.issue42877@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

As discussed on the PR: Since __context__ is documented, we can't just optimize it away. Instead we add a new param "compact", defaulted to False, which controls whether this optimization should be applied. 

Module level functions in traceback pass True since they don't access __context__ directly.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42877>
_______________________________________

From report at bugs.python.org  Thu Jan 14 15:33:58 2021
From: report at bugs.python.org (Batuhan Taskaya)
Date: Thu, 14 Jan 2021 20:33:58 +0000
Subject: [issue42927] Inline cache for slots
In-Reply-To: <1610599509.18.0.893371992468.issue42927@roundup.psfhosted.org>
Message-ID: <1610656438.62.0.571386844203.issue42927@roundup.psfhosted.org>


Change by Batuhan Taskaya <isidentical at gmail.com>:


----------
nosy: +BTaskaya

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42927>
_______________________________________

From report at bugs.python.org  Thu Jan 14 16:29:10 2021
From: report at bugs.python.org (fireattack)
Date: Thu, 14 Jan 2021 21:29:10 +0000
Subject: [issue42929] On Windows,
 shutil.move doesn't raise FileExistsError if dst exists like os.rename
Message-ID: <1610659750.09.0.0459892919552.issue42929@roundup.psfhosted.org>


New submission from fireattack <human.peng at gmail.com>:

According to https://docs.python.org/3.8/library/shutil.html#shutil.move

"If the destination already exists but is not a directory, it may be overwritten depending on os.rename() semantics."

I interpret "depending on os.rename() semantics" to mean it will follow os.rename()'s behavior.

According to https://docs.python.org/3/library/os.html#os.rename

"On Windows, if dst exists a FileExistsError is always raised."

However, their behaviors are not the same.

For os.rename, it does raise FileExistsError if dst exists.
For shutil.move, it silently overwrites dst.

It's either a bug in behavior of shutil.move, or the documentation need to be updated.

----------
components: Library (Lib)
messages: 385083
nosy: fireattack
priority: normal
severity: normal
status: open
title: On Windows, shutil.move doesn't raise FileExistsError if dst exists like os.rename
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42929>
_______________________________________

From report at bugs.python.org  Thu Jan 14 16:29:56 2021
From: report at bugs.python.org (fireattack)
Date: Thu, 14 Jan 2021 21:29:56 +0000
Subject: [issue42929] On Windows,
 shutil.move doesn't raise FileExistsError if dst exists like os.rename
In-Reply-To: <1610659750.09.0.0459892919552.issue42929@roundup.psfhosted.org>
Message-ID: <1610659796.07.0.605839177575.issue42929@roundup.psfhosted.org>


fireattack <human.peng at gmail.com> added the comment:

Sorry, I should link https://docs.python.org/3/library/shutil.html#shutil.move for latest doc. But the content is the same.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42929>
_______________________________________

From report at bugs.python.org  Thu Jan 14 16:36:39 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 14 Jan 2021 21:36:39 +0000
Subject: [issue42827] pegen parser: Multiline eval with assignment to function
 call: assertion failed
In-Reply-To: <1609793289.79.0.762652539307.issue42827@roundup.psfhosted.org>
Message-ID: <1610660199.27.0.792816211104.issue42827@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset e5fe509054183bed9aef42c92da8407d339e8af8 by Lysandros Nikolaou in branch 'master':
bpo-42827: Fix crash on SyntaxError in multiline expressions (GH-24140)
https://github.com/python/cpython/commit/e5fe509054183bed9aef42c92da8407d339e8af8


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42827>
_______________________________________

From report at bugs.python.org  Thu Jan 14 17:04:58 2021
From: report at bugs.python.org (Michael XU)
Date: Thu, 14 Jan 2021 22:04:58 +0000
Subject: [issue42930] xml.parsers.expat results differ buffer_text and / or
 buffer_size
Message-ID: <1610661898.66.0.880926471495.issue42930@roundup.psfhosted.org>


New submission from Michael XU <mfxecon at gmail.com>:

More details available here:
https://stackoverflow.com/questions/65676934/python-xml-parsers-expat-results-differ-based-on-buffer-text-true-or-false-and

Raw data to replicate the issue is available upon request.

----------
components: XML
messages: 385086
nosy: mfxuus
priority: normal
severity: normal
status: open
title: xml.parsers.expat results differ buffer_text and / or buffer_size
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42930>
_______________________________________

From report at bugs.python.org  Thu Jan 14 17:34:41 2021
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Thu, 14 Jan 2021 22:34:41 +0000
Subject: [issue42827] pegen parser: Multiline eval with assignment to function
 call: assertion failed
In-Reply-To: <1609793289.79.0.762652539307.issue42827@roundup.psfhosted.org>
Message-ID: <1610663681.13.0.831517770151.issue42827@roundup.psfhosted.org>


Lysandros Nikolaou <lisandrosnik at gmail.com> added the comment:

This is now fixed.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42827>
_______________________________________

From report at bugs.python.org  Thu Jan 14 17:56:19 2021
From: report at bugs.python.org (Stuart Axon)
Date: Thu, 14 Jan 2021 22:56:19 +0000
Subject: [issue7946] Convoy effect with I/O bound threads and New GIL
In-Reply-To: <1266353325.38.0.278549753357.issue7946@psf.upfronthosting.co.za>
Message-ID: <1610664979.44.0.150170456713.issue7946@roundup.psfhosted.org>


Stuart Axon <stu.axon at gmail.com> added the comment:

Catching up on the comments on this, it seems like nobody has enough certainty to say it will work well enough.

In Linux, the scheduler is pluggable, which lets other non-default schedulers be shipped and tried in the real world.

- See schedutil, introduced in Linux 4.7 in 2016 default for some architectures in 2020, in 2021 still not default everywhere.

Similarly I think this needs more testing than it will get living here as a bug.   If, like Linux the scheduler was pluggable, it could be shipped and enabled by real users that were brave enough and data could be collected.

----------
nosy: +stuaxo

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue7946>
_______________________________________

From report at bugs.python.org  Thu Jan 14 18:14:10 2021
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 14 Jan 2021 23:14:10 +0000
Subject: [issue33809] Expose `capture_locals` parameter in `traceback`
 convenience functions
In-Reply-To: <1528473140.44.0.592728768989.issue33809@psf.upfronthosting.co.za>
Message-ID: <1610666050.58.0.819303805246.issue33809@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

On the other hand, I think it makes sense to add a print() method to TracebackException so that you can do

TracebackException.from_exception(ex, capture_locals=True).print(file)

or whatever other combination of current or future params.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33809>
_______________________________________

From report at bugs.python.org  Thu Jan 14 18:23:32 2021
From: report at bugs.python.org (Eryk Sun)
Date: Thu, 14 Jan 2021 23:23:32 +0000
Subject: [issue42929] On Windows,
 shutil.move doesn't raise FileExistsError if dst exists like os.rename
In-Reply-To: <1610659750.09.0.0459892919552.issue42929@roundup.psfhosted.org>
Message-ID: <1610666612.1.0.096713915978.issue42929@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

shutil.move() has always fallen back on copy/unlink if os.rename() fails. This used to be clearly documented to account for the behavior of os.rename() in Windows, but the details were obscured over multiple rewrites. Currently the documentation makes it seem that copy/unlink are only used if the destination is on another filesystem.

Anyway, falling back on copy/unlink is sub-optimal as a move operation [1] and should be avoided wherever possible. It would be better to use os.replace() instead of os.rename(). This expands support for an atomic move within a filesystem, and it avoids the need to modify the documentation, except to reference os.replace() instead of os.rename().

---

[1] As implemented, a copy will not retain the source file's alternate data streams, security descriptor (i.e. owner and access/audit control), file attributes, or extended file attributes. There are additional problems with reparse points other than symlinks, but that's a difficult problem. We don't support raw copying of reparse points, or even high-level support for creating mountpoint (aka junction) reparse points. There's _winapi.CreateJunction, but the current implementation is just for testing purposes.

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42929>
_______________________________________

From report at bugs.python.org  Thu Jan 14 18:23:47 2021
From: report at bugs.python.org (Eryk Sun)
Date: Thu, 14 Jan 2021 23:23:47 +0000
Subject: [issue42929] On Windows,
 shutil.move doesn't raise FileExistsError if dst exists like os.rename
In-Reply-To: <1610659750.09.0.0459892919552.issue42929@roundup.psfhosted.org>
Message-ID: <1610666627.23.0.237939104622.issue42929@roundup.psfhosted.org>


Change by Eryk Sun <eryksun at gmail.com>:


----------
components: +Windows
nosy: +paul.moore, steve.dower, tim.golden, zach.ware
versions: +Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42929>
_______________________________________

From report at bugs.python.org  Thu Jan 14 18:24:01 2021
From: report at bugs.python.org (Setrak Balian)
Date: Thu, 14 Jan 2021 23:24:01 +0000
Subject: [issue42931] Include randbytes in random.__all__
Message-ID: <1610666641.18.0.781615576275.issue42931@roundup.psfhosted.org>


Change by Setrak Balian <setrak at faculty.ai>:


----------
components: Library (Lib)
nosy: sbalian
priority: normal
severity: normal
status: open
title: Include randbytes in random.__all__
type: behavior
versions: Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42931>
_______________________________________

From report at bugs.python.org  Thu Jan 14 19:17:50 2021
From: report at bugs.python.org (Setrak Balian)
Date: Fri, 15 Jan 2021 00:17:50 +0000
Subject: [issue42931] Include randbytes in random.__all__
Message-ID: <1610669870.94.0.181361130067.issue42931@roundup.psfhosted.org>


Change by Setrak Balian <seto.balian at gmail.com>:


----------
keywords: +patch
pull_requests: +23044
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24219

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42931>
_______________________________________

From report at bugs.python.org  Thu Jan 14 19:56:34 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 15 Jan 2021 00:56:34 +0000
Subject: [issue42931] Include randbytes in random.__all__
Message-ID: <1610672194.66.0.361386697664.issue42931@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
assignee:  -> rhettinger
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42931>
_______________________________________

From report at bugs.python.org  Thu Jan 14 19:59:28 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 15 Jan 2021 00:59:28 +0000
Subject: [issue42927] Inline cache for slots
In-Reply-To: <1610599509.18.0.893371992468.issue42927@roundup.psfhosted.org>
Message-ID: <1610672368.29.0.0630132152118.issue42927@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

+1 Thanks for this.

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42927>
_______________________________________

From report at bugs.python.org  Thu Jan 14 20:26:32 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 15 Jan 2021 01:26:32 +0000
Subject: [issue42827] pegen parser: Multiline eval with assignment to function
 call: assertion failed
In-Reply-To: <1609793289.79.0.762652539307.issue42827@roundup.psfhosted.org>
Message-ID: <1610673992.94.0.97624399519.issue42827@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

On Windows, Victor's one liner failed on repository debug builds with Windows' process error popup.  I have seen this mysterious failure at least once when testing IDLE Shell running on the repository build.   After the patch, my debug build gives the correct message,
  SyntaxError: cannot assign to function call
and correctly points to the 's' of 'str' on the first line.  Ditto when run from IDLE's Shell or editor.  Thank you for the fix.

Installed Python 3.10.0a4, Jan 4, gives the correct message  but confusingly points at the final ']' on a line by itself.  The latter should be fixed in the next release.

----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42827>
_______________________________________

From report at bugs.python.org  Thu Jan 14 20:52:49 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 15 Jan 2021 01:52:49 +0000
Subject: [issue42827] pegen parser: Multiline eval with assignment to function
 call: assertion failed
In-Reply-To: <1609793289.79.0.762652539307.issue42827@roundup.psfhosted.org>
Message-ID: <1610675569.21.0.449297851064.issue42827@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

In order to test code.InteractiveCompiler (used by IDLE) and codeop._maybe_compile (which IC calls), which calls compile() 3 times with mode 'single', I entered the example as 2 or 3 lines in Shell.
>>> [file for str(file) in []  # Error highlight on 's'.
 ]
SyntaxError: cannot assign to function call

Breaking the expression elsewhere, including before 'str', gives the same message and highlighted 's'.

I did not test before recompiling but it is certainly correct now.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42827>
_______________________________________

From report at bugs.python.org  Thu Jan 14 20:53:49 2021
From: report at bugs.python.org (robpats)
Date: Fri, 15 Jan 2021 01:53:49 +0000
Subject: [issue42893] Strange XPath search behavior of
 xml.etree.ElementTree.Element.find
In-Reply-To: <1610385165.69.0.550442509332.issue42893@roundup.psfhosted.org>
Message-ID: <1610675629.83.0.626188616763.issue42893@roundup.psfhosted.org>


robpats <robotpats at gmail.com> added the comment:

Thanks for the pointer. I didn't notice this paragraph.
xml.etree.ElementTree.Element.find currently returns None if XPath expression is invalid or unsupported. I think it should also return None if position predicates are not preceded by a tag name. It would be even better to emit warnings or raise exceptions to indicate any errors.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42893>
_______________________________________

From report at bugs.python.org  Thu Jan 14 21:30:31 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Fri, 15 Jan 2021 02:30:31 +0000
Subject: [issue42927] Inline cache for slots
In-Reply-To: <1610599509.18.0.893371992468.issue42927@roundup.psfhosted.org>
Message-ID: <1610677831.19.0.579198314293.issue42927@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Thanks for all the positive feedback! What is the next step?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42927>
_______________________________________

From report at bugs.python.org  Thu Jan 14 21:45:14 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Fri, 15 Jan 2021 02:45:14 +0000
Subject: [issue42877] TracebackException saves more data than it needs for
 format
In-Reply-To: <1610219460.26.0.944321944788.issue42877@roundup.psfhosted.org>
Message-ID: <1610678714.71.0.765352629314.issue42877@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:


New changeset 4c94d74152a511d977fe26a4f3a32b7352ba9024 by Irit Katriel in branch 'master':
bpo-42877: add the 'compact' param to TracebackException's __init__ (#24179)
https://github.com/python/cpython/commit/4c94d74152a511d977fe26a4f3a32b7352ba9024


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42877>
_______________________________________

From report at bugs.python.org  Thu Jan 14 21:46:07 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Fri, 15 Jan 2021 02:46:07 +0000
Subject: [issue42877] TracebackException saves more data than it needs for
 format
In-Reply-To: <1610219460.26.0.944321944788.issue42877@roundup.psfhosted.org>
Message-ID: <1610678767.48.0.627182224047.issue42877@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Thanks!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42877>
_______________________________________

From report at bugs.python.org  Thu Jan 14 23:53:43 2021
From: report at bugs.python.org (lizhu)
Date: Fri, 15 Jan 2021 04:53:43 +0000
Subject: [issue42932] How to handle import tripartite pacakge issue in
 unittest scripts for python expect mock.Mock
Message-ID: <1610686423.78.0.418946884784.issue42932@roundup.psfhosted.org>


New submission from lizhu <2541058309 at qq.com>:

Hi, all
When i use unittest to test my package which import other pacakge, however other pacakge use more and more tripartite pacakges, and it has an impact on test case, example:

occur an err: moduleNotFindErro

how to fix this issue?

----------
components: Tests
messages: 385098
nosy: lizhu
priority: normal
severity: normal
status: open
title: How to handle import tripartite pacakge  issue in unittest scripts for python expect mock.Mock
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42932>
_______________________________________

From report at bugs.python.org  Fri Jan 15 01:52:46 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Fri, 15 Jan 2021 06:52:46 +0000
Subject: [issue42932] How to handle import tripartite pacakge issue in
 unittest scripts for python expect mock.Mock
In-Reply-To: <1610686423.78.0.418946884784.issue42932@roundup.psfhosted.org>
Message-ID: <1610693566.37.0.567967429379.issue42932@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Please try a user forum. E.g. stackoverflow.

----------
nosy: +gvanrossum
resolution:  -> rejected
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42932>
_______________________________________

From report at bugs.python.org  Fri Jan 15 03:02:20 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 15 Jan 2021 08:02:20 +0000
Subject: [issue42931] Include randbytes in random.__all__
Message-ID: <1610697740.68.0.0659146903256.issue42931@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42931>
_______________________________________

From report at bugs.python.org  Fri Jan 15 03:32:18 2021
From: report at bugs.python.org (Kkshitish)
Date: Fri, 15 Jan 2021 08:32:18 +0000
Subject: [issue42933] OUTPUT WRONG
Message-ID: <1610699538.98.0.545500481144.issue42933@roundup.psfhosted.org>


New submission from Kkshitish <kkshitish at yahoo.com>:

try:
  
  a = 10
  
  if a == 11:
    
    print ("Yes")
    
except:
  
  print ("Out")
  
else:
  
  print ("No")


Output: No

The output should be "Out" but it print "No", The else statement should be print when try condition is execute. But the try condition is not execute on program. But still it print else statement. 

This is not ideal output. If you are disagree with me. So, kindly provide very strong argument over this.

----------
files: main.py
messages: 385100
nosy: Kkshitish
priority: normal
severity: normal
status: open
title: OUTPUT WRONG
type: security
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9
Added file: https://bugs.python.org/file49745/main.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42933>
_______________________________________

From report at bugs.python.org  Fri Jan 15 03:47:03 2021
From: report at bugs.python.org (Christian Heimes)
Date: Fri, 15 Jan 2021 08:47:03 +0000
Subject: [issue42933] OUTPUT WRONG
In-Reply-To: <1610699538.98.0.545500481144.issue42933@roundup.psfhosted.org>
Message-ID: <1610700423.05.0.0817604606755.issue42933@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

"No" is the correct output for your code example. Your code does not raise an exception, therefore the else block is executed.

Please don't use the bug tracker to get assistance with learning Python. There are community resources like chat and forums dedicated to that, https://www.python.org/community/

----------
nosy: +christian.heimes
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed
type: security -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42933>
_______________________________________

From report at bugs.python.org  Fri Jan 15 03:55:18 2021
From: report at bugs.python.org (Christian Heimes)
Date: Fri, 15 Jan 2021 08:55:18 +0000
Subject: [issue41837] Upgrade installers to OpenSSL 1.1.1i
In-Reply-To: <1600822748.89.0.850484234677.issue41837@roundup.psfhosted.org>
Message-ID: <1610700918.24.0.693506638461.issue41837@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

I got bad news. OpenSSL 1.1.1i introduced a regression in cert validation. This affects some cases that involve self-signed certificates. Cert validation fails if a self-signed certificate is used as both a trust anchor (root CA) and EE cert. This may affect Python.

Would it be possible to rebuild our OpenSSL binaries with patch https://github.com/openssl/openssl/pull/13749 ?

----------
resolution: fixed -> 
stage: resolved -> patch review
status: closed -> open
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41837>
_______________________________________

From report at bugs.python.org  Fri Jan 15 04:20:07 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 15 Jan 2021 09:20:07 +0000
Subject: [issue42927] Inline cache for slots
In-Reply-To: <1610599509.18.0.893371992468.issue42927@roundup.psfhosted.org>
Message-ID: <1610702407.16.0.128742633863.issue42927@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> What is the next step?

I would say just finishing the PR (making sure that we do not miss some arcane edge case) and updating the what's new for 3.10 :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42927>
_______________________________________

From report at bugs.python.org  Fri Jan 15 05:05:03 2021
From: report at bugs.python.org (=?utf-8?q?Walter_D=C3=B6rwald?=)
Date: Fri, 15 Jan 2021 10:05:03 +0000
Subject: [issue42930] xml.parsers.expat results differ buffer_text and / or
 buffer_size
In-Reply-To: <1610661898.66.0.880926471495.issue42930@roundup.psfhosted.org>
Message-ID: <1610705103.14.0.835439953584.issue42930@roundup.psfhosted.org>


Walter D?rwald <walter at livinglogic.de> added the comment:

Just a guess, but the buffer size might be so small that the text that you expect gets passed via **two** calls to _char_data(). You should refactor your code the simply collect all the text in _char_data() and act on it in the _end_element() handler.

So this probably isn't a bug in xml.parsers.expat.

----------
nosy: +doerwalter

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42930>
_______________________________________

From report at bugs.python.org  Fri Jan 15 06:06:03 2021
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 15 Jan 2021 11:06:03 +0000
Subject: [issue42934] use TracebackException's new compact param in
 unittest.TestResult
Message-ID: <1610708763.72.0.663493099071.issue42934@roundup.psfhosted.org>


New submission from Irit Katriel <iritkatriel at yahoo.com>:

The TracebackException instance created here
https://github.com/python/cpython/blob/63298930fb531ba2bb4f23bc3b915dbf1e17e9e1/Lib/unittest/result.py#L185
is only used for format(), so it can benefit from the compact param added in issue42877.

----------
components: Library (Lib)
messages: 385105
nosy: iritkatriel
priority: normal
severity: normal
status: open
title: use TracebackException's new compact param in unittest.TestResult
type: performance
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42934>
_______________________________________

From report at bugs.python.org  Fri Jan 15 06:09:31 2021
From: report at bugs.python.org (Ulrich Petri)
Date: Fri, 15 Jan 2021 11:09:31 +0000
Subject: [issue33809] Expose `capture_locals` parameter in `traceback`
 convenience functions
In-Reply-To: <1528473140.44.0.592728768989.issue33809@psf.upfronthosting.co.za>
Message-ID: <1610708971.25.0.811185819606.issue33809@roundup.psfhosted.org>


Ulrich Petri <python at ulo.pe> added the comment:

That would make it slightly better, but I still think it's a pretty arcane incantation (esp. for newer people).

What makes you hesitant to adding the parameter to the convenience functions?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33809>
_______________________________________

From report at bugs.python.org  Fri Jan 15 06:10:48 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 15 Jan 2021 11:10:48 +0000
Subject: [issue42929] On Windows,
 shutil.move doesn't raise FileExistsError if dst exists like os.rename
In-Reply-To: <1610659750.09.0.0459892919552.issue42929@roundup.psfhosted.org>
Message-ID: <1610709048.95.0.516758657286.issue42929@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Eryk Sun, do you mind to create a PR?

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42929>
_______________________________________

From report at bugs.python.org  Fri Jan 15 06:24:59 2021
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 15 Jan 2021 11:24:59 +0000
Subject: [issue33809] Expose `capture_locals` parameter in `traceback`
 convenience functions
In-Reply-To: <1528473140.44.0.592728768989.issue33809@psf.upfronthosting.co.za>
Message-ID: <1610709899.06.0.0137217392145.issue33809@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Generally speaking, I don't think it's a good idea to create redundant APIs. If we copy all the params from TracebackException (and it will be all params, why only this one?) that means more code, more tests, more documentation and a higher cognitive load for someone reading the documentation to learn the API.  And the users don't really get anything tangible in return - they can do exactly the same things, maybe with a slightly smaller number of characters.  A good standard library API has a small number of buttons that can be used in combination to get a lot of functionality.

In this particular case, I think it's nice that print_exception() gives novices a simple way to get some basic functionality, and more sophisticated users can go to TracebackException for more options. I agree with you that at the moment it's a bit clumsy, and a print() method would make it more usable. Note that a programmer who understands the different parts of a traceback and wants to tweak its representation is not a novice and should be able to use that with ease.

----------
versions: +Python 3.10 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33809>
_______________________________________

From report at bugs.python.org  Fri Jan 15 06:44:14 2021
From: report at bugs.python.org (Maarten Breddels)
Date: Fri, 15 Jan 2021 11:44:14 +0000
Subject: [issue7946] Convoy effect with I/O bound threads and New GIL
In-Reply-To: <1266353325.38.0.278549753357.issue7946@psf.upfronthosting.co.za>
Message-ID: <1610711054.9.0.0340815129673.issue7946@roundup.psfhosted.org>


Maarten Breddels <maartenbreddels at gmail.com> added the comment:

In case someone finds it useful, I've written a blog post on how to visualize the GIL:
https://www.maartenbreddels.com/perf/jupyter/python/tracing/gil/2021/01/14/Tracing-the-Python-GIL.html

In the comments (or at https://github.com/maartenbreddels/fastblog/issues/3#issuecomment-760891430 )
I looked specifically at the iotest.py example (no solutions though).

----------
nosy: +maartenbreddels

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue7946>
_______________________________________

From report at bugs.python.org  Fri Jan 15 06:50:48 2021
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 15 Jan 2021 11:50:48 +0000
Subject: [issue42934] use TracebackException's new compact param in
 unittest.TestResult
In-Reply-To: <1610708763.72.0.663493099071.issue42934@roundup.psfhosted.org>
Message-ID: <1610711448.61.0.181098320878.issue42934@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
keywords: +patch
pull_requests: +23046
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24221

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42934>
_______________________________________

From report at bugs.python.org  Fri Jan 15 06:53:28 2021
From: report at bugs.python.org (Irit Katriel)
Date: Fri, 15 Jan 2021 11:53:28 +0000
Subject: [issue42934] use TracebackException's new compact param in
 unittest.TestResult
In-Reply-To: <1610708763.72.0.663493099071.issue42934@roundup.psfhosted.org>
Message-ID: <1610711608.88.0.0352866945496.issue42934@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
nosy: +ezio.melotti, michael.foord, rbcollins

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42934>
_______________________________________

From report at bugs.python.org  Fri Jan 15 07:05:38 2021
From: report at bugs.python.org (Pete Wicken)
Date: Fri, 15 Jan 2021 12:05:38 +0000
Subject: [issue42935] Pickle can't import builtins at exit
Message-ID: <1610712338.22.0.647900497597.issue42935@roundup.psfhosted.org>


New submission from Pete Wicken <petewicken at gmail.com>:

Originally found as an issue in Lib/shelve.py; if we attempt to pickle a builtin as the program is exiting then Modules/_pickle.c will fail at the point of the PyImport_Import in save_global. In CPython3.8 this causes a segfault, in CPython3.9 a PicklingError is raised.

This is especially problematic in shelve.py as object pickling is attempted by the __del__ method's call stack when writeback=True. Therefore if the program exits before an explicit sync is called; in 3.8 the data will not be written to disk and a segfault occurs; in 3.9 the data is written to disk, but with an uncaught exception being raised.


Exception demonstrated via shelve on 3.9.1 on MacOS with Clang:

Python 3.9.1 (default, Dec 10 2020, 11:11:14)
[Clang 12.0.0 (clang-1200.0.32.27)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import shelve
>>> s = shelve.open('testing', writeback=True)
>>> s['a'] = Exception
>>> exit()
Exception ignored in: <function Shelf.__del__ at 0x10ed67790>
Traceback (most recent call last):
  File ".../3.9/lib/python3.9/shelve.py", line 162, in __del__
  File ".../3.9/lib/python3.9/shelve.py", line 144, in close
  File ".../3.9/lib/python3.9/shelve.py", line 168, in sync
  File ".../3.9/lib/python3.9/shelve.py", line 124, in __setitem__
_pickle.PicklingError: Can't pickle <class 'Exception'>: import of module 'builtins' failed


Segfault demonstrated via shelve on 3.8.5 on MacOS with Clang (different system from above):

Python 3.8.5 (v3.8.5:580fbb018f, Jul 20 2020, 12:11:27)
[Clang 6.0 (clang-600.0.57)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import shelve
>>> s = shelve.open('testing', writeback=True)
>>> s['a'] = Exception
>>> exit()
[1]    10040 segmentation fault  python3.8


Exception demonstrated via shelve on 3.9.1 on RHEL with GCC:

Python 3.9.1 (default, Dec  8 2020, 00:00:00) 
[GCC 10.2.1 20201125 (Red Hat 10.2.1-9)] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import shelve
>>> s = shelve.open("thing", writeback=True)
>>> s['a'] = Exception
>>> 
Exception ignored in: <function Shelf.__del__ at 0x7f3f30b7c820>
Traceback (most recent call last):
  File "/usr/lib64/python3.9/shelve.py", line 162, in __del__
  File "/usr/lib64/python3.9/shelve.py", line 144, in close
  File "/usr/lib64/python3.9/shelve.py", line 168, in sync
  File "/usr/lib64/python3.9/shelve.py", line 124, in __setitem__
_pickle.PicklingError: Can't pickle <class 'Exception'>: import of module 'builtins' failed


Code example to reproduce using Pickle in the class __del__, demonstrated on a RHEL system:

Python 3.9.1 (default, Dec  8 2020, 00:00:00) 
[GCC 10.2.1 20201125 (Red Hat 10.2.1-9)] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> from pickle import DEFAULT_PROTOCOL, Pickler
>>> from io import BytesIO
>>> class T:
...   def __del__(self):
...     f = BytesIO()
...     p = Pickler(f, DEFAULT_PROTOCOL)
...     p.dump(sum)
... 
>>> t = T()
>>> exit()
Exception ignored in: <function T.__del__ at 0x7f5f04d9ef70>
Traceback (most recent call last):
  File "<stdin>", line 5, in __del__
_pickle.PicklingError: Can't pickle <built-in function sum>: import of module 'builtins' failed


Have not tested on 3.6, 3.7 or 3.10.

----------
components: Library (Lib)
messages: 385110
nosy: Wicken
priority: normal
severity: normal
status: open
title: Pickle can't import builtins at exit
type: crash
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42935>
_______________________________________

From report at bugs.python.org  Fri Jan 15 07:27:36 2021
From: report at bugs.python.org (Mark Shannon)
Date: Fri, 15 Jan 2021 12:27:36 +0000
Subject: [issue42925] Error trace of else inside class
In-Reply-To: <1610542676.59.0.693705484765.issue42925@roundup.psfhosted.org>
Message-ID: <1610713656.59.0.911184512921.issue42925@roundup.psfhosted.org>


Change by Mark Shannon <mark at hotpy.org>:


----------
keywords: +patch
pull_requests: +23047
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24222

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42925>
_______________________________________

From report at bugs.python.org  Fri Jan 15 07:52:19 2021
From: report at bugs.python.org (gaborjbernat)
Date: Fri, 15 Jan 2021 12:52:19 +0000
Subject: [issue9334] argparse does not accept options taking arguments
 beginning with dash (regression from optparse)
In-Reply-To: <1279836939.11.0.811316280273.issue9334@psf.upfronthosting.co.za>
Message-ID: <1610715139.62.0.516647189422.issue9334@roundup.psfhosted.org>


Change by gaborjbernat <gaborjbernat at gmail.com>:


----------
nosy: +gaborjbernat

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue9334>
_______________________________________

From report at bugs.python.org  Fri Jan 15 08:37:26 2021
From: report at bugs.python.org (Mark Shannon)
Date: Fri, 15 Jan 2021 13:37:26 +0000
Subject: [issue42917] Block stack size for frame objects should be dynamically
 sizable
In-Reply-To: <1610502849.77.0.30833881241.issue42917@roundup.psfhosted.org>
Message-ID: <1610717846.01.0.456239292452.issue42917@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

Reducing the size of the frame object seems like a worthwhile goal, but what's the point in increasing the maximum block stack?

----------
nosy: +Mark.Shannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42917>
_______________________________________

From report at bugs.python.org  Fri Jan 15 08:40:05 2021
From: report at bugs.python.org (Mark Shannon)
Date: Fri, 15 Jan 2021 13:40:05 +0000
Subject: [issue42693] "if 0:" lines are traced; they didn't use to be
In-Reply-To: <1608498368.47.0.692310939381.issue42693@roundup.psfhosted.org>
Message-ID: <1610718005.37.0.604966003369.issue42693@roundup.psfhosted.org>


Change by Mark Shannon <mark at hotpy.org>:


----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42693>
_______________________________________

From report at bugs.python.org  Fri Jan 15 09:29:28 2021
From: report at bugs.python.org (Michael XU)
Date: Fri, 15 Jan 2021 14:29:28 +0000
Subject: [issue42930] xml.parsers.expat results differ buffer_text and / or
 buffer_size
In-Reply-To: <1610661898.66.0.880926471495.issue42930@roundup.psfhosted.org>
Message-ID: <1610720968.36.0.863161636005.issue42930@roundup.psfhosted.org>


Michael XU <mfxecon at gmail.com> added the comment:

Thank you so much Walter. I think that might be it - it fixed this particular instance, and it makes sense given what you have said. I'll proceed to close this up but will follow up if I encounter this issue when the data has changed.

Thanks again!

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42930>
_______________________________________

From report at bugs.python.org  Fri Jan 15 10:33:47 2021
From: report at bugs.python.org (Jens)
Date: Fri, 15 Jan 2021 15:33:47 +0000
Subject: [issue42936] Decimal module performs wrong floor division with
 negative numbers
Message-ID: <1610724827.91.0.138727691523.issue42936@roundup.psfhosted.org>


New submission from Jens <multiks2200 at gmail.com>:

from decimal import Decimal

print(-0.9//0.123)
# prints -8.0
print(Decimal('-0.9')//Decimal('0.123'))
# prints -7
print(-10//4.2)
# prints -3.0
print(Decimal('-10')//Decimal('4.2'))
# prints -2

----------
messages: 385113
nosy: multiks2200
priority: normal
severity: normal
status: open
title: Decimal module performs wrong floor division with negative numbers
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42936>
_______________________________________

From report at bugs.python.org  Fri Jan 15 10:38:05 2021
From: report at bugs.python.org (Mark Dickinson)
Date: Fri, 15 Jan 2021 15:38:05 +0000
Subject: [issue42936] Decimal module performs wrong floor division with
 negative numbers
In-Reply-To: <1610724827.91.0.138727691523.issue42936@roundup.psfhosted.org>
Message-ID: <1610725085.84.0.474969613536.issue42936@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

The behaviour is deliberate, if unfortunate: it's covered in the documentation here: https://docs.python.org/3/library/decimal.html#decimal-objects - see the paragraph starting

> There are some small differences between arithmetic on Decimal objects
> and arithmetic on integers and floats. When the remainder operator % is
> applied to Decimal objects

The issue is that the decimal spec specifies "divide-integer" and "remainder" operations. We've chosen to map those operations to "%" and "//" for convenience, even though there's a difference between float and Decimal here.

----------
nosy: +mark.dickinson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42936>
_______________________________________

From report at bugs.python.org  Fri Jan 15 10:59:56 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Fri, 15 Jan 2021 15:59:56 +0000
Subject: [issue42934] use TracebackException's new compact param in
 unittest.TestResult
In-Reply-To: <1610708763.72.0.663493099071.issue42934@roundup.psfhosted.org>
Message-ID: <1610726396.11.0.259149537136.issue42934@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:


New changeset ba876c44a8d06668e622fb580fdcde45c7a36d48 by Irit Katriel in branch 'master':
bpo-42934: use TracebackException(compact=True) in unittest.TestResult (GH-24221)
https://github.com/python/cpython/commit/ba876c44a8d06668e622fb580fdcde45c7a36d48


----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42934>
_______________________________________

From report at bugs.python.org  Fri Jan 15 11:00:37 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Fri, 15 Jan 2021 16:00:37 +0000
Subject: [issue42934] use TracebackException's new compact param in
 unittest.TestResult
In-Reply-To: <1610708763.72.0.663493099071.issue42934@roundup.psfhosted.org>
Message-ID: <1610726437.68.0.228679992863.issue42934@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42934>
_______________________________________

From report at bugs.python.org  Fri Jan 15 11:18:14 2021
From: report at bugs.python.org (Eryk Sun)
Date: Fri, 15 Jan 2021 16:18:14 +0000
Subject: [issue42929] On Windows,
 shutil.move doesn't raise FileExistsError if dst exists like os.rename
In-Reply-To: <1610659750.09.0.0459892919552.issue42929@roundup.psfhosted.org>
Message-ID: <1610727494.41.0.246930962589.issue42929@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

I can help, but in this case there isn't much to do. Just replace os.rename() with os.replace(), make a minor doc change, and maybe add a test that ensures a junction can be moved over an existing file on the same filesystem. For example:

    >>> os.mkdir('temp')
    >>> _winapi.CreateJunction('temp', 'src')
    >>> os.lstat('src').st_reparse_tag == stat.IO_REPARSE_TAG_MOUNT_POINT
    True
    >>> open('dst', 'w').close()

The current implementation tries copytree() on the junction mountpoint and fails to create a new directory named "dst":

    >>> try: shutil.move('src', 'dst')
    ... except FileExistsError as e: e
    ...
    FileExistsError(17, 'Cannot create a file when that file already exists')

But move() should simply replace "dst" with the junction via os.replace():

    >>> os.replace('src', 'dst')
    >>> os.lstat('dst').st_reparse_tag == stat.IO_REPARSE_TAG_MOUNT_POINT
    True

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42929>
_______________________________________

From report at bugs.python.org  Fri Jan 15 11:26:05 2021
From: report at bugs.python.org (Mark Dickinson)
Date: Fri, 15 Jan 2021 16:26:05 +0000
Subject: [issue42936] Decimal module performs wrong floor division with
 negative numbers
In-Reply-To: <1610724827.91.0.138727691523.issue42936@roundup.psfhosted.org>
Message-ID: <1610727965.31.0.170942559126.issue42936@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

Thanks for the report. I'm going to close here, since this isn't a bug.

If you want to advocate for a behaviour change, by all means go ahead, but be aware that it would likely be a hard sell. The main challenge would be finding a way to change the behaviour that doesn't abruptly break existing code that depends on the current semantics.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42936>
_______________________________________

From report at bugs.python.org  Fri Jan 15 11:30:06 2021
From: report at bugs.python.org (Ken Jin)
Date: Fri, 15 Jan 2021 16:30:06 +0000
Subject: [issue41824] Docs for typing.ForwardRef don't state that it was added
 in 3.7
In-Reply-To: <1600706127.1.0.52497874592.issue41824@roundup.psfhosted.org>
Message-ID: <1610728206.86.0.137294610345.issue41824@roundup.psfhosted.org>


Change by Ken Jin <kenjin4096 at gmail.com>:


----------
keywords: +patch
nosy: +kj
nosy_count: 2.0 -> 3.0
pull_requests: +23048
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24224

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41824>
_______________________________________

From report at bugs.python.org  Fri Jan 15 11:30:36 2021
From: report at bugs.python.org (Jurjen N.E. Bos)
Date: Fri, 15 Jan 2021 16:30:36 +0000
Subject: [issue42911] Addition chains for pow saves 10 % time!
In-Reply-To: <1610463140.75.0.177431925065.issue42911@roundup.psfhosted.org>
Message-ID: <1610728236.86.0.714082152356.issue42911@roundup.psfhosted.org>


Jurjen N.E. Bos <jneb at users.sourceforge.net> added the comment:

Well, measurements show that it saves more time than I thought (sometimes over 20%!), because there are other ways in which it saves time; I am quite happy with that.

In the code I needed functions _Py_bit_length64 and _Py_bit_count64.
I thought these could better move to the bitutils, but I am not sure about a good name to use, since there are probably other places where these are used, too (I know of at least one in hashtable.c).
The 32 bits versions in bitutils are called _Py_bit_length and _Py_popcount32 (not the most logical names).
So then it would also be more logical to give all four of these consistent names, everywhere. But that's probably better at a later time, right?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42911>
_______________________________________

From report at bugs.python.org  Fri Jan 15 11:32:52 2021
From: report at bugs.python.org (Jurjen N.E. Bos)
Date: Fri, 15 Jan 2021 16:32:52 +0000
Subject: [issue42911] Addition chains for pow saves 5-20% time for pow(int,
 int)
In-Reply-To: <1610463140.75.0.177431925065.issue42911@roundup.psfhosted.org>
Message-ID: <1610728372.64.0.288560801714.issue42911@roundup.psfhosted.org>


Change by Jurjen N.E. Bos <jneb at users.sourceforge.net>:


----------
title: Addition chains for pow saves 10 % time! -> Addition chains for pow saves 5-20% time for pow(int,int)

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42911>
_______________________________________

From report at bugs.python.org  Fri Jan 15 12:05:35 2021
From: report at bugs.python.org (Ken Jin)
Date: Fri, 15 Jan 2021 17:05:35 +0000
Subject: [issue42377] allow typing.cast with TYPE_CHECKING
In-Reply-To: <1605556237.18.0.0550967152781.issue42377@roundup.psfhosted.org>
Message-ID: <1610730335.05.0.319922550271.issue42377@roundup.psfhosted.org>


Ken Jin <kenjin4096 at gmail.com> added the comment:

Sorry, I don't think this is a typing module issue.

The NameError stems from what you mentioned: 'A' not being defined since TYPE_CHECKING evaluates to false at runtime. This would raise an error in any Python code, not just typing. The equivalent is this::

>>> A
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
NameError: name 'A' is not defined

Without the future import, def f(a: A): ... already throws that NameError. The reason why it works in your example is because 'A' isn't evaluated at function declaration time with the future import.

To appease your static type checker and not cause runtime errors, you might want to try:

f(cast("A", "anything"))

Which seems to work in mypy and pycharm. (Sorry, I don't have pyre/pytype/pyright to check with, though I would be surprised if this didn't pass on them.)

Please correct me if you feel anything I wrote was incorrect :).

----------
nosy: +gvanrossum, kj, levkivskyi

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42377>
_______________________________________

From report at bugs.python.org  Fri Jan 15 12:06:16 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 15 Jan 2021 17:06:16 +0000
Subject: [issue42917] Block stack size for frame objects should be dynamically
 sizable
In-Reply-To: <1610502849.77.0.30833881241.issue42917@roundup.psfhosted.org>
Message-ID: <1610730376.32.0.211470715338.issue42917@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Getting rid of hardcoded limits is good. And at first look the proposed PR looks good (some minor details can be discussed).

Although there is different approach to solve the same problem. The stack of blocks is used to set handlers for exceptions. For example, when enter the try block, it pushes the handler that points to except and/or finally clauses, when enter the with block, it pushes the handler that calls __exit__, etc. The stack of handlers is changed at run time, and it was the only solution to this problem. But after reorganizes of bytecode in latest Python versions (mainly by Mark) it is now possible to determine handlers for every instruction statically, at compile time. Instead of stack of blocks we would have a table of addresses of handlers. It is more efficient approach and it is used in modern C++ compilers. The only technical issue is compact and platform-independent representation of the table (because the size of the uncompressed table would be larger than the size of the code, but most of entries are repeated and usually are small integers).

It would make PR 24204 unneeded, so I suggest to wait some time before reviewing it.

----------
nosy: +gvanrossum, serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42917>
_______________________________________

From report at bugs.python.org  Fri Jan 15 12:25:38 2021
From: report at bugs.python.org (Mark Dickinson)
Date: Fri, 15 Jan 2021 17:25:38 +0000
Subject: [issue42911] Addition chains for pow saves 5-20% time for pow(int,
 int)
In-Reply-To: <1610463140.75.0.177431925065.issue42911@roundup.psfhosted.org>
Message-ID: <1610731538.55.0.439962724025.issue42911@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

Thank you for the proposal and PR!

There are some tradeoffs to be considered here, between simplicity and performance; it's not always trivial to find the sweet spot.  Python's int implementation mostly favours the simplicity end of the spectrum. It's also focused on the sort of integer sizes that turn up in everyday problems, rather than crypto-sized (or worse, number-theoretic-sized) integers - those are more the province of libraries like cryptlib and GMP. That's why Python still has quadratic-time division and base-conversion algorithms.

For this particular case, my feeling is that the added complexity (~300 lines of C code) isn't worth the payoff.

That said, the existing integer powering implementation, like much else in longobject.c, goes back to Tim Peters. If Tim wants to champion this change and push it forward, I'm certainly not going to oppose that.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42911>
_______________________________________

From report at bugs.python.org  Fri Jan 15 12:51:05 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 15 Jan 2021 17:51:05 +0000
Subject: [issue42931] Include randbytes in random.__all__
Message-ID: <1610733065.1.0.117018206949.issue42931@roundup.psfhosted.org>


New submission from Raymond Hettinger <raymond.hettinger at gmail.com>:


New changeset 998ae1fa3fb05a790071217cf8f6ae3a928da13f by Setrak Balian in branch 'master':
bpo-42931: randbytes missing from random.__all__ (GH-24219)
https://github.com/python/cpython/commit/998ae1fa3fb05a790071217cf8f6ae3a928da13f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42931>
_______________________________________

From report at bugs.python.org  Fri Jan 15 12:51:48 2021
From: report at bugs.python.org (miss-islington)
Date: Fri, 15 Jan 2021 17:51:48 +0000
Subject: [issue42931] Include randbytes in random.__all__
In-Reply-To: <1610733065.1.0.117018206949.issue42931@roundup.psfhosted.org>
Message-ID: <1610733108.97.0.490530463774.issue42931@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 3.0 -> 4.0
pull_requests: +23049
pull_request: https://github.com/python/cpython/pull/24225

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42931>
_______________________________________

From report at bugs.python.org  Fri Jan 15 13:22:16 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 15 Jan 2021 18:22:16 +0000
Subject: [issue42931] Include randbytes in random.__all__
In-Reply-To: <1610733065.1.0.117018206949.issue42931@roundup.psfhosted.org>
Message-ID: <1610734936.2.0.61975263227.issue42931@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42931>
_______________________________________

From report at bugs.python.org  Fri Jan 15 13:22:26 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 15 Jan 2021 18:22:26 +0000
Subject: [issue42931] Include randbytes in random.__all__
In-Reply-To: <1610733065.1.0.117018206949.issue42931@roundup.psfhosted.org>
Message-ID: <1610734946.37.0.574756130958.issue42931@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset 17c1f0c8cb96637c36548edf6e4570ac7564004b by Miss Islington (bot) in branch '3.9':
bpo-42931: randbytes missing from random.__all__ (GH-24219) (GH-24225)
https://github.com/python/cpython/commit/17c1f0c8cb96637c36548edf6e4570ac7564004b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42931>
_______________________________________

From report at bugs.python.org  Fri Jan 15 14:07:18 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Fri, 15 Jan 2021 19:07:18 +0000
Subject: [issue42927] Inline cache for slots
In-Reply-To: <1610599509.18.0.893371992468.issue42927@roundup.psfhosted.org>
Message-ID: <1610737638.69.0.677053910271.issue42927@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

I created a benchmark for this, see https://github.com/python/pyperformance/pull/86.

Next I'll add a blurb and then it's off to reviewers.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42927>
_______________________________________

From report at bugs.python.org  Fri Jan 15 14:08:40 2021
From: report at bugs.python.org (Thomas Anderson)
Date: Fri, 15 Jan 2021 19:08:40 +0000
Subject: [issue42917] Block stack size for frame objects should be dynamically
 sizable
In-Reply-To: <1610502849.77.0.30833881241.issue42917@roundup.psfhosted.org>
Message-ID: <1610737720.81.0.61173720157.issue42917@roundup.psfhosted.org>


Thomas Anderson <tomkpz at gmail.com> added the comment:

> Reducing the size of the frame object seems like a worthwhile goal, but what's the point in increasing the maximum block stack?

No point for humans, but it may be useful for code generators.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42917>
_______________________________________

From report at bugs.python.org  Fri Jan 15 16:53:53 2021
From: report at bugs.python.org (ppperry)
Date: Fri, 15 Jan 2021 21:53:53 +0000
Subject: [issue42849] pool worker can't be terminated
In-Reply-To: <1609992006.83.0.897606551243.issue42849@roundup.psfhosted.org>
Message-ID: <1610747633.64.0.58146910904.issue42849@roundup.psfhosted.org>


ppperry <mapreader at olum.org> added the comment:

duplicate of issue22393?

----------
nosy: +ppperry

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42849>
_______________________________________

From report at bugs.python.org  Fri Jan 15 17:55:42 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 15 Jan 2021 22:55:42 +0000
Subject: [issue42885] Regex performance problem with ^ aka AT_BEGINNING
In-Reply-To: <1610315901.41.0.467379667553.issue42885@roundup.psfhosted.org>
Message-ID: <1610751342.42.0.323714384828.issue42885@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42885>
_______________________________________

From report at bugs.python.org  Fri Jan 15 18:00:38 2021
From: report at bugs.python.org (CDirkx)
Date: Fri, 15 Jan 2021 23:00:38 +0000
Subject: [issue42937] 192.0.0.8 (IPv4 dummy address) considered globally
 reachable
Message-ID: <1610751638.64.0.309759393541.issue42937@roundup.psfhosted.org>


New submission from CDirkx <christiaan at dirkx.email>:

Currently the method `ipaddress.is_global` returns true for the IPv4 address 192.0.0.8. This was correct when `is_global` was initially implemented, but in 2015 192.0.0.8 got designated as the "IPv4 dummy address" and not globally reachable, see the IANA special purpose address registry: https://www.iana.org/assignments/iana-ipv4-special-registry/iana-ipv4-special-registry.xhtml.

The correct behaviour now, according to the documentation of `is_global` which refers to the IANA registry, would be to return false for 192.0.0.8.

----------
messages: 385127
nosy: cdirkx
priority: normal
severity: normal
status: open
title: 192.0.0.8 (IPv4 dummy address) considered globally reachable
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42937>
_______________________________________

From report at bugs.python.org  Fri Jan 15 18:30:56 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 15 Jan 2021 23:30:56 +0000
Subject: =?utf-8?q?=5Bissue42888=5D_Not_installed_=E2=80=9Clibgcc=5Fs=2Eso=2E1?=
 =?utf-8?q?=E2=80=9D_causes_exit_crash=2E?=
In-Reply-To: <1610350822.34.0.431759793604.issue42888@roundup.psfhosted.org>
Message-ID: <1610753456.77.0.707524557507.issue42888@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
components: +C API -Interpreter Core
title: Not installed ?libgcc_s.so.1? causes parser crash. -> Not installed ?libgcc_s.so.1? causes exit crash.

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42888>
_______________________________________

From report at bugs.python.org  Fri Jan 15 18:38:39 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 15 Jan 2021 23:38:39 +0000
Subject: [issue42887] 100000 assignments of .__sizeof__ cause a segfault on del
In-Reply-To: <1610350684.08.0.491719857036.issue42887@roundup.psfhosted.org>
Message-ID: <1610753919.2.0.727222169802.issue42887@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Xinmeng, to verify Ronald's explanation, run this instead

mystr  = "hello123"
for x in range(1000000):
    mystr = mystr.__sizeof__()
input('>')  # Hit Enter to continue.
del mystr   # Expect crash here.
input('<')  # And never get here.

----------
nosy: +terry.reedy
title: Multiple assignments of attribute "__sizeof__" will cause a segfault -> 100000 assignments of .__sizeof__  cause a segfault on del

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42887>
_______________________________________

From report at bugs.python.org  Fri Jan 15 19:38:24 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 16 Jan 2021 00:38:24 +0000
Subject: [issue42889] Incorrect behavior  after ast node visits
In-Reply-To: <1610351139.91.0.540037450972.issue42889@roundup.psfhosted.org>
Message-ID: <1610757504.49.0.843963015847.issue42889@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

The parser is not involved here.  The transformed code is *not* equivalent to "1=2; print(1)" because you replace 'a' with the string '1', not the int 1.  The result is to transform
 "globals()['a']=2; print(globals()['a'])" to 
 "globals()['1']=2; print(globals()['1'])"
This works because globals() is a regular dict.

If one does try to make the code equivalent to "1=2; print(1)" by replacing with 1, the result is an error.

Traceback (most recent call last):
  File "F:\Python\a\tem4.py", line 19, in <module>
    print(ast.unparse(newast))
  File "C:\Programs\Python310\lib\ast.py", line 1567, in unparse
    return unparser.visit(ast_obj)
  File "C:\Programs\Python310\lib\ast.py", line 805, in visit
    return "".join(self._source)
TypeError: sequence item 1: expected str instance, int found

With unparse removed, I get a compile error when the identifier type is checked.

Traceback (most recent call last):
  File "F:\Python\a\tem4.py", line 19, in <module>
    c = compile(newast,'','exec')
TypeError: AST identifier must be of type str

In the binary example, unparsing gives an infinite recursion error with this repeated sequence.

  File "C:\Programs\Python310\lib\ast.py", line 1372, in visit_BinOp
    self.traverse(node.left)
  File "C:\Programs\Python310\lib\ast.py", line 798, in traverse
    super().visit(node)
  File "C:\Programs\Python310\lib\ast.py", line 410, in visit
    return visitor(node)

Without unparse, the compile call crashes.  (In IDLE, this means there is an unrequested restart of the Shell subprocess that executes user code, without IDLE crashing.)  I suspect that there is a related loop in the compile C code that crashes the process before any checking is done.  If so, the situation would be similar to your #42887 and we may not be able to do anything.

----------
nosy: +terry.reedy
title: Incorrect behavior of Python parser after ast node of test program  being modified -> Incorrect behavior  after ast node visits
versions:  -Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42889>
_______________________________________

From report at bugs.python.org  Fri Jan 15 19:41:51 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 16 Jan 2021 00:41:51 +0000
Subject: [issue42935] Pickle can't import builtins at exit
In-Reply-To: <1610712338.22.0.647900497597.issue42935@roundup.psfhosted.org>
Message-ID: <1610757711.24.0.799816385445.issue42935@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

I don?t know there is much we can do about this. I recommend using ?with? to close the shelf earlier.

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42935>
_______________________________________

From report at bugs.python.org  Fri Jan 15 19:46:51 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 16 Jan 2021 00:46:51 +0000
Subject: [issue42916] Support for DICOM image file format in imghdr module
In-Reply-To: <1610497726.98.0.199039272928.issue42916@roundup.psfhosted.org>
Message-ID: <1610758011.43.0.0771179896965.issue42916@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Can you submit a patch, or post here an test_dicom function?

----------
nosy: +terry.reedy
stage:  -> needs patch

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42916>
_______________________________________

From report at bugs.python.org  Fri Jan 15 22:02:46 2021
From: report at bugs.python.org (Xinmeng Xia)
Date: Sat, 16 Jan 2021 03:02:46 +0000
Subject: [issue42887] 100000 assignments of .__sizeof__ cause a segfault on del
In-Reply-To: <1610350684.08.0.491719857036.issue42887@roundup.psfhosted.org>
Message-ID: <1610766166.42.0.876511960023.issue42887@roundup.psfhosted.org>


Xinmeng Xia <xiaxm at smail.nju.edu.cn> added the comment:

Thank you. But I am not sure this is a recursion problem. Please see the following example, I replace "__sizeof__" with "__class__". No segmentation fault. Everything goes well.

========================
mystr  = "hello123"
print(dir(mystr))
for x in range(1000000):
    mystr = mystr.__class__
    print(mystr)
=========================
and

=========================
mystr  = "hello123"
for x in range(1000000):
    mystr = mystr.__class__
input('>')  # Hit Enter to continue.
del mystr   # Expect crash here.
input('<')  # And never get here
=========================
No segmentation fault

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42887>
_______________________________________

From report at bugs.python.org  Fri Jan 15 22:31:05 2021
From: report at bugs.python.org (Xinmeng Xia)
Date: Sat, 16 Jan 2021 03:31:05 +0000
Subject: [issue42889] Incorrect behavior  after ast node visits
In-Reply-To: <1610351139.91.0.540037450972.issue42889@roundup.psfhosted.org>
Message-ID: <1610767865.83.0.94994957984.issue42889@roundup.psfhosted.org>


Xinmeng Xia <xiaxm at smail.nju.edu.cn> added the comment:

Thank you for your kindly explanations! The output of the first program in msg384799 behaves as expected from the view of AST compiling.  Yes,I see now. But for the second example in msg384879, the behaviors are inconsistent between old Python version(3.6,3.7,3.8) and new Python version(3.9,3.10). It is probably something wrong in "compile" parsing bool string, "False"?"True" in new version of Python(3.9,3.10). 

I think a checker in function "compile" will not be complicated. Like you said, the simplest way I can think is to re-perform lexical analysis and syntax analysis. e.g. unparse ast, then parse ast before compiling AST object. 

As for #42887, only part of attributes will lead to that bug. I think it's attribute-related. If that bug is triggered by c loop, all attributes should be involved.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42889>
_______________________________________

From report at bugs.python.org  Fri Jan 15 23:16:50 2021
From: report at bugs.python.org (Austin "Paco" Rainwater)
Date: Sat, 16 Jan 2021 04:16:50 +0000
Subject: [issue37006] Add top level await statement support for doctest
In-Reply-To: <1558516850.14.0.4225480118.issue37006@roundup.psfhosted.org>
Message-ID: <1610770610.07.0.55286498344.issue37006@roundup.psfhosted.org>


Change by Austin "Paco" Rainwater <paco at heckin.io>:


----------
nosy: +pacorain

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37006>
_______________________________________

From report at bugs.python.org  Fri Jan 15 23:25:41 2021
From: report at bugs.python.org (William Pickard)
Date: Sat, 16 Jan 2021 04:25:41 +0000
Subject: [issue42887] 100000 assignments of .__sizeof__ cause a segfault on del
In-Reply-To: <1610350684.08.0.491719857036.issue42887@roundup.psfhosted.org>
Message-ID: <1610771141.49.0.237009457684.issue42887@roundup.psfhosted.org>


William Pickard <lollol222gg at gmail.com> added the comment:

Jumping in here to explain why '__class' doesn't crash when '__sizeof__' does:

When '__class__' is fetched, it returns a new reference to the object's type.

When '__sizeof__' is fetched on the otherhand, a new object is allocated on the heap ('types.MethodType') and is returned to the caller.

This object also has a '__sizeof__' that does the same (as it's implemented on 'object'.

So yes, you are exhausting the C runtime stack by de-allocating over a THOUSAND objects.

You can see this happen by watching the memory usage of Python steadily climb.

----------
nosy: +WildCard65

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42887>
_______________________________________

From report at bugs.python.org  Sat Jan 16 00:36:16 2021
From: report at bugs.python.org (hai shi)
Date: Sat, 16 Jan 2021 05:36:16 +0000
Subject: [issue41618] [C API] How many slots of static types should be exposed
 in PyType_GetSlot()
In-Reply-To: <1598172498.12.0.869607269568.issue41618@roundup.psfhosted.org>
Message-ID: <1610775376.13.0.0303552185494.issue41618@roundup.psfhosted.org>


hai shi <shihai1991 at 126.com> added the comment:

>Not a function, shouldn't be used with PyType_Slot:
>  * tp_dict - I'd add a PyType_GetDict if there is a need to get this
>  * tp_mro - I'd add a PyType_GetMRO if there is a need to get this

I checked some other projects which use type fileds directly.
cpython doesn't expose the tp_dict and tp_mro directly in headers. 
I am not sure which way is more better(calling function vs using fileld directly).

refs:
https://gitlab.gnome.org/GNOME/pygobject/-/blob/master/gi/gimodule.c#L1168
https://github.com/biolab/orange2/blob/db40a9449cb45b507d63dcd5739b223f9cffb8e6/source/orange/cls_orange.cpp#L587

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41618>
_______________________________________

From report at bugs.python.org  Sat Jan 16 03:03:27 2021
From: report at bugs.python.org (Jordy Zomer)
Date: Sat, 16 Jan 2021 08:03:27 +0000
Subject: [issue42938] ctypes double representation BoF
Message-ID: <1610784207.02.0.722384660803.issue42938@roundup.psfhosted.org>


New submission from Jordy Zomer <jordy at simplyhacker.com>:

Hi, 

There's a buffer overflow in the PyCArg_repr() function in _ctypes/callproc.c.

The buffer overflow happens due to not checking the length of th sprintf() function on line: 

    case 'd':
        sprintf(buffer, "<cparam '%c' (%f)>",
            self->tag, self->value.d);
        break;

Because we control self->value.d we could make it copy _extreme_ values. For example we could make it copy 1e300 which would be a 1 with 300 zero's  to overflow the buffer.

This could potentially cause RCE when a user allows untrusted input in these functions.

A minimal PoC:

>>> from ctypes import *
>>> c_double.from_param(1e300)
*** buffer overflow detected ***: terminated
Aborted


I recommend __always__ controlling how much you copy so I'd use snprintf with a size argument instead.

Best Regards,

Jordy Zomer

----------
components: ctypes
messages: 385136
nosy: JordyZomer
priority: normal
severity: normal
status: open
title: ctypes double representation BoF
type: security
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42938>
_______________________________________

From report at bugs.python.org  Sat Jan 16 03:59:13 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 16 Jan 2021 08:59:13 +0000
Subject: [issue42885] Optimize re.search() for \A (and maybe ^)
In-Reply-To: <1610315901.41.0.467379667553.issue42885@roundup.psfhosted.org>
Message-ID: <1610787553.89.0.699530326868.issue42885@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

^ matches not just the beginning of the string. It matches the beginning of a line, i.e. an anchor just after '\n'. If the input string contains '\n', the result cannot be found less than by linear time. If you want to check if the beginning of the string matches a regular expression, it is better to use match(). If you want the check if the whole string matches it, it is better to use fullmatch().

But in some cases you cannot choose what method to use. If you have a set of patterns, and only some of them should be anchored to the start of the string, you have to use search(). And while linear complexity for ^ is expected, search() is not optimized for \A.

So the original report is rejected, the behavior is expected and cannot be changed. It is not a bug. But some optimization can be added for \A, and perhaps the constant multiplier for ^ can be reduced too.

----------
title: Regex performance problem with ^ aka AT_BEGINNING -> Optimize re.search() for \A (and maybe ^)
versions:  -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42885>
_______________________________________

From report at bugs.python.org  Sat Jan 16 04:49:31 2021
From: report at bugs.python.org (=?utf-8?q?Charles-Fran=C3=A7ois_Natali?=)
Date: Sat, 16 Jan 2021 09:49:31 +0000
Subject: [issue7946] Convoy effect with I/O bound threads and New GIL
In-Reply-To: <1266353325.38.0.278549753357.issue7946@psf.upfronthosting.co.za>
Message-ID: <1610790571.03.0.821926491986.issue7946@roundup.psfhosted.org>


Change by Charles-Fran?ois Natali <cf.natali at gmail.com>:


----------
nosy:  -neologix

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue7946>
_______________________________________

From report at bugs.python.org  Sat Jan 16 05:53:05 2021
From: report at bugs.python.org (Steven D'Aprano)
Date: Sat, 16 Jan 2021 10:53:05 +0000
Subject: [issue42885] Optimize re.search() for \A (and maybe ^)
In-Reply-To: <1610787553.89.0.699530326868.issue42885@roundup.psfhosted.org>
Message-ID: <20210116105159.GX7948@ando.pearwood.info>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

On Sat, Jan 16, 2021 at 08:59:13AM +0000, Serhiy Storchaka wrote:
> 
> Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:
> 
> ^ matches not just the beginning of the string. It matches the 
> beginning of a line, i.e. an anchor just after '\n'.

Only in MULTILINE mode.

I completely agree that in multiline mode '^a' has to search the entire 
string. But in single line mode, if the first character isn't an 'a', 
there is no need to continue searching.

As far as I can see from the docs, ^ in single line mode and \A always 
should be constant time.

> So the original report is rejected, the behavior is expected and 
> cannot be changed. It is not a bug.

I disagree that it is expected behaviour. "Match the start of the 
string" cannot possibly match anything except the start of the string, 
so who would expect it to keep scanning past the start of the string?

(Multiline mode is, of course, different.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42885>
_______________________________________

From report at bugs.python.org  Sat Jan 16 07:42:35 2021
From: report at bugs.python.org (Ross Rhodes)
Date: Sat, 16 Jan 2021 12:42:35 +0000
Subject: [issue42916] Support for DICOM image file format in imghdr module
In-Reply-To: <1610497726.98.0.199039272928.issue42916@roundup.psfhosted.org>
Message-ID: <1610800955.87.0.697460860805.issue42916@roundup.psfhosted.org>


Change by Ross Rhodes <ross.rhodes at hotmail.co.uk>:


----------
keywords: +patch
nosy: +trrhodes
nosy_count: 2.0 -> 3.0
pull_requests: +23050
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/24227

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42916>
_______________________________________

From report at bugs.python.org  Sat Jan 16 07:54:48 2021
From: report at bugs.python.org (David Bordeynik)
Date: Sat, 16 Jan 2021 12:54:48 +0000
Subject: [issue42643] http.server does not support HTTP range requests
In-Reply-To: <1607999046.16.0.658504644018.issue42643@roundup.psfhosted.org>
Message-ID: <1610801688.06.0.7038985215.issue42643@roundup.psfhosted.org>


Change by David Bordeynik <david.bordeynik at gmail.com>:


----------
keywords: +patch
nosy: +DavidBord
nosy_count: 2.0 -> 3.0
pull_requests: +23051
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24228

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42643>
_______________________________________

From report at bugs.python.org  Sat Jan 16 08:27:33 2021
From: report at bugs.python.org (Ross Rhodes)
Date: Sat, 16 Jan 2021 13:27:33 +0000
Subject: [issue42916] Support for DICOM image file format in imghdr module
In-Reply-To: <1610497726.98.0.199039272928.issue42916@roundup.psfhosted.org>
Message-ID: <1610803653.65.0.682981469053.issue42916@roundup.psfhosted.org>


Ross Rhodes <ross.rhodes at hotmail.co.uk> added the comment:

Hello Charles,

Following the format provided, I've opened a PR to implement your proposal. Feedback welcome.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42916>
_______________________________________

From report at bugs.python.org  Sat Jan 16 08:38:40 2021
From: report at bugs.python.org (Pete Wicken)
Date: Sat, 16 Jan 2021 13:38:40 +0000
Subject: [issue42935] Pickle can't import builtins at exit
In-Reply-To: <1610712338.22.0.647900497597.issue42935@roundup.psfhosted.org>
Message-ID: <1610804320.7.0.316931484022.issue42935@roundup.psfhosted.org>


Pete Wicken <petewicken at gmail.com> added the comment:

Out of curiosity, why is there not much we can do? I'm not familiar enough with Python's C code to appreciate the difficulty of making the builtins available at the point where the pickle save is run when exiting. The fact that this segfaults in the 3.8 version tested was rather concerning.

Shelve's implementation without the context manager was how we found the original bug; but it feels the way pickle handles this should be a lot safer.

Some clarification might help me craft a warning for the documentation if there is nothing that can be done in the code base.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42935>
_______________________________________

From report at bugs.python.org  Sat Jan 16 09:25:34 2021
From: report at bugs.python.org (=?utf-8?b?0JzQsNGA0Log0JrQvtGA0LXQvdCx0LXRgNCz?=)
Date: Sat, 16 Jan 2021 14:25:34 +0000
Subject: [issue42939] Linux's chattr i.e. ioctl(FS_IOC_SETFLAGS) is not
 supported in os.chflags()
Message-ID: <1610807134.64.0.859060580807.issue42939@roundup.psfhosted.org>


New submission from ???? ????????? <socketpair at gmail.com>:

https://man7.org/linux/man-pages/man2/ioctl_iflags.2.html

Seems the ioctl is only way to implement chattr(). I propose to add all these flags to os.chflags() and to gain its support in Linux.

----------
components: Library (Lib)
messages: 385141
nosy: socketpair
priority: normal
severity: normal
status: open
title: Linux's chattr i.e. ioctl(FS_IOC_SETFLAGS) is not supported in os.chflags()
versions: Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42939>
_______________________________________

From report at bugs.python.org  Sat Jan 16 10:44:43 2021
From: report at bugs.python.org (Arnim Rupp)
Date: Sat, 16 Jan 2021 15:44:43 +0000
Subject: [issue42885] Optimize re.search() for \A (and maybe ^)
In-Reply-To: <1610315901.41.0.467379667553.issue42885@roundup.psfhosted.org>
Message-ID: <1610811883.18.0.85533035807.issue42885@roundup.psfhosted.org>


Arnim Rupp <erich at rupp.de> added the comment:

some more observations, which might be helpful in tracking it down:

x$ is much faster than ^x
A$ is as slow as ^x

$ python3 -m timeit -s "a = 'A'*100000000" "import re" "re.search('x$', a)"
10 loops, best of 5: 32.9 msec per loop

$ python3 -m timeit -s "a = 'A'*100000000" "import re" "re.search('A$', a)"
1 loop, best of 5: 802 msec per loop

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42885>
_______________________________________

From report at bugs.python.org  Sat Jan 16 11:30:52 2021
From: report at bugs.python.org (Slava Kostrov)
Date: Sat, 16 Jan 2021 16:30:52 +0000
Subject: [issue42940] Incorrect behavior of inspect.signature(f).bind
Message-ID: <1610814652.94.0.812646879341.issue42940@roundup.psfhosted.org>


New submission from Slava Kostrov <slavkostrov at gmail.com>:

>>> def foo(a, /, b=1, **kwargs): pass
...
>>> foo(a=1)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
TypeError: foo() missing 1 required positional argument: 'a'

>>> inspect.signature(foo).bind(a=1)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "\Python\Python39\lib\inspect.py", line 3062, in bind
    return self._bind(args, kwargs)
  File "\Python\Python39\lib\inspect.py", line 2958, in _bind
    raise TypeError(msg) from None
TypeError: 'a' parameter is positional only, but was passed as a keyword

There is a different behaviour between a simple function call and inspect.signature(foo).bind - different TypeError messages.

I think inspect should check for VARKEYWORDS before throwing an error and throw only if there are not.

----------
messages: 385143
nosy: slavkostrov
priority: normal
severity: normal
status: open
title: Incorrect behavior of inspect.signature(f).bind
type: behavior
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42940>
_______________________________________

From report at bugs.python.org  Sat Jan 16 12:10:09 2021
From: report at bugs.python.org (Hingyuen Lam)
Date: Sat, 16 Jan 2021 17:10:09 +0000
Subject: [issue42941] Infinite loop in asyncio sslproto
Message-ID: <1610817009.05.0.00842749014089.issue42941@roundup.psfhosted.org>


New submission from Hingyuen Lam <linxy95 at gmail.com>:

There is an infinite loop in feed_appdata() of sslproto.py.
The OpenSSL documents said when some fatal I/O error occurred, SSL_ERROR_SYSCALL is returned and no further I/O operations should be performed. This error is ignored in the exception handling of feed_appdata(), and the while loop will never be break.
This error should be raised, the same for feed_ssldata().

----------
components: asyncio
messages: 385144
nosy: asvetlov, linxy95, yselivanov
priority: normal
severity: normal
status: open
title: Infinite loop in asyncio sslproto
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42941>
_______________________________________

From report at bugs.python.org  Sat Jan 16 12:22:30 2021
From: report at bugs.python.org (miss-islington)
Date: Sat, 16 Jan 2021 17:22:30 +0000
Subject: [issue42531] importlib.resources.path() raises TypeError for packages
 without __file__
In-Reply-To: <1606890702.39.0.177441013455.issue42531@roundup.psfhosted.org>
Message-ID: <1610817750.27.0.188314653878.issue42531@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset f08c66467d56c71f75c6659ede9177449fe9d2e6 by William Schwartz in branch '3.8':
[3.8] bpo-42531: Teach importlib.resources.path to handle packages without __file__ (GH-23611)
https://github.com/python/cpython/commit/f08c66467d56c71f75c6659ede9177449fe9d2e6


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42531>
_______________________________________

From report at bugs.python.org  Sat Jan 16 12:23:09 2021
From: report at bugs.python.org (miss-islington)
Date: Sat, 16 Jan 2021 17:23:09 +0000
Subject: [issue42531] importlib.resources.path() raises TypeError for packages
 without __file__
In-Reply-To: <1606890702.39.0.177441013455.issue42531@roundup.psfhosted.org>
Message-ID: <1610817789.51.0.58838497594.issue42531@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +23052
pull_request: https://github.com/python/cpython/pull/24229

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42531>
_______________________________________

From report at bugs.python.org  Sat Jan 16 12:24:48 2021
From: report at bugs.python.org (Jason R. Coombs)
Date: Sat, 16 Jan 2021 17:24:48 +0000
Subject: [issue42531] importlib.resources.path() raises TypeError for packages
 without __file__
In-Reply-To: <1606890702.39.0.177441013455.issue42531@roundup.psfhosted.org>
Message-ID: <1610817888.25.0.546369593256.issue42531@roundup.psfhosted.org>


Change by Jason R. Coombs <jaraco at jaraco.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42531>
_______________________________________

From report at bugs.python.org  Sat Jan 16 12:27:28 2021
From: report at bugs.python.org (Roundup Robot)
Date: Sat, 16 Jan 2021 17:27:28 +0000
Subject: [issue42941] Infinite loop in asyncio sslproto
In-Reply-To: <1610817009.05.0.00842749014089.issue42941@roundup.psfhosted.org>
Message-ID: <1610818048.04.0.495482568629.issue42941@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
keywords: +patch
nosy: +python-dev
nosy_count: 3.0 -> 4.0
pull_requests: +23053
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24230

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42941>
_______________________________________

From report at bugs.python.org  Sat Jan 16 12:54:28 2021
From: report at bugs.python.org (Jason R. Coombs)
Date: Sat, 16 Jan 2021 17:54:28 +0000
Subject: [issue42531] importlib.resources.path() raises TypeError for packages
 without __file__
In-Reply-To: <1606890702.39.0.177441013455.issue42531@roundup.psfhosted.org>
Message-ID: <1610819668.79.0.288921619245.issue42531@roundup.psfhosted.org>


Change by Jason R. Coombs <jaraco at jaraco.com>:


----------
versions:  -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42531>
_______________________________________

From report at bugs.python.org  Sat Jan 16 13:57:44 2021
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 16 Jan 2021 18:57:44 +0000
Subject: [issue33809] Expose `capture_locals` parameter in `traceback`
 convenience functions
In-Reply-To: <1528473140.44.0.592728768989.issue33809@psf.upfronthosting.co.za>
Message-ID: <1610823464.95.0.152773438473.issue33809@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
keywords: +patch
pull_requests: +23054
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24231

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33809>
_______________________________________

From report at bugs.python.org  Sat Jan 16 14:22:28 2021
From: report at bugs.python.org (Jason R. Coombs)
Date: Sat, 16 Jan 2021 19:22:28 +0000
Subject: [issue42163] _replace() no longer works on platform.uname_result
 objects
In-Reply-To: <1603750912.81.0.950571190169.issue42163@roundup.psfhosted.org>
Message-ID: <1610824948.1.0.0598167677941.issue42163@roundup.psfhosted.org>


Change by Jason R. Coombs <jaraco at jaraco.com>:


----------
pull_requests: +23055
pull_request: https://github.com/python/cpython/pull/24232

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42163>
_______________________________________

From report at bugs.python.org  Sat Jan 16 14:22:28 2021
From: report at bugs.python.org (Jason R. Coombs)
Date: Sat, 16 Jan 2021 19:22:28 +0000
Subject: [issue42659] Objects of uname_result Class Cannot be Successfully
 Pickled
In-Reply-To: <1608131578.78.0.823168956156.issue42659@roundup.psfhosted.org>
Message-ID: <1610824948.22.0.834775521021.issue42659@roundup.psfhosted.org>


Change by Jason R. Coombs <jaraco at jaraco.com>:


----------
pull_requests: +23057
pull_request: https://github.com/python/cpython/pull/24232

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42659>
_______________________________________

From report at bugs.python.org  Sat Jan 16 14:22:28 2021
From: report at bugs.python.org (Jason R. Coombs)
Date: Sat, 16 Jan 2021 19:22:28 +0000
Subject: [issue42189] copy.deepcopy() no longer works on platform.uname_result
 objects
In-Reply-To: <1603936415.14.0.266024580779.issue42189@roundup.psfhosted.org>
Message-ID: <1610824948.17.0.329256602003.issue42189@roundup.psfhosted.org>


Change by Jason R. Coombs <jaraco at jaraco.com>:


----------
pull_requests: +23056
pull_request: https://github.com/python/cpython/pull/24232

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42189>
_______________________________________

From report at bugs.python.org  Sat Jan 16 14:45:51 2021
From: report at bugs.python.org (Jason R. Coombs)
Date: Sat, 16 Jan 2021 19:45:51 +0000
Subject: [issue42659] Objects of uname_result Class Cannot be Successfully
 Pickled
In-Reply-To: <1608131578.78.0.823168956156.issue42659@roundup.psfhosted.org>
Message-ID: <1610826351.13.0.715684898915.issue42659@roundup.psfhosted.org>


Jason R. Coombs <jaraco at jaraco.com> added the comment:


New changeset 799722cb0ddb90752cde7798cab543f30623ebf2 by Jason R. Coombs in branch '3.9':
[3.9] bpo-42163, bpo-42189, bpo-42659: Support uname_tuple._replace (for all but processor) (GH-23010) (#24232)
https://github.com/python/cpython/commit/799722cb0ddb90752cde7798cab543f30623ebf2


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42659>
_______________________________________

From report at bugs.python.org  Sat Jan 16 14:45:51 2021
From: report at bugs.python.org (Jason R. Coombs)
Date: Sat, 16 Jan 2021 19:45:51 +0000
Subject: [issue42163] _replace() no longer works on platform.uname_result
 objects
In-Reply-To: <1603750912.81.0.950571190169.issue42163@roundup.psfhosted.org>
Message-ID: <1610826351.02.0.641160429383.issue42163@roundup.psfhosted.org>


Jason R. Coombs <jaraco at jaraco.com> added the comment:


New changeset 799722cb0ddb90752cde7798cab543f30623ebf2 by Jason R. Coombs in branch '3.9':
[3.9] bpo-42163, bpo-42189, bpo-42659: Support uname_tuple._replace (for all but processor) (GH-23010) (#24232)
https://github.com/python/cpython/commit/799722cb0ddb90752cde7798cab543f30623ebf2


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42163>
_______________________________________

From report at bugs.python.org  Sat Jan 16 14:45:51 2021
From: report at bugs.python.org (Jason R. Coombs)
Date: Sat, 16 Jan 2021 19:45:51 +0000
Subject: [issue42189] copy.deepcopy() no longer works on platform.uname_result
 objects
In-Reply-To: <1603936415.14.0.266024580779.issue42189@roundup.psfhosted.org>
Message-ID: <1610826351.1.0.783681254345.issue42189@roundup.psfhosted.org>


Jason R. Coombs <jaraco at jaraco.com> added the comment:


New changeset 799722cb0ddb90752cde7798cab543f30623ebf2 by Jason R. Coombs in branch '3.9':
[3.9] bpo-42163, bpo-42189, bpo-42659: Support uname_tuple._replace (for all but processor) (GH-23010) (#24232)
https://github.com/python/cpython/commit/799722cb0ddb90752cde7798cab543f30623ebf2


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42189>
_______________________________________

From report at bugs.python.org  Sat Jan 16 14:46:20 2021
From: report at bugs.python.org (Jason R. Coombs)
Date: Sat, 16 Jan 2021 19:46:20 +0000
Subject: [issue42163] _replace() no longer works on platform.uname_result
 objects
In-Reply-To: <1603750912.81.0.950571190169.issue42163@roundup.psfhosted.org>
Message-ID: <1610826380.37.0.636476329965.issue42163@roundup.psfhosted.org>


Change by Jason R. Coombs <jaraco at jaraco.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42163>
_______________________________________

From report at bugs.python.org  Sat Jan 16 14:46:42 2021
From: report at bugs.python.org (Jason R. Coombs)
Date: Sat, 16 Jan 2021 19:46:42 +0000
Subject: [issue42189] copy.deepcopy() no longer works on platform.uname_result
 objects
In-Reply-To: <1603936415.14.0.266024580779.issue42189@roundup.psfhosted.org>
Message-ID: <1610826402.14.0.391988100319.issue42189@roundup.psfhosted.org>


Change by Jason R. Coombs <jaraco at jaraco.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42189>
_______________________________________

From report at bugs.python.org  Sat Jan 16 14:47:09 2021
From: report at bugs.python.org (Jason R. Coombs)
Date: Sat, 16 Jan 2021 19:47:09 +0000
Subject: [issue42659] Objects of uname_result Class Cannot be Successfully
 Pickled
In-Reply-To: <1608131578.78.0.823168956156.issue42659@roundup.psfhosted.org>
Message-ID: <1610826429.53.0.894074212146.issue42659@roundup.psfhosted.org>


Change by Jason R. Coombs <jaraco at jaraco.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42659>
_______________________________________

From report at bugs.python.org  Sat Jan 16 15:51:41 2021
From: report at bugs.python.org (Christian Heimes)
Date: Sat, 16 Jan 2021 20:51:41 +0000
Subject: [issue42935] Pickle can't import builtins at exit
In-Reply-To: <1610712338.22.0.647900497597.issue42935@roundup.psfhosted.org>
Message-ID: <1610830301.52.0.0452634304591.issue42935@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

At the end of a Python process, the interpreter is shut down in multiple steps. Object finalizers such as __del__ may be executed late in the interpreter shut down process. In your case, most of the interpreter is already gone. There isn't anything we can do to solve the problem.

That's why we recommend explicit resource management with the "with" statement. The atexit module is another way to execute cleanup hooks before the interpreter is shut down.

----------
nosy: +christian.heimes

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42935>
_______________________________________

From report at bugs.python.org  Sat Jan 16 16:07:45 2021
From: report at bugs.python.org (Arnim Rupp)
Date: Sat, 16 Jan 2021 21:07:45 +0000
Subject: [issue42885] Optimize re.search() for \A (and maybe ^)
In-Reply-To: <1610315901.41.0.467379667553.issue42885@roundup.psfhosted.org>
Message-ID: <1610831265.24.0.269246697127.issue42885@roundup.psfhosted.org>


Change by Arnim Rupp <python at rupp.de>:


----------
components: +Regular Expressions -Library (Lib)
nosy: +ezio.melotti, mrabarnett

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42885>
_______________________________________

From report at bugs.python.org  Sat Jan 16 16:33:21 2021
From: report at bugs.python.org (Arnim Rupp)
Date: Sat, 16 Jan 2021 21:33:21 +0000
Subject: [issue42942] Feature request: Add decdigest() to hashlib
Message-ID: <1610832800.98.0.200773545993.issue42942@roundup.psfhosted.org>


New submission from Arnim Rupp <python at rupp.de>:

Problem: hashlib only offers digest() and hexdigest() but the fastest way to work with hashes is as integer.

The first thing loki does after getting the hashes is to convert them to int:
md5, sha1, sha256 = generateHashes(fileData)
                        md5_num=int(md5, 16)
                        sha1_num=int(sha1, 16)
                        sha256_num=int(sha256, 16)
https://github.com/Neo23x0/Loki/blob/master/loki.py

All the ~50000 hashes to compare are also converted to int after reading them from a file. The comparison is about twice as fast compared to hexdigest in strings because it uses just half the memory. 

(The use case here is to compare these 50,000 hashes to the hashes of all the 200,000 files on a system that gets scanned for malicious files.)

Solution: Add decdigest() to hashlib which returns the int version of the hash. This has 2 advantages: 
1. It saves the time for converting the hash to hex and back
2. Having decdigest() in the documentation inspires more programmers to work with hashes as int opposed to slow strings (where it's performance relevant.)

Should be just few lines of code for each algorithm, I could do the PR.

static PyObject *
_sha3_shake_128_hexdigest(SHA3object *self, PyObject *arg)
{
    PyObject *return_value = NULL;
    unsigned long length;

    if (!_PyLong_UnsignedLong_Converter(arg, &length)) {
        goto exit;
    }
    return_value = _sha3_shake_128_hexdigest_impl(self, length);

https://github.com/python/cpython/blob/63298930fb531ba2bb4f23bc3b915dbf1e17e9e1/Modules/_sha3/clinic/sha3module.c.h

----------
components: Library (Lib)
messages: 385150
nosy: 2d4d
priority: normal
severity: normal
status: open
title: Feature request: Add decdigest() to hashlib
type: performance
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42942>
_______________________________________

From report at bugs.python.org  Sat Jan 16 16:46:19 2021
From: report at bugs.python.org (Ilya Kulakov)
Date: Sat, 16 Jan 2021 21:46:19 +0000
Subject: [issue42943] singledispatchmethod should expose registry of all known
 overloads
Message-ID: <1610833579.12.0.993134178442.issue42943@roundup.psfhosted.org>


New submission from Ilya Kulakov <kulakov.ilya at gmail.com>:

The wrapper created by singledispatchmethod does not (trivially) expose registry of all known overloads.
Consider the following example:


    @singledispatchmethod
    def on_message(message):
        raise NotImplementedError

    @on_message.register
    def _(message: MessageA): ...

    @on_message.register
    def _(message: MessageB): ...

    loop = ...
    condition = ...
    messages = []

    def receive_message_on_thread(message):
        if ...:  # only signal to asyncio if message can be handled
            messages.append(message)
            loop.call_soon_threadsafe(condition.notify_all)
        else:
            ...

    async def process_messages_on_asyncio():
        while True:
            await condition.wait_for(lambda: len(messages) > 0)

            while len(messages):
                m = messages.pop(0)
                ...


Here messages are delivered outside of asyncio in a separate thread and thus they need to be forwarded into asyncio for further processing in the app. If the flow of messages is high it is desirable to filter inside the thread handler before signaling asyncio.

There are multiple approaches to describe which messages can be handled by the asyncio processor, but singledispatchmethod is the most elegant as it allows to keep everything in one place without if/else or code duplication.

Having a registry (trivially) exposed would allow to write the condition as `isinstance(message, tuple(on_message.registry.keys()))`.

----------
components: Library (Lib)
messages: 385151
nosy: Ilya.Kulakov, lukasz.langa, methane, ncoghlan
priority: normal
severity: normal
status: open
title: singledispatchmethod should expose registry of all known overloads
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42943>
_______________________________________

From report at bugs.python.org  Sat Jan 16 17:58:54 2021
From: report at bugs.python.org (Jon FRANCO)
Date: Sat, 16 Jan 2021 22:58:54 +0000
Subject: [issue42944] random.Random.sample bug when counts is not None
Message-ID: <1610837934.67.0.783808477389.issue42944@roundup.psfhosted.org>


New submission from Jon FRANCO <jonani.franco at hotmail.fr>:

Hello,

If I am reading right, random.Random.sample method has a bug if counts is not None.

Line 482 (of master):
"""
            selections = sample(range(total), k=k)
"""
this is calling the module function 'sample' and not the instance method.

IMO this line should be:
"""
            selections = self.sample(range(total), k=k)
"""

Python 3.9.1 (default, Dec 11 2020, 14:32:07) 
[GCC 7.3.0] :: Anaconda, Inc. on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> from random import Random
>>> r = Random()
>>> r.seed('bug')
>>> r.sample(range(50), 5, counts=range(1,51))
[34, 39, 31, 42, 38]
>>> r.seed('bug')
>>> r.sample(range(50), 5, counts=range(1,51))
[39, 11, 3, 12, 29]  <====== this should be [34, 39, 31, 42, 38]
>>> r.seed('nobug')
>>> r.sample(range(50), 5)
[0, 30, 23, 17, 49]
>>> r.seed('nobug')
>>> r.sample(range(50), 5)
[0, 30, 23, 17, 49]

Regards,
Jon FRANCO

----------
components: Library (Lib)
messages: 385152
nosy: jonfranco, rhettinger
priority: normal
severity: normal
status: open
title: random.Random.sample bug when counts is not None
type: behavior
versions: Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42944>
_______________________________________

From report at bugs.python.org  Sat Jan 16 21:58:15 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 17 Jan 2021 02:58:15 +0000
Subject: [issue42944] random.Random.sample bug when counts is not None
In-Reply-To: <1610837934.67.0.783808477389.issue42944@roundup.psfhosted.org>
Message-ID: <1610852295.33.0.622376243521.issue42944@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
assignee:  -> rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42944>
_______________________________________

From report at bugs.python.org  Sat Jan 16 22:03:37 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 17 Jan 2021 03:03:37 +0000
Subject: [issue42944] random.Random.sample bug when counts is not None
In-Reply-To: <1610837934.67.0.783808477389.issue42944@roundup.psfhosted.org>
Message-ID: <1610852617.84.0.0498782662513.issue42944@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Would you like to submit a PR for this?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42944>
_______________________________________

From report at bugs.python.org  Sat Jan 16 22:28:19 2021
From: report at bugs.python.org (Jason R. Coombs)
Date: Sun, 17 Jan 2021 03:28:19 +0000
Subject: [issue32509] doctest syntax ambiguity between continuation line and
 ellipsis
In-Reply-To: <1515297917.31.0.467229070634.issue32509@psf.upfronthosting.co.za>
Message-ID: <1610854099.44.0.198193759201.issue32509@roundup.psfhosted.org>


Jason R. Coombs <jaraco at jaraco.com> added the comment:

I've encountered this issue again with a different use-case.

I'm attempting to add a doctest to a routine that emits the paths of the files it processes. I want to use ellipses to ignore the prefixes of the output because they're not pertinent to the test. Here's the test that might have worked: https://github.com/python/importlib_resources/commit/ca9d014e1b884ff7f8cee63a436832a3e6e809fb, but failed with:

```
_______________________________________ ERROR collecting importlib_resources/tests/update-zips.py _______________________________________
/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/doctest.py:939: in find
    self._find(tests, obj, name, module, source_lines, globs, {})
.tox/python/lib/python3.9/site-packages/_pytest/doctest.py:522: in _find
    doctest.DocTestFinder._find(  # type: ignore
/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/doctest.py:1001: in _find
    self._find(tests, val, valname, module, source_lines,
.tox/python/lib/python3.9/site-packages/_pytest/doctest.py:522: in _find
    doctest.DocTestFinder._find(  # type: ignore
/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/doctest.py:989: in _find
    test = self._get_test(obj, name, module, globs, source_lines)
/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/doctest.py:1073: in _get_test
    return self._parser.get_doctest(docstring, globs, name,
/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/doctest.py:675: in get_doctest
    return DocTest(self.get_examples(string, name), globs,
/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/doctest.py:689: in get_examples
    return [x for x in self.parse(string, name)
/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/doctest.py:651: in parse
    self._parse_example(m, name, lineno)
/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/doctest.py:709: in _parse_example
    self._check_prompt_blank(source_lines, indent, name, lineno)
/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/doctest.py:793: in _check_prompt_blank
    raise ValueError('line %r of the docstring for %s '
E   ValueError: line 6 of the docstring for importlib_resources.tests.update-zips.main lacks blank after ...: '.../data01/utf-16.file -> ziptestdata/utf-16.file'
```

I was able to work around the issue by injecting a newline into the output (https://github.com/python/importlib_resources/commit/b8d48d5a86a9f5bd391c18e1acb39b5697f7ca40).

I notice also that in some environments that the test still fails due to the arbitrary ordering of the output, but that test does pass in some environments.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32509>
_______________________________________

From report at bugs.python.org  Sat Jan 16 23:12:18 2021
From: report at bugs.python.org (Ryan Heisler)
Date: Sun, 17 Jan 2021 04:12:18 +0000
Subject: [issue42945] weakref.finalize documentation contradicts itself RE:
 finalizer callback or args referencing object
Message-ID: <1610856738.09.0.530478209911.issue42945@roundup.psfhosted.org>


New submission from Ryan Heisler <ryan.a.heisler at gmail.com>:

In the documentation for `weakref.finalize` (https://docs.python.org/3.9/library/weakref.html#weakref.finalize), it says:

"Note It is important to ensure that func, args and kwargs do not own any references to obj, either directly or indirectly, since otherwise obj will never be garbage collected. In particular, func should not be a bound method of obj."

However, at the bottom of the document, in the section called "Comparing finalizers with __del__() methods" (https://docs.python.org/3.8/library/weakref.html#comparing-finalizers-with-del-methods), the following code is part of an example of how to use `weakref.finalize`:

class TempDir:
    def __init__(self):
        self.name = tempfile.mkdtemp()
        self._finalizer = weakref.finalize(self, shutil.rmtree, self.name)

I believe this code violates the rule that func, args, and kwargs should not have a reference to obj. In the example, obj is the instance of TempDir, and one of the arguments to finalize's callback is an attribute of the same instance of TempDir.

I do not know how to fix this example code. I found it while trying to figure out how to use `weakref.finalize`.

----------
assignee: docs at python
components: Documentation
messages: 385155
nosy: docs at python, ryan.a.heisler
priority: normal
severity: normal
status: open
title: weakref.finalize documentation contradicts itself RE: finalizer callback or args referencing object
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42945>
_______________________________________

From report at bugs.python.org  Sat Jan 16 23:40:50 2021
From: report at bugs.python.org (Tim Peters)
Date: Sun, 17 Jan 2021 04:40:50 +0000
Subject: [issue42945] weakref.finalize documentation contradicts itself RE:
 finalizer callback or args referencing object
In-Reply-To: <1610856738.09.0.530478209911.issue42945@roundup.psfhosted.org>
Message-ID: <1610858450.93.0.233387927478.issue42945@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

Not a problem. Arguments to a function are evaluated before the function is invoked.  So in

self._finalizer = weakref.finalize(self, shutil.rmtree, self.name)

self.name is evaluated before weakref.finalize is called(). `self.name` _extracts_ the `.name` attribute of `self`, and the result is simply a pathname (returned by the earlier call to `mkdtemp()`), from which `self` cannot be accessed.

Just like, e.g., for just about any old object O, after

    O.name = 42

a later `O.name` extracts the int 42, with no trace of that 42 had anything to do with `O`.

This isn't so when for a bound method object: `O.method_name` constructs and returns an object that _does_ reference `O`. That's why the earlier docs highlight bound method objects. For an attribute `name` bound to a chunk of data, `O.name` just retrieves that data, which _generally_ has nothing to do with `O` beyond that it happens to be reachable from `O` (but also generally NOT the reverse).

----------
nosy: +tim.peters

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42945>
_______________________________________

From report at bugs.python.org  Sun Jan 17 00:08:41 2021
From: report at bugs.python.org (Ryan Heisler)
Date: Sun, 17 Jan 2021 05:08:41 +0000
Subject: [issue42945] weakref.finalize documentation contradicts itself RE:
 finalizer callback or args referencing object
In-Reply-To: <1610856738.09.0.530478209911.issue42945@roundup.psfhosted.org>
Message-ID: <1610860121.95.0.190572353106.issue42945@roundup.psfhosted.org>


Ryan Heisler <ryan.a.heisler at gmail.com> added the comment:

Perfect, thanks for your quick response. I was passing a bound method of obj as the func to `weakref.finalize(obj, func, /, *args, **kwargs)`. It slipped my mind that an instance variable like self.name and a bound method like self.clean_up, though they both belong to self, would be evaluated differently.

For anyone wondering, I was looking for weakref.proxy (https://docs.python.org/3/library/weakref.html#weakref.proxy) or weakref.WeakMethod (https://docs.python.org/3/library/weakref.html#weakref.WeakMethod)

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42945>
_______________________________________

From report at bugs.python.org  Sun Jan 17 06:16:39 2021
From: report at bugs.python.org (Jon FRANCO)
Date: Sun, 17 Jan 2021 11:16:39 +0000
Subject: [issue42944] random.Random.sample bug when counts is not None
In-Reply-To: <1610837934.67.0.783808477389.issue42944@roundup.psfhosted.org>
Message-ID: <1610882199.27.0.213591987175.issue42944@roundup.psfhosted.org>


Change by Jon FRANCO <jonani.franco at hotmail.fr>:


----------
keywords: +patch
pull_requests: +23058
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24235

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42944>
_______________________________________

From report at bugs.python.org  Sun Jan 17 06:27:56 2021
From: report at bugs.python.org (Jon FRANCO)
Date: Sun, 17 Jan 2021 11:27:56 +0000
Subject: [issue42944] random.Random.sample bug when counts is not None
In-Reply-To: <1610837934.67.0.783808477389.issue42944@roundup.psfhosted.org>
Message-ID: <1610882876.94.0.452969510455.issue42944@roundup.psfhosted.org>


Jon FRANCO <jonani.franco at hotmail.fr> added the comment:

PR submitted. 
Let me know if I missed something, this is also my first PR.
Regards.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42944>
_______________________________________

From report at bugs.python.org  Sun Jan 17 06:31:15 2021
From: report at bugs.python.org (Christian Heimes)
Date: Sun, 17 Jan 2021 11:31:15 +0000
Subject: [issue42942] Feature request: Add decdigest() to hashlib
In-Reply-To: <1610832800.98.0.200773545993.issue42942@roundup.psfhosted.org>
Message-ID: <1610883075.17.0.812556237167.issue42942@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

Do you have any benchmarks that back up your claim that integers are faster than using digest or hexdigests? Python's str and bytes types are highly optimized.

Hash digests don't fit into native integers, because they are larger than uint64_t and therefore have to be converted into arbitrary size integers (aka bigints). Arbitrary size integers have an overhead. For example it's slower to convert bytes to an integer than to hex string. Comparison of long its takes about as much time as comparing bytes.

By the way int(h.hexdigest(), 16) is a slow and inefficient way to convert a hash digest into an integer. int.from_bytes(h.digest(), endian) is much faster.

$ ./python -m timeit -s "from hashlib import sha256; s = sha256()" "s.digest()"
500000 loops, best of 5: 450 nsec per loop
$ ./python -m timeit -s "from hashlib import sha256; s = sha256()" "s.hexdigest()"
500000 loops, best of 5: 615 nsec per loop
$ ./python -m timeit -s "from hashlib import sha256; s = sha256()" "int.from_bytes(s.digest(), 'big')"
500000 loops, best of 5: 809 nsec per loop
$ ./python -m timeit -s "from hashlib import sha256; s = sha256()" "int(s.hexdigest(), 16)"
200000 loops, best of 5: 1.03 usec per loop

----------
nosy: +christian.heimes, gregory.p.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42942>
_______________________________________

From report at bugs.python.org  Sun Jan 17 06:35:17 2021
From: report at bugs.python.org (Christian Heimes)
Date: Sun, 17 Jan 2021 11:35:17 +0000
Subject: [issue42942] Feature request: Add decdigest() to hashlib
In-Reply-To: <1610832800.98.0.200773545993.issue42942@roundup.psfhosted.org>
Message-ID: <1610883317.67.0.659660802299.issue42942@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

Is there any particular reason you are using bisect search with sorted list of integers? Why don't you use a simple approach with a dict of digest bytes? bisect search is O(log(n)), dict lookup is O(1) and therefore scales much better.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42942>
_______________________________________

From report at bugs.python.org  Sun Jan 17 07:27:24 2021
From: report at bugs.python.org (Jeremy Kloth)
Date: Sun, 17 Jan 2021 12:27:24 +0000
Subject: [issue42705] Intercepting thread lock objects not working under
 context managers
In-Reply-To: <1608563683.89.0.442233562977.issue42705@roundup.psfhosted.org>
Message-ID: <1610886444.73.0.250337501487.issue42705@roundup.psfhosted.org>


Change by Jeremy Kloth <jeremy.kloth+python-tracker at gmail.com>:


----------
components:  -Distutils

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42705>
_______________________________________

From report at bugs.python.org  Sun Jan 17 11:54:42 2021
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 17 Jan 2021 16:54:42 +0000
Subject: [issue42923] Py_FatalError(): dump the list of extension modules
In-Reply-To: <1610535013.1.0.942204365805.issue42923@roundup.psfhosted.org>
Message-ID: <1610902482.98.0.784093850805.issue42923@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Example of a Pillow crash in Python 3.10:
https://mail.python.org/archives/list/python-dev at python.org/message/5DCR2R6POCOHTPFUOY4F5G7GTBYX6OPO/

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42923>
_______________________________________

From report at bugs.python.org  Sun Jan 17 12:14:51 2021
From: report at bugs.python.org (Florian Bruhin)
Date: Sun, 17 Jan 2021 17:14:51 +0000
Subject: [issue42946] email: ValueError in get_section when parsing header
 with non-ASCII digit
Message-ID: <1610903691.7.0.354788620236.issue42946@roundup.psfhosted.org>


New submission from Florian Bruhin <python.org at the-compiler.org>:

Found mostly by accident:

>>> import email.headerregistry
>>> reg = email.headerregistry.HeaderRegistry()
>>> h = reg('Content-Disposition', 'inline; 0*?')
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/lib/python3.10/email/headerregistry.py", line 608, in __call__
    return self[name](name, value)
  File "/usr/lib/python3.10/email/headerregistry.py", line 196, in __new__
    cls.parse(value, kwds)
  File "/usr/lib/python3.10/email/headerregistry.py", line 452, in parse
    kwds['parse_tree'] = parse_tree = cls.value_parser(value)
  File "/usr/lib/python3.10/email/_header_value_parser.py", line 2705, in parse_content_disposition_header
    disp_header.append(parse_mime_parameters(value[1:]))
  File "/usr/lib/python3.10/email/_header_value_parser.py", line 2569, in parse_mime_parameters
    token, value = get_parameter(value)
  File "/usr/lib/python3.10/email/_header_value_parser.py", line 2431, in get_parameter
    token, value = get_section(value)
  File "/usr/lib/python3.10/email/_header_value_parser.py", line 2384, in get_section
    section.number = int(digits)
ValueError: invalid literal for int() with base 10: '?'

This probably happens because:

>>> '?'.isdigit()
True
>>> int('?')
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ValueError: invalid literal for int() with base 10: '?'

----------
components: Library (Lib)
messages: 385162
nosy: The Compiler, barry, maxking, r.david.murray
priority: normal
severity: normal
status: open
title: email: ValueError in get_section when parsing header with non-ASCII digit
type: behavior
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42946>
_______________________________________

From report at bugs.python.org  Sun Jan 17 12:28:07 2021
From: report at bugs.python.org (Florian Bruhin)
Date: Sun, 17 Jan 2021 17:28:07 +0000
Subject: [issue42947] email: Handling when both extended/ascii parameter
 (filename*/filename) are present?
Message-ID: <1610904487.73.0.582828355991.issue42947@roundup.psfhosted.org>


New submission from Florian Bruhin <python.org at the-compiler.org>:

Consider this reproducer:

    >>> import email.headerregistry
    >>> reg = email.headerregistry.HeaderRegistry()
    >>> parsed = reg('Content-Disposition', """attachment; filename="foo-ae.html"; filename*=UTF-8''foo-%c3%a4.html""")
    >>> parsed.defects
    (InvalidHeaderDefect('duplicate parameter name; duplicate(s) ignored'),)
    >>> parsed.params['filename']
    'foo-ae.html'

However, the relevant section of RFC 5987 says:

https://greenbytes.de/tech/webdav/rfc5987.html#rfc.section.4.2

> This specification suggests that a parameter using the extended syntax takes precedence. This would allow producers to use both formats without breaking recipients that do not understand the extended syntax yet.

And RFC 6266 says:

https://greenbytes.de/tech/webdav/rfc6266.html#rfc.section.4.3

> Many user agent implementations predating this specification do not understand the "filename*" parameter. Therefore, when both "filename" and "filename*" are present in a single header field value, recipients should pick "filename*" and ignore "filename". This way, senders can avoid special-casing specific user agents by sending both the more expressive "filename*" parameter, and the "filename" parameter as fallback for legacy recipients (see Section 5 for an example).

Also see the related attfnboth and attfnboth2 test cases here:
http://test.greenbytes.de/tech/tc2231/#attfnboth

I'm aware those two RFCs are specific to HTTP - but given that there's a "HTTP" policy and "utils.py" has some HTTP-specific date/time handling, I suppose correct handling of this might be in scope as well?

----------
components: Library (Lib)
messages: 385163
nosy: The Compiler
priority: normal
severity: normal
status: open
title: email: Handling when both extended/ascii parameter (filename*/filename) are present?
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42947>
_______________________________________

From report at bugs.python.org  Sun Jan 17 13:41:52 2021
From: report at bugs.python.org (wim glenn)
Date: Sun, 17 Jan 2021 18:41:52 +0000
Subject: [issue42948] bytearray.copy is undocumented
Message-ID: <1610908912.39.0.795030432727.issue42948@roundup.psfhosted.org>


New submission from wim glenn <wim.glenn at gmail.com>:

bytearray type has a copy method which seems to be undocumented

https://docs.python.org/3/library/stdtypes.html#bytes-and-bytearray-operations

----------
assignee: docs at python
components: Documentation
messages: 385164
nosy: docs at python, wim.glenn
priority: normal
severity: normal
status: open
title: bytearray.copy is undocumented
type: enhancement
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42948>
_______________________________________

From report at bugs.python.org  Sun Jan 17 14:01:18 2021
From: report at bugs.python.org (Gregory P. Smith)
Date: Sun, 17 Jan 2021 19:01:18 +0000
Subject: [issue42942] Feature request: Add decdigest() to hashlib
In-Reply-To: <1610832800.98.0.200773545993.issue42942@roundup.psfhosted.org>
Message-ID: <1610910078.38.0.24688630847.issue42942@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

Agreed, using a dict or set hash table lookup is more appropriate for such an algorithm.

Also agreed: comparing python integers (30-bit digit bignums internally) cannot be faster than comparing a binary bytes object.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42942>
_______________________________________

From report at bugs.python.org  Sun Jan 17 14:03:50 2021
From: report at bugs.python.org (Arnim Rupp)
Date: Sun, 17 Jan 2021 19:03:50 +0000
Subject: [issue42942] Feature request: Add decdigest() to hashlib
In-Reply-To: <1610832800.98.0.200773545993.issue42942@roundup.psfhosted.org>
Message-ID: <1610910230.49.0.780167853775.issue42942@roundup.psfhosted.org>


Arnim Rupp <python at rupp.de> added the comment:

oh, you're absolutely right about digest(), sorry, mixed the representation with the data. closing this, thanks.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42942>
_______________________________________

From report at bugs.python.org  Sun Jan 17 14:49:53 2021
From: report at bugs.python.org (Patrick Haller)
Date: Sun, 17 Jan 2021 19:49:53 +0000
Subject: [issue42948] bytearray.copy is undocumented
In-Reply-To: <1610908912.39.0.795030432727.issue42948@roundup.psfhosted.org>
Message-ID: <1610912993.11.0.441253578704.issue42948@roundup.psfhosted.org>


Patrick Haller <patrickhaller40 at googlemail.com> added the comment:

You will see this on every bytes and bytearray type as the behaviour described is the same for both.

----------
nosy: +HallerPatrick

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42948>
_______________________________________

From report at bugs.python.org  Sun Jan 17 17:10:12 2021
From: report at bugs.python.org (Freek Dijkstra)
Date: Sun, 17 Jan 2021 22:10:12 +0000
Subject: [issue42949] pdb & multiprocessing.Pool: AttributeError: module
 '__main__' has no attribute '__spec__'
Message-ID: <1610921412.78.0.54587473242.issue42949@roundup.psfhosted.org>


New submission from Freek Dijkstra <freek at macfreek.nl>:

Summary:

multiprocessing.Pool contains a bug when the script is invoked with pdb.



Steps to reproduce:

Consider the following script:

```
from multiprocessing import Pool

def f(x):
    return x*x

if __name__ == '__main__':
    with Pool(5) as p:
        print(p.map(f, [1, 2, 3]))
```

When called as `python3.10 test.py`, this works fine, and returns `[1, 4, 9]`

When called as `python3.10 -m pdb test.py`, it gives the following exception:

```
freek at minnie ~ ? python3.9 -m pdb test.py
> /Users/freek/test.py(3)<module>()
-> from multiprocessing import Pool
(Pdb) c
Traceback (most recent call last):
  File "/opt/local/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/pdb.py", line 1704, in main
    pdb._runscript(mainpyfile)
  File "/opt/local/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/pdb.py", line 1573, in _runscript
    self.run(statement)
  File "/opt/local/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/bdb.py", line 580, in run
    exec(cmd, globals, locals)
  File "<string>", line 1, in <module>
  File "/Users/freek/test.py", line 3, in <module>
    from multiprocessing import Pool
  File "/opt/local/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/multiprocessing/context.py", line 119, in Pool
    return Pool(processes, initializer, initargs, maxtasksperchild,
  File "/opt/local/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/multiprocessing/pool.py", line 212, in __init__
    self._repopulate_pool()
  File "/opt/local/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/multiprocessing/pool.py", line 303, in _repopulate_pool
    return self._repopulate_pool_static(self._ctx, self.Process,
  File "/opt/local/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/multiprocessing/pool.py", line 326, in _repopulate_pool_static
    w.start()
  File "/opt/local/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/multiprocessing/process.py", line 121, in start
    self._popen = self._Popen(self)
  File "/opt/local/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/multiprocessing/context.py", line 284, in _Popen
    return Popen(process_obj)
  File "/opt/local/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/multiprocessing/popen_spawn_posix.py", line 32, in __init__
    super().__init__(process_obj)
  File "/opt/local/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/multiprocessing/popen_fork.py", line 19, in __init__
    self._launch(process_obj)
  File "/opt/local/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/multiprocessing/popen_spawn_posix.py", line 42, in _launch
    prep_data = spawn.get_preparation_data(process_obj._name)
  File "/opt/local/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/multiprocessing/spawn.py", line 183, in get_preparation_data
    main_mod_name = getattr(main_module.__spec__, "name", None)
AttributeError: module '__main__' has no attribute '__spec__'
```

I can reproduce this in Python 3.8.7, 3.9.1, 3.10.0a3. It works fine in Python 3.7.9.

A workaround is to define `__spec__` in __main__:

```
from multiprocessing import Pool

def f(x):
    return x*x

if __name__ == '__main__':
    __spec__ = None
    with Pool(5) as p:
        print(p.map(f, [1, 2, 3]))
```

I'd say that multiprocessing/spawn.py", line 183, in get_preparation_data is flawed
    main_mod_name = getattr(main_module.__spec__, "name", None)

----------
components: Library (Lib)
messages: 385168
nosy: macfreek
priority: normal
severity: normal
status: open
title: pdb & multiprocessing.Pool: AttributeError: module '__main__' has no attribute '__spec__'
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42949>
_______________________________________

From report at bugs.python.org  Sun Jan 17 17:56:56 2021
From: report at bugs.python.org (Dennis Sweeney)
Date: Sun, 17 Jan 2021 22:56:56 +0000
Subject: [issue41972] bytes.find consistently hangs in a particular scenario
In-Reply-To: <1602113519.53.0.297229304628.issue41972@roundup.psfhosted.org>
Message-ID: <1610924216.68.0.863724303611.issue41972@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

PR 22904 now adds a text document explaining how the Two-Way algorithm works in much more detail.

I was looking at more benchmarking results, and I came to a couple of conclusions about cutoffs.

There's a consistent benefit to using the two-way algorithm whenever both strings are long enough and the needle is less than 20% the length of the haystack. If that percentage is higher, the preprocessing cost starts to dominate, and the Two-Way algorithm is slower than the status quo in average such cases. This doesn't change the fact that in cases like OP's original example, the Two-way algorithm can be thousands of times faster than the status quo, even though the needle is a significant percentage of the length of the haystack.

So to handle that, I tried an adaptive/introspective algorithm like Tim suggested: it counts the number of matched characters that don't lead to full matches, and once that total exceeds O(m), the Two-Way preprocessing cost will surely be worth it. The only way I could figure out how to not damage the speed of the usual small-string cases is to duplicate that code. See comparison.jpg for how much better the adaptive version is as opposed to always using two-way on this Zipf benchmark, while still guaranteeing O(m + n).

----------
Added file: https://bugs.python.org/file49746/comparison.jpg

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41972>
_______________________________________

From report at bugs.python.org  Sun Jan 17 23:14:45 2021
From: report at bugs.python.org (Xinmeng Xia)
Date: Mon, 18 Jan 2021 04:14:45 +0000
Subject: [issue42950] Incorrect exception behavior in handling recursive call.
Message-ID: <1610943284.97.0.842137525249.issue42950@roundup.psfhosted.org>


New submission from Xinmeng Xia <xiaxm at smail.nju.edu.cn>:

Seeing the following programs, we try to catch a recursive call error in exception handling.  The behaviors between Python 3.10.0a4 and older version are inconsistent. The outputs are attached in the end. The output on Python 3.10.0a4 is very weird. Two "print statements" lie in same "except" block to print "exception info" and a string "kk". "kk" is printed once while "exception info" is printed twice! I think a bug probably exists in Python 3.10.0a4 parser on handling stacks. 


=========================
def foo(c):
         try:
             c = c + 1
             print("ss"+str(c))
             foo(c)
         except Exception as e:
             print(str(e))
             print("kk")
         print(c)
c = 0
foo(c)
=========================

Output in Python 3.10.0a2 and older version(expected)
------------------------------------------------------------------------
ss1
ss2
....
ss996
maximum recursion depth exceeded while calling a Python object
kk
996
995
......
3
2
1
------------------------------------------------------------------------

Output in Python 3.10.0a4 (unexpected)
------------------------------------------------------------------------
ss1
ss2
....
ss996
maximum recursion depth exceeded while calling a Python object
maximum recursion depth exceeded while calling a Python object
kk
995
......
3
2
1
------------------------------------------------------------------------

----------
components: Interpreter Core
messages: 385170
nosy: xxm
priority: normal
severity: normal
status: open
title: Incorrect exception behavior in handling recursive call.
type: behavior
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42950>
_______________________________________

From report at bugs.python.org  Sun Jan 17 23:17:00 2021
From: report at bugs.python.org (Xinmeng Xia)
Date: Mon, 18 Jan 2021 04:17:00 +0000
Subject: [issue42951] Random and infinite loop in dealing with recursion error
 for "try-except "
Message-ID: <1610943420.56.0.379356825462.issue42951@roundup.psfhosted.org>


New submission from Xinmeng Xia <xiaxm at smail.nju.edu.cn>:

In issue 42500, recursive calls in "Try-except" are resolved. This PR has fixed the crashes of some programs, such as program 1. And the core dump error is replaced with RecursiveError.  
However, program 2 will not report a RecursiveError. The program will fall into an infinite loop. Even "Ctrl C" cannot stop the infinite loop. I try to track the execution of this program and insert "print" information(see program 3). The output seems random in execution between try branch and except branch!  I think this is a new bug after fixing 42500. I believe the program should also return RecursiveError.


Program 1
=========================== 
def foo():
    try:
        1/0
    except:
        foo()
foo()
================================

Program 2
================================
def foo():
    try:
        foo()
    except:
        foo()
foo()
================================


Program 3
================================
def foo():
    try:
        print("a")
        foo()
    except:
        print("b")
        foo()

foo()
================================
Output for program3( unexpected infinite random loop. ):
......bbaaaabbabbaabbabbaaabbabbaabbabbaaaaaaaabbabbaabbabbaaabbabbaabbabbaaaabbabbaabbabbaaabbabbaabbabbaaaaabbabbaabbabbaaabbabbaabbabbaaaabbabbaabbabbaaabbabbaabbabbaaaaaabbabbaabbabbaaabbabbaabbabbaaaabb......

>>python -V
Python 3.10.0a4

----------
components: Interpreter Core
messages: 385171
nosy: xxm
priority: normal
severity: normal
status: open
title: Random and infinite loop in dealing with recursion error for "try-except "
type: behavior
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42951>
_______________________________________

From report at bugs.python.org  Sun Jan 17 23:20:15 2021
From: report at bugs.python.org (Xinmeng Xia)
Date: Mon, 18 Jan 2021 04:20:15 +0000
Subject: [issue42717] The python interpreter crashed with
 "_enter_buffered_busy"
In-Reply-To: <1608632703.27.0.708410911987.issue42717@roundup.psfhosted.org>
Message-ID: <1610943615.68.0.868914450031.issue42717@roundup.psfhosted.org>


Xinmeng Xia <xiaxm at smail.nju.edu.cn> added the comment:

It seems that this bug won't be fixed. Should this issue be closed now?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42717>
_______________________________________

From report at bugs.python.org  Mon Jan 18 01:26:19 2021
From: report at bugs.python.org (Zackery Spytz)
Date: Mon, 18 Jan 2021 06:26:19 +0000
Subject: [issue42952] Incorrect handling of EC_KEY_new_by_curve_name() in the
 _ssl module
Message-ID: <1610951179.15.0.310007065401.issue42952@roundup.psfhosted.org>


New submission from Zackery Spytz <zspytz at gmail.com>:

A EC_KEY_new_by_curve_name() call in the _ssl__SSLContext_impl() function is not checked for failure.

----------
assignee: christian.heimes
components: Extension Modules, SSL
messages: 385173
nosy: ZackerySpytz, christian.heimes
priority: normal
severity: normal
status: open
title: Incorrect handling of EC_KEY_new_by_curve_name() in the _ssl module
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42952>
_______________________________________

From report at bugs.python.org  Mon Jan 18 01:28:57 2021
From: report at bugs.python.org (Zackery Spytz)
Date: Mon, 18 Jan 2021 06:28:57 +0000
Subject: [issue42952] Incorrect handling of EC_KEY_new_by_curve_name() in the
 _ssl module
In-Reply-To: <1610951179.15.0.310007065401.issue42952@roundup.psfhosted.org>
Message-ID: <1610951337.52.0.200369746923.issue42952@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
keywords: +patch
pull_requests: +23059
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24237

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42952>
_______________________________________

From report at bugs.python.org  Mon Jan 18 02:08:01 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 18 Jan 2021 07:08:01 +0000
Subject: [issue42950] Incorrect exception behavior in handling recursive call.
In-Reply-To: <1610943284.97.0.842137525249.issue42950@roundup.psfhosted.org>
Message-ID: <1610953681.99.0.711470804548.issue42950@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
nosy: +Mark.Shannon, serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42950>
_______________________________________

From report at bugs.python.org  Mon Jan 18 02:31:23 2021
From: report at bugs.python.org (Chenxi Liu)
Date: Mon, 18 Jan 2021 07:31:23 +0000
Subject: [issue42953] After the subclass of enum.Enum is imported in some
 diffenent ways, the same enumeration value is judged as False
Message-ID: <1610955083.36.0.549548278035.issue42953@roundup.psfhosted.org>


New submission from Chenxi Liu <liuchenxirs at 163.com>:

When you run the test.py in attachment, it will print a False but the two enumeration value which are acquired in different ways is same

----------
components: Library (Lib)
files: test.zip
messages: 385174
nosy: Lcx994611818
priority: normal
severity: normal
status: open
title: After the subclass of enum.Enum is imported in some diffenent ways, the same enumeration value is judged as False
type: behavior
versions: Python 3.9
Added file: https://bugs.python.org/file49747/test.zip

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42953>
_______________________________________

From report at bugs.python.org  Mon Jan 18 02:50:30 2021
From: report at bugs.python.org (Christian Heimes)
Date: Mon, 18 Jan 2021 07:50:30 +0000
Subject: [issue42952] Incorrect handling of EC_KEY_new_by_curve_name() in the
 _ssl module
In-Reply-To: <1610951179.15.0.310007065401.issue42952@roundup.psfhosted.org>
Message-ID: <1610956230.14.0.80443041111.issue42952@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

Thanks!

The block is dead code. OpenSSL 1.0.2 and newer always defines SSL_CTX_set_ecdh_auto. All supported LibreSSL versions define SSL_CTX_set_ecdh_auto, too. I'll remove the block when PEP 644 is accepted.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42952>
_______________________________________

From report at bugs.python.org  Mon Jan 18 02:56:53 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 18 Jan 2021 07:56:53 +0000
Subject: [issue42939] Linux's chattr i.e. ioctl(FS_IOC_SETFLAGS) is not
 supported in os.chflags()
In-Reply-To: <1610807134.64.0.859060580807.issue42939@roundup.psfhosted.org>
Message-ID: <1610956613.91.0.0341945321902.issue42939@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy: +christian.heimes

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42939>
_______________________________________

From report at bugs.python.org  Mon Jan 18 03:17:28 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 18 Jan 2021 08:17:28 +0000
Subject: [issue7946] Convoy effect with I/O bound threads and New GIL
In-Reply-To: <1266353325.38.0.278549753357.issue7946@psf.upfronthosting.co.za>
Message-ID: <1610957848.5.0.510577849656.issue7946@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue7946>
_______________________________________

From report at bugs.python.org  Mon Jan 18 03:18:32 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 18 Jan 2021 08:18:32 +0000
Subject: [issue40170] [C API] Make PyTypeObject structure an opaque structure
 in the public C API
In-Reply-To: <1585915023.07.0.846808236133.issue40170@roundup.psfhosted.org>
Message-ID: <1610957912.77.0.806989446389.issue40170@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

See also bpo-41618: [C API] How many slots of static types should be exposed in PyType_GetSlot().

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40170>
_______________________________________

From report at bugs.python.org  Mon Jan 18 03:33:47 2021
From: report at bugs.python.org (Ronald Oussoren)
Date: Mon, 18 Jan 2021 08:33:47 +0000
Subject: [issue42887] 100000 assignments of .__sizeof__ cause a segfault on del
In-Reply-To: <1610350684.08.0.491719857036.issue42887@roundup.psfhosted.org>
Message-ID: <1610958827.58.0.42290157943.issue42887@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

Note that there is a way to avoid this crash using the trashcan API (see the use of Py_TRASHCAN_BEGIN in various implementation).  This API is generally only used for recursive data structures and because it has a performance cost (based on what I've read in other issues).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42887>
_______________________________________

From report at bugs.python.org  Mon Jan 18 03:53:33 2021
From: report at bugs.python.org (daniel hahler)
Date: Mon, 18 Jan 2021 08:53:33 +0000
Subject: [issue35212] Expressions with format specifiers in f-strings give
 wrong code position in AST
In-Reply-To: <1541939640.9.0.788709270274.issue35212@psf.upfronthosting.co.za>
Message-ID: <1610960013.23.0.325068478182.issue35212@roundup.psfhosted.org>


Change by daniel hahler <python-bugs at thequod.de>:


----------
nosy: +blueyed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35212>
_______________________________________

From report at bugs.python.org  Mon Jan 18 04:59:35 2021
From: report at bugs.python.org (=?utf-8?b?0JXQstCz0LXQvdC40LkgSmVu?=)
Date: Mon, 18 Jan 2021 09:59:35 +0000
Subject: [issue42954] new "if-as" syntax
Message-ID: <1610963975.6.0.718455756839.issue42954@roundup.psfhosted.org>


New submission from ??????? Jen <jen.soft.master at gmail.com>:

# use
if users.get(uid, None) as profile != None:
    ...

# instead
profile = users.get(uid, None)
if profile != None:
    ...


# full-sample:

>>> users = {1: {"name": "Jen"}}
... uid = 1
... 
... # current syntax:
... profile = users.get(uid, None)
... if profile != None:
...     print(f"user: {profile['name']}")
... #
... 
... # new:
... if users.get(uid, None) as profile != None:
...     print(f"user: {profile['name']}")
... #
...

----------
components: Interpreter Core
messages: 385178
nosy: jen.soft.master
priority: normal
severity: normal
status: open
title: new "if-as" syntax
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42954>
_______________________________________

From report at bugs.python.org  Mon Jan 18 05:05:45 2021
From: report at bugs.python.org (Steven D'Aprano)
Date: Mon, 18 Jan 2021 10:05:45 +0000
Subject: [issue42954] new "if-as" syntax
In-Reply-To: <1610963975.6.0.718455756839.issue42954@roundup.psfhosted.org>
Message-ID: <1610964345.15.0.721053367834.issue42954@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

Use the walrus operator:

    if profile := users.get(uid, None) is not None:
        print(f"user: {profile['name']}")

----------
nosy: +steven.daprano
resolution:  -> rejected
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42954>
_______________________________________

From report at bugs.python.org  Mon Jan 18 05:08:34 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 18 Jan 2021 10:08:34 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
Message-ID: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at python.org>:

Some use cases require to know if a module comes from the stdlib or not. For example, I would like to only dump extension modules which don't come from the stdlib in bpo-42923: "Py_FatalError(): dump the list of extension modules".

Stdlib modules are special. For example, the maintenance and updates are connected to the Python lifecycle. Stdlib modules cannot be updated with "pip install --upgrade". They are shipped with the system ("system" Python). They are usually "read only": on Unix, only the root user can write into /usr directory where the stdlib is installed, whereas modules installed with "pip install --user" can be modified by the current user.

There is a third party project on PyPI which contains the list of stdlib modules:
https://pypi.org/project/stdlib-list/

There is already sys.builtin_module_names:
"A tuple of strings giving the names of all modules that are compiled into this Python interpreter."
https://docs.python.org/dev/library/sys.html#sys.builtin_module_names

I propose to add a similar sys.module_names tuple of strings (module names).

There are different constraints:

* If we add a public sys attribute, users will likely expect the list to be (1) exhaustive (2) correct
* Some extensions are not built if there are missing dependencies. Dependencies are checked after Python "core" (the sys module) is built.
* Some extensions are not available on some platforms.
* This list should be maintained.

Should we only list top level packages, or also submodules? For example, only list "asyncio", or list the 31 submodules (asyncio.base_events, asyncio.futures, ...)? Maybe it can be decided on a case by case basis. For example, I consider that "os.path" is a stdlib module, even it's just an alias to "posixpath" or "ntpath" depending on the platform.

I propose to include all extensions in the list, even if they are not built/available on some platforms. For example, "winsound" would also be listed on Linux, even if the extension is specific to Windows.

I also propose to include stdlib module names even if they are overridden at runtime using PYTHONPATH with a different implementation. For example, "asyncio" would be in the list, even if an user creates "asyncio.py" file. The list would not depend on sys.path.

--

Another option is to add an attribute to modules to mark them as coming from the stdlib. The API would be an attribute: module.__stdlib__ (bool).

The attribute could be set directly in the module code. For example, add "__stdlib__ = True" in Python modules. Similar idea for C extension modules.

Or the attribute could be set after importing the module, in the import site. But we don't control how stdlib modules are imported.

--

For the specific case of bpo-42923, another option is to use a list of stdlib paths, and check module.__file__ to check if a module is a stdlib module, and also use sys.builtin_module_names. And so don't add any API.

----------
components: Library (Lib)
messages: 385180
nosy: vstinner
priority: normal
severity: normal
status: open
title: Add sys.module_names: list of stdlib module names (Python and extension modules)
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Mon Jan 18 05:15:17 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 18 Jan 2021 10:15:17 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1610964917.23.0.947461196433.issue42955@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

On Fedora 33, the stdlib lives in two main directories:

* /usr/lib64/python3.9: Python modules
* /usr/lib64/python3.9/lib-dynload: C extension modules

Example:

>>> import os.path
>>> os.path.dirname(os.__file__) # Python
'/usr/lib64/python3.9'
>>> os.path.dirname(_asyncio.__file__)
'/usr/lib64/python3.9/lib-dynload'

The Python stdlib path can be retrieved with:

>>> import sysconfig; sysconfig.get_paths()['stdlib']
'/usr/lib64/python3.9'

But I'm not sure how to retrieve /usr/lib64/python3.9/lib-dynload path. "platstdlib" is not what I expect:

>>> import sysconfig; sysconfig.get_paths()['platstdlib']
'/usr/lib64/python3.9'

I found DESTDIR in Makefile:

>>> sysconfig.get_config_var('DESTSHARED')
'/usr/lib64/python3.9/lib-dynload'

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Mon Jan 18 05:18:40 2021
From: report at bugs.python.org (Steven D'Aprano)
Date: Mon, 18 Jan 2021 10:18:40 +0000
Subject: [issue42954] new "if-as" syntax
In-Reply-To: <1610963975.6.0.718455756839.issue42954@roundup.psfhosted.org>
Message-ID: <1610965120.48.0.63681394468.issue42954@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

Oops sorry I got the operator precedence wrong:

    if (profile := users.get(uid, None)) is not None:

The walrus operator was added in Python 3.8. Using the "as" key word was considered and rejected. See the PEP:

https://www.python.org/dev/peps/pep-0572/

https://docs.python.org/3/reference/expressions.html#assignment-expressions


I don't want to discourage you, but the process to get new syntax added to the library is:

* discuss it on Python-Ideas mailing list, to see if there is community support for it;

* if there is community support, as for a core developer to sponsor the idea;

* if you get a sponsor, write a PEP

* hopefully the Steering Council will accept it;

* and somebody (perhaps you, perhaps somebody else) will make the changes to the language.


https://mail.python.org/archives/list/python-ideas at python.org/

https://www.python.org/dev/peps/

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42954>
_______________________________________

From report at bugs.python.org  Mon Jan 18 05:19:59 2021
From: report at bugs.python.org (Steven D'Aprano)
Date: Mon, 18 Jan 2021 10:19:59 +0000
Subject: [issue42954] new "if-as" syntax
In-Reply-To: <1610963975.6.0.718455756839.issue42954@roundup.psfhosted.org>
Message-ID: <1610965199.41.0.995306384519.issue42954@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

I'm not having a good day :-(

> the process to get new syntax added to the library

The process to get new syntax added to the **language**.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42954>
_______________________________________

From report at bugs.python.org  Mon Jan 18 05:31:17 2021
From: report at bugs.python.org (=?utf-8?q?D=C3=A1vid_Nemeskey?=)
Date: Mon, 18 Jan 2021 10:31:17 +0000
Subject: [issue42956] Easy conversion between range and slice
Message-ID: <1610965877.9.0.924226649693.issue42956@roundup.psfhosted.org>


New submission from D?vid Nemeskey <nemeskeyd at gmail.com>:

It would be nice if there was an easy way to convert a range to a slice and vice versa. At least superficially the two are almost the same(*), yet if one wants to convert a slice to a range, he has to go through hoops to avoid potential errors, ending up with code such as:

s = slice(1, 10, 2)
r = range(s.start or 0, s.stop, s.step or 1)

It would be much nicer if the range and slice functions had a signature that accepts the other, which would simplify the above to just r(s).

(*) I don't know the implementation details, but is it even important to have to different objects for effectively the same concept? Cannot these two just be merged?

----------
messages: 385184
nosy: nemeskeyd
priority: normal
severity: normal
status: open
title: Easy conversion between range and slice
type: enhancement
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42956>
_______________________________________

From report at bugs.python.org  Mon Jan 18 05:32:10 2021
From: report at bugs.python.org (=?utf-8?q?D=C3=A1vid_Nemeskey?=)
Date: Mon, 18 Jan 2021 10:32:10 +0000
Subject: [issue42956] Easy conversion between range and slice
In-Reply-To: <1610965877.9.0.924226649693.issue42956@roundup.psfhosted.org>
Message-ID: <1610965930.13.0.0692849679729.issue42956@roundup.psfhosted.org>


D?vid Nemeskey <nemeskeyd at gmail.com> added the comment:

s/to different/two different/

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42956>
_______________________________________

From report at bugs.python.org  Mon Jan 18 05:42:55 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 18 Jan 2021 10:42:55 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1610966575.13.0.563186810997.issue42955@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

There is no technical difference between stdlib modules and other modules. Stdlib modules are only special in context of copyright and responsibility.
What if set __author__ = 'PSF' in every stdib module? Or other attributes which would allow to group modules by origin. Perhaps other authors would use that feature too.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Mon Jan 18 05:54:03 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 18 Jan 2021 10:54:03 +0000
Subject: [issue42887] 100000 assignments of .__sizeof__ cause a segfault on del
In-Reply-To: <1610350684.08.0.491719857036.issue42887@roundup.psfhosted.org>
Message-ID: <1610967243.36.0.221499287736.issue42887@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Yes, there is an overhead of using the trashcan mechanism. This is why it is only used in data collections, because it is expected that your data can contain arbitrary long chains of links. There is many ways to create arbitrary long chains with other objects, but it does not happen in common code. For methods the cost would be especially high, because method objects are usually short-lived and the performance of creating/destroying is critical.

AFAIK the same issue (maybe not with __sizeof__, but with other method of the basic object class, like __reduce__) was already reported earlier. I propose to close  this issue as "won't fix".

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42887>
_______________________________________

From report at bugs.python.org  Mon Jan 18 05:55:25 2021
From: report at bugs.python.org (Steven D'Aprano)
Date: Mon, 18 Jan 2021 10:55:25 +0000
Subject: [issue42956] Easy conversion between range and slice
In-Reply-To: <1610965877.9.0.924226649693.issue42956@roundup.psfhosted.org>
Message-ID: <1610967325.09.0.887570982741.issue42956@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

All versions older than 3.10 are in feature freeze and cannot get new features or enhancements, only bugfixes.

Slices are far more general than range objects. How do you propose to deal with slice objects such as this?

    slice('item', (23, {'key': 'value'}, 4.5), ('a', 2))

Even for plain integer arguments, the meanings are not the same. Consider the slice:

    slice(10, -2)  # Start at the 10th item, end at the second-last.

versus the range:

    range(10, -2)  # Empty range.

----------
nosy: +steven.daprano
versions:  -Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42956>
_______________________________________

From report at bugs.python.org  Mon Jan 18 06:06:10 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 18 Jan 2021 11:06:10 +0000
Subject: [issue42956] Easy conversion between range and slice
In-Reply-To: <1610965877.9.0.924226649693.issue42956@roundup.psfhosted.org>
Message-ID: <1610967970.27.0.590640004222.issue42956@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

> s.start or 0

Why 0? start=None is not the same as start=0 in slice. For example:

>>> 'abcdefgh'[slice(None, 3, -1)]
'hgfe'
>>> 'abcdefgh'[slice(0, 3, -1)]
''

Slices and range objects are very different in many ways. It depends on your application how do you convert a slice to a range object, and in general case it does not make sense. Just use the way that is appropriate in your application.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42956>
_______________________________________

From report at bugs.python.org  Mon Jan 18 06:14:45 2021
From: report at bugs.python.org (Mark Shannon)
Date: Mon, 18 Jan 2021 11:14:45 +0000
Subject: [issue42950] Incorrect exception behavior in handling recursive call.
In-Reply-To: <1610943284.97.0.842137525249.issue42950@roundup.psfhosted.org>
Message-ID: <1610968485.59.0.27949984748.issue42950@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

If you make calls in an exception handler that is handling a RecursionError, without unwinding first, then it is likely that another RecursionError may occur.

What is strange is that the second RecursionError is raised after `print(str(e))` has printed the exception, which is weird and needs further investigation.

The following code, using `list.append` shows what happens without the additional RecursionError from print.
`list.append` is safe to use as it never raises a RecursionError.

    import sys
    sys.setrecursionlimit(100)
    events = []

    def foo(c):
        try:
            c = c + 1
            events.append("ss"+str(c))
            foo(c)
        except Exception as e:
            events.append(e)
            events.append("kk")
        events.append(c)

    c = 0
    foo(c)
    for ev in events:
        print(ev)


ss1
ss2
....
ss97
maximum recursion depth exceeded while getting the str of an object
kk
97
95
......
3
2
1

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42950>
_______________________________________

From report at bugs.python.org  Mon Jan 18 06:40:55 2021
From: report at bugs.python.org (Mark Shannon)
Date: Mon, 18 Jan 2021 11:40:55 +0000
Subject: [issue42717] The python interpreter crashed with
 "_enter_buffered_busy"
In-Reply-To: <1608632703.27.0.708410911987.issue42717@roundup.psfhosted.org>
Message-ID: <1610970055.5.0.525000153847.issue42717@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

Please leave the issue open. This is a real bug.

It may not be fixed right now, but that doesn't mean it won't ever be fixed.

----------
nosy: +Mark.Shannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42717>
_______________________________________

From report at bugs.python.org  Mon Jan 18 06:50:33 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 18 Jan 2021 11:50:33 +0000
Subject: [issue42950] Incorrect exception behavior in handling recursive call.
In-Reply-To: <1610943284.97.0.842137525249.issue42950@roundup.psfhosted.org>
Message-ID: <1610970633.62.0.261881359779.issue42950@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Maybe stdout.flush() or stdout.buffer.flush() raise a RecursionError?

When run the interpreter with option -u the second error is gone.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42950>
_______________________________________

From report at bugs.python.org  Mon Jan 18 07:01:08 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 18 Jan 2021 12:01:08 +0000
Subject: [issue42951] Random and infinite loop in dealing with recursion error
 for "try-except "
In-Reply-To: <1610943420.56.0.379356825462.issue42951@roundup.psfhosted.org>
Message-ID: <1610971268.73.0.221059440677.issue42951@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42951>
_______________________________________

From report at bugs.python.org  Mon Jan 18 07:16:36 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Mon, 18 Jan 2021 12:16:36 +0000
Subject: [issue42862] Use functools.lru_cache iso. _sqlite.Cache in sqlite3
 module
In-Reply-To: <1610066343.94.0.466682345605.issue42862@roundup.psfhosted.org>
Message-ID: <1610972196.33.0.954009353759.issue42862@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

I need some help debugging the Windows issues. There are a handful of tests that fail because the sqlite3 is clinging on to objects or file descriptors. AFAICT, a GC bug. For example, test_open_uri fails with:

PermissionError: [WinError 32] The process cannot access the file because it is being used by another process: [...]

I've tried the following, with no success:
- Remove GC from the Connection type
- Remove the clear method, and modify traverse to only visit Py_TYPE(self) (https://bugs.python.org/issue42866#msg384675)
- Add heap type GC (visit type, GC tracking) to all pysqlite types

Maybe it's best to reopen GH-24135 and continue the work with multi-phase init? That is finalise bpo-40956, add heap type GC (https://bugs.python.org/issue42866#msg384675), establish module state, implement multi-phase init, and then revisit this issue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42862>
_______________________________________

From report at bugs.python.org  Mon Jan 18 07:18:48 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 18 Jan 2021 12:18:48 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1610972328.99.0.36154262787.issue42955@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
keywords: +patch
pull_requests: +23060
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24238

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Mon Jan 18 07:36:12 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 18 Jan 2021 12:36:12 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1610973372.89.0.0188418192779.issue42955@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I wrote PR 24238 which implements an hardcoded list of stdlib module names. The PR uses the CI to ensure that the list always remain up to date. If tomorrow a new module is added, a CI job fails ("file not up to date").

> What if set __author__ = 'PSF' in every stdib module? Or other attributes which would allow to group modules by origin. Perhaps other authors would use that feature too.

Hum, that would go against my bpo-42923 use case.

Also for bpo-42923, I would prefer a tuple of strings ;-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Mon Jan 18 07:51:17 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 18 Jan 2021 12:51:17 +0000
Subject: [issue42952] Incorrect handling of EC_KEY_new_by_curve_name() in the
 _ssl module
In-Reply-To: <1610951179.15.0.310007065401.issue42952@roundup.psfhosted.org>
Message-ID: <1610974277.94.0.806958907502.issue42952@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Will it be removed in master only or in all maintained version too?

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42952>
_______________________________________

From report at bugs.python.org  Mon Jan 18 08:05:21 2021
From: report at bugs.python.org (Christian Heimes)
Date: Mon, 18 Jan 2021 13:05:21 +0000
Subject: [issue42952] Incorrect handling of EC_KEY_new_by_curve_name() in the
 _ssl module
In-Reply-To: <1610951179.15.0.310007065401.issue42952@roundup.psfhosted.org>
Message-ID: <1610975121.57.0.102114496488.issue42952@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

It really doesn't matter. The code is dead and will never trigger. Python 3.7 and newer all require OpenSSL 1.0.2, which always has defines SSL_CTX_set_ecdh_auto. In more recent versions SSL_CTX_set_ecdh_auto() is a no-op. I'll remove the code entirely when I can drop support for 1.0.2, too.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42952>
_______________________________________

From report at bugs.python.org  Mon Jan 18 08:54:44 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 18 Jan 2021 13:54:44 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1610978084.16.0.975098822611.issue42955@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Use cases for sys.module_names:

* When computing dependencies of a project, ignore modules which are part of the stdlib: https://github.com/jackmaney/pypt/issues/3

* Trace the execution of third party code, but ignore stdlib, use --ignore-module option of trace: https://stackoverflow.com/questions/6463918/how-can-i-get-a-list-of-all-the-python-standard-library-modules

* When reformatting a Python source file, group imports of stdlib modules. The isort module contains the list of stdlib modules, one list py Python version: https://github.com/PyCQA/isort/tree/develop/isort/stdlibs which is generated from the online Python documentation.

---

The isort uses the following script to generate the list of stdlib modules:
https://github.com/PyCQA/isort/blob/develop/scripts/mkstdlibs.py

The script uses sphinx.ext.intersphinx.fetch_inventory(...)["py:module"]. This API uses objects.inv from the online Python documentation. Example of Python 3.9:

   https://docs.python.org/3.9/objects.inv

On the "dev" version, mkstdlibs.py lists 211 modules.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Mon Jan 18 09:07:00 2021
From: report at bugs.python.org (Michel Hidalgo)
Date: Mon, 18 Jan 2021 14:07:00 +0000
Subject: [issue42913] asyncio.ProactorEventLoop mishandles signal wakeup file
 descriptor
In-Reply-To: <1610487833.61.0.883604582572.issue42913@roundup.psfhosted.org>
Message-ID: <1610978820.04.0.0983743188575.issue42913@roundup.psfhosted.org>


Michel Hidalgo <hid.michel at gmail.com> added the comment:

Sorry for taking so long to reply. 

Sure, I would be happy to contribute. We should probably take care of Unix event loops -- since I opened this ticket I found out those tend to not cooperate with other signal wakeup file descriptor users either. I am a bit short on time right now though, so it will take some time.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42913>
_______________________________________

From report at bugs.python.org  Mon Jan 18 09:42:44 2021
From: report at bugs.python.org (Jay Chu)
Date: Mon, 18 Jan 2021 14:42:44 +0000
Subject: [issue39950] Add pathlib.Path.hardlink_to()
In-Reply-To: <1584060605.38.0.95953512485.issue39950@roundup.psfhosted.org>
Message-ID: <1610980964.74.0.448846142164.issue39950@roundup.psfhosted.org>


Jay Chu <tothesong at gmail.com> added the comment:

Maybe we could have the correct `Path.hardlink` implemented before removing or even deprecating the confusing `Path.link_to`? It will only help even if we don't remove the latter in a hurry.

----------
nosy: +tothesong

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39950>
_______________________________________

From report at bugs.python.org  Mon Jan 18 09:52:45 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 18 Jan 2021 14:52:45 +0000
Subject: [issue42938] [security] ctypes double representation BoF
In-Reply-To: <1610784207.02.0.722384660803.issue42938@roundup.psfhosted.org>
Message-ID: <1610981565.15.0.742102540768.issue42938@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy: +vstinner
title: ctypes double representation BoF -> [security] ctypes double representation BoF

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42938>
_______________________________________

From report at bugs.python.org  Mon Jan 18 09:54:00 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 18 Jan 2021 14:54:00 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1610981640.23.0.537683626935.issue42955@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

(...) This API uses objects.inv from the online Python documentation.

By the way, there is also this documentation page listing Python stdlib modules:
https://docs.python.org/dev/py-modindex.html

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Mon Jan 18 10:06:38 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 18 Jan 2021 15:06:38 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1610982398.87.0.942289652697.issue42955@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Another way to gather the list of Python modules: pydoc help("modules") uses pkgutil.walk_packages().

pydoc uses ModuleScanner which uses sys.builtin_module_names and pkgutil.walk_packages().

pkgutil.walk_packages() calls pkgutil.iter_modules() which iterates on sys.meta_path and sys.path, and calls iter_modules() on each importer.

For FileImporter, it iterates on os.listdir() on the importer path.

For zipimporter, it iterates on zipimport._zip_directory_cache[importer.archive].

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Mon Jan 18 10:29:01 2021
From: report at bugs.python.org (Benjamin Peterson)
Date: Mon, 18 Jan 2021 15:29:01 +0000
Subject: [issue42938] [security] ctypes double representation BoF
In-Reply-To: <1610784207.02.0.722384660803.issue42938@roundup.psfhosted.org>
Message-ID: <1610983741.66.0.288934129988.issue42938@roundup.psfhosted.org>


Change by Benjamin Peterson <benjamin at python.org>:


----------
keywords: +patch
nosy: +benjamin.peterson
nosy_count: 2.0 -> 3.0
pull_requests: +23061
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24239

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42938>
_______________________________________

From report at bugs.python.org  Mon Jan 18 10:39:39 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 18 Jan 2021 15:39:39 +0000
Subject: [issue42952] Incorrect handling of EC_KEY_new_by_curve_name() in the
 _ssl module
In-Reply-To: <1610951179.15.0.310007065401.issue42952@roundup.psfhosted.org>
Message-ID: <1610984379.07.0.490684421335.issue42952@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Okay. And I have doubts that someone would backport this change to 3.6.

I do not see harm in merging PR 24237, although there is no use of it too. In any case thank you for finding this suspicious code Zackery.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42952>
_______________________________________

From report at bugs.python.org  Mon Jan 18 10:57:23 2021
From: report at bugs.python.org (Mark Shannon)
Date: Mon, 18 Jan 2021 15:57:23 +0000
Subject: [issue42725] PEP 563: Should the behavior change for yield/yield
 from's
In-Reply-To: <1608730131.08.0.595189962302.issue42725@roundup.psfhosted.org>
Message-ID: <1610985443.81.0.744373342664.issue42725@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

Draft PEP here
https://github.com/markshannon/peps/blob/annotation-syntax-errors/pep-9999.rst

Guido, would you like to be co-author as it was your idea to make these things a syntax error?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42725>
_______________________________________

From report at bugs.python.org  Mon Jan 18 10:59:07 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 18 Jan 2021 15:59:07 +0000
Subject: [issue42951] Random and infinite loop in dealing with recursion error
 for "try-except "
In-Reply-To: <1610943420.56.0.379356825462.issue42951@roundup.psfhosted.org>
Message-ID: <1610985547.42.0.989931622092.issue42951@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Funny. But the output is not random. You can generate the sequence of letters by the following simple loop:

s = ''
for i in range(n):
    s = f'a{s}b{s}'

The length of this sequence is 2*(2**n-1). Finally, your code will raise a non-silenced RecursiveError, but it will just take some time (for printing around 2**1000 letters).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42951>
_______________________________________

From report at bugs.python.org  Mon Jan 18 12:03:34 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 18 Jan 2021 17:03:34 +0000
Subject: [issue42923] Py_FatalError(): dump the list of extension modules
In-Reply-To: <1610535013.1.0.942204365805.issue42923@roundup.psfhosted.org>
Message-ID: <1610989414.73.0.0855734566016.issue42923@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +23062
pull_request: https://github.com/python/cpython/pull/24240

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42923>
_______________________________________

From report at bugs.python.org  Mon Jan 18 12:06:54 2021
From: report at bugs.python.org (Alexey Izbyshev)
Date: Mon, 18 Jan 2021 17:06:54 +0000
Subject: =?utf-8?q?=5Bissue42888=5D_Not_installed_=E2=80=9Clibgcc=5Fs=2Eso=2E1?=
 =?utf-8?q?=E2=80=9D_causes_exit_crash=2E?=
In-Reply-To: <1610350822.34.0.431759793604.issue42888@roundup.psfhosted.org>
Message-ID: <1610989614.03.0.684692820366.issue42888@roundup.psfhosted.org>


Change by Alexey Izbyshev <izbyshev at ispras.ru>:


----------
keywords: +patch
pull_requests: +23063
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24241

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42888>
_______________________________________

From report at bugs.python.org  Mon Jan 18 12:07:48 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 18 Jan 2021 17:07:48 +0000
Subject: [issue42923] Py_FatalError(): dump the list of extension modules
In-Reply-To: <1610535013.1.0.942204365805.issue42923@roundup.psfhosted.org>
Message-ID: <1610989668.91.0.38358877434.issue42923@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +23064
pull_request: https://github.com/python/cpython/pull/24242

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42923>
_______________________________________

From report at bugs.python.org  Mon Jan 18 12:10:42 2021
From: report at bugs.python.org (Alexey Izbyshev)
Date: Mon, 18 Jan 2021 17:10:42 +0000
Subject: =?utf-8?q?=5Bissue42888=5D_Not_installed_=E2=80=9Clibgcc=5Fs=2Eso=2E1?=
 =?utf-8?q?=E2=80=9D_causes_exit_crash=2E?=
In-Reply-To: <1610350822.34.0.431759793604.issue42888@roundup.psfhosted.org>
Message-ID: <1610989842.52.0.0861579253502.issue42888@roundup.psfhosted.org>


Alexey Izbyshev <izbyshev at ispras.ru> added the comment:

I've made a PR to remove most calls to pthread_exit().

@xxm: could you test it in your environment?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42888>
_______________________________________

From report at bugs.python.org  Mon Jan 18 12:24:52 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 18 Jan 2021 17:24:52 +0000
Subject: [issue42923] Py_FatalError(): dump the list of extension modules
In-Reply-To: <1610535013.1.0.942204365805.issue42923@roundup.psfhosted.org>
Message-ID: <1610990692.49.0.178380141723.issue42923@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset e232025025c8bd07c1d1b12a583a80c4a673f077 by Victor Stinner in branch 'master':
bpo-42923: Add Py_FatalError() test in test_capi (GH-24240)
https://github.com/python/cpython/commit/e232025025c8bd07c1d1b12a583a80c4a673f077


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42923>
_______________________________________

From report at bugs.python.org  Mon Jan 18 12:35:04 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 18 Jan 2021 17:35:04 +0000
Subject: [issue42923] Py_FatalError(): dump the list of extension modules
In-Reply-To: <1610535013.1.0.942204365805.issue42923@roundup.psfhosted.org>
Message-ID: <1610991304.44.0.158969856811.issue42923@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 314b8787e0c50985ba708034b84ff5b37a1d47de by Victor Stinner in branch 'master':
bpo-42923: Py_FatalError() avoids fprintf() (GH-24242)
https://github.com/python/cpython/commit/314b8787e0c50985ba708034b84ff5b37a1d47de


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42923>
_______________________________________

From report at bugs.python.org  Mon Jan 18 12:38:57 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Mon, 18 Jan 2021 17:38:57 +0000
Subject: [issue42953] After the subclass of enum.Enum is imported in some
 diffenent ways, the same enumeration value is judged as False
In-Reply-To: <1610955083.36.0.549548278035.issue42953@roundup.psfhosted.org>
Message-ID: <1610991537.2.0.852750628298.issue42953@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
nosy: +ethan.furman

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42953>
_______________________________________

From report at bugs.python.org  Mon Jan 18 12:41:45 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 18 Jan 2021 17:41:45 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1610991705.23.0.261590695359.issue42955@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Note for myself: regen-keyword should be included in "make regen-all".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Mon Jan 18 12:51:24 2021
From: report at bugs.python.org (Bar Harel)
Date: Mon, 18 Jan 2021 17:51:24 +0000
Subject: [issue31356] Add context manager to temporarily disable GC
In-Reply-To: <1504655244.01.0.877867263237.issue31356@psf.upfronthosting.co.za>
Message-ID: <1610992284.79.0.992589461453.issue31356@roundup.psfhosted.org>


Change by Bar Harel <bzvi7919 at gmail.com>:


----------
nosy: +bar.harel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31356>
_______________________________________

From report at bugs.python.org  Mon Jan 18 13:04:32 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 18 Jan 2021 18:04:32 +0000
Subject: [issue42944] random.Random.sample bug when counts is not None
In-Reply-To: <1610837934.67.0.783808477389.issue42944@roundup.psfhosted.org>
Message-ID: <1610993072.86.0.332656351366.issue42944@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset f7b5bacd7a0b2084ce699eda6f6f4b1adfa16590 by jonanifranco in branch 'master':
bpo-42944 Fix Random.sample when counts is not None (GH-24235)
https://github.com/python/cpython/commit/f7b5bacd7a0b2084ce699eda6f6f4b1adfa16590


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42944>
_______________________________________

From report at bugs.python.org  Mon Jan 18 13:05:40 2021
From: report at bugs.python.org (miss-islington)
Date: Mon, 18 Jan 2021 18:05:40 +0000
Subject: [issue42944] random.Random.sample bug when counts is not None
In-Reply-To: <1610837934.67.0.783808477389.issue42944@roundup.psfhosted.org>
Message-ID: <1610993140.15.0.621498611299.issue42944@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 2.0 -> 3.0
pull_requests: +23065
pull_request: https://github.com/python/cpython/pull/24243

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42944>
_______________________________________

From report at bugs.python.org  Mon Jan 18 13:07:38 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Mon, 18 Jan 2021 18:07:38 +0000
Subject: [issue42725] PEP 563: Should the behavior change for yield/yield
 from's
In-Reply-To: <1608730131.08.0.595189962302.issue42725@roundup.psfhosted.org>
Message-ID: <1610993258.27.0.0759126044414.issue42725@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

It'll probably be quicker if you leave me out of the loop (feel free to quote me though). I am currently quite overwhelmed with PEP-sized discussions. I expect that the SC can rule on this quickly (just use their tracker to send them the PEP).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42725>
_______________________________________

From report at bugs.python.org  Mon Jan 18 13:09:15 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Mon, 18 Jan 2021 18:09:15 +0000
Subject: [issue42913] asyncio.ProactorEventLoop mishandles signal wakeup file
 descriptor
In-Reply-To: <1610487833.61.0.883604582572.issue42913@roundup.psfhosted.org>
Message-ID: <1610993355.71.0.655508677687.issue42913@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

No pressure. If there's an API change needed you will have until 3.10 beta 1. Without API changes this can be fixed any time.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42913>
_______________________________________

From report at bugs.python.org  Mon Jan 18 13:17:24 2021
From: report at bugs.python.org (Dennis Sweeney)
Date: Mon, 18 Jan 2021 18:17:24 +0000
Subject: [issue41545] gc API requiring matching number of gc.disable -
 gc.enable calls
In-Reply-To: <1597362741.87.0.831562855057.issue41545@roundup.psfhosted.org>
Message-ID: <1610993844.96.0.911335880563.issue41545@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

It looks like this was a duplicate of https://bugs.python.org/issue31356

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41545>
_______________________________________

From report at bugs.python.org  Mon Jan 18 13:18:48 2021
From: report at bugs.python.org (Dennis Sweeney)
Date: Mon, 18 Jan 2021 18:18:48 +0000
Subject: [issue31356] Add context manager to temporarily disable GC
In-Reply-To: <1504655244.01.0.877867263237.issue31356@psf.upfronthosting.co.za>
Message-ID: <1610993928.2.0.384537118349.issue31356@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

https://bugs.python.org/issue41545 is a duplicate of this.

In that report, there's an example of something that can go wrong with the save-a-boolean-per-context-manager approach even when threads are not used, but when concurrent generators are used, like

def gen():
    with gc_disabled():
        yield 1
        yield 2
        yield 3

a = gen()
b = gen()
next(a) # disable gc
next(b) 
list(a) # this re-enableds the gc
next(b) # gc is enabled but shouldn't be.

A counter for "number of times disabled" may be a better approach.

----------
nosy: +Dennis Sweeney

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31356>
_______________________________________

From report at bugs.python.org  Mon Jan 18 13:33:34 2021
From: report at bugs.python.org (Bar Harel)
Date: Mon, 18 Jan 2021 18:33:34 +0000
Subject: [issue31356] Add context manager to temporarily disable GC
In-Reply-To: <1504655244.01.0.877867263237.issue31356@psf.upfronthosting.co.za>
Message-ID: <1610994814.03.0.281579372721.issue31356@roundup.psfhosted.org>


Bar Harel <bzvi7919 at gmail.com> added the comment:

I've taken a shot making this in pure Python, and took into account a few more factors such as starvation and reentrancy.

As Nick said, one of the only ways it can truly work is if it's completely global, in which case we don't need to use the internal lock and relying on the GIL would work.

It's not very efficient atm, as the overhead of the Lock() and 
resulting python code probably offsets the benefit of disabling the GC, but it can be fine for some uses I guess.
 
https://github.com/bharel/disable_gc

I'll release it to pypi sometime soon and we can take a look at the not-so-accurate usage metric to see if such a thing is needed in the standard library.

----------
nosy:  -Dennis Sweeney

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31356>
_______________________________________

From report at bugs.python.org  Mon Jan 18 13:36:15 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 18 Jan 2021 18:36:15 +0000
Subject: [issue42944] random.Random.sample bug when counts is not None
In-Reply-To: <1610837934.67.0.783808477389.issue42944@roundup.psfhosted.org>
Message-ID: <1610994975.14.0.894145390855.issue42944@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset a90539f5723a4c34430761be8cba97daa8474abf by Miss Islington (bot) in branch '3.9':
bpo-42944 Fix Random.sample when counts is not None (GH-24235) (GH-24243)
https://github.com/python/cpython/commit/a90539f5723a4c34430761be8cba97daa8474abf


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42944>
_______________________________________

From report at bugs.python.org  Mon Jan 18 13:36:36 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 18 Jan 2021 18:36:36 +0000
Subject: [issue42944] random.Random.sample bug when counts is not None
In-Reply-To: <1610837934.67.0.783808477389.issue42944@roundup.psfhosted.org>
Message-ID: <1610994996.63.0.19992962211.issue42944@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Thanks for the report and the PR.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42944>
_______________________________________

From report at bugs.python.org  Mon Jan 18 13:38:18 2021
From: report at bugs.python.org (Batuhan Taskaya)
Date: Mon, 18 Jan 2021 18:38:18 +0000
Subject: [issue42725] PEP 563: Should the behavior change for yield/yield
 from's
In-Reply-To: <1608730131.08.0.595189962302.issue42725@roundup.psfhosted.org>
Message-ID: <1610995098.37.0.89583661703.issue42725@roundup.psfhosted.org>


Batuhan Taskaya <isidentical at gmail.com> added the comment:

> The use of nonlocal variables in an annotation will be a syntax error in Python 3.10

What is the reasoning for forbidding nonlocal variables (https://bugs.python.org/msg383659), can't we just treat them like regular variables and leave the value to whom needed to deal with resolving the scope? 

Also, you should preferably clarify other cases regarding the symbol table interaction of annotations. For example this case:

Here is one;
class T:
    def foo(self):
        a: super().bar() = x
print(T.foo.__closure__)

And if we are on the road to writing a PEP, maybe we should somehow squeeze issue 42737 somewhere, since the annotations for complex targets are still evaluated and this makes everything a bit problematic and inconsistent. If you need collaboration on the PEP, just let me know (isidentical at gmail.com) (I have a patch ready to go for the symbol table to both make annotations ineffective and forbid this stuff but was waiting for issue 42737)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42725>
_______________________________________

From report at bugs.python.org  Mon Jan 18 14:13:09 2021
From: report at bugs.python.org (simon mackenzie)
Date: Mon, 18 Jan 2021 19:13:09 +0000
Subject: [issue42957] os.readlink produces wrong result on windows
Message-ID: <1610997189.12.0.447653130689.issue42957@roundup.psfhosted.org>


New submission from simon mackenzie <simonm3 at gmail.com>:

os.readlink gives wrong result on python 3.8 onwards for windows

os.readlink("c:/users/simon/v1")
'\\\\?\\d:\\v1'

Should read d:\\v1

----------
components: Windows
messages: 385218
nosy: paul.moore, simon mackenzie, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: os.readlink produces wrong result on windows
type: behavior
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42957>
_______________________________________

From report at bugs.python.org  Mon Jan 18 14:17:17 2021
From: report at bugs.python.org (Ethan Furman)
Date: Mon, 18 Jan 2021 19:17:17 +0000
Subject: [issue42953] After the subclass of enum.Enum is imported in some
 diffenent ways, the same enumeration value is judged as False
In-Reply-To: <1610955083.36.0.549548278035.issue42953@roundup.psfhosted.org>
Message-ID: <1610997437.69.0.8760066278.issue42953@roundup.psfhosted.org>


Ethan Furman <ethan at stoneleaf.us> added the comment:

This issue is not unique to Enum, and is not an Enum problem.

What is happening is that "test.py" has the `__name__` of `__main__` because it is being directly executed from the command line, but when `test2.py` imports it, it is being re-executed and everything inside is re-created -- so you end up with two copies of everything in that module.

You can also see this issue if you manage to import a module under two different names (usually by messing with `sys.path`).

To see it yourself, add a custom __str__ to A:

        def __str__(self):
            return "%s.%s.%s" % (
                    __name__,
                    self.__class__.
                   __qualname__, self._name_,
                   _)

Then your print() will show:

    __main__.A.a test.A.a

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42953>
_______________________________________

From report at bugs.python.org  Mon Jan 18 14:21:18 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 18 Jan 2021 19:21:18 +0000
Subject: [issue42956] Easy conversion between range and slice
In-Reply-To: <1610965877.9.0.924226649693.issue42956@roundup.psfhosted.org>
Message-ID: <1610997678.75.0.393393953434.issue42956@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Perhaps the indices() method will suffice:

    >>> slice(None, 10, 2).indices(8)
    (0, 8, 2)

    >>> range(8)[:10:2]
    range(0, 8, 2)

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42956>
_______________________________________

From report at bugs.python.org  Mon Jan 18 14:47:21 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 18 Jan 2021 19:47:21 +0000
Subject: [issue42923] Py_FatalError(): dump the list of extension modules
In-Reply-To: <1610535013.1.0.942204365805.issue42923@roundup.psfhosted.org>
Message-ID: <1610999241.59.0.890375384056.issue42923@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 250035d134ad482e724f73ce654682254b513ee0 by Victor Stinner in branch 'master':
bpo-42923: Dump extension modules on fatal error (GH-24207)
https://github.com/python/cpython/commit/250035d134ad482e724f73ce654682254b513ee0


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42923>
_______________________________________

From report at bugs.python.org  Mon Jan 18 14:47:59 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 18 Jan 2021 19:47:59 +0000
Subject: [issue42923] Py_FatalError(): dump the list of extension modules
In-Reply-To: <1610535013.1.0.942204365805.issue42923@roundup.psfhosted.org>
Message-ID: <1610999279.64.0.296006375683.issue42923@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I created https://bugs.python.org/issue42955 to add sys.modules_names tuple: names of stdlib modules. Once it will be merged, I will updated this PR to filter the list of modules (ignore stdlib modules).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42923>
_______________________________________

From report at bugs.python.org  Mon Jan 18 14:52:38 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 18 Jan 2021 19:52:38 +0000
Subject: [issue36143] Auto-generate Lib/keyword.py
In-Reply-To: <1551327070.18.0.354102770805.issue36143@roundup.psfhosted.org>
Message-ID: <1610999558.11.0.680124913935.issue36143@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +23066
pull_request: https://github.com/python/cpython/pull/24245

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36143>
_______________________________________

From report at bugs.python.org  Mon Jan 18 15:09:59 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Mon, 18 Jan 2021 20:09:59 +0000
Subject: [issue42725] PEP 563: Should the behavior change for yield/yield
 from's
In-Reply-To: <1610995098.37.0.89583661703.issue42725@roundup.psfhosted.org>
Message-ID: <CAP7+vJJDzCkEjbNy8khC_Ad-UN9v4XWtXEqFd1R9oRLawqo0Fw@mail.gmail.com>


Guido van Rossum <guido at python.org> added the comment:

I'm not keen on prohibiting nonlocal variable reference in annotations,
since I can imagine uses for this (e.g. in tests). I'm not too worried
about keeping the cell alive "forever", since with Larry's PEP 649 their
lifetime would end when the object containing the annotation ends.

Someone should look into how Batuhan's super()-in-annotation example would
behave under Larry's PEP 649. (Using super() in the magical function Larry
proposes to generate might not work anyway, since super()'s own magical
powers don't work in a nested function.)

Re: issue42737, not sure what to do for that, since neither PEP 563 nor PEP
649 gives a way to access those annotations. Then again, that's also true
for annotations on local variables. So maybe we can treat them the same?
Type checkers won't care, and runtime uses of annotations (whether as type
hints or otherwise) won't have access......

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42725>
_______________________________________

From report at bugs.python.org  Mon Jan 18 15:23:47 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 18 Jan 2021 20:23:47 +0000
Subject: [issue36143] Auto-generate Lib/keyword.py
In-Reply-To: <1551327070.18.0.354102770805.issue36143@roundup.psfhosted.org>
Message-ID: <1611001427.82.0.799959539555.issue36143@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 6a809fa01f59bb00f4029d35d132cd87553554c3 by Victor Stinner in branch 'master':
bpo-36143: make regen-all now also runs regen-keyword (GH-24245)
https://github.com/python/cpython/commit/6a809fa01f59bb00f4029d35d132cd87553554c3


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36143>
_______________________________________

From report at bugs.python.org  Mon Jan 18 15:24:48 2021
From: report at bugs.python.org (Alexander Vandenbulcke)
Date: Mon, 18 Jan 2021 20:24:48 +0000
Subject: [issue42958] filecmp.cmp(shallow=True) isn't actually shallow when
 only mtime differs
Message-ID: <1611001488.57.0.420421194337.issue42958@roundup.psfhosted.org>


New submission from Alexander Vandenbulcke <alexander.vandenbulcke95 at gmail.com>:

Consider the case where 2 files are shallow compared where only the mtime differs (i.e. the mode and size is identical).

With filecmp.cmp(f1, f2, shallow=True) a deep compare would be performed behind the scenes since the guard clauses fell through. This discrepancy is either a problem in the docstring or a problem in the comparison itself.

Two options remain:
- the documentation is altered and describes that, in case only the mtime differs (i.e. mode and size are equal) a deep compare is performed
- the behaviour is restricted in that effectively only a shallow compare is performed
- a shallow compare becomes more restrictive (do not consider the mtime during the compare)

My preference is to adjust the function to safeguard the meaning of 'shallow' in this context.

----------
components: Library (Lib)
messages: 385225
nosy: AlexVndnblcke
priority: normal
severity: normal
status: open
title: filecmp.cmp(shallow=True) isn't actually shallow when only mtime differs
type: behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42958>
_______________________________________

From report at bugs.python.org  Mon Jan 18 15:31:56 2021
From: report at bugs.python.org (Alexander Vandenbulcke)
Date: Mon, 18 Jan 2021 20:31:56 +0000
Subject: [issue42958] filecmp.cmp(shallow=True) isn't actually shallow when
 only mtime differs
In-Reply-To: <1611001488.57.0.420421194337.issue42958@roundup.psfhosted.org>
Message-ID: <1611001916.93.0.543047504607.issue42958@roundup.psfhosted.org>


Change by Alexander Vandenbulcke <alexander.vandenbulcke95 at gmail.com>:


----------
keywords: +patch
pull_requests: +23067
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24246

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42958>
_______________________________________

From report at bugs.python.org  Mon Jan 18 15:47:22 2021
From: report at bugs.python.org (Benjamin Peterson)
Date: Mon, 18 Jan 2021 20:47:22 +0000
Subject: [issue42938] [security] ctypes double representation BoF
In-Reply-To: <1610784207.02.0.722384660803.issue42938@roundup.psfhosted.org>
Message-ID: <1611002842.42.0.0919742242227.issue42938@roundup.psfhosted.org>


Benjamin Peterson <benjamin at python.org> added the comment:


New changeset 916610ef90a0d0761f08747f7b0905541f0977c7 by Benjamin Peterson in branch 'master':
closes bpo-42938: Replace snprintf with Python unicode formatting in ctypes param reprs. (24239)
https://github.com/python/cpython/commit/916610ef90a0d0761f08747f7b0905541f0977c7


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42938>
_______________________________________

From report at bugs.python.org  Mon Jan 18 15:47:25 2021
From: report at bugs.python.org (miss-islington)
Date: Mon, 18 Jan 2021 20:47:25 +0000
Subject: [issue42938] [security] ctypes double representation BoF
In-Reply-To: <1610784207.02.0.722384660803.issue42938@roundup.psfhosted.org>
Message-ID: <1611002845.56.0.61639455061.issue42938@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 3.0 -> 4.0
pull_requests: +23069
pull_request: https://github.com/python/cpython/pull/24247

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42938>
_______________________________________

From report at bugs.python.org  Mon Jan 18 15:47:38 2021
From: report at bugs.python.org (miss-islington)
Date: Mon, 18 Jan 2021 20:47:38 +0000
Subject: [issue42938] [security] ctypes double representation BoF
In-Reply-To: <1610784207.02.0.722384660803.issue42938@roundup.psfhosted.org>
Message-ID: <1611002858.2.0.419388650938.issue42938@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +23070
pull_request: https://github.com/python/cpython/pull/24248

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42938>
_______________________________________

From report at bugs.python.org  Mon Jan 18 15:48:11 2021
From: report at bugs.python.org (Joel Ewaldo)
Date: Mon, 18 Jan 2021 20:48:11 +0000
Subject: [issue42959] AttributeError: module 'signal' has no attribute 'SIGHUP'
Message-ID: <1611002891.36.0.245706132459.issue42959@roundup.psfhosted.org>


New submission from Joel Ewaldo <ametatheton2 at gmail.com>:

I have already tried uninstalling and reinstalling python 3.7.9 via the 64-bit installer on the official python website. Also, I am on the latest version of windows. I have also made sure that signal.py was not a file in my directory and when I import _signal followed with print(dir(_signal)), it returns ['CTRL_BREAK_EVENT', 'CTRL_C_EVENT', 'NSIG', 'SIGABRT', 'SIGBREAK', 'SIGFPE', 'SIGILL', 'SIGINT', 'SIGSEGV', 'SIGTERM', 'SIG_DFL', 'SIG_IGN', '__doc__', '__loader__', '__name__', '__package__', 
'__spec__', 'default_int_handler', 'getsignal', 'set_wakeup_fd', 'signal'].

----------
components: Windows
files: unknown (2).png
messages: 385227
nosy: ametatheton2, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: AttributeError: module 'signal' has no attribute 'SIGHUP'
type: compile error
versions: Python 3.9
Added file: https://bugs.python.org/file49748/unknown (2).png

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42959>
_______________________________________

From report at bugs.python.org  Mon Jan 18 15:49:42 2021
From: report at bugs.python.org (Benjamin Peterson)
Date: Mon, 18 Jan 2021 20:49:42 +0000
Subject: [issue42938] [security] ctypes double representation BoF
In-Reply-To: <1610784207.02.0.722384660803.issue42938@roundup.psfhosted.org>
Message-ID: <1611002982.6.0.67579537452.issue42938@roundup.psfhosted.org>


Change by Benjamin Peterson <benjamin at python.org>:


----------
pull_requests: +23071
pull_request: https://github.com/python/cpython/pull/24249

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42938>
_______________________________________

From report at bugs.python.org  Mon Jan 18 15:51:14 2021
From: report at bugs.python.org (Benjamin Peterson)
Date: Mon, 18 Jan 2021 20:51:14 +0000
Subject: [issue42938] [security] ctypes double representation BoF
In-Reply-To: <1610784207.02.0.722384660803.issue42938@roundup.psfhosted.org>
Message-ID: <1611003074.35.0.522438012831.issue42938@roundup.psfhosted.org>


Change by Benjamin Peterson <benjamin at python.org>:


----------
pull_requests: +23072
pull_request: https://github.com/python/cpython/pull/24250

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42938>
_______________________________________

From report at bugs.python.org  Mon Jan 18 15:58:57 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Mon, 18 Jan 2021 20:58:57 +0000
Subject: [issue42959] AttributeError: module 'signal' has no attribute 'SIGHUP'
In-Reply-To: <1611002891.36.0.245706132459.issue42959@roundup.psfhosted.org>
Message-ID: <1611003537.18.0.507205803879.issue42959@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

As the docs explain, SIGHUP is not available on Windows. This is as designed.

----------
nosy: +gvanrossum
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42959>
_______________________________________

From report at bugs.python.org  Mon Jan 18 15:59:19 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Mon, 18 Jan 2021 20:59:19 +0000
Subject: [issue36143] Auto-generate Lib/keyword.py
In-Reply-To: <1551327070.18.0.354102770805.issue36143@roundup.psfhosted.org>
Message-ID: <1611003559.42.0.18233211544.issue36143@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
nosy:  -gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36143>
_______________________________________

From report at bugs.python.org  Mon Jan 18 16:05:03 2021
From: report at bugs.python.org (David CARLIER)
Date: Mon, 18 Jan 2021 21:05:03 +0000
Subject: [issue42960] resources module,
 FreeBSD update adding RLIMIT_KQUEUES constant
Message-ID: <1611003903.78.0.469721357758.issue42960@roundup.psfhosted.org>


Change by David CARLIER <devnexen at gmail.com>:


----------
components: FreeBSD
nosy: devnexen, koobs
priority: normal
pull_requests: 23073
severity: normal
status: open
title: resources module, FreeBSD update adding RLIMIT_KQUEUES constant
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42960>
_______________________________________

From report at bugs.python.org  Mon Jan 18 16:11:52 2021
From: report at bugs.python.org (Benjamin Peterson)
Date: Mon, 18 Jan 2021 21:11:52 +0000
Subject: [issue42938] [security] ctypes double representation BoF
In-Reply-To: <1610784207.02.0.722384660803.issue42938@roundup.psfhosted.org>
Message-ID: <1611004312.79.0.64992845771.issue42938@roundup.psfhosted.org>


Benjamin Peterson <benjamin at python.org> added the comment:


New changeset 34df10a9a16b38d54421eeeaf73ec89828563be7 by Benjamin Peterson in branch '3.6':
[3.6] closes bpo-42938: Replace snprintf with Python unicode formatting in ctypes param reprs. (GH-24250)
https://github.com/python/cpython/commit/34df10a9a16b38d54421eeeaf73ec89828563be7


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42938>
_______________________________________

From report at bugs.python.org  Mon Jan 18 16:16:00 2021
From: report at bugs.python.org (Boris Staletic)
Date: Mon, 18 Jan 2021 21:16:00 +0000
Subject: [issue42961] Use-after-free (of a heap type) during finalization
Message-ID: <1611004560.18.0.844080226766.issue42961@roundup.psfhosted.org>


New submission from Boris Staletic <boris.staletic at gmail.com>:

When a C extension module exposes a heap-type that is used as a base class for a "pure" python class, that gets deallocated during `Py_Finalize()`, `subtype_dealloc()` runs into a use-after-free error.

That is a hell of a run-on sentence. The thing is that every part of the sentence needs to happen, to trigger the error, at least according to valgrind. The whole thing took a very long time to debug and I finally have a concise and self-contained repro:

///////////////////////////////////////////////////////////
#include <Python.h>

static void pybind11_object_dealloc(PyObject *self) {
        auto type = Py_TYPE(self);
        type->tp_free(self);
        Py_DECREF(type);
}

static PyModuleDef pybind11_module_def_m{
        .m_base = PyModuleDef_HEAD_INIT,
        .m_name = "m",
        .m_size = -1,
};

static PyObject *pybind11_init_impl_m() {
        auto m = PyModule_Create(&pybind11_module_def_m);
        PyType_Slot slots[] = {
                {Py_tp_dealloc, (void*)pybind11_object_dealloc},
                {0, nullptr}
        };
        PyType_Spec spec{"m.B", sizeof(PyObject), 0, Py_TPFLAGS_BASETYPE | Py_TPFLAGS_HEAPTYPE, slots};
        auto type = PyType_FromSpec(&spec);
        PyObject_SetAttrString(m, "B", (PyObject*)type);
        return m;
}

int main() {
        PyImport_AppendInittab("m", pybind11_init_impl_m);
        Py_InitializeEx(1);
        PyRun_SimpleString("import m\n"
                           "def t():\n"
                           "  class A:\n"
                           "    class B(m.B):pass\n"
                           "    B()\n"
                           "t()\n");
        Py_Finalize();
}
/////////////////////////////////////////////////////////////////////////

Below is the valgrind-produced traceback of the error:

==3768== Using Valgrind-3.16.1 and LibVEX; rerun with -h for copyright info

==3768== Invalid read of size 1                                                                                                                          [4/36]
==3768==    at 0x4952AD6: subtype_dealloc (typeobject.c:1368)
==3768==    by 0x4928B6C: _Py_DECREF (object.h:448)
==3768==    by 0x4928B6C: _Py_XDECREF (object.h:514)
==3768==    by 0x4928B6C: free_keys_object (dictobject.c:628)
==3768==    by 0x492DAC8: dict_tp_clear (dictobject.c:3289)
==3768==    by 0x4A365EF: delete_garbage (gcmodule.c:1018)
==3768==    by 0x4A365EF: gc_collect_main (gcmodule.c:1301)
==3768==    by 0x4A370A4: gc_collect_with_callback (gcmodule.c:1414)
==3768==    by 0x4A370A4: PyGC_Collect (gcmodule.c:2066)
==3768==    by 0x4A106A6: Py_FinalizeEx (pylifecycle.c:1716)
==3768==    by 0x4A106A6: Py_FinalizeEx (pylifecycle.c:1638)
==3768==    by 0x109337: main (newtype.cpp:36)
==3768==  Address 0x59cc609 is 185 bytes inside a block of size 944 free'd
==3768==    at 0x483B9AB: free (vg_replace_malloc.c:538)
==3768==    by 0x4951830: type_dealloc (typeobject.c:3593)
==3768==    by 0x1091F3: _Py_DECREF (object.h:448)
==3768==    by 0x10922E: pybind11_object_dealloc(_object*) (newtype.cpp:6)
==3768==    by 0x4952AD5: subtype_dealloc (typeobject.c:1362)
==3768==    by 0x4928B6C: _Py_DECREF (object.h:448)
==3768==    by 0x4928B6C: _Py_XDECREF (object.h:514)
==3768==    by 0x4928B6C: free_keys_object (dictobject.c:628)
==3768==    by 0x492DAC8: dict_tp_clear (dictobject.c:3289)
==3768==    by 0x4A365EF: delete_garbage (gcmodule.c:1018)
==3768==    by 0x4A365EF: gc_collect_main (gcmodule.c:1301)
==3768==    by 0x4A370A4: gc_collect_with_callback (gcmodule.c:1414)
==3768==    by 0x4A370A4: PyGC_Collect (gcmodule.c:2066)
==3768==    by 0x4A106A6: Py_FinalizeEx (pylifecycle.c:1716)
==3768==    by 0x4A106A6: Py_FinalizeEx (pylifecycle.c:1638)
==3768==    by 0x109337: main (newtype.cpp:36)
==3768==  Block was alloc'd at
==3768==    at 0x483A77F: malloc (vg_replace_malloc.c:307)
==3768==    by 0x4A37402: _PyObject_GC_Alloc (gcmodule.c:2217)
==3768==    by 0x4A37402: _PyObject_GC_Malloc (gcmodule.c:2244)
==3768==    by 0x49523B5: PyType_GenericAlloc (typeobject.c:1072)
==3768==    by 0x495F2B4: type_new (typeobject.c:2622)
==3768==    by 0x49550F5: type_call (typeobject.c:1039)
==3768==    by 0x48F0EC7: _PyObject_MakeTpCall (call.c:191)
==3768==    by 0x49CD6CF: builtin___build_class__ (bltinmodule.c:232)
==3768==    by 0x493B674: cfunction_vectorcall_FASTCALL_KEYWORDS (methodobject.c:442)
==3768==    by 0x48B0040: _PyObject_VectorcallTstate (abstract.h:114)
==3768==    by 0x48B0040: PyObject_Vectorcall (abstract.h:123)
==3768==    by 0x48B0040: call_function (ceval.c:5379)
==3768==    by 0x48B0040: _PyEval_EvalFrameDefault (ceval.c:3803)
==3768==    by 0x49D383A: _PyEval_EvalFrame (pycore_ceval.h:40)
==3768==    by 0x49D383A: _PyEval_EvalCode (ceval.c:4625)
==3768==    by 0x49D3B9D: _PyEval_EvalCodeWithName (ceval.c:4657)
==3768==    by 0x49D3BED: PyEval_EvalCodeEx (ceval.c:4673)

FWIW, the valgrind command doesn't need any extra flags/switches. Looking at the output, it seems to me that the following happens:

1. [1] Objects/typeobject.c#L1362 calls the user provided (see the attached file) `tp_dealloc(p)`.
2. [2] Immediately after, Objects/typeobject.c#L1368 dereferences the, now dangling, pointer.

The provided `tp_dealloc` looks like this:

static void pybind11_object_dealloc(PyObject *self) {
        auto type = Py_TYPE(self);
        type->tp_free(self);
        Py_DECREF(type);
}


Which seems correct to me, given the "whatsnew" page for python 3.8:

https://docs.python.org/3.8/whatsnew/3.8.html#changes-in-the-c-api


Finally, this found while running an innocent-looking pybind11 test inside valgrind:

https://github.com/pybind/pybind11/pull/2797

[1]: https://github.com/python/cpython/blob/master/Objects/typeobject.c#L1362
[2]: https://github.com/python/cpython/blob/master/Objects/typeobject.c#L1368

----------
components: C API
files: heap_type_base_use_after_free.cpp
messages: 385230
nosy: bstaletic
priority: normal
severity: normal
status: open
title: Use-after-free (of a heap type) during finalization
type: behavior
versions: Python 3.10, Python 3.9
Added file: https://bugs.python.org/file49749/heap_type_base_use_after_free.cpp

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42961>
_______________________________________

From report at bugs.python.org  Mon Jan 18 16:23:22 2021
From: report at bugs.python.org (Yannick Jadoul)
Date: Mon, 18 Jan 2021 21:23:22 +0000
Subject: [issue42961] Use-after-free (of a heap type) during finalization
In-Reply-To: <1611004560.18.0.844080226766.issue42961@roundup.psfhosted.org>
Message-ID: <1611005002.39.0.208188979841.issue42961@roundup.psfhosted.org>


Change by Yannick Jadoul <yannick.jadoul at gmail.com>:


----------
nosy: +YannickJadoul

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42961>
_______________________________________

From report at bugs.python.org  Mon Jan 18 16:24:05 2021
From: report at bugs.python.org (Benjamin Peterson)
Date: Mon, 18 Jan 2021 21:24:05 +0000
Subject: [issue42938] [security] ctypes double representation BoF
In-Reply-To: <1610784207.02.0.722384660803.issue42938@roundup.psfhosted.org>
Message-ID: <1611005045.56.0.515469617853.issue42938@roundup.psfhosted.org>


Benjamin Peterson <benjamin at python.org> added the comment:


New changeset d9b8f138b7df3b455b54653ca59f491b4840d6fa by Benjamin Peterson in branch '3.7':
[3.7] closes bpo-42938: Replace snprintf with Python unicode formatting in ctypes param reprs. (GH-24249)
https://github.com/python/cpython/commit/d9b8f138b7df3b455b54653ca59f491b4840d6fa


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42938>
_______________________________________

From report at bugs.python.org  Mon Jan 18 16:25:21 2021
From: report at bugs.python.org (Eryk Sun)
Date: Mon, 18 Jan 2021 21:25:21 +0000
Subject: [issue42957] os.readlink produces wrong result on windows
In-Reply-To: <1610997189.12.0.447653130689.issue42957@roundup.psfhosted.org>
Message-ID: <1611005121.16.0.27754348191.issue42957@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

Symlinks and mountpoints (aka junctions) contain two forms of the target path. There's a path that's intended for display in the shell, and there's the actual substitute path to which the link resolves. os.readlink() was changed to return the substitute path because the display form is not mandated by filesystem protocols (it's sometimes missing, especially for junctions) and not reliable (e.g. the display path may be a long path or contain reserved names such that it's not valid without the \\?\ prefix). It was decided to keep the C implementation of os.readlink() simple. Whether to retain the \\?\ prefix was shifted to high-level functions that consume the result of os.readlink(), such as os.path.realpath().

There was a previous issue related to this, in that the shutil module copies symlinks via os.readlink() and os.symlink(), which thus copies only the substitute path now. The issue was closed as not a bug, but had it been resolved with new functionality, I would have preferred to do so with a low-level function to copy a reparse point, not by reverting the behavior of os.readlink(). I also see no reason against adding an option to readlink() to return the display path instead of the substitute path, or to just remove the prefix. But I'd vote against making it the default behavior.

----------
components: +Library (Lib)
nosy: +eryksun
versions: +Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42957>
_______________________________________

From report at bugs.python.org  Mon Jan 18 16:28:57 2021
From: report at bugs.python.org (Benjamin Peterson)
Date: Mon, 18 Jan 2021 21:28:57 +0000
Subject: [issue42938] [security] ctypes double representation BoF
In-Reply-To: <1610784207.02.0.722384660803.issue42938@roundup.psfhosted.org>
Message-ID: <1611005337.54.0.385028861618.issue42938@roundup.psfhosted.org>


Benjamin Peterson <benjamin at python.org> added the comment:


New changeset ece5dfd403dac211f8d3c72701fe7ba7b7aa5b5f by Miss Islington (bot) in branch '3.8':
closes bpo-42938: Replace snprintf with Python unicode formatting in ctypes param reprs. (GH-24248)
https://github.com/python/cpython/commit/ece5dfd403dac211f8d3c72701fe7ba7b7aa5b5f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42938>
_______________________________________

From report at bugs.python.org  Mon Jan 18 16:29:34 2021
From: report at bugs.python.org (Benjamin Peterson)
Date: Mon, 18 Jan 2021 21:29:34 +0000
Subject: [issue42938] [security] ctypes double representation BoF
In-Reply-To: <1610784207.02.0.722384660803.issue42938@roundup.psfhosted.org>
Message-ID: <1611005374.8.0.144209990732.issue42938@roundup.psfhosted.org>


Benjamin Peterson <benjamin at python.org> added the comment:


New changeset c347cbe694743cee120457aa6626712f7799a932 by Miss Islington (bot) in branch '3.9':
closes bpo-42938: Replace snprintf with Python unicode formatting in ctypes param reprs. (GH-24247)
https://github.com/python/cpython/commit/c347cbe694743cee120457aa6626712f7799a932


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42938>
_______________________________________

From report at bugs.python.org  Mon Jan 18 16:34:26 2021
From: report at bugs.python.org (Ned Deily)
Date: Mon, 18 Jan 2021 21:34:26 +0000
Subject: [issue42938] [security] ctypes double representation BoF
In-Reply-To: <1610784207.02.0.722384660803.issue42938@roundup.psfhosted.org>
Message-ID: <1611005666.13.0.43214867952.issue42938@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
keywords: +security_issue
priority: normal -> high
versions: +Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42938>
_______________________________________

From report at bugs.python.org  Mon Jan 18 17:12:34 2021
From: report at bugs.python.org (William Schwartz)
Date: Mon, 18 Jan 2021 22:12:34 +0000
Subject: [issue42962] Windows: SystemError during os.kill(...,
 signal.CTRL_C_EVENT)
Message-ID: <1611007954.59.0.488720921329.issue42962@roundup.psfhosted.org>


New submission from William Schwartz <wkschwartz at gmail.com>:

I don't have an automated test at this time, but here's how to get os.kill to raise SystemError. I did this on Windows 10 version 20H2 (build 19042.746) with Pythons 3.7.7, 3.8.5, and 3.9.1. os_kill_impl at Modules/posixmodule.c:7833 does not appear to have been modified recently (but I haven't checked its transitive callees), so I imagine you can get the same behavior from os.kill on Python 3.10.

1. Open two consoles, A and B. (I'm using tabs in Windows Terminal, if that matters.)
2. In console A, type but DO NOT EXECUTE the following command:

python -c"import os, signal; os.kill(, signal.CTRL_C_EVENT)"

Move your cursor back before the comma.

3. In console B, create a process that does nothing but print its process identifier and wait long enough for you to type it in console A:

python -c"import os, time; print(os.getpid()); time.sleep(60); print('exiting cleanly')"

Copy or remember the printed PID. Hurry to step 4 before your 60 seconds expires!

4. In console A, type the PID from console B and execute the command.
5. In console B, confirm that the Python exited without printing "exiting cleanly". Oddly, `echo %errorlevel%` will print `0` rather than `-1073741510` (which is `2**32 - 0xc000013a`, the CTRL_C_EVENT exit code), which is what it prints after `python -c"raise KeyboardInturrupt"`.
6. In console A, you should see the following traceback.

OSError: [WinError 87] The parameter is incorrect

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "<string>", line 1, in <module>
SystemError: <built-in function kill> returned a result with an error set

----------
components: Extension Modules, Windows
messages: 385235
nosy: William.Schwartz, ncoghlan, paul.moore, petr.viktorin, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: Windows: SystemError during os.kill(..., signal.CTRL_C_EVENT)
type: behavior
versions: Python 3.10, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42962>
_______________________________________

From report at bugs.python.org  Mon Jan 18 17:29:08 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 18 Jan 2021 22:29:08 +0000
Subject: [issue42938] [security] ctypes double representation BoF
In-Reply-To: <1610784207.02.0.722384660803.issue42938@roundup.psfhosted.org>
Message-ID: <1611008948.34.0.530740727697.issue42938@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

FYI I created https://python-security.readthedocs.io/vuln/ctypes-buffer-overflow-pycarg_repr.html to track fixes of this issue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42938>
_______________________________________

From report at bugs.python.org  Mon Jan 18 17:33:41 2021
From: report at bugs.python.org (Petr Viktorin)
Date: Mon, 18 Jan 2021 22:33:41 +0000
Subject: [issue42962] Windows: SystemError during os.kill(...,
 signal.CTRL_C_EVENT)
In-Reply-To: <1611007954.59.0.488720921329.issue42962@roundup.psfhosted.org>
Message-ID: <1611009221.19.0.0988759071503.issue42962@roundup.psfhosted.org>


Change by Petr Viktorin <encukou at gmail.com>:


----------
nosy:  -petr.viktorin

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42962>
_______________________________________

From report at bugs.python.org  Mon Jan 18 17:38:05 2021
From: report at bugs.python.org (Eryk Sun)
Date: Mon, 18 Jan 2021 22:38:05 +0000
Subject: [issue42959] AttributeError: module 'signal' has no attribute 'SIGHUP'
In-Reply-To: <1611002891.36.0.245706132459.issue42959@roundup.psfhosted.org>
Message-ID: <1611009485.33.0.344577705382.issue42959@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

FYI, Windows is not a POSIX operating system and does not implement Unix signals in the kernel. That said, the C language serves as a base level of cross-platform support for language runtimes across most operating systems, and there's significant coupling between C and Unix. Standard C requires six Unix signals to be supported in some fashion: SIGABRT, SIGTERM, SIGFPE, SIGILL, SIGSEGV, and SIGINT. 

The C runtime in Windows implements SIGABRT and SIGTERM only within the process, e.g. with C raise() and abort(). There's no mechanism to send these signals to another process. It implements SIGFPE, SIGILL, SIGSEGV using an OS structured exception handler, but these can't and shouldn't be handled in Python. 

That leaves SIGINT, which is implemented for console applications using a console control handler for the cancel event (CTRL_C_EVENT). The same handler also implements non-standard SIGBREAK for the other console control events: break, close, logoff, and shutdown. 

There's limited support to send the cancel and break events (CTRL_C_EVENT and CTRL_BREAK_EVENT) to other processes via WinAPI GenerateConsoleCtrlEvent(ctrlEvent, processGroupId). The event can be sent to a process group in the current console session or to all processes (group 0) in the console session. The process group ID (pgid) of a process cannot be directly queried. The only way to know a pgid is to create a process as the leader of a new group with the creation flag CREATE_NEW_PROCESS_GROUP, in which case the pgid is the pid. A new process group initially has the cancel event ignored, until a process manually enables it. So in practice you can only rely on sending the break event. This is implemented in Python via os.kill(pgid, event) and subprocess.Popen.send_signal(event). But remember the target pgid must be either 0 or a known pgid. Using a pid that's not a pgid has undefined behavior.

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42959>
_______________________________________

From report at bugs.python.org  Mon Jan 18 18:22:48 2021
From: report at bugs.python.org (Eryk Sun)
Date: Mon, 18 Jan 2021 23:22:48 +0000
Subject: [issue42962] Windows: SystemError during os.kill(...,
 signal.CTRL_C_EVENT)
In-Reply-To: <1611007954.59.0.488720921329.issue42962@roundup.psfhosted.org>
Message-ID: <1611012168.51.0.854960050685.issue42962@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> 4. In console A, type the PID from console B and execute the command.

In Windows, os.kill() is a rather confused function. In particular, it confuses a process ID (pid) with a process group ID (pgid). If the signal is CTRL_C_EVENT or CTRL_BREAK_EVENT, it first tries WinAPI GenerateConsoleCtrlEvent(). This function takes a pgid for a process group in the console session. Passing it a pid of a process in the console session that's not a pgid has undefined behavior (usually it acts like passing 0 as the pgid, but it's complicated; I have an open issue on Microsoft's GitHub repo for this that's been languishing for a couple years). Passing it a pid of a process that's not in the console session will fail as an invalid parameter. 

In the latter case, os.kill() sets an error but still tries the regular pid (not pgid) path of OpenProcess() and TerminateProcess(). If the latter succeeds, it returns success. However, it doesn't clear the error that was set as a result of the GenerateConsoleCtrlEvent() call, which causes SystemError to be raised.

>  Oddly, `echo %errorlevel%` will print `0` rather than `-1073741510` 

There's nothing odd about that. The value of CTRL_C_EVENT is 0. GenerateConsoleCtrlEvent() does not work across different console sessions. So os.kill() has simply opened a handle to the process and called TerminateProcess(handle, 0).

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42962>
_______________________________________

From report at bugs.python.org  Mon Jan 18 18:28:02 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 18 Jan 2021 23:28:02 +0000
Subject: [issue42923] Py_FatalError(): dump the list of extension modules
In-Reply-To: <1610535013.1.0.942204365805.issue42923@roundup.psfhosted.org>
Message-ID: <1611012482.07.0.277599950145.issue42923@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +23074
pull_request: https://github.com/python/cpython/pull/24254

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42923>
_______________________________________

From report at bugs.python.org  Mon Jan 18 18:28:49 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 18 Jan 2021 23:28:49 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611012529.07.0.201072829552.issue42955@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +23075
pull_request: https://github.com/python/cpython/pull/24254

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Mon Jan 18 18:33:40 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 18 Jan 2021 23:33:40 +0000
Subject: [issue42923] Py_FatalError(): dump the list of extension modules
In-Reply-To: <1610535013.1.0.942204365805.issue42923@roundup.psfhosted.org>
Message-ID: <1611012820.55.0.608716903089.issue42923@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +23076
pull_request: https://github.com/python/cpython/pull/24238

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42923>
_______________________________________

From report at bugs.python.org  Mon Jan 18 18:41:19 2021
From: report at bugs.python.org (William Schwartz)
Date: Mon, 18 Jan 2021 23:41:19 +0000
Subject: [issue42962] Windows: SystemError during os.kill(...,
 signal.CTRL_C_EVENT)
In-Reply-To: <1611007954.59.0.488720921329.issue42962@roundup.psfhosted.org>
Message-ID: <1611013279.04.0.681567313054.issue42962@roundup.psfhosted.org>


William Schwartz <wkschwartz at gmail.com> added the comment:

> In Windows, os.kill() is a rather confused function.

I know how it feels.

To be honest, I don't have an opinion about whether the steps I laid out ought to work. I just reported it because the SystemError indicates that a C-API function was returning non-NULL even after PyErr_Occurred() returns true. I think that's what you're referring to here...

> it doesn't clear the error that was set as a result of the GenerateConsoleCtrlEvent() call, which causes SystemError to be raised.

...but I lost you on where that's happening and why. Frankly, Windows IPC is not in my wheelhouse.

>>  Oddly, `echo %errorlevel%` will print `0` rather than `-1073741510` 
>
> There's nothing odd about that.

Here's why I thought it was odd. The following session is from the Windows Command shell inside *Command Prompt* (not Windows Terminal):

 C:\Users\wksch>python --version
 Python 3.9.1
 C:\Users\wksch>python -c"import os, signal, time; os.kill(os.getpid(), signal.CTRL_C_EVENT); time.sleep(1)"
 Traceback (most recent call last):
   File "<string>", line 1, in <module>
 KeyboardInterrupt
 ^C
 C:\Users\wksch>echo %errorlevel%
 -1073741510

In the Windows Command shell inside *Windows Terminal* (not Command Prompt):

 C:\Users\wksch>python -c"import os, signal, time; os.kill(os.getpid(), signal.CTRL_C_EVENT); time.sleep(1)"

 C:\Users\wksch>echo %errorlevel%
 0

 C:\Users\wksch>python -c"raise KeyboardInterrupt"
 Traceback (most recent call last):
   File "<string>", line 1, in <module>
 KeyboardInterrupt
 ^C
 C:\Users\wksch>echo %errorlevel%
 -1073741510

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42962>
_______________________________________

From report at bugs.python.org  Mon Jan 18 18:58:56 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 18 Jan 2021 23:58:56 +0000
Subject: [issue42962] Windows: SystemError during os.kill(...,
 signal.CTRL_C_EVENT)
In-Reply-To: <1611007954.59.0.488720921329.issue42962@roundup.psfhosted.org>
Message-ID: <1611014336.4.0.533244408994.issue42962@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42962>
_______________________________________

From report at bugs.python.org  Mon Jan 18 20:07:57 2021
From: report at bugs.python.org (Bar Harel)
Date: Tue, 19 Jan 2021 01:07:57 +0000
Subject: [issue31356] Add context manager to temporarily disable GC
In-Reply-To: <1504655244.01.0.877867263237.issue31356@psf.upfronthosting.co.za>
Message-ID: <1611018477.14.0.114806207379.issue31356@roundup.psfhosted.org>


Change by Bar Harel <bzvi7919 at gmail.com>:


----------
nosy: +Dennis Sweeney

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31356>
_______________________________________

From report at bugs.python.org  Mon Jan 18 20:08:51 2021
From: report at bugs.python.org (Sammy Jelin)
Date: Tue, 19 Jan 2021 01:08:51 +0000
Subject: [issue42963] [multiprocessing] Calling pool.terminate() from an
 error_callback causes deadlock
Message-ID: <1611018531.21.0.537648626366.issue42963@roundup.psfhosted.org>


New submission from Sammy Jelin <sjelin at gmail.com>:

As the title says, calling `pool.terminate()` inside an `error_callback` handler causes a deadlock.  The deadlock always happens, so it's not a race condition or thread-safety issue.

Simple repro:

```
from multiprocessing import Pool
p = Pool()

def error_callback(x):
    print(f'error: {x!r}')
    p.terminate()
    print('this message is never seen, because p.termiante() deadlocks')

p.apply_async(lambda: None, error_callback=error_callback)

# The following lines are technically aren't threadsafe,
# but I manually verified that that wasn't the problem.
p.close()
p.join()
print('this is also never seen, because the task handler is stuck in the deadlock')
```

This will print the following line and then hang:
```
error: PicklingError("Can't pickle <function <lambda> at 0x112c55e18>: attribute lookup <lambda> on __main__ failed")
```

The hanging happens inside `_help_stuff_finish`, when we call `inqueue._rlock.acquire()`.  As far as I can tell, `_handle_tasks` is already holding the lock when it calls the error_callback, so when `_terminate_pool` calls `_help_stuff_finish` a deadlock occurs.

Calling `p.terminate()` from a success callback doesn't appear to be an issue, likely because success callbacks are called via `_handle_results` instead of via `_handle_tasks`.

If calling `p.terminate()` from an error_callback isn't supported, that should be one of those big red warnings in the documentation.

I verified that this bug happens on 3.6 and 3.7, a skimmed the code on the github project to verify that it was likely still an issue.

----------
components: Library (Lib)
messages: 385240
nosy: sjelin
priority: normal
severity: normal
status: open
title: [multiprocessing] Calling pool.terminate() from an error_callback causes deadlock
versions: Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42963>
_______________________________________

From report at bugs.python.org  Mon Jan 18 20:10:42 2021
From: report at bugs.python.org (Sammy Jelin)
Date: Tue, 19 Jan 2021 01:10:42 +0000
Subject: [issue42963] [multiprocessing] Calling pool.terminate() from an
 error_callback causes deadlock
In-Reply-To: <1611018531.21.0.537648626366.issue42963@roundup.psfhosted.org>
Message-ID: <1611018642.33.0.624392124782.issue42963@roundup.psfhosted.org>


Change by Sammy Jelin <sjelin at gmail.com>:


----------
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42963>
_______________________________________

From report at bugs.python.org  Mon Jan 18 20:14:47 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 19 Jan 2021 01:14:47 +0000
Subject: [issue42959] AttributeError: module 'signal' has no attribute 'SIGHUP'
In-Reply-To: <1611002891.36.0.245706132459.issue42959@roundup.psfhosted.org>
Message-ID: <1611018887.16.0.507496104744.issue42959@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
nosy:  -gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42959>
_______________________________________

From report at bugs.python.org  Mon Jan 18 20:17:46 2021
From: report at bugs.python.org (Xinmeng Xia)
Date: Tue, 19 Jan 2021 01:17:46 +0000
Subject: =?utf-8?q?=5Bissue42888=5D_Not_installed_=E2=80=9Clibgcc=5Fs=2Eso=2E1?=
 =?utf-8?q?=E2=80=9D_causes_exit_crash=2E?=
In-Reply-To: <1610350822.34.0.431759793604.issue42888@roundup.psfhosted.org>
Message-ID: <1611019066.08.0.0699316431856.issue42888@roundup.psfhosted.org>


Xinmeng Xia <xiaxm at smail.nju.edu.cn> added the comment:

No crash is reported anymore. The result is like following:
-----------------------------------------
....... 
OSError: [Errno 24] Too many open files
OSError: [Errno 24] Too many open files
OSError: [Errno 24] Too many open files
OSError: [Errno 24] Too many open files
OSError: [Errno 24] Too many open files
  File "/home/xxm/Downloads/cpython-a4afb55fb226e1debcdaaf80890b790198ba14cc/Lib/socket.py", line 953, in getaddrinfo
  File "/home/xxm/Downloads/cpython-a4afb55fb226e1debcdaaf80890b790198ba14cc/Lib/socket.py", line 953, in getaddrinfo
OSError: [Errno 24] Too many open files
  File "/home/xxm/Downloads/cpython-a4afb55fb226e1debcdaaf80890b790198ba14cc/Lib/socket.py", line 953, in getaddrinfo
OSError: [Errno 24] Too many open files
OSError: [Errno 24] Too many open files
OSError: [Errno 24] Too many open files
-----------------------------------------------------------

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42888>
_______________________________________

From report at bugs.python.org  Mon Jan 18 20:26:10 2021
From: report at bugs.python.org (Xinmeng Xia)
Date: Tue, 19 Jan 2021 01:26:10 +0000
Subject: =?utf-8?q?=5Bissue42888=5D_Not_installed_=E2=80=9Clibgcc=5Fs=2Eso=2E1?=
 =?utf-8?q?=E2=80=9D_causes_exit_crash=2E?=
In-Reply-To: <1610350822.34.0.431759793604.issue42888@roundup.psfhosted.org>
Message-ID: <1611019570.9.0.0397302077342.issue42888@roundup.psfhosted.org>


Xinmeng Xia <xiaxm at smail.nju.edu.cn> added the comment:

I think the crash is fixed by this PR. I try other arguments. No crash is reported. Thank you!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42888>
_______________________________________

From report at bugs.python.org  Mon Jan 18 20:58:08 2021
From: report at bugs.python.org (Larry Hastings)
Date: Tue, 19 Jan 2021 01:58:08 +0000
Subject: [issue42964] Draft PEP blob etc
Message-ID: <b6c8112f-edb0-a860-5a52-5be7590d38f8@hastings.org>


New submission from Larry Hastings <larry at hastings.org>:

You interested in me doing an editing pass / critique of your PEP?? I 
just poked around on Github, and I don't think I can do one of those 
inline code review things until it's a PR.

Also, I'm a PEP editor, I can get it assigned a PEP number when you're 
ready for that.

Cheers,

//arry/

----------
messages: 385243
nosy: larry
priority: normal
severity: normal
status: open
title: Draft PEP blob etc

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42964>
_______________________________________

From report at bugs.python.org  Mon Jan 18 20:59:33 2021
From: report at bugs.python.org (Larry Hastings)
Date: Tue, 19 Jan 2021 01:59:33 +0000
Subject: [issue42964] Draft PEP blob etc
In-Reply-To: <b6c8112f-edb0-a860-5a52-5be7590d38f8@hastings.org>
Message-ID: <1611021573.44.0.396770573827.issue42964@roundup.psfhosted.org>


Larry Hastings <larry at hastings.org> added the comment:

(Oops, meant to send that as a private email.  Sorry for the noise, I'll try to be more careful in the future.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42964>
_______________________________________

From report at bugs.python.org  Mon Jan 18 22:42:01 2021
From: report at bugs.python.org (Dustin Rodrigues)
Date: Tue, 19 Jan 2021 03:42:01 +0000
Subject: [issue42819] readline 8.1 bracketed paste
In-Reply-To: <1609707155.89.0.22999518491.issue42819@roundup.psfhosted.org>
Message-ID: <1611027721.68.0.962283210873.issue42819@roundup.psfhosted.org>


Dustin Rodrigues <dust.rod at gmail.com> added the comment:

The linked PR disables bracketed paste regardless of if the user has it as a configuration option or if Python was configured with a version of readline which defaults to on for bracketed paste. Is this a viable approach?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42819>
_______________________________________

From report at bugs.python.org  Tue Jan 19 03:11:26 2021
From: report at bugs.python.org (Ofek Lev)
Date: Tue, 19 Jan 2021 08:11:26 +0000
Subject: [issue42965] Optional callable raises TypeError
Message-ID: <1611043886.41.0.0460380648291.issue42965@roundup.psfhosted.org>


New submission from Ofek Lev <ofekmeister at gmail.com>:

https://docs.python.org/3.9/library/typing.html#callable

```
Python 3.9.1 (default, Jan 12 2021, 16:45:25)
[GCC 8.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> from typing import Optional
>>> from collections.abc import Callable
>>>
>>> Hasher = Optional[Callable[[bytes], bytes]]
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/local/lib/python3.9/typing.py", line 262, in inner
    return func(*args, **kwds)
  File "/usr/local/lib/python3.9/typing.py", line 339, in __getitem__
    return self._getitem(self, parameters)
  File "/usr/local/lib/python3.9/typing.py", line 463, in Optional
    return Union[arg, type(None)]
  File "/usr/local/lib/python3.9/typing.py", line 262, in inner
    return func(*args, **kwds)
  File "/usr/local/lib/python3.9/typing.py", line 339, in __getitem__
    return self._getitem(self, parameters)
  File "/usr/local/lib/python3.9/typing.py", line 451, in Union
    parameters = _remove_dups_flatten(parameters)
  File "/usr/local/lib/python3.9/typing.py", line 231, in _remove_dups_flatten
    return tuple(_deduplicate(params))
  File "/usr/local/lib/python3.9/typing.py", line 205, in _deduplicate
    all_params = set(params)
TypeError: unhashable type: 'list'
>>>
>>> from typing import Tuple
>>> Hasher = Optional[Callable[Tuple[bytes], bytes]]
>>>
```

Tuple type for arguments makes it work

----------
components: Library (Lib)
messages: 385246
nosy: Ofekmeister
priority: normal
severity: normal
status: open
title: Optional callable raises TypeError
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42965>
_______________________________________

From report at bugs.python.org  Tue Jan 19 03:25:07 2021
From: report at bugs.python.org (Ofek Lev)
Date: Tue, 19 Jan 2021 08:25:07 +0000
Subject: [issue42965] Optional callable raises TypeError
In-Reply-To: <1611043886.41.0.0460380648291.issue42965@roundup.psfhosted.org>
Message-ID: <1611044707.01.0.252475180949.issue42965@roundup.psfhosted.org>


Ofek Lev <ofekmeister at gmail.com> added the comment:

I'm using the deprecated typing.Callable instead now and that works

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42965>
_______________________________________

From report at bugs.python.org  Tue Jan 19 04:05:56 2021
From: report at bugs.python.org (Eryk Sun)
Date: Tue, 19 Jan 2021 09:05:56 +0000
Subject: [issue42962] Windows: SystemError during os.kill(...,
 signal.CTRL_C_EVENT)
In-Reply-To: <1611007954.59.0.488720921329.issue42962@roundup.psfhosted.org>
Message-ID: <1611047156.77.0.877433386626.issue42962@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> I just reported it because the SystemError indicates that a C-API function
> was returning non-NULL even after PyErr_Occurred() returns true

Fixing the SystemError should be simple. Just clear an existing error if TerminateProcess() succeeds. 

> Windows Command shell inside *Command Prompt* (not Windows Terminal):

The cmd.exe shell (aka command prompt or command interpreter) is a console client application like python.exe, which attaches to a console session that's hosted by conhost.exe or openconsole.exe. The host also implements the console UI, unless it's executed in pseudoconsole mode (e.g. a tab in Windows Terminal). 

> C:\Users\wksch>python -c"import os, signal, time; os.kill(os.getpid(),
> signal.CTRL_C_EVENT); time.sleep(1)"

The above kill() call is implemented by calling GenerateConsoleCtrlEvent() to send the cancel event to clients of the console session that are members of the process group, os.getpid(). But there is no such group since Python isn't executed as a new process group. GenerateConsoleCtrlEvent() should fail with an invalid parameter error, and kill() should fall back on TerminateProcess(). But GenerateConsoleCtrlEvent() has a bug in cases like this that causes it to behave as if it were passed group ID 0 (i.e. all processes in the console session). If not for the bug in the console, this example would also raise SystemError.

> In the Windows Command shell inside *Windows Terminal*

The misbehavior is different in a pseudoconsole session, which is probably due to an unrelated bug that's affecting the expected bug. Other than Windows Terminal, another simple way to get a pseudoconsole session is to run cmd.exe from WSL. (The UI will be in the same console as WSL, but cmd.exe will actually be attached to a pseudoconsole session that's hosted by a headless instance of conhost.exe.) In pseudoconsole mode, the console will broadcast the control event only after a key such as enter or escape is pressed, which is obviously a bug in the console's input event loop. It's still a case of GenerateConsoleCtrlEvent() nominally succeeding with buggy behavior where it should fail.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42962>
_______________________________________

From report at bugs.python.org  Tue Jan 19 04:25:49 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Tue, 19 Jan 2021 09:25:49 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611048349.87.0.490051606386.issue42955@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na at python.org>:


----------
nosy: +corona10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Tue Jan 19 04:33:11 2021
From: report at bugs.python.org (yota moteuchi)
Date: Tue, 19 Jan 2021 09:33:11 +0000
Subject: [issue39291] "pathlib.Path.link_to()" and "pathlib.Path.symlink_to()"
 have reversed usage
In-Reply-To: <1578678614.26.0.0980677925629.issue39291@roundup.psfhosted.org>
Message-ID: <1611048791.41.0.0550469057243.issue39291@roundup.psfhosted.org>


yota moteuchi <yota.news at gmail.com> added the comment:

one option to could be to create a hardlink_to() method which is link.hardlink_to(target) and in a few release, deprecate link_to ? :)

----------
nosy: +yota moteuchi

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39291>
_______________________________________

From report at bugs.python.org  Tue Jan 19 05:03:19 2021
From: report at bugs.python.org (Ronald Oussoren)
Date: Tue, 19 Jan 2021 10:03:19 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611050599.21.0.748072097.issue42955@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

A list of stdlib modules/extensions is IMHO problematic for maintenance, esp. if you consider that not all modules/extensions are installed on all systems (both because dependencies aren't present and because packagers have decided to unbundle parts of the stdlib).

Wouldn't it be sufficient to somehow mark the stdlib entries on sys.path? Although that might give misleading answers with tools like pyinstaller/py2exe/py2app that package an application and its dependencies into a single zipfile.

----------
nosy: +ronaldoussoren

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Tue Jan 19 06:09:56 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 19 Jan 2021 11:09:56 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611054596.46.0.19001219528.issue42955@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Ronald Oussoren:
> A list of stdlib modules/extensions is IMHO problematic for maintenance, esp. if you consider that not all modules/extensions are installed on all systems (both because dependencies aren't present and because packagers have decided to unbundle parts of the stdlib).

My PR 24238 adds a list of module names (tuple of str): sys.module_names. It includes modules which are not available on the platform. For example, "winsound" is listed on Linux but not available, and "tkinter" is listed even if the extension could not be built (missing dependency).

I tried to make it clear in the sys.module_names documentation (see my PR).

Making the list conditional depending if the module is built or not is causing different issues. For example, for the "isort" (sort and group imports) use case, you want to know on Linux if "import winsound" is a stdlib import or a third party import (same for Linux-only modules on Windows). Moreover, there is a practical issue: extension modules are only built by setup.py *after* the sys module is built. I don't want to rebuild the sys module if building an extension failed.

Even if a module is available (listed in sys.module_names and the file is present on disk), it doesn't mean that "it works". For example, "import multiprocessing" fails if there is no working lock implementation. Other modules have similar issues.


> Wouldn't it be sufficient to somehow mark the stdlib entries on sys.path? Although that might give misleading answers with tools like pyinstaller/py2exe/py2app that package an application and its dependencies into a single zipfile.

Having to actually import modules to check if it's a stdlib module or not is not convenient. Many stdlib modules have side effects on import. For example, "import antigravity" opens a web browser. An import can open files, spawn threads, run programs, etc.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Tue Jan 19 06:18:36 2021
From: report at bugs.python.org (Ronald Oussoren)
Date: Tue, 19 Jan 2021 11:18:36 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611055116.78.0.871884800721.issue42955@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

>> Wouldn't it be sufficient to somehow mark the stdlib entries on sys.path? Although that might give misleading answers with tools like pyinstaller/py2exe/py2app that package an application and its dependencies into a single zipfile.

> Having to actually import modules to check if it's a stdlib module or not is not convenient. Many stdlib modules have side effects on import. For example, "import antigravity" opens a web browser. An import can open files, spawn threads, run programs, etc.

You wouldn't necessarily have to import a module to test, this is something that could be added to importlib.  One (poorly thought out) option is to add sys._stdlib_path with the subsection of sys.path that contains the stdlib, and a function in importlib that returns if a spec is for a stdlib module.

The disadvantage of this, or for the most part anything but your initial proposal, is that might not be save to use a function in importlib in Py_FatalError.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Tue Jan 19 06:30:46 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 19 Jan 2021 11:30:46 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611055846.19.0.297118610487.issue42955@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Myself:
> Having to actually import modules to check if it's a stdlib module or not is not convenient. Many stdlib modules have side effects on import.

The "trace" usecase needs an exhaustive list of all module names. It is even less convenient to have to list all Python modules available on the system only to check modules coming from the stdlib.


Ronald:
> You wouldn't necessarily have to import a module to test, this is something that could be added to importlib.  One (poorly thought out) option is to add sys._stdlib_path with the subsection of sys.path that contains the stdlib, and a function in importlib that returns if a spec is for a stdlib module.

I'm not sure how it would work. I listed different cases which have different constraints:

* From a module name, check if it's part of the stdlib or not
* From a module object, check if it's part of the stdlib or not

For the test on the module name, how would it work with sys._stdlib_path? Should you import the module and then check if its path comes from sys._stdlib_path?


Ronald:
> The disadvantage of this, or for the most part anything but your initial proposal, is that might not be save to use a function in importlib in Py_FatalError.

PR 24254 is a working implementation of my use case: only list third party extension modules on a Python fatal error. It relies on PR 24238 sys.module_names list. The implementation works when called from a signal handler (when faulthandler catch fatal signals like SIGSEGV), it avoids memory allocations on the heap (one of the limits of a signal handler).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Tue Jan 19 07:24:41 2021
From: report at bugs.python.org (Ronald Oussoren)
Date: Tue, 19 Jan 2021 12:24:41 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1611055846.19.0.297118610487.issue42955@roundup.psfhosted.org>
Message-ID: <ABF845CB-EDC2-4092-81E9-334B58238128@mac.com>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

> On 19 Jan 2021, at 12:30, STINNER Victor <report at bugs.python.org> wrote:
> 
> Ronald:
>> You wouldn't necessarily have to import a module to test, this is something that could be added to importlib.  One (poorly thought out) option is to add sys._stdlib_path with the subsection of sys.path that contains the stdlib, and a function in importlib that returns if a spec is for a stdlib module.
> 
> I'm not sure how it would work. I listed different cases which have different constraints:
> 
> * From a module name, check if it's part of the stdlib or not
> * From a module object, check if it's part of the stdlib or not
> 
> For the test on the module name, how would it work with sys._stdlib_path? Should you import the module and then check if its path comes from sys._stdlib_path?

For a module name use importlib.util.find_spec() to locate the module (or toplevel package if this is a module in package). The new importlib function could then use the spec and sys._stdlib_path to check if the spec is one for a stdlib module.  This is pretty handwavy, but I do something similar in py2app (but completely based on paths calculated outside of the import machinery).

For a module object you can extract the spec from the object and use the same function. 

> 
> 
> Ronald:
>> The disadvantage of this, or for the most part anything but your initial proposal, is that might not be save to use a function in importlib in Py_FatalError.
> 
> PR 24254 is a working implementation of my use case: only list third party extension modules on a Python fatal error. It relies on PR 24238 sys.module_names list. The implementation works when called from a signal handler (when faulthandler catch fatal signals like SIGSEGV), it avoids memory allocations on the heap (one of the limits of a signal handler).

I think we agree on that point: my counter proposal won?t work in the faulthandler scenario, and may be problematic in the Py_FatalError case as well.

Ronald

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Tue Jan 19 07:39:23 2021
From: report at bugs.python.org (Ronald Oussoren)
Date: Tue, 19 Jan 2021 12:39:23 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611059963.46.0.545143375114.issue42955@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

BTW. A list of stdlib module names is not sufficient to determine if a module is in the stdlib, thanks to .pth files it is possible to have entries on sys.path before the stdlib.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Tue Jan 19 07:57:55 2021
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 19 Jan 2021 12:57:55 +0000
Subject: [issue41701] Buildbot web page: connection lost after 1 minute,
 then display "Connection restored" popup
In-Reply-To: <1599128479.83.0.639934661132.issue41701@roundup.psfhosted.org>
Message-ID: <1611061075.99.0.117718063455.issue41701@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

Is there anything I can help with to move this forward?
Investigating buildbot failures continues to be very annoying.

----------
nosy: +petr.viktorin

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41701>
_______________________________________

From report at bugs.python.org  Tue Jan 19 07:59:10 2021
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 19 Jan 2021 12:59:10 +0000
Subject: [issue41701] Buildbot web page: connection lost after 1 minute,
 then display "Connection restored" popup
In-Reply-To: <1599128479.83.0.639934661132.issue41701@roundup.psfhosted.org>
Message-ID: <1611061150.96.0.586438598712.issue41701@roundup.psfhosted.org>


Change by Petr Viktorin <encukou at gmail.com>:


----------
keywords: +patch
pull_requests: +23077
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24119

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41701>
_______________________________________

From report at bugs.python.org  Tue Jan 19 08:03:20 2021
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 19 Jan 2021 13:03:20 +0000
Subject: [issue41818] Lib/pty.py major revision
In-Reply-To: <1600557574.22.0.272934906824.issue41818@roundup.psfhosted.org>
Message-ID: <1611061400.33.0.0991736576288.issue41818@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:


New changeset 65cf1ad6723b6b4489fa7dda04283bb2466be531 by Petr Viktorin in branch 'master':
bpo-41818: Close file descriptors in test_openpty (#GH-24119)
https://github.com/python/cpython/commit/65cf1ad6723b6b4489fa7dda04283bb2466be531


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41818>
_______________________________________

From report at bugs.python.org  Tue Jan 19 08:07:49 2021
From: report at bugs.python.org (Alexey Izbyshev)
Date: Tue, 19 Jan 2021 13:07:49 +0000
Subject: [issue42606] Support POSIX atomicity guarantee of O_APPEND on Windows
In-Reply-To: <1607483566.95.0.1927829703.issue42606@roundup.psfhosted.org>
Message-ID: <1611061669.6.0.547242009104.issue42606@roundup.psfhosted.org>


Alexey Izbyshev <izbyshev at ispras.ru> added the comment:

Could anybody provide their thoughts on this RFE? Thanks.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42606>
_______________________________________

From report at bugs.python.org  Tue Jan 19 08:27:19 2021
From: report at bugs.python.org (Boris Staletic)
Date: Tue, 19 Jan 2021 13:27:19 +0000
Subject: [issue42961] Use-after-free (of a heap type) during finalization
In-Reply-To: <1611004560.18.0.844080226766.issue42961@roundup.psfhosted.org>
Message-ID: <1611062839.74.0.228919176992.issue42961@roundup.psfhosted.org>


Boris Staletic <boris.staletic at gmail.com> added the comment:

Oops... I uploaded (and pasted) the wrong file. The /correct/ example can be found here:

https://github.com/pybind/pybind11/pull/2797/#pullrequestreview-570541151

However, I have just realized that the example doesn't really need the embedded module. The following also shows the use-after-free:


#include <Python.h>

static void pybind11_object_dealloc(PyObject *self) {
	auto type = Py_TYPE(self);
	type->tp_free(self);
	Py_DECREF(type);
}
static PyType_Slot base_slots[] = {{Py_tp_dealloc, (void*)pybind11_object_dealloc}, {0, nullptr}};
static PyType_Spec base_spec{"B", sizeof(PyObject), 0, Py_TPFLAGS_BASETYPE | Py_TPFLAGS_HEAPTYPE, base_slots};
int main() {
	Py_InitializeEx(1);
	auto base_type = PyType_FromSpec(&base_spec);
	auto globals = PyDict_New();
	PyDict_SetItemString(globals, "B", base_type);
	auto derived_t = PyRun_String("def f():\n"
                                      "  class C:\n"
                                      "    class D(B):pass\n"
                                      "    b=D()\n"
                                      "f()", Py_file_input, globals, nullptr);
	Py_DECREF(globals);
	Py_DECREF(derived_t);
	Py_Finalize();
}

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42961>
_______________________________________

From report at bugs.python.org  Tue Jan 19 08:43:14 2021
From: report at bugs.python.org (Mark Shannon)
Date: Tue, 19 Jan 2021 13:43:14 +0000
Subject: [issue42951] Random and infinite loop in dealing with recursion error
 for "try-except "
In-Reply-To: <1610943420.56.0.379356825462.issue42951@roundup.psfhosted.org>
Message-ID: <1611063794.37.0.227781377198.issue42951@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

Try setting the recursion limit to 10 or so and it should terminate.

The reason ctrl-C doesn't work is that you are catching the KeyboardInterrupt. Never use a plain `except:`, use `except Exception:`

----------
nosy: +Mark.Shannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42951>
_______________________________________

From report at bugs.python.org  Tue Jan 19 09:10:02 2021
From: report at bugs.python.org (Xinmeng Xia)
Date: Tue, 19 Jan 2021 14:10:02 +0000
Subject: [issue42951] Random and infinite loop in dealing with recursion error
 for "try-except "
In-Reply-To: <1610943420.56.0.379356825462.issue42951@roundup.psfhosted.org>
Message-ID: <1611065402.91.0.736311254727.issue42951@roundup.psfhosted.org>


Xinmeng Xia <xiaxm at smail.nju.edu.cn> added the comment:

oh,I see. By the way, I set the argument of sys.setrecursionlimit to 100000 in this program and a segmentation fault is reported. Is that normal?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42951>
_______________________________________

From report at bugs.python.org  Tue Jan 19 09:20:04 2021
From: report at bugs.python.org (Ken Jin)
Date: Tue, 19 Jan 2021 14:20:04 +0000
Subject: [issue42965] Optional callable raises TypeError
In-Reply-To: <1611043886.41.0.0460380648291.issue42965@roundup.psfhosted.org>
Message-ID: <1611066004.82.0.167009464522.issue42965@roundup.psfhosted.org>


Ken Jin <kenjin4096 at gmail.com> added the comment:

Hello, this issue is a byproduct of issue42195. It has already been fixed on Python 3.10, and on Python 3.9.2 (which isn't out yet). You can see the what's new for it here https://docs.python.org/3/whatsnew/3.9.html#notable-changes-in-python-3-9-2.

The expected release date for Python 3.9.2 is Monday, 2021-02-15 according to PEP 596 https://www.python.org/dev/peps/pep-0596/.

For now, I guess you'll have to use the old typing.Callable, then update it in newer versions of Python.

On Python 3.10a4:
>>> from typing import Optional
>>> from collections.abc import Callable
>>> Optional[Callable[[bytes], bytes]]
typing.Optional[collections.abc.Callable[[bytes], bytes]]

----------
nosy: +kj

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42965>
_______________________________________

From report at bugs.python.org  Tue Jan 19 09:27:00 2021
From: report at bugs.python.org (Tadek Kijkowski)
Date: Tue, 19 Jan 2021 14:27:00 +0000
Subject: [issue42966] argpare: customizable help formatter
Message-ID: <1611066420.6.0.700026495964.issue42966@roundup.psfhosted.org>


New submission from Tadek Kijkowski <tkijkowski at gmail.com>:

Current implementation of the argparse module doesn't make it easy for developers to customize the help text message format. On one hand the module doesn't provide any builtin ways to do it, and the only way is to provide developer's own formatter class, on the other hand developers are threatened, that all internal structures of the module, including API of the HelpFormatter class is subject to change. Trying to customize anything but the most basic things, developer risks that his or hers module will suddenly stop working with a new version of argparse.

For most basic customization there is a set of four alternative formatting classes, but their usage as well as development of additional formatting classes is hindered by following reasons:
- Only one formatting class can be used at a time. Although arguably devloper can safely derive his own formatter class from multiple argparse's formatters - if he or she will come up with this idea.
- At this moment there is no way to pass any configuration data to the formatter object, so each formatter class can only change one aspect of the output format.
- Any new functionality added to argparse help formatting has to take form of new formatter class. If it is significant change, it means duplicating parts of HelpFormatter code and in the future maintaining additional classes.
- Even if additional formatter classes are added to argparse, developers have make sure that the new class is present in the argparse used by their module - either add dependency to specific argparse version, or dynamically check for presence of the new class in argparse module.

The most important part of this enhancement request is change in argparse public API - addition of class CustomHelpFormat. Object of this class would serve as factory for CustomizableHelpFormatter objects and could be passed to ArgumentParser constructor in place of format class type:

custom_format = argparse.CustomHelpFormat()
custom_format.indent_increment = 4
custom_format.raw_description = True
parser = argparse.ArgumentParser(formatter_class=custom_format)

The idea of passing callable instead of class type as formatter_class argument is not new, but this time it would be part of official API with access to internal details and maintained along with the module.

In conrtast to the list of drawbacks above, the advantages of this solution are:
- It is much easier to do basic customization. Developers won't have to search the internet for information how to customize argparse output, when they just want to focus on their own application functionality.
- There is no need to check for presence of future additional help formatter in the argparse module. One just has to set appropriate attribute in the 'custom_format' object. If required functionality is not present in the module on the system, it would be simply ignored, developer could even safely set attribute for future feature not present in released version.
- Detection of implemented feature would is much easier - developer would just call `hasattr(custom_format, "hybrid_text_formatter")` and modify displayed text accordingly in the absence of the requested feature.
- Development of new features should be easier - instead of creating new class for each possible aspect of customization, new features could be combined in one new class, or even added to the base HelpFormatter and just enabled by an attribute.

Altough this solution will not immediately help developers wanting to customize their argparse, the main idea is that it will unclog development of new formatters and incorporating existing propositions and possibly lessen or remove the need for client side customizations.

Initially, the new class would contain attributes corresponding to funcionality of existing alternative formatting classes as well as arguments to default HelpFormatter - indent, max help position and width.

Attached implementation of the CustomizableHelpFormatter class may seem rudimentary or hackish (or maybe not). Perhaps it should implement all appropriate methods instead of patching self.

----------
components: Library (Lib)
files: CustomizableHelpFormatter.txt
messages: 385263
nosy: monkeyman79
priority: normal
severity: normal
status: open
title: argpare: customizable help formatter
type: enhancement
versions: Python 3.10
Added file: https://bugs.python.org/file49750/CustomizableHelpFormatter.txt

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42966>
_______________________________________

From report at bugs.python.org  Tue Jan 19 09:29:43 2021
From: report at bugs.python.org (Tadek Kijkowski)
Date: Tue, 19 Jan 2021 14:29:43 +0000
Subject: [issue42966] argparse: customizable help formatter
In-Reply-To: <1611066420.6.0.700026495964.issue42966@roundup.psfhosted.org>
Message-ID: <1611066583.72.0.0546980615178.issue42966@roundup.psfhosted.org>


Change by Tadek Kijkowski <tkijkowski at gmail.com>:


----------
title: argpare: customizable help formatter -> argparse: customizable help formatter

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42966>
_______________________________________

From report at bugs.python.org  Tue Jan 19 09:48:11 2021
From: report at bugs.python.org (Ofek Lev)
Date: Tue, 19 Jan 2021 14:48:11 +0000
Subject: [issue42965] Optional callable raises TypeError
In-Reply-To: <1611043886.41.0.0460380648291.issue42965@roundup.psfhosted.org>
Message-ID: <1611067691.25.0.0596730199039.issue42965@roundup.psfhosted.org>


Ofek Lev <ofekmeister at gmail.com> added the comment:

Ah I see, thanks!

----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42965>
_______________________________________

From report at bugs.python.org  Tue Jan 19 10:01:53 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 19 Jan 2021 15:01:53 +0000
Subject: [issue42887] 100000 assignments of .__sizeof__ cause a segfault on del
In-Reply-To: <1610350684.08.0.491719857036.issue42887@roundup.psfhosted.org>
Message-ID: <1611068513.38.0.352120036805.issue42887@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Mark, would your proposal in PEP-651 fix this case?

----------
nosy: +Mark.Shannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42887>
_______________________________________

From report at bugs.python.org  Tue Jan 19 10:06:49 2021
From: report at bugs.python.org (Adam Goldschmidt)
Date: Tue, 19 Jan 2021 15:06:49 +0000
Subject: [issue42967] Web cache poisoning - `;` as a query args separator
Message-ID: <1611068809.96.0.58823274544.issue42967@roundup.psfhosted.org>


New submission from Adam Goldschmidt <adamgold7 at gmail.com>:

The urlparse module treats semicolon as a separator (https://github.com/python/cpython/blob/master/Lib/urllib/parse.py#L739) - whereas most proxies today only take ampersands as separators. Link to a blog post explaining this vulnerability: https://snyk.io/blog/cache-poisoning-in-popular-open-source-packages/

When the attacker can separate query parameters using a semicolon (;), they can cause a difference in the interpretation of the request between the proxy (running with default configuration) and the server. This can result in malicious requests being cached as completely safe ones, as the proxy would usually not see the semicolon as a separator, and therefore would not include it in a cache key of an unkeyed parameter - such as `utm_*` parameters, which are usually unkeyed. Let?s take the following example of a malicious request:				

```
GET /?link=http://google.com&utm_content=1;link='><t>alert(1)</script> HTTP/1.1

Host: somesite.com

Upgrade-Insecure-Requests: 1		

User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/85.0.4183.83 Safari/537.36

Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,imag e/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9 Accept-Encoding: gzip, deflate			

Accept-Language: en-US,en;q=0.9 Connection: close			
```

urlparse sees 3 parameters here: `link`, `utm_content` and then `link` again. On the other hand, the proxy considers this full string: `1;link='><t>alert(1)</script>` as the value of `utm_content`, which is why the cache key would only contain `somesite.com/?link=http://google.com`. 

A possible solution could be to allow developers to specify a separator, like werkzeug does:

https://github.com/pallets/werkzeug/blob/6784c44673d25c91613c6bf2e614c84465ad135b/src/werkzeug/urls.py#L833

----------
components: C API
messages: 385266
nosy: AdamGold
priority: normal
severity: normal
status: open
title: Web cache poisoning - `;` as a query args separator
type: security
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Tue Jan 19 10:11:28 2021
From: report at bugs.python.org (Mark Shannon)
Date: Tue, 19 Jan 2021 15:11:28 +0000
Subject: [issue42887] 100000 assignments of .__sizeof__ cause a segfault on del
In-Reply-To: <1610350684.08.0.491719857036.issue42887@roundup.psfhosted.org>
Message-ID: <1611069088.54.0.405343611454.issue42887@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

It won't solve the problem.
Maybe make it would make it easier to avoid the segfault, but some sort of recursion/overflow check is needed. 

It might make the use of the trashcan cheaper, as it only need be used when stack space is running low.

Ultimately, the cycle GC needs to be iterative, rather than recursive. That will take a *lot* of work though.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42887>
_______________________________________

From report at bugs.python.org  Tue Jan 19 10:11:48 2021
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 19 Jan 2021 15:11:48 +0000
Subject: [issue41713] _signal module leak: test_interpreters leaked [1424, 1422,
 1424] references
In-Reply-To: <1599213221.63.0.522110671593.issue41713@roundup.psfhosted.org>
Message-ID: <1611069108.47.0.332958750972.issue41713@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

The PyOS_InitInterrupts function is still listed in PC/python3dll.c.

----------
nosy: +petr.viktorin

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41713>
_______________________________________

From report at bugs.python.org  Tue Jan 19 10:27:02 2021
From: report at bugs.python.org (Ee W. Durbin III)
Date: Tue, 19 Jan 2021 15:27:02 +0000
Subject: [issue41701] Buildbot web page: connection lost after 1 minute,
 then display "Connection restored" popup
In-Reply-To: <1599128479.83.0.639934661132.issue41701@roundup.psfhosted.org>
Message-ID: <1611070022.67.0.734910009249.issue41701@roundup.psfhosted.org>


Ee W. Durbin III <ewdurbin at gmail.com> added the comment:

OK, I've confirmed that HAProxy seems to be the issue. WebSockets opened to the nginx proxy on the server or directly to the twisted server successfully remain indefinitely.

If anyone familiar with HAProxy would be interested in helping debug, the current relevant information is:

- Ubuntu 18.04.5 LTS
- HA-Proxy version 1.8.8-1ubuntu0.11 2020/06/22

Here is the current HAProxy configuration: https://gist.github.com/ewdurbin/d8a42c30a04d6cb5763431200acaecde which is generated from this salt state: https://github.com/python/psf-salt/tree/master/salt/haproxy and this pillar data: https://github.com/python/psf-salt/blob/master/pillar/base/haproxy.sls

I can provide any additional information that would be helpful to someone trying to sort out what's going on.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41701>
_______________________________________

From report at bugs.python.org  Tue Jan 19 10:52:03 2021
From: report at bugs.python.org (Ken Jin)
Date: Tue, 19 Jan 2021 15:52:03 +0000
Subject: [issue42392] remove the deprecated 'loop' parameter asyncio API
In-Reply-To: <1605639845.5.0.800535008799.issue42392@roundup.psfhosted.org>
Message-ID: <1611071523.61.0.786393364957.issue42392@roundup.psfhosted.org>


Change by Ken Jin <kenjin4096 at gmail.com>:


----------
nosy: +kj
nosy_count: 5.0 -> 6.0
pull_requests: +23078
pull_request: https://github.com/python/cpython/pull/24256

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42392>
_______________________________________

From report at bugs.python.org  Tue Jan 19 11:15:13 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 19 Jan 2021 16:15:13 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611072913.12.0.778215394852.issue42955@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Ronald:
> BTW. A list of stdlib module names is not sufficient to determine if a module is in the stdlib, thanks to .pth files it is possible to have entries on sys.path before the stdlib.

Yeah, I wrote it in my first message. I solved this issue with documentation:

"Note: If a third party module has the same name than a standard library module and it comes before the standard library in sys.path, it overrides the standard library module on import."

I updated sys.module_names documentation in my PR.

IMO it's an acceptable limitation.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Tue Jan 19 11:29:17 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 19 Jan 2021 16:29:17 +0000
Subject: [issue41701] Buildbot web page: connection lost after 1 minute,
 then display "Connection restored" popup
In-Reply-To: <1599128479.83.0.639934661132.issue41701@roundup.psfhosted.org>
Message-ID: <1611073757.08.0.329485544055.issue41701@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I looked at these files.

HAProxy configuration, "defaults" section contains:

    timeout connect 5000
    timeout client  50000
    timeout server  50000

These timeouts are not overriden in "frontend main" nor in "backend buildbot-master" sections.

pillar/base/haproxy.sls seems to try to override these variables:

https://github.com/python/psf-salt/blob/d89e5ef2e86f45c1766c8b93d6e9621b0ab1bb09/pillar/base/haproxy.sls#L7-L11

I don't see these in the rendered HAProxy config, but I see "timeout tunnel 3600s" is rendered as "timeout tunnel 1d" in "backend buildbot-master".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41701>
_______________________________________

From report at bugs.python.org  Tue Jan 19 11:35:33 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 19 Jan 2021 16:35:33 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611074133.27.0.657326178455.issue42955@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Ronald:
> I think we agree on that point: my counter proposal won?t work in the faulthandler scenario, and may be problematic in the Py_FatalError case as well.

The API providing a tuple of str (sys.module_names) works with the 4 use cases that I listed:

* faulthandler/Py_FatalError (dump third party extensions of sys.modules)
* isort (group stdlib imports)
* trace (don't trace stdlib modules)
* pypt (ignore stdlib modules when computing dependencies)


Ronald:
> Although that might give misleading answers with tools like pyinstaller/py2exe/py2app that package an application and its dependencies into a single zipfile.

These tools worked for years without sys.module_names and don't need to be modified to use sys.module_names.

sys.module_names is well defined, extract of its doc:

"The list is the same on all platforms. Modules which are not available on some platforms and modules disabled at Python build are also listed."

These packaging tools may require further checks than just checking if the name is in sys.module_names. These tools are complex anyway ;-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Tue Jan 19 11:37:42 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 19 Jan 2021 16:37:42 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611074262.63.0.328501573303.issue42955@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> One (poorly thought out) option is to add sys._stdlib_path with the subsection of sys.path that contains the stdlib, and a function in importlib that returns if a spec is for a stdlib module.

There is already sysconfig.get_paths()['stdlib']. Maybe we need to add a new key for extension modules.

I don't think that these two options are exclusive. For me, it can even be a similar but different use case.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Tue Jan 19 11:43:23 2021
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 19 Jan 2021 16:43:23 +0000
Subject: [issue42035] [C API] PyType_GetSlot cannot get tp_name
In-Reply-To: <1602683525.08.0.938781399322.issue42035@roundup.psfhosted.org>
Message-ID: <1611074603.46.0.145148106947.issue42035@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

Now that I see the implementation (and now that I'm spending a lot of time trying to formalize what is good stable API), I see a problem with PyType_GetName: it effectively returns a borrowed reference.
The proposed docs say:

   Callers can hold [the retuned] pointer until the type has been deallocated.

This is not friendly to alternate Python implementations. For example, if tp_name is stored as UTF-32, it would need to generate the char* data -- and then retain it until the class is deallocated.
I guess the "correct" way would be to return a Py_buffer, which would (in CPython) reference the class.

Victor, what do you think?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42035>
_______________________________________

From report at bugs.python.org  Tue Jan 19 11:46:11 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 19 Jan 2021 16:46:11 +0000
Subject: [issue41713] _signal module leak: test_interpreters leaked [1424, 1422,
 1424] references
In-Reply-To: <1599213221.63.0.522110671593.issue41713@roundup.psfhosted.org>
Message-ID: <1611074771.26.0.708473330402.issue41713@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +23079
pull_request: https://github.com/python/cpython/pull/24257

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41713>
_______________________________________

From report at bugs.python.org  Tue Jan 19 11:46:50 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 19 Jan 2021 16:46:50 +0000
Subject: [issue41713] _signal module leak: test_interpreters leaked [1424, 1422,
 1424] references
In-Reply-To: <1599213221.63.0.522110671593.issue41713@roundup.psfhosted.org>
Message-ID: <1611074810.08.0.871803377777.issue41713@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Petr Viktorin:
> The PyOS_InitInterrupts function is still listed in PC/python3dll.c.

Ooops, I proposed PR 24257 to remove it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41713>
_______________________________________

From report at bugs.python.org  Tue Jan 19 11:53:09 2021
From: report at bugs.python.org (Ee W. Durbin III)
Date: Tue, 19 Jan 2021 16:53:09 +0000
Subject: [issue41701] Buildbot web page: connection lost after 1 minute,
 then display "Connection restored" popup
In-Reply-To: <1599128479.83.0.639934661132.issue41701@roundup.psfhosted.org>
Message-ID: <1611075189.87.0.841129813432.issue41701@roundup.psfhosted.org>


Ee W. Durbin III <ewdurbin at gmail.com> added the comment:

Apologies, I gisted a version that was from attempts to debug the timeouts. It's been updated.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41701>
_______________________________________

From report at bugs.python.org  Tue Jan 19 11:53:41 2021
From: report at bugs.python.org (William Schwartz)
Date: Tue, 19 Jan 2021 16:53:41 +0000
Subject: [issue42962] Windows: SystemError during os.kill(...,
 signal.CTRL_C_EVENT)
In-Reply-To: <1611007954.59.0.488720921329.issue42962@roundup.psfhosted.org>
Message-ID: <1611075221.16.0.866500498863.issue42962@roundup.psfhosted.org>


William Schwartz <wkschwartz at gmail.com> added the comment:

> Fixing the SystemError should be simple. Just clear an existing error if TerminateProcess() succeeds.

Should there be a `return NULL;` between these two lines? https://github.com/python/cpython/blob/e485be5b6bd5fde97d78f09e2e4cca7f363763c3/Modules/posixmodule.c#L7854-L7855

I'm not the best person to work on a patch for this.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42962>
_______________________________________

From report at bugs.python.org  Tue Jan 19 12:01:35 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 19 Jan 2021 17:01:35 +0000
Subject: [issue41701] Buildbot web page: connection lost after 1 minute,
 then display "Connection restored" popup
In-Reply-To: <1599128479.83.0.639934661132.issue41701@roundup.psfhosted.org>
Message-ID: <1611075695.24.0.123520432473.issue41701@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Ee:
> Apologies, I gisted a version that was from attempts to debug the timeouts. It's been updated.

Aaaah :-D No problem. Can you please try:

* replace "timeout client 30s" with "timeout client 1d"
* replace "timeout server 30s" with "timeout server 1d"

in buildbot-master server of the pillar config:

https://github.com/python/psf-salt/blob/d89e5ef2e86f45c1766c8b93d6e9621b0ab1bb09/pillar/base/haproxy.sls#L7-L11

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41701>
_______________________________________

From report at bugs.python.org  Tue Jan 19 12:02:42 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 19 Jan 2021 17:02:42 +0000
Subject: [issue41701] Buildbot web page: connection lost after 1 minute,
 then display "Connection restored" popup
In-Reply-To: <1599128479.83.0.639934661132.issue41701@roundup.psfhosted.org>
Message-ID: <1611075762.91.0.676015750559.issue41701@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> "timeout server 1d"

Hum. I'm not sure if "1d" syntax is accepted. Maybe use "3600s".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41701>
_______________________________________

From report at bugs.python.org  Tue Jan 19 12:07:10 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 19 Jan 2021 17:07:10 +0000
Subject: [issue42887] 100000 assignments of .__sizeof__ cause a segfault on del
In-Reply-To: <1610350684.08.0.491719857036.issue42887@roundup.psfhosted.org>
Message-ID: <1611076030.97.0.811733786523.issue42887@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42887>
_______________________________________

From report at bugs.python.org  Tue Jan 19 12:27:22 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 19 Jan 2021 17:27:22 +0000
Subject: [issue41713] _signal module leak: test_interpreters leaked [1424, 1422,
 1424] references
In-Reply-To: <1599213221.63.0.522110671593.issue41713@roundup.psfhosted.org>
Message-ID: <1611077242.7.0.245973658157.issue41713@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset e8e66eab941b983b6e85cd0d57cd45838880c568 by Victor Stinner in branch 'master':
bpo-41713: Remove PyOS_InitInterrupts() from python3dll.c (GH-24257)
https://github.com/python/cpython/commit/e8e66eab941b983b6e85cd0d57cd45838880c568


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41713>
_______________________________________

From report at bugs.python.org  Tue Jan 19 12:34:28 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 19 Jan 2021 17:34:28 +0000
Subject: [issue42035] [C API] PyType_GetSlot cannot get tp_name
In-Reply-To: <1602683525.08.0.938781399322.issue42035@roundup.psfhosted.org>
Message-ID: <1611077668.5.0.551754271581.issue42035@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

New C API functions must not return borrowed references, but strong references.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42035>
_______________________________________

From report at bugs.python.org  Tue Jan 19 12:36:42 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 19 Jan 2021 17:36:42 +0000
Subject: [issue42035] [C API] PyType_GetSlot cannot get tp_name
In-Reply-To: <1602683525.08.0.938781399322.issue42035@roundup.psfhosted.org>
Message-ID: <1611077802.9.0.123488181397.issue42035@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

A type has different names:

* short name: "name"
* qualified name: "module.name"

Which one should be returned by PyType_GetName()? Is there a warranty that it's always short or always qualified?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42035>
_______________________________________

From report at bugs.python.org  Tue Jan 19 12:52:49 2021
From: report at bugs.python.org (David Murphy)
Date: Tue, 19 Jan 2021 17:52:49 +0000
Subject: [issue42896] Solaris 11.4 crle output not handled correctly
In-Reply-To: <1610391317.65.0.0245738213738.issue42896@roundup.psfhosted.org>
Message-ID: <1611078769.36.0.667649033059.issue42896@roundup.psfhosted.org>


Change by David Murphy <damurphy at vmware.com>:


----------
pull_requests: +23080
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24226

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42896>
_______________________________________

From report at bugs.python.org  Tue Jan 19 13:24:16 2021
From: report at bugs.python.org (Daniel Grunwald)
Date: Tue, 19 Jan 2021 18:24:16 +0000
Subject: [issue42968] multiprocessing handle leak on Windows when child
 process is killed during startup/unpickling
Message-ID: <1611080656.89.0.981627513492.issue42968@roundup.psfhosted.org>


New submission from Daniel Grunwald <daniel at danielgrunwald.de>:

Running the attached script deadlocks.
Uncommenting the `time.sleep(1)` in the script makes the deadlock disappear.

For context: our application uses multiple child processes (multiprocessing.Process) and uses pipes (multiprocessing.Pipe) to communicate with them.
If one process fails with an error, the main process will kill all other child processes running concurrently.
We noticed that sometimes (non-deterministically), when an error occurs soon after startup, the main process ends up hanging.

We expect that when we pass the writing half of a connection to a child process and close the connection in the main process, that we will receive EOFError if the child process terminates unexpectedly.
But sometimes the EOFError never comes and our application hangs.

I've reduced the problem to the script attached. With the reduced script, the deadlock happens reliably for me.

I've debugged this a bit, and I think this is happening because passing a connection to the process being started involves reduce_pipe_connection() which creates a copy of the handle within the main process.
When the pickled data is unpickled in the child process, it uses DUPLICATE_CLOSE_SOURCE to close the copy in the main process.
But if the pickled data is never unpickled by the child process, the handle ends up being leaked.
Thus the main process itself holds the writing half of the connection open, causing the recv() call on the reading half to block forever.

----------
components: Windows
files: deadlock.py
messages: 385283
nosy: dgrunwald, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: multiprocessing handle leak on Windows when child process is killed during startup/unpickling
type: behavior
versions: Python 3.7, Python 3.8, Python 3.9
Added file: https://bugs.python.org/file49751/deadlock.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42968>
_______________________________________

From report at bugs.python.org  Tue Jan 19 13:27:07 2021
From: report at bugs.python.org (Daniel Grunwald)
Date: Tue, 19 Jan 2021 18:27:07 +0000
Subject: [issue42968] multiprocessing handle leak on Windows when child
 process is killed during startup/unpickling
In-Reply-To: <1611080656.89.0.981627513492.issue42968@roundup.psfhosted.org>
Message-ID: <1611080827.94.0.503905739481.issue42968@roundup.psfhosted.org>


Daniel Grunwald <daniel at danielgrunwald.de> added the comment:

Fix idea: get_spawning_popen().pid could be used to directly copy the handle into the child process, thus avoiding the temporary copy in the main process.
This would help at least in our case (where we pass all connections during startup).

I don't know if the general case is solvable -- in general we don't know which process will unpickle the data, and "child process is killed" isn't the only possible reason why the call to rebuild_pipe_connection() might not happen (e.g. exception while unpickling an earlier part of the same message).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42968>
_______________________________________

From report at bugs.python.org  Tue Jan 19 13:48:40 2021
From: report at bugs.python.org (simon mackenzie)
Date: Tue, 19 Jan 2021 18:48:40 +0000
Subject: [issue42957] os.readlink produces wrong result on windows
In-Reply-To: <1611005121.16.0.27754348191.issue42957@roundup.psfhosted.org>
Message-ID: <CAGG2XGfgfcQJWjd0BML-p14RBz1390UEtwvC7VC8DmWPSJ+bfQ@mail.gmail.com>


simon mackenzie <simonm3 at gmail.com> added the comment:

For most people the expectation would be that it returns a path in the same
format as any other path. Furthermore it seems odd to change the default
behaviour after years when it worked as expected. I never heard of this
substitute path before and it does not work in some circumstances e.g.
docker does not recognise it.

Note also that os.path.realpath(os.path.readlink("v1")) still returns
\\\\?\\d:\\v1. There needs to be some way of getting to the path that
everyone actually uses.

On Mon, 18 Jan 2021 at 21:25, Eryk Sun <report at bugs.python.org> wrote:

>
> Eryk Sun <eryksun at gmail.com> added the comment:
>
> Symlinks and mountpoints (aka junctions) contain two forms of the target
> path. There's a path that's intended for display in the shell, and there's
> the actual substitute path to which the link resolves. os.readlink() was
> changed to return the substitute path because the display form is not
> mandated by filesystem protocols (it's sometimes missing, especially for
> junctions) and not reliable (e.g. the display path may be a long path or
> contain reserved names such that it's not valid without the \\?\ prefix).
> It was decided to keep the C implementation of os.readlink() simple.
> Whether to retain the \\?\ prefix was shifted to high-level functions that
> consume the result of os.readlink(), such as os.path.realpath().
>
> There was a previous issue related to this, in that the shutil module
> copies symlinks via os.readlink() and os.symlink(), which thus copies only
> the substitute path now. The issue was closed as not a bug, but had it been
> resolved with new functionality, I would have preferred to do so with a
> low-level function to copy a reparse point, not by reverting the behavior
> of os.readlink(). I also see no reason against adding an option to
> readlink() to return the display path instead of the substitute path, or to
> just remove the prefix. But I'd vote against making it the default behavior.
>
> ----------
> components: +Library (Lib)
> nosy: +eryksun
> versions: +Python 3.10
>
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue42957>
> _______________________________________
>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42957>
_______________________________________

From report at bugs.python.org  Tue Jan 19 14:15:11 2021
From: report at bugs.python.org (simon mackenzie)
Date: Tue, 19 Jan 2021 19:15:11 +0000
Subject: [issue42957] os.readlink produces wrong result on windows
In-Reply-To: <CAGG2XGfgfcQJWjd0BML-p14RBz1390UEtwvC7VC8DmWPSJ+bfQ@mail.gmail.com>
Message-ID: <CAGG2XGckToGLkRjyMbLKmSKiFZTVLD3c7aOL_7zOgCdnt2pmDA@mail.gmail.com>


simon mackenzie <simonm3 at gmail.com> added the comment:

I note os.path.realpath("v1") does produce the right path in windows. Maybe
that is what you meant. Will that work cross-platform?

On Tue, 19 Jan 2021 at 18:48, simon mackenzie <simonm3 at gmail.com> wrote:

> For most people the expectation would be that it returns a path in the
> same format as any other path. Furthermore it seems odd to change the
> default behaviour after years when it worked as expected. I never heard of
> this substitute path before and it does not work in some circumstances e.g.
> docker does not recognise it.
>
> Note also that os.path.realpath(os.path.readlink("v1")) still returns
> \\\\?\\d:\\v1. There needs to be some way of getting to the path that
> everyone actually uses.
>
> On Mon, 18 Jan 2021 at 21:25, Eryk Sun <report at bugs.python.org> wrote:
>
>>
>> Eryk Sun <eryksun at gmail.com> added the comment:
>>
>> Symlinks and mountpoints (aka junctions) contain two forms of the target
>> path. There's a path that's intended for display in the shell, and there's
>> the actual substitute path to which the link resolves. os.readlink() was
>> changed to return the substitute path because the display form is not
>> mandated by filesystem protocols (it's sometimes missing, especially for
>> junctions) and not reliable (e.g. the display path may be a long path or
>> contain reserved names such that it's not valid without the \\?\ prefix).
>> It was decided to keep the C implementation of os.readlink() simple.
>> Whether to retain the \\?\ prefix was shifted to high-level functions that
>> consume the result of os.readlink(), such as os.path.realpath().
>>
>> There was a previous issue related to this, in that the shutil module
>> copies symlinks via os.readlink() and os.symlink(), which thus copies only
>> the substitute path now. The issue was closed as not a bug, but had it been
>> resolved with new functionality, I would have preferred to do so with a
>> low-level function to copy a reparse point, not by reverting the behavior
>> of os.readlink(). I also see no reason against adding an option to
>> readlink() to return the display path instead of the substitute path, or to
>> just remove the prefix. But I'd vote against making it the default behavior.
>>
>> ----------
>> components: +Library (Lib)
>> nosy: +eryksun
>> versions: +Python 3.10
>>
>> _______________________________________
>> Python tracker <report at bugs.python.org>
>> <https://bugs.python.org/issue42957>
>> _______________________________________
>>
>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42957>
_______________________________________

From report at bugs.python.org  Tue Jan 19 14:35:46 2021
From: report at bugs.python.org (Gregory P. Smith)
Date: Tue, 19 Jan 2021 19:35:46 +0000
Subject: [issue42969] pthread_exit & PyThread_exit_thread are harmful
Message-ID: <1611084946.55.0.234619663171.issue42969@roundup.psfhosted.org>


New submission from Gregory P. Smith <greg at krypto.org>:

## BACKGROUND

`PyThread_exit_thread()` calls `pthread_exit(`) and is in turn called from a variety of APIs as documented in the C-API doc update from https://bugs.python.org/issue36427.

The `pthread_exit()` call was originally introduced as a way "resolve" a crashes from daemon threads during shutdown https://bugs.python.org/issue1856.  It did that.  That fix to that even landed in 2.7.8 but was rolled back before 2.7.9 due to a bug in an existing application it exposed at the time (did we miss the implications of that? maybe).  It remained in 3.x.

## PROBLEM

`pthread_exit()` cannot be used blindly by any application.  All code in the threaded application needs to be on board with it and always prepared for any API call they make to potentially lead to thread termination.  Quoting a colleague: "pthread_exit() does not result in stack unwind or local variable destruction".  This means that any code up the stack from the ultimate `pthread_exit()` call that has process-wide state implications that did not go out of its way to register cleanup with `pthread_cleanup_push()` could lead to deadlocks or lost resources. Something implausible to assume that code does.

We're seeing this happen with C/C++ code.  Our C++ builds with `-fno-exceptions` so uncatchable exception based stack unwinding as some pthread_exit implementations may trigger does not happen (and cannot be guaranteed anyways, see bpo-42888).  Said C/C++ code is calling back into Python from a thread and thus must use `PyEval_RestoreThread()` or similar APIs before performing Python C API calls.  If the interpreter is being finalized from another thread... these enter a codepath that ultimately calls `pthread_exit()` leaving corrupt state in the process.  In this case that unexpected thread simply disappearing can lead to a deadlock in our process.

Fundamentally I do not believe the CPython VM should ever call `pthread_exit()` when non-CPython frames are anywhere in the C stack.  This may mean we should never call `pthread_exit()` at all (unsure; but it'd be ideal).

The documentation suggests that all callers in user code of the four C-APIs with the documented `pthread_exit()` caveats need auditing and pre-call `_Py_IsFinalizing()` API checks.  But... I do not believe that would fix anything even if it were done.  `_Py_IsFinalizing()` called without the GIL held means that it could change by the time the `PyEval_RestoreThreads()` API calls it internally do determine if it should exit the thread.  Thus the race condition window would merely be narrowed, not eliminated.  Not good enough.

## CURRENT WORKAROUND (Big Hammer)

Change CPython to call abort() instead of pthread_exit() as that situation is unresolvable and the process dying is better than hanging, partially alive.  That solution isn't friendly, but is better than being silent and allowing deadlock.  A failing process is always better than a hung process, especially a partially hung process.

## SEMI RELATED WORK

https://bugs.python.org/issue42888 - appears to be avoiding some `PyThread_exit_thread()` calls to stop some crashes due to `libgcc_s` being loaded on demand upon thread exit.

----------
components: Interpreter Core
keywords: 3.2regression
messages: 385288
nosy: gregory.p.smith
priority: normal
severity: normal
status: open
title: pthread_exit & PyThread_exit_thread are harmful
type: behavior
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42969>
_______________________________________

From report at bugs.python.org  Tue Jan 19 14:58:22 2021
From: report at bugs.python.org (Gregory P. Smith)
Date: Tue, 19 Jan 2021 19:58:22 +0000
Subject: [issue42969] pthread_exit & PyThread_exit_thread are harmful
In-Reply-To: <1611084946.55.0.234619663171.issue42969@roundup.psfhosted.org>
Message-ID: <1611086302.06.0.876579939033.issue42969@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

C-APIs such as `PyEval_RestoreThreads()` are insufficient for the task they are asked to do.  They return void, yet have a failure mode.

They call pthread_exit() on failure today.

Instead, they need to return an error to the calling application to indicate that "The Python runtime is no longer available."

Callers need to act on that in whatever way is most appropriate to them.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42969>
_______________________________________

From report at bugs.python.org  Tue Jan 19 14:58:51 2021
From: report at bugs.python.org (Gregory P. Smith)
Date: Tue, 19 Jan 2021 19:58:51 +0000
Subject: [issue42969] pthread_exit & PyThread_exit_thread from
 PyEval_RestoreThread etc. are harmful
In-Reply-To: <1611084946.55.0.234619663171.issue42969@roundup.psfhosted.org>
Message-ID: <1611086331.63.0.919530638683.issue42969@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
title: pthread_exit & PyThread_exit_thread are harmful -> pthread_exit & PyThread_exit_thread from PyEval_RestoreThread etc. are harmful

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42969>
_______________________________________

From report at bugs.python.org  Tue Jan 19 15:26:21 2021
From: report at bugs.python.org (Doug Day)
Date: Tue, 19 Jan 2021 20:26:21 +0000
Subject: [issue42970] File path with blank causes open error in 3.8, not in 3.7
Message-ID: <1611087981.59.0.713366355851.issue42970@roundup.psfhosted.org>


New submission from Doug Day <dgday6 at gmail.com>:

The following code generates a path that works in Pythons 3.7.6 on macOS Big Sur but not in Catalina  with 3.8.2.. 
mySrcFldr="~/Library/Mobile Documents/com~apple~CloudDocs/Utilities/"
srcFldr=os.path.expanduser(mySrcFldr)
f=os.path.join(srcFldr,"mortgage.py")

When python tries to run the code file(montage.py) on 3.8.2, an open error results.
/Library/Developer/CommandLineTools/usr/bin/python3: can't open file '/Users/Doug/Library/Mobile': [Errno 2] No such file or directory
 I tried putting a backslash after 'Mobile'. Does not help.
The complete path is:
'/Users/Doug/Library/Mobile Documents/com~apple~CloudDocs/Utilities/mortgage.py'

While the doc changes show some changes in the os.path module, I see no mention of this issue.

----------
components: Interpreter Core
messages: 385290
nosy: dday52
priority: normal
severity: normal
status: open
title: File path with blank causes open error in 3.8, not in 3.7
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42970>
_______________________________________

From report at bugs.python.org  Tue Jan 19 15:38:35 2021
From: report at bugs.python.org (Eryk Sun)
Date: Tue, 19 Jan 2021 20:38:35 +0000
Subject: [issue42962] Windows: SystemError during os.kill(...,
 signal.CTRL_C_EVENT)
In-Reply-To: <1611007954.59.0.488720921329.issue42962@roundup.psfhosted.org>
Message-ID: <1611088715.62.0.57153730216.issue42962@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> Should there be a `return NULL;` between these two lines?

In 3.x, os.kill() has always fallen back on TerminateProcess() when GenerateConsoleCtrlEvent() fails, and I assumed that was intentional. But I misunderstood that it's not actually chaining the exception via PyErr_Fetch and _PyErr_ChainExceptions, so it still fails with a SystemError when both GenerateConsoleCtrlEvent() and TerminateProcess() fail -- e.g. os.kill(4, 1). 

I checked the history for bpo-1220212. It appears that win32_kill() was committed to the 2.x branch first with a missing return statement, which was fixed a day later:

https://github.com/python/cpython/commit/ae509520de5a0321f58c79afffad10ae59dae8b9

A few days later it was ported to 3.x without that fix:

https://github.com/python/cpython/commit/eb24d7498f3e34586fee24209f5630a58bb1a04b

If Steve Dower or Victor Stinner is okay with changing the behavior to agree with 2.x -- after more than a decade -- then I say just add the missing return statement. In that case, if os.kill() is called with a sig value of CTRL_C_EVENT (0) or CTRL_BREAK_EVENT (1), then it will only try GenerateConsoleCtrlEvent() and no longer fall back on TerminateProcess(). 

That said, it's common to call TerminateProcess() with an exit status of 1. Maybe the enum values of signal.CTRL_C_EVENT and signal.CTRL_BREAK_EVENT can be checked by identity instead of checking the integer value. That way os.kill(pid, 1) can still be used to forcefully terminate an arbitrary process with an exit status of 1.

---

To reiterate previous comments, the sig values of signal.CTRL_C_EVENT and signal.CTRL_BREAK_EVENT are not supported for an individual, arbitrary process. To use them, the pid value must be a process group ID, such as the pid of a process created with the flag CREATE_NEW_PROCESS_GROUP, and the process must be in the same console session as the current process. Anything else either fails (assuming no fallback on TerminateProcess) or invokes buggy behavior in the console, which can even leave the console in a broken state.

For a new process group, the cancel event is initially ignored, but the break event is always handled. To enable the cancel event, the process must call SetConsoleCtrlHandler(NULL, FALSE), such as via ctypes with kernel32.SetConsoleCtrlHandler(None, False). I think the signal module should provide a function to enable/disable Ctrl+C handling without ctypes, and implicitly enable it when setting a new SIGINT handler.

---
Hypothetical la la land...

I wish os.kill() in Windows had been implemented to conform with Unix kill(), and that CTRL_C_EVENT and CTRL_BREAK_EVENT were not added since they are not signals. Route negative pid values to the process-group branch that calls GenerateConsoleCtrlEvent(), and special case pid -1 to send the event to all accessible processes in the console session. Support SIGINT and SIGBREAK sig values in this case, respectively mapped to the console's cancel and break events. Don't support pid 0 in Windows, since there's no documented function to get the process group ID of the current process. Route positive pid values to the TerminateProcess() branch. Special case the sig value 0 to test for existence and access via OpenProcess(). Also, the latter should only request PROCESS_TERMINATE access, not PROCESS_ALL_ACCESS. It's common to have terminate access but not all access, e.g. to an elevated process in the current desktop session.

----------
components: +Library (Lib) -Extension Modules

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42962>
_______________________________________

From report at bugs.python.org  Tue Jan 19 15:41:43 2021
From: report at bugs.python.org (Steve Arnold)
Date: Tue, 19 Jan 2021 20:41:43 +0000
Subject: [issue36344] install_certificates.command too complicated
In-Reply-To: <1552911860.35.0.715970160231.issue36344@roundup.psfhosted.org>
Message-ID: <1611088903.64.0.51168399509.issue36344@roundup.psfhosted.org>


Steve Arnold <nerdboy at gentoo.org> added the comment:

I can't seem to find a usable answer for a user on Sierra with a (supposedly) working python 3.6 install.  From what I can tell all the related bugs are closed except this one, and this one doesn't include python 3.6.  Running the install_certificates.command does not work in his case and double-clicking results in a permissions error.  I suspect the target system is not in the best shape, but I haven't touched a Mac since the powerpc days.

What exactly is the backport status for this issue, and is there anything with more info for this user?

----------
nosy: +sarnold

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36344>
_______________________________________

From report at bugs.python.org  Tue Jan 19 15:56:36 2021
From: report at bugs.python.org (Enji Cooper)
Date: Tue, 19 Jan 2021 20:56:36 +0000
Subject: [issue42971] Some errnos for BSD/OSX are missing from errno module
Message-ID: <1611089796.05.0.463787343348.issue42971@roundup.psfhosted.org>


New submission from Enji Cooper <yaneurabeya at gmail.com>:

Some errnos for BSD/OSX are currently not supported by the errno module. It would be helpful for these to be exposed to the end-user so they could programmatically use them instead of reinventing the wheel in a separate module/C extension, or hardcoding the information in consuming pieces of code.

----------
components: Extension Modules
messages: 385293
nosy: ngie
priority: normal
severity: normal
status: open
title: Some errnos for BSD/OSX are missing from errno module
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42971>
_______________________________________

From report at bugs.python.org  Tue Jan 19 16:07:03 2021
From: report at bugs.python.org (Ned Deily)
Date: Tue, 19 Jan 2021 21:07:03 +0000
Subject: [issue36344] install_certificates.command too complicated
In-Reply-To: <1552911860.35.0.715970160231.issue36344@roundup.psfhosted.org>
Message-ID: <1611090423.44.0.943502586933.issue36344@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

> What exactly is the backport status for this issue, and is there anything with more info for this user?

Python 3.6 has been in the security-fix-only phase of its life cycle since 2018-12 which means that python.org binary installers for Mac or Windows platforms have not been produced since then. If at all possible, your user should upgrade to a fully-supported version, currently either Python 3.9.1 or 3.8.7 (https://www.python.org/downloads/). That said, the last python.org macOS installers for 3.6, 3.6.8, still work for me on the most recent macOS Sierra update (10.12.6) including the "Install Certificates Command".  Make sure the user has admin privileges or that "Install Certificates Commnad" is run under a user that does have admin privs. If it still fails, you could try downloading and re-installing Python 3.6.8 or give more information about exactly what error is being seen.  But this sort of problem is really off-topic for this issue; better to ask in a help forum.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36344>
_______________________________________

From report at bugs.python.org  Tue Jan 19 16:07:19 2021
From: report at bugs.python.org (Enji Cooper)
Date: Tue, 19 Jan 2021 21:07:19 +0000
Subject: [issue42971] Some errnos for BSD/OSX are missing from errno module
In-Reply-To: <1611089796.05.0.463787343348.issue42971@roundup.psfhosted.org>
Message-ID: <1611090439.11.0.248050115348.issue42971@roundup.psfhosted.org>


Enji Cooper <yaneurabeya at gmail.com> added the comment:

Some items that I've noted so far that are missing:

- ENOATTR (BSD/OSX)
- ENOLINK (BSD; is reserved on OSX)
- ENOTSUP (NetBSD, OpenBSD, OSX)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42971>
_______________________________________

From report at bugs.python.org  Tue Jan 19 16:10:22 2021
From: report at bugs.python.org (William Schwartz)
Date: Tue, 19 Jan 2021 21:10:22 +0000
Subject: [issue42962] Windows: SystemError during os.kill(...,
 signal.CTRL_C_EVENT)
In-Reply-To: <1611007954.59.0.488720921329.issue42962@roundup.psfhosted.org>
Message-ID: <1611090622.13.0.00610089898522.issue42962@roundup.psfhosted.org>


William Schwartz <wkschwartz at gmail.com> added the comment:

>For a new process group, the cancel event is initially ignored, but the break event is always handled. To enable the cancel event, the process must call SetConsoleCtrlHandler(NULL, FALSE), such as via ctypes with kernel32.SetConsoleCtrlHandler(None, False). I think the signal module should provide a function to enable/disable Ctrl+C handling without ctypes, and implicitly enable it when setting a new SIGINT handler.

That's what Lib/test/win_console_handler.py:39 does. What I don't understand is why that's necessary. Isn't that what PyConfig.install_signal_handlers is supposed to do?

Which brings me to how I ended up here in the first place: I wanted to write a test that PyConfig.install_signal_handlers is set in an embedded instance of Python I'm working with. In outline, the following test works on both Windows and macOS *except on Windows running under Tox*.

@unittest.removeHandler
def test_signal_handlers_installed(self):
    SIG = signal.SIGINT
    if sys.platform == 'win32':
        SIG = signal.CTRL_C_EVENT
    with self.assertRaises(KeyboardInterrupt):
        os.kill(os.getpid(), SIG)
        if sys.platform == 'win32':
            time.sleep(.1)  # Give handler's thread time to join

Using SetConsoleCtrlHandler if I detect that I'm running on Windows under Tox would, if I understand correctly, hide whether PyConfig.install_signal_handlers was set before the Python I'm running in started, right? (I know this isn't the right venue for discussing my embedding/testing problem. But maybe the use case informs the pending discussion of what to do about os.kill's semantics.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42962>
_______________________________________

From report at bugs.python.org  Tue Jan 19 16:45:40 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 19 Jan 2021 21:45:40 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611092740.41.0.1111739839.issue42955@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +23082
pull_request: https://github.com/python/cpython/pull/24258

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Tue Jan 19 16:54:26 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 19 Jan 2021 21:54:26 +0000
Subject: [issue42972] [C API] Heap types (PyType_FromSpec) must fully
 implement the GC protocol
Message-ID: <1611093266.11.0.721387186389.issue42972@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at python.org>:

Copy of my email sent to python-dev:
https://mail.python.org/archives/list/python-dev at python.org/thread/C4ILXGPKBJQYUN5YDMTJOEOX7RHOD4S3/

Hi,

In the Python stdlib, many heap types currently don't "properly"
(fully?) implement the GC protocol which can prevent to destroy these
types at Python exit. As a side effect, some other Python objects can
also remain alive, and so are not destroyed neither.

There is an on-going effect to destroy all Python objects at exit
(bpo-1635741). This problem is getting worse when subinterpreters are
involved: Refleaks buildbots failures which prevent to spot other
regressions, and so these "leaks" / "GC bugs" must be fixed as soon as
possible. In my experience, many leaks spotted by tests using
subinterpreters were quite old, it's just that they were ignored
previously.

It's an hard problem and I don't see any simple/obvious solution right
now, except of workarounds that I dislike. Maybe the only good
solution is to fix all heap types, one by one.

== Only the Python stdlib should be affected ==

PyType_FromSpec() was added to Python 3.2 by the PEP 384 to define
"heap types" in C, but I'm not sure if it's popular in practice (ex:
Cython doesn't use it, but defines static types). I expect that most
types to still be defined the old style (static types) in a vas
majority of third party extension modules.

To be clear, static types are not affected by this email.

Third party extension modules using the limited C API (to use the
stable ABI) and PyType_FromSpec() can be affected (if they don't fully
implement the GC protocol).

== Heap type instances now stores a strong reference to their type ==

In March 2019, the PyObject_Init() function was modified in bpo-35810
to keep a strong reference (INCREF) to the type if the type is a heap
type. The fixed problem was that heap types could be destroyed before
the last instance is destroyed.

== GC and heap types ==

The new problem is that most heap types don't collaborate well with
the garbage collector. The garbage collector doesn't know anything
about Python objects, types, reference counting or anything. It only
uses the PyGC_Head header and the traverse functions. If an object
holds a strong reference to an object but its type does not define a
traverse function, the GC cannot guess/infer this reference.

A heap type must respect the following 3 conditions to collaborate with the GC:

    Have the Py_TPFLAGS_HAVE_GC flag;
    Define a traverse function (tp_traverse) which visits the type: Py_VISIT(Py_TYPE(self));
    Instances must be tracked by the GC.

If one of these conditions is not met, the GC can fail to destroy a
type during a GC collection. If an instance is kept alive late while a
Python interpreter is being deleted, it's possible that the type is
never deleted, which can keep indirectly many objects alive and so
don't delete them neither.

In practice, when a type is not deleted, a test using subinterpreter
starts to fail on Refleaks buildbot since it leaks references. Without
subinterpreters, such leak is simply ignored, whereas this is an
on-going effect to delete Python objects at exit (bpo-1635741).

== Boring traverse functions ==

Currently, there is no default traverse implementation which visits the type.

For example, I had the implement the following function for _thread.LockType:

static int
lock_traverse(lockobject self, visitproc visit, void arg)
{
    Py_VISIT(Py_TYPE(self));
    return 0;
}

It's a little bit annoying to have to implement the GC protocol
whereas a lock cannot contain other Python objects, it's not a
container. It's just a thin wrapper to a C lock.

There is exactly one strong reference: to the type.

== Workaround: loop on gc.collect() ==

A workaround is to run gc.collect() in a loop until it returns 0 (no
object was collected).

== Traverse automatically? Nope. ==

Pablo Galindo attempts to automatically visit the type in the traverse function:

https://bugs.python.org/issue40217
https://github.com/python/cpython/commit/0169d3003be3d072751dd14a5c84748ab63...

Moreover, What's New in Python 3.9 contains a long section suggesting
to implement a traverse function for this problem, but it doesn't
suggest to track instances:
https://docs.python.org/dev/whatsnew/3.9.html#changes-in-the-c-api

This solution causes too many troubles, and so instead, traverse
functions were defined on heap types to visit the type.

Currently in the master branch, 89 types are defined as heap types on
a total of 206 types (117 types are defined statically). I don't think
that these 89 heap types respect the 3 conditions to collaborate with
the GC.

== How should we address this issue? ==

I'm not sure what should be done. Working around the issue by
triggering multiple GC collections? Emit a warning in development mode
if a heap type doesn't collaborate well with the GC?

If core developers miss these bugs and have troubles to debug them, I
expect that extension module authors would suffer even more.

== GC+heap type bugs became common  ==

I'm fixing such GC issue for 1 year as part as the work on cleaning
Python objects at exit, and also indirectly related to
subinterpreters. The behavior is surprising, it's really hard to dig
into GC internals and understand what's going on. I wrote an article
on this kind of "GC bugs":
https://vstinner.github.io/subinterpreter-leaks.html

Today, I learnt the hard way that defining a traverse is not enough.
The type constructor (tp_new) must also track instances! See my fix
for _multibytecodec related to CJK codecs:

https://github.com/python/cpython/commit/11ef53aefbecfac18b63cee518a7184f771...
https://bugs.python.org/issue42866

== Reference cycles are common ==

The GC only serves to break reference cycles. But reference cycles are
rare, right? Well...

First of all, most types create reference cycles involing themselves.
For example, a type __mro__ tuple contains the type which already
creates a ref cycle. Type methods can also contain a reference to the
type.

=> The GC must break the cycle, otherwise the type cannot be destroyed

When a function is defined in a Python module, the function
__globals__ is the module namespace (module.__dict__) which...
contains the function. Defining a function in a Python module also
creates a reference cycle which prevents to delete the module
namespace.

If a function is used as a callback somewhere, the whole module
remains "alive" until the reference to the callback is cleared.
Example. os.register_at_fork() and codecs.register() callbacks are
cleared really late during Python finalization. Currently, it's
basically the last objects which are cleared at Python exit. After
that, there is exactly one final GC collection.

=> The GC

== Debug GC issues ==

    gc.get_referents() and gc.get_referrers() can be used to check traverse functions.
    gc.is_tracked() can be used to check if the GC tracks an object.
    Using the gdb debugger on gc_collect_main() helps to see which objects are collected. See for example the finalize_garbage() functions which calls finalizers on unreachable objects.
    The solution is usually a missing traverse functions or a missing Py_VISIT() in an existing traverse function.

== __del__ hack for debugging ==

If you want to play with the issue or if you have to debug a GC issue,
you can use an object which logs a message when it's being deleted:

class VerboseDel:
    def __del__(self):
        print("DELETE OBJECT")
obj = VerboseDel()

Warning: creating such object in a module also prevents to destroy the
module namespace when the last reference to the module is deleted!
__del__.__globals__ contains a reference to the module namespace, and
obj.__class__ contains a reference to the type... Yeah, ref cycle and
GC issues are fun!

== Long email ==

Yeah, I like to put titles in my long emails. Enjoy. Happy hacking!
Victor

--
Night gathers, and now my watch begins. It shall not end until my death

----------
components: C API
messages: 385297
nosy: vstinner
priority: normal
severity: normal
status: open
title: [C API] Heap types (PyType_FromSpec) must fully implement the GC protocol
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42972>
_______________________________________

From report at bugs.python.org  Tue Jan 19 16:55:23 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 19 Jan 2021 21:55:23 +0000
Subject: [issue41036] Visit the type of instance of heap types if tp_traverse
 is not implemented
In-Reply-To: <1592575501.27.0.818244173351.issue41036@roundup.psfhosted.org>
Message-ID: <1611093323.04.0.697250346039.issue41036@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I created bpo-42972 instead.

----------
resolution:  -> duplicate
stage: patch review -> resolved
status: open -> closed
superseder:  -> [C API] Heap types (PyType_FromSpec) must fully implement the GC protocol

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41036>
_______________________________________

From report at bugs.python.org  Tue Jan 19 16:56:39 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 19 Jan 2021 21:56:39 +0000
Subject: [issue42972] [C API] Heap types (PyType_FromSpec) must fully
 implement the GC protocol
In-Reply-To: <1611093266.11.0.721387186389.issue42972@roundup.psfhosted.org>
Message-ID: <1611093399.4.0.845878263169.issue42972@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

In June 2020, I create PR 20983 to attempt to automatically traverse the type:
"Provide a default tp_traverse implementation for the base object
type for heap types which have no tp_traverse function. The
traverse function visits the type if the type is a heap type."

I abandoned my PR.

I marked bpo-41036 as a duplicate of this issue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42972>
_______________________________________

From report at bugs.python.org  Tue Jan 19 17:04:57 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 19 Jan 2021 22:04:57 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611093897.94.0.0408792699192.issue42955@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset cad8020cb83ec6d904f874c0e4f599e651022196 by Victor Stinner in branch 'master':
bpo-42955: Add Python/module_names.h (GH-24258)
https://github.com/python/cpython/commit/cad8020cb83ec6d904f874c0e4f599e651022196


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Tue Jan 19 17:20:40 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 19 Jan 2021 22:20:40 +0000
Subject: [issue42971] Some errnos for BSD/OSX are missing from errno module
In-Reply-To: <1611089796.05.0.463787343348.issue42971@roundup.psfhosted.org>
Message-ID: <1611094840.13.0.788945299541.issue42971@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
nosy: +ned.deily, ronaldoussoren

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42971>
_______________________________________

From report at bugs.python.org  Tue Jan 19 17:21:34 2021
From: report at bugs.python.org (Tadek Kijkowski)
Date: Tue, 19 Jan 2021 22:21:34 +0000
Subject: [issue42973] argparse: mixing optional and positional arguments...
 not again
Message-ID: <1611094894.69.0.476759327253.issue42973@roundup.psfhosted.org>


New submission from Tadek Kijkowski <tkijkowski at gmail.com>:

I have following use case for argparse:

./prog --tracks=80 image1 --tracks=40 image2 --tracks=80 image3 ...

I expected that the following parser would be able process that command line:

parser = argparse.ArgumentParser()
add = parser.add_argument
add('--tracks', choices=['40', '80'])
add('image', nargs='*', action=_CustomAction)
parser.parse_args()

But it stops with 'unrecognized arguments: image2' error. It turns out that there is no way to prepare parser which could handle this command line.

There was a long discussion about this issue in #14191. There were two approaches proposed:
- Allow 'image' action to trigger multiple times with additional encountered parameters.
- Parse all optionals first and all positionals in second pass.

The first approach was represented by a patch by user guilherme-pg. This patch was slightly criticized (undeservedly IMO) and pretty much ignored.

The discussion then focused on the second approach which ended up with introduction of `parse_intermixed_args` into codebase.

The problem with `parse_intermixed_args` is that it defeats the purpose of having intermixed arguments. When the arguments are effectively reordered, there is no way to match "optionals" with "positionals" with they relate to.

In my option the Guilherme's approach was the correct way to go, I would say it was elegant. The only complaint against that patch is that it unnecessarily modified _StoreAction class - instead of that, the way to go is to use "extend" or custom action.

I allowed myself to simplify the changes a bit for readability. The patch doesn't change default functionality, for the cost of changing public API by adding new argument to ArgumentParser constructor.

With the changes applied, I can parse my command line with this code:

parser = argparse.ArgumentParser(greedy_star=True)
add = parser.add_argument
add('--tracks', choices=['40', '80'])
add('image', nargs='*', action=_CustomAction)
parser.parse_args()

----------
components: Library (Lib)
messages: 385301
nosy: monkeyman79
priority: normal
severity: normal
status: open
title: argparse: mixing optional and positional arguments... not again
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42973>
_______________________________________

From report at bugs.python.org  Tue Jan 19 17:24:32 2021
From: report at bugs.python.org (Doug Day)
Date: Tue, 19 Jan 2021 22:24:32 +0000
Subject: [issue42970] File path with blank causes open error in 3.8, not in 3.7
In-Reply-To: <1611087981.59.0.713366355851.issue42970@roundup.psfhosted.org>
Message-ID: <1611095072.79.0.0170053325545.issue42970@roundup.psfhosted.org>


Doug Day <dgday6 at gmail.com> added the comment:

To clarify: either python version generates the same path. On 3.8.2 though an open error results

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42970>
_______________________________________

From report at bugs.python.org  Tue Jan 19 17:28:47 2021
From: report at bugs.python.org (Tadek Kijkowski)
Date: Tue, 19 Jan 2021 22:28:47 +0000
Subject: [issue14191] argparse doesn't allow optionals within positionals
In-Reply-To: <1330843053.88.0.983162018395.issue14191@psf.upfronthosting.co.za>
Message-ID: <1611095327.3.0.306205250364.issue14191@roundup.psfhosted.org>


Change by Tadek Kijkowski <tkijkowski at gmail.com>:


----------
nosy: +monkeyman79
nosy_count: 9.0 -> 10.0
pull_requests: +23084
pull_request: https://github.com/python/cpython/pull/24259

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue14191>
_______________________________________

From report at bugs.python.org  Tue Jan 19 17:28:47 2021
From: report at bugs.python.org (Tadek Kijkowski)
Date: Tue, 19 Jan 2021 22:28:47 +0000
Subject: [issue42973] argparse: mixing optional and positional arguments...
 not again
In-Reply-To: <1611094894.69.0.476759327253.issue42973@roundup.psfhosted.org>
Message-ID: <1611095327.23.0.908862851638.issue42973@roundup.psfhosted.org>


Change by Tadek Kijkowski <tkijkowski at gmail.com>:


----------
keywords: +patch
pull_requests: +23083
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24259

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42973>
_______________________________________

From report at bugs.python.org  Tue Jan 19 17:35:34 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 19 Jan 2021 22:35:34 +0000
Subject: [issue42923] Py_FatalError(): dump the list of extension modules
In-Reply-To: <1610535013.1.0.942204365805.issue42923@roundup.psfhosted.org>
Message-ID: <1611095734.78.0.587466133002.issue42923@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 66f77caca39ba39ebe1e4a95dba6d19b20d51951 by Victor Stinner in branch 'master':
bpo-42923: _Py_DumpExtensionModules() ignores stdlib ext (GH-24254)
https://github.com/python/cpython/commit/66f77caca39ba39ebe1e4a95dba6d19b20d51951


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42923>
_______________________________________

From report at bugs.python.org  Tue Jan 19 17:36:24 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 19 Jan 2021 22:36:24 +0000
Subject: [issue42923] Py_FatalError(): dump the list of extension modules
In-Reply-To: <1610535013.1.0.942204365805.issue42923@roundup.psfhosted.org>
Message-ID: <1611095784.75.0.0163139986496.issue42923@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42923>
_______________________________________

From report at bugs.python.org  Tue Jan 19 17:40:57 2021
From: report at bugs.python.org (Josh Rosenberg)
Date: Tue, 19 Jan 2021 22:40:57 +0000
Subject: [issue42958] filecmp.cmp(shallow=True) isn't actually shallow when
 only mtime differs
In-Reply-To: <1611001488.57.0.420421194337.issue42958@roundup.psfhosted.org>
Message-ID: <1611096057.05.0.993257789031.issue42958@roundup.psfhosted.org>


Josh Rosenberg <shadowranger+python at gmail.com> added the comment:

This is a problem with the docstring. The actual docs for it are a bit more clear, https://docs.python.org/3/library/filecmp.html#filecmp.cmp :

"If shallow is true, files with identical os.stat() signatures are taken to be equal. Otherwise, the contents of the files are compared."

Your patch can't be used because it changes longstanding documented behavior. If you'd like to submit a patch to fix the docstring, that's fine, but we're not going to break existing code to make the function less accurate.

The patch should probably make the documentation more clear while it's at it.

1. The original wording could be misinterpreted as having the "Otherwise" apply to shallow=False only, not to the case where shallow=T rue but os.stat doesn't match.
2. The existing wording isn't clear on what an os.stat() "signature" is, which can leave the impression that the entirety of os.stat is compared (which would only match for hardlinks of the same file), when in fact it's just the file type (stat.S_IFMT(st.st_mode), file vs. directory vs. symlink, etc.), size and mtime.

Proposed rewording of main docs would be:

"If shallow is true, files with identical os.stat() signatures (file type, size, and modification time) are taken to be equal. When shallow is false, or the file signatures are identical, the contents of the files are compared."

A similar wording (or at least, a shorter version of the above, rather than a strictly wrong description of the shallow parameter) could be applied to the docstring.

----------
nosy: +josh.r

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42958>
_______________________________________

From report at bugs.python.org  Tue Jan 19 17:50:17 2021
From: report at bugs.python.org (Eryk Sun)
Date: Tue, 19 Jan 2021 22:50:17 +0000
Subject: [issue42962] Windows: SystemError during os.kill(...,
 signal.CTRL_C_EVENT)
In-Reply-To: <1611007954.59.0.488720921329.issue42962@roundup.psfhosted.org>
Message-ID: <1611096617.38.0.909218259637.issue42962@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> That's what Lib/test/win_console_handler.py:39 does. 

No, that script is currently broken.

SetConsoleCtrlHandler(None, False) clears the Ctrl+C ignore flag in the PEB ProcessParameters, which is normally inherited by child processes. But using the CREATE_NEW_PROCESS_GROUP creation flag always causes Ctrl+C to be initially ignored in the process. The intent is to make it a 'background' process by default, to support CMD's `start /b` option.

Win32KillTests in Lib/test/test_os.py incorrectly assumes it only has to enable Ctrl+C in the parent process. win_console_handler.py incorrectly assumes it does not have to call SetConsoleCtrlHandler(None, False). This is why test_CTRL_C_EVENT() is currently being skipped. To fix it, win_console_handler.py needs to call SetConsoleCtrlHandler(None, False).

> Isn't that what PyConfig.install_signal_handlers is supposed to do?

The C runtime's signal() function does not clear the Ctrl+C ignore flag when a SIGINT handler is set. I think Python should. It's expected behavior for POSIX compatibility.

>    with self.assertRaises(KeyboardInterrupt):
>        os.kill(os.getpid(), SIG)

Unless you know the current process was created in a new process group, it is not correct to call os.kill(os.getpid(), signal.CTRL_C_EVENT). You'd be better off using os.kill(0, signal.CTRL_C_EVENT) and ensuring that Ctrl+C is temporarily ignored in the parent process, if that's in your control. Also, Python 3.8 added raise_signal(), which calls C raise(), so a more reliable way to test just the signal handler is to call signal.raise_signal(signal.SIGINT). This also eliminates needing to synchronize with the console control thread.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42962>
_______________________________________

From report at bugs.python.org  Tue Jan 19 17:55:01 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 19 Jan 2021 22:55:01 +0000
Subject: [issue42923] Py_FatalError(): dump the list of extension modules
In-Reply-To: <1610535013.1.0.942204365805.issue42923@roundup.psfhosted.org>
Message-ID: <1611096901.74.0.847426663154.issue42923@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

More "real world" example using cinder which imports 220 modules (ctypes is used to simulate a crash):
---------------
$ ./python -m venv env
$ env/bin/python -m pip install wheel
$ env/bin/python -m pip install cinder
$ env/bin/python -X dev -c 'import cinder, ctypes, sys; print(f"{len(sys.modules)=}"); print(); ctypes.string_at(0)'
(...)
len(sys.modules)=220

Fatal Python error: Segmentation fault

Current thread 0x00007fc4a88e0740 (most recent call first):
  File "/home/vstinner/python/master/Lib/ctypes/__init__.py", line 517 in string_at
  File "<string>", line 1 in <module>

Extension modules: greenlet._greenlet, __original_module__thread, __original_module_select, __original_module_time, _cffi_backend (total: 5)
Erreur de segmentation (core dumped)
---------------

cinder only uses 2 third party extension modules (on a total of 220 modules): greenlet and cffi.

Note: __original_xxx modules are aliases of stdlib modules created by eventlet monkey patching.

So if cinder does crash, I suggest to look at Python, but *also* look at these 2 extensions ;-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42923>
_______________________________________

From report at bugs.python.org  Tue Jan 19 18:57:04 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 19 Jan 2021 23:57:04 +0000
Subject: [issue42973] argparse: mixing optional and positional arguments...
 not again
In-Reply-To: <1611094894.69.0.476759327253.issue42973@roundup.psfhosted.org>
Message-ID: <1611100624.93.0.0824784138684.issue42973@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
nosy: +paul.j3, r.david.murray

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42973>
_______________________________________

From report at bugs.python.org  Tue Jan 19 18:59:44 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 19 Jan 2021 23:59:44 +0000
Subject: [issue42864] Improve error messages regarding unclosed parentheses
In-Reply-To: <1610075010.91.0.684383999677.issue42864@roundup.psfhosted.org>
Message-ID: <1611100784.92.0.869561018718.issue42864@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset d6d6371447357c9c69b093657bbbb3977a3e60f2 by Pablo Galindo in branch 'master':
bpo-42864: Improve error messages regarding unclosed parentheses (GH-24161)
https://github.com/python/cpython/commit/d6d6371447357c9c69b093657bbbb3977a3e60f2


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42864>
_______________________________________

From report at bugs.python.org  Tue Jan 19 19:07:04 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 20 Jan 2021 00:07:04 +0000
Subject: [issue42864] Improve error messages regarding unclosed parentheses
In-Reply-To: <1610075010.91.0.684383999677.issue42864@roundup.psfhosted.org>
Message-ID: <1611101224.84.0.309431790161.issue42864@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42864>
_______________________________________

From report at bugs.python.org  Tue Jan 19 19:18:02 2021
From: report at bugs.python.org (Daniel Lenski)
Date: Wed, 20 Jan 2021 00:18:02 +0000
Subject: [issue35829] datetime: parse "Z" timezone suffix in fromisoformat()
In-Reply-To: <1548445007.56.0.14925163397.issue35829@roundup.psfhosted.org>
Message-ID: <1611101882.94.0.014902094506.issue35829@roundup.psfhosted.org>


Change by Daniel Lenski <dlenski at gmail.com>:


----------
nosy: +dlenski

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35829>
_______________________________________

From report at bugs.python.org  Tue Jan 19 19:24:29 2021
From: report at bugs.python.org (Eryk Sun)
Date: Wed, 20 Jan 2021 00:24:29 +0000
Subject: [issue42957] os.readlink produces wrong result on windows
In-Reply-To: <1610997189.12.0.447653130689.issue42957@roundup.psfhosted.org>
Message-ID: <1611102269.71.0.187270957855.issue42957@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

os.readlink() was generalized to support mountpoints (junctions) as well as symlinks, and it's more common for mountpoints to lack the print name field in the reparse data buffer [1]. For example, PowerShell's new-item creates junctions that only have a substitute path. This is allowed since the filesystem protocols only require that the substitute path is valid in the reparse data buffer, since that's all that the system actually uses when resolving the reparse point.

The substitute path in the reparse point is a \\?\ prefixed path (actually a \??\ NT path, but they're effectively the same for our purposes). This type of path is usually called an extended path -- or an extended device path, or verbatim path. It's a device path, like the \\.\ prefix, except that (1) it's verbatim (i.e. not normalized), (2) its length is never limited to MAX_PATH (260) characters, and (3) the Windows file API supports the \\?\ prefix more broadly than the \\.\ prefix.

You're right that some programs can't grok an extended path. Some can't even handle any type of UNC path. I agree that we need a simple way to remove the prefix. I just don't agree that removing it should be the default behavior in nt.readlink(), which I prefer to keep efficient and free of race conditions.

os.path.realpath() isn't necessarily what you want since it resolves the final path. The link may target a path that traverses any number of reparse points and mapped drives, so the final path may be completely different from the os.readlink() result. We simply need an option to remove the \\?\ or \\?\UNC prefix, either always or only when the path doesn't require it. It could be implemented by a high-level wrapper function in os.py.

---
Reasons the prefix may be required

If the length of the target path exceeds MAX_PATH, then removing the prefix may render the path inaccessible if the current process doesn't support long paths without it (e.g. Windows 10 without long paths enabled at the system level, or any version prior to Windows 10).

Also, reserved DOS device names are only accessible using an extended path. Say I have the following "spam" junction:

    >>> print(os.readlink('spam'))
    \\?\C:\Temp\con

The junction allows accessing the target directory normally:

    >>> stat.S_ISDIR(os.stat('spam').st_mode)
    True

But look what happens when I try to access the target path without the prefix:

    >>> stat.S_ISDIR(os.stat(r'C:\Temp\con').st_mode)
    False
    >>> stat.S_ISCHR(os.stat(r'C:\Temp\con').st_mode)
    True

Instead of the directory that one might expect, it's actually a character device!? Let's see what Windows opens:

    >>> print(os.path.abspath(r'C:\Temp\con'))
    \\.\con

It opens the "CON" device, for console I/O. It turns out that a bunch of names are reserved, including NUL, CON, CONIN$, CONOUT$, AUX, PRN, COM<1-9>, and LPT<1-9>. They're reserved even with an extension introduced by a colon or dot, preceded by zero or more spaces. For example:

    >>> print(os.path.abspath(r'C:\Temp\con :whatever'))
    \\.\con

Directly accessing such a name in the filesystem requires a verbatim path. For example:

    >>> stat.S_ISDIR(os.stat(r'\\?\C:\Temp\con').st_mode)
    True

Using reserved names is cautioned against, but in the real world we have to be defensive. We can't simply remove the prefix and hope for the best.

---

[1] https://docs.microsoft.com/en-us/windows-hardware/drivers/ddi/ntifs/ns-ntifs-_reparse_data_buffer

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42957>
_______________________________________

From report at bugs.python.org  Tue Jan 19 19:32:15 2021
From: report at bugs.python.org (Daniel Lenski)
Date: Wed, 20 Jan 2021 00:32:15 +0000
Subject: [issue35829] datetime: parse "Z" timezone suffix in fromisoformat()
In-Reply-To: <1548445007.56.0.14925163397.issue35829@roundup.psfhosted.org>
Message-ID: <1611102735.02.0.114122304478.issue35829@roundup.psfhosted.org>


Daniel Lenski <dlenski at gmail.com> added the comment:

Like many others here, I've run into this issue because I'm trying to parse timestamps from JSON.

(Specifically, I'm trying to parse timestamps from JSON serialization of Java POJOs and/or Kotlin data classes, as serialized by the Jackson serialization library for JVM languages, in conjunction with JavaTimeModule.
https://fasterxml.github.io/jackson-modules-java8/javadoc/datetime/2.9/com/fasterxml/jackson/datatype/jsr310/JavaTimeModule.html)

In order to "be lenient in what I accept" (adhering to the robustness principal), I need to add a special case for deserialization of strings ending with 'Z'. This gets pretty tricky and pretty subtle quickly.

Here is my Python 3.7+ code path (the strptime-based code path for earlier versions is much, much uglier).

    from numbers import Number
    from datetime import datetime, timezone
    def number_or_iso8601_to_dt(ts, t=datetime):
        if isinstance(ts, Number):
            return datetime.utcfromtimestamp(ts).replace(tzinfo=timezone.utc)
        elif ts.endswith('Z'):
            # This is not strictly correct, since it would accept a string with
            # two timezone specifications (e.g. ending with +01:00Z) and 
            # silently pass that erroneous representation:
            #
            # return datetime.fromisoformat(ts[:-1]).replace(tzinfo=timezone.utc)
            #
            # This version is better:
            d = datetime.fromisoformat(ts[:-1])
            if d.tzinfo is not None:
                raise ValueError(f"time data '{ts}' contains multiple timezone suffixes")
            return d.replace(tzinfo=timezone.utc)
        else:
            return datetime.fromisoformat(ts)

I don't really understand why .fromisoformat() must be *strictly* the inverse of .isoformat(). As @mehaase points out, the transformation isn't strictly reversible as is.

There are other functions where the Python standard library has special-cased options for extremely common use cases. For example, `str.split(None)`, which is certainly not the inverse of the non-existent `None.join()`.

This feels to me like a case where the standard library should simply just accept an extremely-common real-world variant in the interests of interoperability.

I would also be in favor of @p-ganssle's proposal (3), wherein `datetime.isoformat` would also output the 'Z' suffix for the UTC timezone.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35829>
_______________________________________

From report at bugs.python.org  Tue Jan 19 19:32:39 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 00:32:39 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611102759.78.0.115833155427.issue42955@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

sys.module_names also solves the following old StackOverflow question:
"How to check if a module/library/package is part of the python standard library?"
https://stackoverflow.com/questions/22195382/how-to-check-if-a-module-library-package-is-part-of-the-python-standard-library

"I have installed sooo many libraries/modules/packages with pip and now I cannot differentiate which is native to the python standard library and which is not. This causes problem when my code works on my machine but it doesn't work anywhere else."

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Tue Jan 19 19:37:29 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 00:37:29 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611103049.38.0.442523874523.issue42955@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The pants project also uses a list of stdlib module names, similar to isort, to infer dependencies:
https://github.com/pantsbuild/pants/tree/master/src/python/pants/backend/python/dependency_inference/python_stdlib

"Pants is a scalable build system for monorepos: codebases containing multiple projects, often using multiple programming languages and frameworks, in a single unified code repository."

See https://blog.pantsbuild.org/dependency-inference/

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Tue Jan 19 19:39:00 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 00:39:00 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611103140.33.0.15245144592.issue42955@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Yet another use case: the friendly-traceback project detects typos on imports using the list of stdlib module names:
https://aroberge.github.io/friendly-traceback-docs/docs/html/tracebacks_en_3.8.html#standard-library-module

For example, it suggest to replace "import Tkinter" with "import tkinter".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Tue Jan 19 22:13:57 2021
From: report at bugs.python.org (Brian Romanowski)
Date: Wed, 20 Jan 2021 03:13:57 +0000
Subject: [issue42974] tokenize reports incorrect end col offset and line
 string when input ends without explicit newline
Message-ID: <1611112437.84.0.130779999528.issue42974@roundup.psfhosted.org>


New submission from Brian Romanowski <romanows at gmail.com>:

The tokenize module's tokenizer functions output incorrect (or at least misleading) information when the content being tokenized does not end in a line ending character.  This is related to the fix for issue<33899>  which added the NEWLINE tokens for this case but did not fill out the whole token tuple correctly.

The bug can be seen by running a version of the test in Lib/test/test_tokenize.py:

import io, tokenize

newline_token_1 = list(tokenize.tokenize(io.BytesIO("x\n".encode('utf-8')).readline))[-2]
newline_token_2 = list(tokenize.tokenize(io.BytesIO("x".encode('utf-8')).readline))[-2]

print(newline_token_1)
print(newline_token_2)

# Prints:
# TokenInfo(type=4 (NEWLINE), string='\n', start=(1, 1), end=(1, 2), line='x\n')
# TokenInfo(type=4 (NEWLINE), string='', start=(1, 1), end=(1, 2), line='')  # bad "end" and "line"!

Notice that "len(newline_token_2.string) == 0" but "newline_token_2.end[1] - newline_token_2.start[1] == 1".  Seems more consistent if the newline_token_2.end == (1, 1).

Also, newline_token_2.line should hold the physical line rather than the empty string.  This would make it consistent with newline_token_1.line.

I'll add a PR shortly with a change so the output from the two cases is:

TokenInfo(type=4 (NEWLINE), string='\n', start=(1, 1), end=(1, 2), line='x\n')
TokenInfo(type=4 (NEWLINE), string='', start=(1, 1), end=(1, 1), line='x')

If this looks reasonable, I can backport it for the other branches.  Thanks!

----------
components: Library (Lib)
messages: 385313
nosy: romanows
priority: normal
severity: normal
status: open
title: tokenize reports incorrect end col offset and line string when input ends without explicit newline
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42974>
_______________________________________

From report at bugs.python.org  Tue Jan 19 22:29:44 2021
From: report at bugs.python.org (Brian Romanowski)
Date: Wed, 20 Jan 2021 03:29:44 +0000
Subject: [issue42974] tokenize reports incorrect end col offset and line
 string when input ends without explicit newline
In-Reply-To: <1611112437.84.0.130779999528.issue42974@roundup.psfhosted.org>
Message-ID: <1611113384.76.0.0337886649575.issue42974@roundup.psfhosted.org>


Change by Brian Romanowski <romanows at gmail.com>:


----------
keywords: +patch
pull_requests: +23085
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24260

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42974>
_______________________________________

From report at bugs.python.org  Wed Jan 20 02:39:31 2021
From: report at bugs.python.org (Eryk Sun)
Date: Wed, 20 Jan 2021 07:39:31 +0000
Subject: [issue42606] Support POSIX atomicity guarantee of O_APPEND on Windows
In-Reply-To: <1607483566.95.0.1927829703.issue42606@roundup.psfhosted.org>
Message-ID: <1611128371.95.0.913738893871.issue42606@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> os.write(fd) can't ... know that the fd was opened with O_APPEND

It's possible to query the granted access of a kernel handle via NtQueryObject: ObjectBasicInformation -- not that I'm suggesting to use it.

> the most serious one is rather silly: we need to honor the current 
> umask to possibly create a read-only file, 

It pains me to see umask get in the way of implementing open() directly via CreateFileW, which we need in order to support delete-access sharing. 

Python could implement its own umask value in Windows. os.umask() would set the C umask value as well, but only for the sake of consistency with C extensions and embedding.

> os module exposes some MSVCRT-specific flags for use with os.open() 
> (like O_TEMPORARY), which a reimplementation would have to support. 

Additionally, ucrt has an undocumented O_OBTAIN_DIR flag. It opens with backup semantics, which would be more obvious if aliased as O_BACKUP_SEMANTICS. This allows an open to take advantage of SeBackupPrivilege and SeRestorePrivilege if they're enabled, to get read or write access regardless of the file security.

Open attribute flags could also be supported, such as O_ATTR_HIDDEN and O_ATTR_SYSTEM. These are needed because a hidden or system file is required to remain as such when it's overwritten, else CreateFileW fails.

> It seems easy in most cases, but there is O_TEXT, 

Retaining O_TEXT in 3.x was probably an accident. Text mode should use a TextIOWrapper instance, and I doubt that there's a serious need to support Ctrl+Z as EOF. 

If it's important enough, msvcrt.open() and msvcrt.O_TEXT could be provided.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42606>
_______________________________________

From report at bugs.python.org  Wed Jan 20 03:39:00 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 08:39:00 +0000
Subject: [issue41995] five possible Null Pointer Dereference bugs.
In-Reply-To: <1602330580.94.0.791834118141.issue41995@roundup.psfhosted.org>
Message-ID: <1611131940.06.0.0340355342449.issue41995@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset f1ff800db1f9fa5ff8f2fa2863796a46bfa9ee46 by Yunlongs in branch 'master':
bpo-41995: Handle allocation failure in _tracemalloc and _zoneinfo (GH-22635)
https://github.com/python/cpython/commit/f1ff800db1f9fa5ff8f2fa2863796a46bfa9ee46


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41995>
_______________________________________

From report at bugs.python.org  Wed Jan 20 03:39:33 2021
From: report at bugs.python.org (miss-islington)
Date: Wed, 20 Jan 2021 08:39:33 +0000
Subject: [issue41995] five possible Null Pointer Dereference bugs.
In-Reply-To: <1602330580.94.0.791834118141.issue41995@roundup.psfhosted.org>
Message-ID: <1611131973.85.0.647931661957.issue41995@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +23086
pull_request: https://github.com/python/cpython/pull/24261

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41995>
_______________________________________

From report at bugs.python.org  Wed Jan 20 03:42:42 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 08:42:42 +0000
Subject: [issue41995] five possible Null Pointer Dereference bugs.
In-Reply-To: <1602330580.94.0.791834118141.issue41995@roundup.psfhosted.org>
Message-ID: <1611132162.51.0.8830476322.issue41995@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Thanks for the bug report brightest star, and thanks for the fix Yunlongs!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41995>
_______________________________________

From report at bugs.python.org  Wed Jan 20 03:51:55 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 08:51:55 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611132715.21.0.817881550122.issue42955@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Another use case similar to the "isort" use case: vim plugin to insert an import, it checks if the module name is a stdlib module. It checks the module path (for Python stdlib modules) and uses an hardcoded list of builtin stdlib modules.

https://github.com/mgedmin/python-imports.vim

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Wed Jan 20 03:56:47 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 08:56:47 +0000
Subject: [issue42005] profile/cProfile CLI should catch BrokenPipeError
In-Reply-To: <1602395117.19.0.101668557354.issue42005@roundup.psfhosted.org>
Message-ID: <1611133007.56.0.593564592206.issue42005@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 3554fa4abecfb77ac5fcaa5ce8310eeca5683960 by Zhiming Wang in branch 'master':
bpo-42005: profile and cProfile catch BrokenPipeError (GH-22643)
https://github.com/python/cpython/commit/3554fa4abecfb77ac5fcaa5ce8310eeca5683960


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42005>
_______________________________________

From report at bugs.python.org  Wed Jan 20 03:57:04 2021
From: report at bugs.python.org (miss-islington)
Date: Wed, 20 Jan 2021 08:57:04 +0000
Subject: [issue42005] profile/cProfile CLI should catch BrokenPipeError
In-Reply-To: <1602395117.19.0.101668557354.issue42005@roundup.psfhosted.org>
Message-ID: <1611133024.51.0.0744424533616.issue42005@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 3.0 -> 4.0
pull_requests: +23087
pull_request: https://github.com/python/cpython/pull/24262

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42005>
_______________________________________

From report at bugs.python.org  Wed Jan 20 03:57:42 2021
From: report at bugs.python.org (miss-islington)
Date: Wed, 20 Jan 2021 08:57:42 +0000
Subject: [issue42005] profile/cProfile CLI should catch BrokenPipeError
In-Reply-To: <1602395117.19.0.101668557354.issue42005@roundup.psfhosted.org>
Message-ID: <1611133062.97.0.4711116195.issue42005@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +23088
pull_request: https://github.com/python/cpython/pull/24263

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42005>
_______________________________________

From report at bugs.python.org  Wed Jan 20 04:00:28 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 09:00:28 +0000
Subject: [issue42005] profile/cProfile CLI should catch BrokenPipeError
In-Reply-To: <1602395117.19.0.101668557354.issue42005@roundup.psfhosted.org>
Message-ID: <1611133228.76.0.216853174167.issue42005@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42005>
_______________________________________

From report at bugs.python.org  Wed Jan 20 04:03:36 2021
From: report at bugs.python.org (miss-islington)
Date: Wed, 20 Jan 2021 09:03:36 +0000
Subject: [issue41995] five possible Null Pointer Dereference bugs.
In-Reply-To: <1602330580.94.0.791834118141.issue41995@roundup.psfhosted.org>
Message-ID: <1611133416.54.0.713706305804.issue41995@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 50938b63fbb0d4bed24dceccf188b8d0fe58463c by Miss Islington (bot) in branch '3.9':
bpo-41995: Handle allocation failure in _tracemalloc and _zoneinfo (GH-22635)
https://github.com/python/cpython/commit/50938b63fbb0d4bed24dceccf188b8d0fe58463c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41995>
_______________________________________

From report at bugs.python.org  Wed Jan 20 04:03:58 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 09:03:58 +0000
Subject: [issue42197] Disable automatic update of frame locals during tracing
In-Reply-To: <1603981001.04.0.667888856285.issue42197@roundup.psfhosted.org>
Message-ID: <1611133438.52.0.641513319747.issue42197@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Fabio created a thread on python-dev:
https://mail.python.org/archives/list/python-dev at python.org/thread/62WK3THUDNWZCDOMXXDZFG3O4LIOIP4W/

In 2017, Nick Coghlan wrote the PEP 558 "Defined semantics for locals()".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42197>
_______________________________________

From report at bugs.python.org  Wed Jan 20 04:18:25 2021
From: report at bugs.python.org (miss-islington)
Date: Wed, 20 Jan 2021 09:18:25 +0000
Subject: [issue42005] profile/cProfile CLI should catch BrokenPipeError
In-Reply-To: <1602395117.19.0.101668557354.issue42005@roundup.psfhosted.org>
Message-ID: <1611134305.33.0.646514402914.issue42005@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 648b72900b5039ab46b8b459f921daecb8db2a6b by Miss Islington (bot) in branch '3.8':
bpo-42005: profile and cProfile catch BrokenPipeError (GH-22643)
https://github.com/python/cpython/commit/648b72900b5039ab46b8b459f921daecb8db2a6b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42005>
_______________________________________

From report at bugs.python.org  Wed Jan 20 04:19:13 2021
From: report at bugs.python.org (miss-islington)
Date: Wed, 20 Jan 2021 09:19:13 +0000
Subject: [issue42005] profile/cProfile CLI should catch BrokenPipeError
In-Reply-To: <1602395117.19.0.101668557354.issue42005@roundup.psfhosted.org>
Message-ID: <1611134353.35.0.203747501932.issue42005@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 0654c4c4cc54a325e878154f8b117159d0105cf7 by Miss Islington (bot) in branch '3.9':
bpo-42005: profile and cProfile catch BrokenPipeError (GH-22643)
https://github.com/python/cpython/commit/0654c4c4cc54a325e878154f8b117159d0105cf7


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42005>
_______________________________________

From report at bugs.python.org  Wed Jan 20 04:23:26 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 09:23:26 +0000
Subject: [issue42197] Disable automatic update of frame locals during tracing
In-Reply-To: <1603981001.04.0.667888856285.issue42197@roundup.psfhosted.org>
Message-ID: <1611134606.52.0.382667531762.issue42197@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Mark: do you think that it's an acceptable trade-off to ask debuggers and profilers to call explicitly PyFrame_FastToLocalsWithError() and PyFrame_LocalsToFast(), to optimize the common case, when locals are not needed?

----------
nosy: +Mark.Shannon, ncoghlan

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42197>
_______________________________________

From report at bugs.python.org  Wed Jan 20 05:24:02 2021
From: report at bugs.python.org (miss-islington)
Date: Wed, 20 Jan 2021 10:24:02 +0000
Subject: [issue36769] doc Document that fnmatch.filter supports any kind of
 iterable not just lists
In-Reply-To: <1556719965.28.0.191162970906.issue36769@roundup.psfhosted.org>
Message-ID: <1611138242.26.0.476928775231.issue36769@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +23089
pull_request: https://github.com/python/cpython/pull/24264

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36769>
_______________________________________

From report at bugs.python.org  Wed Jan 20 05:27:09 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 20 Jan 2021 10:27:09 +0000
Subject: [issue42778] Add follow_symlinks=True parameter to both
 os.path.samefile() and Path.samefile()
In-Reply-To: <1609228261.66.0.888283704166.issue42778@roundup.psfhosted.org>
Message-ID: <1611138429.13.0.062662988144.issue42778@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Why is this feature needed? Currently you can use a combination of samestat() with lstat(). And more, you can follow symbolic links only for one of arguments.

samestat(stat(path1), stat(path1))  # same as samefile(path1, path1)
samestat(lstat(path1), stat(path1))
samestat(stat(path1), lstat(path1))
samestat(lstat(path1), lstat(path1))

samefile() covers one (presumably most common) of these cases. The proposed option would cover yet one (is it common enough?). And there are two mixed cases remained.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42778>
_______________________________________

From report at bugs.python.org  Wed Jan 20 05:38:42 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 10:38:42 +0000
Subject: [issue42323] [AIX] test_math: test_nextafter(float('nan'),
 1.0) does not return a NaN on AIX
In-Reply-To: <1605094498.01.0.809514320528.issue42323@roundup.psfhosted.org>
Message-ID: <1611139122.39.0.777441902677.issue42323@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
keywords: +patch
pull_requests: +23090
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24265

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42323>
_______________________________________

From report at bugs.python.org  Wed Jan 20 05:43:33 2021
From: report at bugs.python.org (miss-islington)
Date: Wed, 20 Jan 2021 10:43:33 +0000
Subject: [issue36769] doc Document that fnmatch.filter supports any kind of
 iterable not just lists
In-Reply-To: <1556719965.28.0.191162970906.issue36769@roundup.psfhosted.org>
Message-ID: <1611139413.36.0.88890844192.issue36769@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 8f334dbbf04582071d1318e5817e2fe99f1e5169 by Miss Islington (bot) in branch '3.8':
bpo-36769: Document that fnmatch.filter supports any kind of iterable (GH-13039)
https://github.com/python/cpython/commit/8f334dbbf04582071d1318e5817e2fe99f1e5169


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36769>
_______________________________________

From report at bugs.python.org  Wed Jan 20 05:43:56 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 10:43:56 +0000
Subject: [issue42323] [AIX] test_math: test_nextafter(float('nan'),
 1.0) does not return a NaN on AIX
In-Reply-To: <1605094498.01.0.809514320528.issue42323@roundup.psfhosted.org>
Message-ID: <1611139436.33.0.847251017349.issue42323@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I wrote PR 24265 to fix the issue. math.nextafter(x, y) already had a special case for AIX for x==y.

test_nextafter fails on PPC64 AIX 3.x (build 749).

test_nextafter pass on POWER6 AIX 3.x (build 701).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42323>
_______________________________________

From report at bugs.python.org  Wed Jan 20 05:46:27 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 10:46:27 +0000
Subject: [issue42680] unicode identifiers not accessible or assignable through
 globals()
In-Reply-To: <1608337638.31.0.282266859185.issue42680@roundup.psfhosted.org>
Message-ID: <1611139587.88.0.0231323704978.issue42680@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42680>
_______________________________________

From report at bugs.python.org  Wed Jan 20 05:52:29 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 10:52:29 +0000
Subject: [issue42975] urllib.parse.parse_qsl(): add an option to not consider
 semicolon (; ) as separator
Message-ID: <1611139949.1.0.449801455781.issue42975@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at python.org>:

urllib.parse.parse_qsl() uses "&" *and* ";" as separators:

>>> urllib.parse.parse_qsl("a=1&b=2&c=3")
[('a', '1'), ('b', '2'), ('c', '3')]
>>> urllib.parse.parse_qsl("a=1&b=2;c=3")
[('a', '1'), ('b', '2'), ('c', '3')]

But the W3C standards evolved and now suggest against considering semicolon (";") as a separator:

https://www.w3.org/TR/2014/REC-html5-20141028/forms.html#url-encoded-form-data

"This form data set encoding is in many ways an aberrant monstrosity, the result of many years of implementation accidents and compromises leading to a set of requirements necessary for interoperability, but in no way representing good design practices. In particular, readers are cautioned to pay close attention to the twisted details involving repeated (and in some cases nested) conversions between character encodings and byte sequences."

"To decode application/x-www-form-urlencoded payloads (...) Let strings be the result of strictly splitting the string payload on U+0026 AMPERSAND characters (&)."

Maybe we should even go further in Python 3.10 and only split at "&" by default, but let the caller to opt-in for ";" separator as well.

----------
components: Library (Lib)
messages: 385327
nosy: vstinner
priority: normal
severity: normal
status: open
title: urllib.parse.parse_qsl(): add an option to not consider semicolon (;) as separator
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42975>
_______________________________________

From report at bugs.python.org  Wed Jan 20 05:56:11 2021
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Wed, 20 Jan 2021 10:56:11 +0000
Subject: [issue42975] urllib.parse.parse_qsl(): add an option to not consider
 semicolon (; ) as separator
In-Reply-To: <1611139949.1.0.449801455781.issue42975@roundup.psfhosted.org>
Message-ID: <1611140171.51.0.683378997677.issue42975@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

See also https://bugs.python.org/issue42967

----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42975>
_______________________________________

From report at bugs.python.org  Wed Jan 20 06:01:17 2021
From: report at bugs.python.org (Mark Shannon)
Date: Wed, 20 Jan 2021 11:01:17 +0000
Subject: [issue42197] Disable automatic update of frame locals during tracing
In-Reply-To: <1603981001.04.0.667888856285.issue42197@roundup.psfhosted.org>
Message-ID: <1611140477.88.0.144976818859.issue42197@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

I don't think so.
Tracing is already somewhat fragile, see https://bugs.python.org/issue30744.
Making it more complex is likely to add more bugs.

PEP 558 should help, as f_locals becomes a proxy. 
There are some minor issues with PEP 558 (I'm not convinced that it is completely robust), but it should fix this issue.

Ultimately, what we need is a decent debugger API, something along the lines of the JVMTI.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42197>
_______________________________________

From report at bugs.python.org  Wed Jan 20 06:03:56 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 11:03:56 +0000
Subject: [issue41798] [C API] Revisit usage of the PyCapsule C API with
 multi-phase initialization API
In-Reply-To: <1600265269.2.0.881235166904.issue41798@roundup.psfhosted.org>
Message-ID: <1611140636.7.0.404858211801.issue41798@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 61d26394f97306ab4890f1522f26ee6d17461e2b by Erlend Egeberg Aasland in branch 'master':
bpo-41798: Allocate unicodedata CAPI on the heap (GH-24128)
https://github.com/python/cpython/commit/61d26394f97306ab4890f1522f26ee6d17461e2b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41798>
_______________________________________

From report at bugs.python.org  Wed Jan 20 06:06:54 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 11:06:54 +0000
Subject: [issue42975] urllib.parse.parse_qsl(): add an option to not consider
 semicolon (; ) as separator
In-Reply-To: <1611139949.1.0.449801455781.issue42975@roundup.psfhosted.org>
Message-ID: <1611140814.1.0.969744739326.issue42975@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Oh, I mark my issue as a duplicate of bpo-42967.

----------
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> Web cache poisoning - `;` as a query args separator

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42975>
_______________________________________

From report at bugs.python.org  Wed Jan 20 06:07:32 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 11:07:32 +0000
Subject: [issue42967] Web cache poisoning - `;` as a query args separator
In-Reply-To: <1611068809.96.0.58823274544.issue42967@roundup.psfhosted.org>
Message-ID: <1611140852.58.0.815112509408.issue42967@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Oops, I missed this issue. I just marked my bpo-42975 issue as a duplicate of this one.

My message:

urllib.parse.parse_qsl() uses "&" *and* ";" as separators:

>>> urllib.parse.parse_qsl("a=1&b=2&c=3")
[('a', '1'), ('b', '2'), ('c', '3')]
>>> urllib.parse.parse_qsl("a=1&b=2;c=3")
[('a', '1'), ('b', '2'), ('c', '3')]

But the W3C standards evolved and now suggest against considering semicolon (";") as a separator:

https://www.w3.org/TR/2014/REC-html5-20141028/forms.html#url-encoded-form-data

"This form data set encoding is in many ways an aberrant monstrosity, the result of many years of implementation accidents and compromises leading to a set of requirements necessary for interoperability, but in no way representing good design practices. In particular, readers are cautioned to pay close attention to the twisted details involving repeated (and in some cases nested) conversions between character encodings and byte sequences."

"To decode application/x-www-form-urlencoded payloads (...) Let strings be the result of strictly splitting the string payload on U+0026 AMPERSAND characters (&)."

Maybe we should even go further in Python 3.10 and only split at "&" by default, but let the caller to opt-in for ";" separator as well.

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Wed Jan 20 06:08:56 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 11:08:56 +0000
Subject: [issue42967] urllib.parse.parse_qsl(): Web cache poisoning - `;
 ` as a query args separator
In-Reply-To: <1611068809.96.0.58823274544.issue42967@roundup.psfhosted.org>
Message-ID: <1611140936.74.0.104769580211.issue42967@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
title: Web cache poisoning - `;` as a query args separator -> urllib.parse.parse_qsl(): Web cache poisoning - `;` as a query args separator

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Wed Jan 20 06:09:07 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 11:09:07 +0000
Subject: [issue42967] [security] urllib.parse.parse_qsl(): Web cache poisoning
 - `; ` as a query args separator
In-Reply-To: <1611068809.96.0.58823274544.issue42967@roundup.psfhosted.org>
Message-ID: <1611140947.46.0.35057481674.issue42967@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
title: urllib.parse.parse_qsl(): Web cache poisoning - `;` as a query args separator -> [security] urllib.parse.parse_qsl(): Web cache poisoning - `;` as a query args separator

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Wed Jan 20 06:15:43 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 11:15:43 +0000
Subject: [issue26003] Issues with PyEval_InitThreads and PyGILState_Ensure
In-Reply-To: <1451847866.91.0.926666566382.issue26003@psf.upfronthosting.co.za>
Message-ID: <1611141343.81.0.288440284565.issue26003@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The GIL is now created by _PyEval_InitGIL() which is called by Py_Initialize(): at Python startup.

_PyRuntime.main_thread is set by _PyRuntime_Initialize() which is also called by Py_Initialize(): at Python startup.

The code to handle signals and pending calls changed a lot since 2016. I close the issue.

----------
stage:  -> resolved
status: pending -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26003>
_______________________________________

From report at bugs.python.org  Wed Jan 20 06:20:15 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 11:20:15 +0000
Subject: [issue42048] Document Argument Clinic's defining_class converter
In-Reply-To: <1602792744.97.0.495560068875.issue42048@roundup.psfhosted.org>
Message-ID: <1611141615.85.0.897961396292.issue42048@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset e982fe496bf756afd2ead8e56eb24b28a93c627a by Erlend Egeberg Aasland in branch 'master':
bpo-42048: Clinic Howto: Document AC's defining_class converter (GH-23978)
https://github.com/python/cpython/commit/e982fe496bf756afd2ead8e56eb24b28a93c627a


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42048>
_______________________________________

From report at bugs.python.org  Wed Jan 20 06:21:25 2021
From: report at bugs.python.org (Antony Lee)
Date: Wed, 20 Jan 2021 11:21:25 +0000
Subject: [issue42976] __text_signature__ parser silently drops arguments with
 certain unsupported default forms
Message-ID: <1611141685.32.0.342483333341.issue42976@roundup.psfhosted.org>


New submission from Antony Lee <anntzer.lee at gmail.com>:

Starting from the keyword-arguments example at https://docs.python.org/3/extending/extending.html#keyword-parameters-for-extension-functions, change the docstring of `parrot` to "parrot(voltage, state, action, type=1<<5)\n--\n\n" (yes, the documented default value for type does not correspond to the actual implementation, but that's irrelevant here).  Compiling the extension module and running pydoc on it yields the following parsed signature for `parrot`: `parrot(voltage, state, action)` i.e. the `type` parameter got silently dropped.  (Note that `1<<5` can legitimately occur, e.g. as a bitmask flag, especially given that one currently cannot refer to globals in __text_signature__ (https://bugs.python.org/issue37881).)

----------
components: Extension Modules
messages: 385335
nosy: Antony.Lee
priority: normal
severity: normal
status: open
title: __text_signature__ parser silently drops arguments with certain unsupported default forms

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42976>
_______________________________________

From report at bugs.python.org  Wed Jan 20 06:21:40 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Wed, 20 Jan 2021 11:21:40 +0000
Subject: [issue42048] Document Argument Clinic's defining_class converter
In-Reply-To: <1602792744.97.0.495560068875.issue42048@roundup.psfhosted.org>
Message-ID: <1611141700.04.0.67214337285.issue42048@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42048>
_______________________________________

From report at bugs.python.org  Wed Jan 20 06:30:22 2021
From: report at bugs.python.org (Fabio Zadrozny)
Date: Wed, 20 Jan 2021 11:30:22 +0000
Subject: [issue42197] Disable automatic update of frame locals during tracing
In-Reply-To: <1603981001.04.0.667888856285.issue42197@roundup.psfhosted.org>
Message-ID: <1611142222.81.0.981022755403.issue42197@roundup.psfhosted.org>


Fabio Zadrozny <fabiofz at gmail.com> added the comment:

I agree that it can be made better, but I think most of the issues right now comes from CPython trying to automatically do something that's not bound to work (calling PyFrame_FastToLocals/PyFrame_LocalsToFast under the hood during the tracing call).

https://bugs.python.org/issue30744 is a great example of why that can never work properly (debuggers need to manage that much more carefully, just doing it on all calls is really bound to not work).

So, the current implementation besides being broken also makes things pretty slow.

I agree that PEP 558 may fix things here (but it's much more work).

As a disclaimer, pydevd actually uses a different tracer which doesn't do those calls and when possible uses the frame eval to modify the bytecode directly to minimize the overhead, so, in practice the current support given by CPython for debugger is pretty reasonable for doing a fast debugger (but there are a few caveats that it must work around -- such as the auto PyFrame_FastToLocals/PyFrame_LocalsToFast calls).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42197>
_______________________________________

From mal at egenix.com  Wed Jan 20 07:02:38 2021
From: mal at egenix.com (M.-A. Lemburg)
Date: Wed, 20 Jan 2021 13:02:38 +0100
Subject: [issue42967] Web cache poisoning - `;` as a query args separator
In-Reply-To: <1611140852.58.0.815112509408.issue42967@roundup.psfhosted.org>
References: <1611140852.58.0.815112509408.issue42967@roundup.psfhosted.org>
Message-ID: <4aa75429-504e-65a8-5aa4-b7b0c83eaacb@egenix.com>

On 20.01.2021 12:07, STINNER Victor wrote:
> Maybe we should even go further in Python 3.10 and only split at "&" by default, but let the caller to opt-in for ";" separator as well.

+1.

Personally, I've never seen URLs encoded with ";" as query parameter
separator in practice on the server side.

The use of ";" was recommended in the HTML4 spec, but only in an
implementation side note:

https://www.w3.org/TR/1999/REC-html401-19991224/appendix/notes.html#h-B.2.2

and not in the main reference:

https://www.w3.org/TR/1999/REC-html401-19991224/interact/forms.html#h-17.13.4.1

Browsers are also pretty relaxed about seeing non-escaped ampersands in
link URLs and do the right thing, so the suggested work-around for
avoiding escaping is not really needed.

-- 
Marc-Andre Lemburg
eGenix.com


From report at bugs.python.org  Wed Jan 20 07:02:44 2021
From: report at bugs.python.org (Marc-Andre Lemburg)
Date: Wed, 20 Jan 2021 12:02:44 +0000
Subject: [issue42967] Web cache poisoning - `;` as a query args separator
In-Reply-To: <1611140852.58.0.815112509408.issue42967@roundup.psfhosted.org>
Message-ID: <4aa75429-504e-65a8-5aa4-b7b0c83eaacb@egenix.com>


Marc-Andre Lemburg <mal at egenix.com> added the comment:

On 20.01.2021 12:07, STINNER Victor wrote:
> Maybe we should even go further in Python 3.10 and only split at "&" by default, but let the caller to opt-in for ";" separator as well.

+1.

Personally, I've never seen URLs encoded with ";" as query parameter
separator in practice on the server side.

The use of ";" was recommended in the HTML4 spec, but only in an
implementation side note:

https://www.w3.org/TR/1999/REC-html401-19991224/appendix/notes.html#h-B.2.2

and not in the main reference:

https://www.w3.org/TR/1999/REC-html401-19991224/interact/forms.html#h-17.13.4.1

Browsers are also pretty relaxed about seeing non-escaped ampersands in
link URLs and do the right thing, so the suggested work-around for
avoiding escaping is not really needed.

----------
nosy: +lemburg
title: [security] urllib.parse.parse_qsl(): Web cache poisoning - `;` as a query args separator -> Web cache poisoning - `;` as a query args separator

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Wed Jan 20 07:04:10 2021
From: report at bugs.python.org (Marc-Andre Lemburg)
Date: Wed, 20 Jan 2021 12:04:10 +0000
Subject: [issue42967] [security] Web cache poisoning - `;
 ` as a query args separator
In-Reply-To: <1611068809.96.0.58823274544.issue42967@roundup.psfhosted.org>
Message-ID: <1611144250.13.0.579296130518.issue42967@roundup.psfhosted.org>


Change by Marc-Andre Lemburg <mal at egenix.com>:


----------
title: Web cache poisoning - `;` as a query args separator -> [security] Web cache poisoning - `;` as a query args separator

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Wed Jan 20 07:23:30 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 20 Jan 2021 12:23:30 +0000
Subject: [issue42864] Improve error messages regarding unclosed parentheses
In-Reply-To: <1610075010.91.0.684383999677.issue42864@roundup.psfhosted.org>
Message-ID: <1611145410.38.0.961026542927.issue42864@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
pull_requests: +23091
pull_request: https://github.com/python/cpython/pull/24266

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42864>
_______________________________________

From report at bugs.python.org  Wed Jan 20 07:53:59 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 20 Jan 2021 12:53:59 +0000
Subject: [issue42864] Improve error messages regarding unclosed parentheses
In-Reply-To: <1610075010.91.0.684383999677.issue42864@roundup.psfhosted.org>
Message-ID: <1611147239.15.0.273367553605.issue42864@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset ae7d3cd980fae6b9a9778c0ccd162b93035ad33e by Pablo Galindo in branch 'master':
bpo-42864: Fix compiler warning in the tokenizer with the new paren stack for column numbers (GH-24266)
https://github.com/python/cpython/commit/ae7d3cd980fae6b9a9778c0ccd162b93035ad33e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42864>
_______________________________________

From report at bugs.python.org  Wed Jan 20 09:06:25 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 14:06:25 +0000
Subject: [issue42780] os.set_inheritable() fails for O_PATH file descriptors
 on Linux
In-Reply-To: <1609262318.62.0.976413615492.issue42780@roundup.psfhosted.org>
Message-ID: <1611151585.85.0.893103615495.issue42780@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 7dc71c425cf6aa6a4070a418dce5d95ca435c79f by cptpcrd in branch 'master':
bpo-42780: Fix set_inheritable() for O_PATH file descriptors on Linux (GH-24172)
https://github.com/python/cpython/commit/7dc71c425cf6aa6a4070a418dce5d95ca435c79f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42780>
_______________________________________

From report at bugs.python.org  Wed Jan 20 09:08:18 2021
From: report at bugs.python.org (miss-islington)
Date: Wed, 20 Jan 2021 14:08:18 +0000
Subject: [issue42780] os.set_inheritable() fails for O_PATH file descriptors
 on Linux
In-Reply-To: <1609262318.62.0.976413615492.issue42780@roundup.psfhosted.org>
Message-ID: <1611151698.4.0.398052447459.issue42780@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 3.0 -> 4.0
pull_requests: +23092
pull_request: https://github.com/python/cpython/pull/24269

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42780>
_______________________________________

From report at bugs.python.org  Wed Jan 20 09:06:43 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Wed, 20 Jan 2021 14:06:43 +0000
Subject: [issue42972] [C API] Heap types (PyType_FromSpec) must fully
 implement the GC protocol
In-Reply-To: <1611093266.11.0.721387186389.issue42972@roundup.psfhosted.org>
Message-ID: <1611151603.0.0.44816282549.issue42972@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na at python.org>:


----------
nosy: +corona10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42972>
_______________________________________

From report at bugs.python.org  Wed Jan 20 09:10:02 2021
From: report at bugs.python.org (miss-islington)
Date: Wed, 20 Jan 2021 14:10:02 +0000
Subject: [issue42780] os.set_inheritable() fails for O_PATH file descriptors
 on Linux
In-Reply-To: <1609262318.62.0.976413615492.issue42780@roundup.psfhosted.org>
Message-ID: <1611151802.24.0.775449472694.issue42780@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +23093
pull_request: https://github.com/python/cpython/pull/24270

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42780>
_______________________________________

From report at bugs.python.org  Wed Jan 20 09:12:38 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 14:12:38 +0000
Subject: [issue42967] [security] urllib.parse.parse_qsl(): Web cache poisoning
 - `; ` as a query args separator
In-Reply-To: <1611068809.96.0.58823274544.issue42967@roundup.psfhosted.org>
Message-ID: <1611151958.83.0.36209826089.issue42967@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
title: [security] Web cache poisoning - `;` as a query args separator -> [security] urllib.parse.parse_qsl(): Web cache poisoning - `;` as a query args separator

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Wed Jan 20 09:13:31 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 14:13:31 +0000
Subject: [issue42780] os.set_inheritable() fails for O_PATH file descriptors
 on Linux
In-Reply-To: <1609262318.62.0.976413615492.issue42780@roundup.psfhosted.org>
Message-ID: <1611152011.47.0.165150998392.issue42780@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Thanks cptpcrd for your bug report and your great fix! I like your tests ;-)

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42780>
_______________________________________

From report at bugs.python.org  Wed Jan 20 09:15:31 2021
From: report at bugs.python.org (Marc-Andre Lemburg)
Date: Wed, 20 Jan 2021 14:15:31 +0000
Subject: [issue42967] [security] urllib.parse.parse_qsl(): Web cache poisoning
 - `; ` as a query args separator
In-Reply-To: <1611068809.96.0.58823274544.issue42967@roundup.psfhosted.org>
Message-ID: <1611152131.5.0.561160434276.issue42967@roundup.psfhosted.org>


Marc-Andre Lemburg <mal at egenix.com> added the comment:

Sorry for the title mess: It seems that when replying to a ticket, RoundUp uses the subject line as the new header regardless of what it was set to before.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Wed Jan 20 09:16:33 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 14:16:33 +0000
Subject: [issue42967] [security] urllib.parse.parse_qsl(): Web cache poisoning
 - `; ` as a query args separator
In-Reply-To: <1611068809.96.0.58823274544.issue42967@roundup.psfhosted.org>
Message-ID: <1611152193.4.0.990028154483.issue42967@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> Sorry for the title mess: It seems that when replying to a ticket, RoundUp uses the subject line as the new header regardless of what it was set to before.

Yeah, it's annoying :-( I like to put a module name in the issue title, to help bug triage.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Wed Jan 20 09:20:27 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 14:20:27 +0000
Subject: [issue42323] [AIX] test_math: test_nextafter(float('nan'),
 1.0) does not return a NaN on AIX
In-Reply-To: <1605094498.01.0.809514320528.issue42323@roundup.psfhosted.org>
Message-ID: <1611152427.04.0.416132287144.issue42323@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset c1c3493fb7a3af8efdc50175e592d29e8cb93886 by Victor Stinner in branch 'master':
bpo-42323: Fix math.nextafter() for NaN on AIX (GH-24265)
https://github.com/python/cpython/commit/c1c3493fb7a3af8efdc50175e592d29e8cb93886


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42323>
_______________________________________

From report at bugs.python.org  Wed Jan 20 09:23:52 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 20 Jan 2021 14:23:52 +0000
Subject: [issue42967] [security] urllib.parse.parse_qsl(): Web cache poisoning
 - `; ` as a query args separator
In-Reply-To: <1611068809.96.0.58823274544.issue42967@roundup.psfhosted.org>
Message-ID: <1611152632.86.0.178796446353.issue42967@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

It looks to me, that this is an issue of proxies, not Python. Python implementation obeys contemporary standards, and they are not formally cancelled yet. If we add an option in parse_qsl() or change its default behavior, it should be considered as a new feature which helps to mitigate proxies' issues.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Wed Jan 20 09:48:54 2021
From: report at bugs.python.org (DDavid)
Date: Wed, 20 Jan 2021 14:48:54 +0000
Subject: [issue42977] Tkinter Optionmenu Too Narrow on Mac
Message-ID: <1611154134.32.0.566162791222.issue42977@roundup.psfhosted.org>


New submission from DDavid <zjdavid.2003 at gmail.com>:

Hello,

I am building a program with Tkinter. However, I found the Optionmenu widget has inconsistent behaviors on default lengths on a Mac and a Windows PC. 

So I set the width of an optionmenu through menu.configure(width=70). On Windows, this correctly sets the menu width to 70 when the program runs. However, on a Mac, the menu is still very narrow at the start. It only expands to 70 after I select an option. 

I have attached a screenshot to help explain the issue. It does not occur on Windows.

----------
components: Tkinter
files: TKinter Menu issue.png
messages: 385345
nosy: zjdavid
priority: normal
severity: normal
status: open
title: Tkinter Optionmenu Too Narrow on Mac
type: behavior
versions: Python 3.9
Added file: https://bugs.python.org/file49752/TKinter Menu issue.png

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42977>
_______________________________________

From report at bugs.python.org  Wed Jan 20 10:17:28 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 15:17:28 +0000
Subject: [issue42967] [security] urllib.parse.parse_qsl(): Web cache poisoning
 - `; ` as a query args separator
In-Reply-To: <1611068809.96.0.58823274544.issue42967@roundup.psfhosted.org>
Message-ID: <1611155848.0.0.965414382951.issue42967@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> Python implementation obeys contemporary standards

The contemporary standard is HTML5 and HTML5 asks to only split at "&", no?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Wed Jan 20 10:20:51 2021
From: report at bugs.python.org (Ken Jin)
Date: Wed, 20 Jan 2021 15:20:51 +0000
Subject: [issue42967] [security] urllib.parse.parse_qsl(): Web cache poisoning
 - `; ` as a query args separator
In-Reply-To: <1611068809.96.0.58823274544.issue42967@roundup.psfhosted.org>
Message-ID: <1611156051.73.0.849036722541.issue42967@roundup.psfhosted.org>


Change by Ken Jin <kenjin4096 at gmail.com>:


----------
keywords: +patch
nosy: +kj
nosy_count: 4.0 -> 5.0
pull_requests: +23094
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24271

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Wed Jan 20 10:32:51 2021
From: report at bugs.python.org (Irit Katriel)
Date: Wed, 20 Jan 2021 15:32:51 +0000
Subject: [issue36769] doc Document that fnmatch.filter supports any kind of
 iterable not just lists
In-Reply-To: <1556719965.28.0.191162970906.issue36769@roundup.psfhosted.org>
Message-ID: <1611156771.94.0.288872868429.issue36769@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.10 -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36769>
_______________________________________

From report at bugs.python.org  Wed Jan 20 10:35:50 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 15:35:50 +0000
Subject: [issue42604] EXT_SUFFIX too short on FreeBSD and AIX
In-Reply-To: <1607464402.35.0.336960410788.issue42604@roundup.psfhosted.org>
Message-ID: <1611156950.49.0.0726815821119.issue42604@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I reopen the issue.

It seems like Python no long builds on PPC64 AIX 3.x buildbot:
https://buildbot.python.org/all/#/builders/438/builds/753

"setup.py build" crash with an assertion error:

Assertion failed: (item != NULL) ^ (PyErr_Occurred() != NULL), file  Objects/abstract.c, line 163

The linker also displays tons of warnings. Examples:

ld: 0711-327 WARNING: Entry point not found: PyInit__uuid.cpython-310d
ld: 0711-327 WARNING: Entry point not found: PyInit__multiprocessing.cpython-310d
ld: 0711-327 WARNING: Entry point not found: PyInit__tkinter.cpython-310d

Can it be related to the commit a44ce6c9f725d336aea51a946b42769f29fed613 of this issue?

----------
resolution: fixed -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42604>
_______________________________________

From report at bugs.python.org  Wed Jan 20 10:36:16 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 15:36:16 +0000
Subject: [issue42323] [AIX] test_math: test_nextafter(float('nan'),
 1.0) does not return a NaN on AIX
In-Reply-To: <1605094498.01.0.809514320528.issue42323@roundup.psfhosted.org>
Message-ID: <1611156976.25.0.547816027033.issue42323@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Oh, it seems like Python no long builds on PPC64 AIX 3.x buildbot :-(
https://bugs.python.org/issue42604#msg385347

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42323>
_______________________________________

From report at bugs.python.org  Wed Jan 20 10:40:27 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 20 Jan 2021 15:40:27 +0000
Subject: [issue42978] Improve error message when "self" is missing from the
 method definition
Message-ID: <1611157227.52.0.513625976683.issue42978@roundup.psfhosted.org>


New submission from Pablo Galindo Salgado <pablogsal at gmail.com>:

We currently say:

Traceback (most recent call last):
  File "/Users/pgalindo3/github/python/master/lel.py", line 5, in <module>
    A().foo(1,2)
TypeError: foo() takes 2 positional arguments but 3 were given

but we should say:
Traceback (most recent call last):
  File "/Users/pgalindo3/github/python/master/lel.py", line 5, in <module>
    A().foo(1,2)
TypeError: A.foo() takes 2 positional arguments but 3 were given. Did you forget 'self' in the method definition?

----------
messages: 385349
nosy: pablogsal
priority: normal
severity: normal
status: open
title: Improve error message when "self" is missing from the method definition

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42978>
_______________________________________

From report at bugs.python.org  Wed Jan 20 10:41:11 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 20 Jan 2021 15:41:11 +0000
Subject: [issue42978] Improve error message when "self" is missing from the
 method definition
In-Reply-To: <1611157227.52.0.513625976683.issue42978@roundup.psfhosted.org>
Message-ID: <1611157271.43.0.478318404239.issue42978@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
keywords: +patch
pull_requests: +23095
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24272

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42978>
_______________________________________

From report at bugs.python.org  Wed Jan 20 11:00:32 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 16:00:32 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611158432.73.0.677251837635.issue42955@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Another example: the unimport project ("linter, formatter for finding and removing unused import statements") uses the following function to guess if a module object is part of the stdlib:

def is_std(package: str) -> bool:
    """Returns True if package module came with from Python."""

    if package in C.BUILTIN_MODULE_NAMES:
        return True
    spec = get_spec(package)
    if spec and isinstance(spec.origin, str):
        return any(
            (
                spec.origin.startswith(C.STDLIB_PATH),
                spec.origin in ["built-in", "frozen"],
                spec.origin.endswith(".so"),
            )
        )
    else:
        return False

https://github.com/hakancelik96/unimport/blob/c9bd5de99bd8a5239d3dee2c3ff633979bb3ead2/unimport/utils.py#L61-L77

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Wed Jan 20 11:06:24 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 20 Jan 2021 16:06:24 +0000
Subject: [issue42604] EXT_SUFFIX too short on FreeBSD and AIX
In-Reply-To: <1607464402.35.0.336960410788.issue42604@roundup.psfhosted.org>
Message-ID: <1611158784.94.0.47502108213.issue42604@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> Can it be related to the commit a44ce6c9f725d336aea51a946b42769f29fed613 of this issue?

Quite likely. @mattip, can you investigate?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42604>
_______________________________________

From report at bugs.python.org  Wed Jan 20 11:06:30 2021
From: report at bugs.python.org (Ken Jin)
Date: Wed, 20 Jan 2021 16:06:30 +0000
Subject: [issue42967] [security] urllib.parse.parse_qsl(): Web cache poisoning
 - `; ` as a query args separator
In-Reply-To: <1611068809.96.0.58823274544.issue42967@roundup.psfhosted.org>
Message-ID: <1611158790.09.0.212553831731.issue42967@roundup.psfhosted.org>


Ken Jin <kenjin4096 at gmail.com> added the comment:

FWIW, a surprising amount of things rely on treating ';' as a valid separator in the standard test suite.

>From just a cursory look:

test_cgi
test_urlparse

A change in the public API of urlparse will also require a change in cgi.py's FieldStorage, FieldStorage.read_multi, parse and parse_multipart to expose that parameter since those functions forward arguments directly to urllib.parse.parse_qs internally.

If we backport this, it seems that we will *also* need to backport all those changes to cgi's public API. Otherwise, just backporting the security fix part without allowing the user to switch would break existing code.

Just my 2 cents on the issue. I'm not too familiar with security fixes in cpython anyways ;).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Wed Jan 20 11:07:28 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 16:07:28 +0000
Subject: [issue42856] ensurepip: add configure --with-wheel-pkg-dir=PATH to
 get wheel packages from a system directory
In-Reply-To: <1610018466.49.0.695886938784.issue42856@roundup.psfhosted.org>
Message-ID: <1611158848.4.0.753015545082.issue42856@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 75e59a97f5d1fddb0c30ed9747b1b8cb84420a62 by Victor Stinner in branch 'master':
bpo-42856: Add --with-wheel-pkg-dir=PATH configure option (GH-24210)
https://github.com/python/cpython/commit/75e59a97f5d1fddb0c30ed9747b1b8cb84420a62


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42856>
_______________________________________

From report at bugs.python.org  Wed Jan 20 12:13:10 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 20 Jan 2021 17:13:10 +0000
Subject: [issue42978] Improve error message when "self" is missing from the
 method definition
In-Reply-To: <1611157227.52.0.513625976683.issue42978@roundup.psfhosted.org>
Message-ID: <1611162790.45.0.887087700195.issue42978@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

I don't think this makes sense. How do you know there's a missing 'self'? Surely it's just as likely that there is indeed an extra argument. Especially if A.foo is defined by a library (stdib or 3rd party).

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42978>
_______________________________________

From report at bugs.python.org  Wed Jan 20 12:26:06 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 17:26:06 +0000
Subject: [issue42979] _zoneinfo: zoneinfomodule_exec() doesn't check for
 PyDateTime_IMPORT failure
Message-ID: <1611163566.26.0.253539458839.issue42979@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at python.org>:

_zoneinfo starts with:

static int
zoneinfomodule_exec(PyObject *m)
{
    PyDateTime_IMPORT;

with:

#define PyDateTime_CAPSULE_NAME "datetime.datetime_CAPI"
#define PyDateTime_IMPORT \
    PyDateTimeAPI = (PyDateTime_CAPI *)PyCapsule_Import(PyDateTime_CAPSULE_NAME, 0)

If PyCapsule_Import() fails, zoneinfomodule_exec() returns 0 (success) with an exception raised.

It should check if the import succeeded or not. Concrete example on AIX where datetime cannot be imported:
https://bugs.python.org/issue42604#msg385347

"./python setup.py build" fails with:

Assertion failed: (item != NULL) ^ (PyErr_Occurred() != NULL), file  Objects/abstract.c, line 163

--

By the way, the import machinery should raise a SystemError if a module exec function raises an exception *and* reports a success: see _Py_CheckFunctionResult().

----------
components: Extension Modules
messages: 385355
nosy: vstinner
priority: normal
severity: normal
status: open
title: _zoneinfo: zoneinfomodule_exec() doesn't check for PyDateTime_IMPORT failure
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42979>
_______________________________________

From report at bugs.python.org  Wed Jan 20 12:26:39 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 17:26:39 +0000
Subject: [issue42604] EXT_SUFFIX too short on FreeBSD and AIX
In-Reply-To: <1607464402.35.0.336960410788.issue42604@roundup.psfhosted.org>
Message-ID: <1611163599.11.0.730576711019.issue42604@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> Assertion failed: (item != NULL) ^ (PyErr_Occurred() != NULL), file  Objects/abstract.c, line 163

This is bpo-42979: "_zoneinfo: zoneinfomodule_exec() doesn't check for PyDateTime_IMPORT failure".

It's a side effect of the broken _datetime module.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42604>
_______________________________________

From report at bugs.python.org  Wed Jan 20 13:02:12 2021
From: report at bugs.python.org (mattip)
Date: Wed, 20 Jan 2021 18:02:12 +0000
Subject: [issue42604] EXT_SUFFIX too short on FreeBSD and AIX
In-Reply-To: <1607464402.35.0.336960410788.issue42604@roundup.psfhosted.org>
Message-ID: <1611165732.99.0.959378505349.issue42604@roundup.psfhosted.org>


mattip <matti.picus at gmail.com> added the comment:

I think this issue can only cause failed tests. `sysconfig.get_config_var('EXT_SUFFIX')` is, as far as I can tell, not used internally by any cpython build or import code.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42604>
_______________________________________

From report at bugs.python.org  Wed Jan 20 13:26:40 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 20 Jan 2021 18:26:40 +0000
Subject: [issue42978] Improve error message when "self" is missing from the
 method definition
In-Reply-To: <1611157227.52.0.513625976683.issue42978@roundup.psfhosted.org>
Message-ID: <1611167200.81.0.591603432145.issue42978@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Concur with Guido. Seems that that guess will be wrong in most cases.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42978>
_______________________________________

From report at bugs.python.org  Wed Jan 20 13:44:19 2021
From: report at bugs.python.org (Will Noble)
Date: Wed, 20 Jan 2021 18:44:19 +0000
Subject: [issue42980] argparse: GNU-style help formatter
Message-ID: <1611168259.85.0.840894983384.issue42980@roundup.psfhosted.org>


New submission from Will Noble <author at will.party>:

argparse allows GNU-style long options (with '=' in between the option and the value as opposed to a space): https://docs.python.org/3/library/argparse.html#option-value-syntax

Call it pickiness, but I'd like to be able to print the help message in that format. Looking at the code, a simple refactor would be much cleaner than implementing my own custom help formatter and having to copy-paste a bunch of implementation details that are potentially subject to change in future releases. I'll submit a patch shortly.

----------
components: Library (Lib)
messages: 385359
nosy: will
priority: normal
severity: normal
status: open
title: argparse: GNU-style help formatter
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42980>
_______________________________________

From report at bugs.python.org  Wed Jan 20 13:48:59 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 20 Jan 2021 18:48:59 +0000
Subject: [issue42864] Improve error messages regarding unclosed parentheses
In-Reply-To: <1610075010.91.0.684383999677.issue42864@roundup.psfhosted.org>
Message-ID: <1611168539.67.0.806238545382.issue42864@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
pull_requests: +23096
pull_request: https://github.com/python/cpython/pull/24273

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42864>
_______________________________________

From report at bugs.python.org  Wed Jan 20 14:02:38 2021
From: report at bugs.python.org (Illia Volochii)
Date: Wed, 20 Jan 2021 19:02:38 +0000
Subject: [issue42981] Error messages raised by _hashlib_scrypt_impl() are
 slightly misleading
Message-ID: <1611169358.29.0.992442760668.issue42981@roundup.psfhosted.org>


New submission from Illia Volochii <illia.volochii at gmail.com>:

Error messages state that maxmem and dklen must be smaller than INT_MAX, but values equal to INT_MAX are allowed too.

Also, another error message states that n must be a power of 2, but it does not mention that 1 or 2? is not allowed.

----------
components: Extension Modules
messages: 385360
nosy: illia-v
priority: normal
severity: normal
status: open
title: Error messages raised by _hashlib_scrypt_impl() are slightly misleading

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42981>
_______________________________________

From report at bugs.python.org  Wed Jan 20 14:10:09 2021
From: report at bugs.python.org (Illia Volochii)
Date: Wed, 20 Jan 2021 19:10:09 +0000
Subject: [issue42981] Error messages raised by _hashlib_scrypt_impl() are
 slightly misleading
In-Reply-To: <1611169358.29.0.992442760668.issue42981@roundup.psfhosted.org>
Message-ID: <1611169809.28.0.385388825515.issue42981@roundup.psfhosted.org>


Change by Illia Volochii <illia.volochii at gmail.com>:


----------
keywords: +patch
pull_requests: +23097
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24274

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42981>
_______________________________________

From report at bugs.python.org  Wed Jan 20 14:11:52 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 20 Jan 2021 19:11:52 +0000
Subject: [issue42978] Improve error message when "self" is missing from the
 method definition
In-Reply-To: <1611157227.52.0.513625976683.issue42978@roundup.psfhosted.org>
Message-ID: <1611169912.4.0.960752392898.issue42978@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> I don't think this makes sense. How do you know there's a missing 'self'? Surely it's just as likely that there is indeed an extra argument. Especially if A.foo is defined by a library (stdib or 3rd party).

I use the same heuristic as Pypy: the callable is a bound method, the first name in the definition is not named "self" and it was called with n+1 positional arguments

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42978>
_______________________________________

From report at bugs.python.org  Wed Jan 20 14:12:05 2021
From: report at bugs.python.org (miss-islington)
Date: Wed, 20 Jan 2021 19:12:05 +0000
Subject: [issue42864] Improve error messages regarding unclosed parentheses
In-Reply-To: <1610075010.91.0.684383999677.issue42864@roundup.psfhosted.org>
Message-ID: <1611169925.41.0.651836798877.issue42864@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset c3f167d7b243f8b8e1b797586e6cef35add013bc by Pablo Galindo in branch 'master':
bpo-42864: Simplify the tokenizer exceptions after generic SyntaxError (GH-24273)
https://github.com/python/cpython/commit/c3f167d7b243f8b8e1b797586e6cef35add013bc


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42864>
_______________________________________

From report at bugs.python.org  Wed Jan 20 14:12:58 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 20 Jan 2021 19:12:58 +0000
Subject: [issue42978] Improve error message when "self" is missing from the
 method definition
In-Reply-To: <1611157227.52.0.513625976683.issue42978@roundup.psfhosted.org>
Message-ID: <1611169978.82.0.986487660755.issue42978@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> Seems that that guess will be wrong in most cases.

Maybe I am missing something. Could you list some cases where this will give the wrong advice?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42978>
_______________________________________

From report at bugs.python.org  Wed Jan 20 14:51:21 2021
From: report at bugs.python.org (SylvainDe)
Date: Wed, 20 Jan 2021 19:51:21 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611172281.32.0.211659579197.issue42955@roundup.psfhosted.org>


SylvainDe <sylvain.desodt at gmail.com> added the comment:

For similar reasons as friendly-traceback, I'd be interested in a list of stdlib modules to be able to provide additional information in case of exceptions.

For instance:

string.ascii_lowercase
> Before: NameError("name 'string' is not defined",)
> After: NameError("name 'string' is not defined. Did you mean to import string first)

from maths import pi
> Before: ImportError('No module named maths',)
> After: ImportError("No module named maths. Did you mean 'math'?",)

choice
> Before: NameError("name 'choice' is not defined",)
> After: NameError("name 'choice' is not defined. Did you mean 'choice' from random (not imported)?",)

from itertools import pi
> Before: ImportError('cannot import name pi',)
> After: ImportError("cannot import name pi. Did you mean 'from math import pi'?",)

The first 2 cases only use the module name but the last 2 cases will actually import the modules to get the names in it and I want to do this for modules which are safe to import (no side-effect expected).

Source: https://github.com/SylvainDe/DidYouMean-Python/blob/master/didyoumean/didyoumean_internal.py#L30 (but if you are interested in that kind of features, I'd recommend using friendly-traceback instead)

----------
nosy: +SylvainDe

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Wed Jan 20 15:06:39 2021
From: report at bugs.python.org (Illia Volochii)
Date: Wed, 20 Jan 2021 20:06:39 +0000
Subject: [issue42982] Update suggested number of iterations for pbkdf2_hmac()
Message-ID: <1611173199.26.0.961948207202.issue42982@roundup.psfhosted.org>


New submission from Illia Volochii <illia.volochii at gmail.com>:

Documentation [1] suggests using at least 100,000 iterations of SHA-256 as of 2013.

Currently, it is 2021, and it is common to use much more iterations.
For example, Django will use 260,000 by default in the next 3.2 LTS release and 320,000 in 4.0 [2][3].

I suggest suggesting at least 250,000 iterations that is a somewhat round number close to the one used by modern libraries.

[1] https://docs.python.org/3/library/hashlib.html#hashlib.pbkdf2_hmac
[2] https://github.com/django/django/commit/f2187a227f7a3c80282658e699ae9b04023724e5
[3] https://github.com/django/django/commit/a948d9df394aafded78d72b1daa785a0abfeab48

----------
assignee: docs at python
components: Documentation
messages: 385365
nosy: docs at python, illia-v
priority: normal
severity: normal
status: open
title: Update suggested number of iterations for pbkdf2_hmac()

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42982>
_______________________________________

From report at bugs.python.org  Wed Jan 20 15:07:16 2021
From: report at bugs.python.org (Jason Williams)
Date: Wed, 20 Jan 2021 20:07:16 +0000
Subject: [issue42983] sys.argv incorrectly parses command lines with args in
 environment variables.
Message-ID: <1611173236.13.0.461370515171.issue42983@roundup.psfhosted.org>


New submission from Jason Williams <jasonjwwilliams at gmail.com>:

Passing arguments to a Python script using an environment variable like:

export en_auth="--arg1 test --arg2 \"$(<private_key.pem)\""
./test.py $en_auth

Incorrectly treats the value of arg2 as another argument rather than a value because the file value being inserted starts with "--":
-----BEGIN EC PARAMETERS----- BggqhkjOPQMBBw== -----END EC PARAMETERS-----

sys.argv parses it as:
['--arg1', 'test', '--arg2', '"-----BEGIN', 'EC', 'PARAMETERS-----', 'BggqhkjOPQMBBw==', '-----END', 'EC', 'PARAMETERS-----"']

If the arguments are provided directly to the script it parses correctly:
./test.py --arg1 test --arg2 "$(<private_key.pem)"

['--base-api-url', 'test', '--provisioning-device-private-key', '-----BEGIN EC PARAMETERS-----']

This looks like two bugs...sys.argv is splitting the value incorrectly because its ignoring the quoting, and argparse is treating values that start with -- as arguments.

----------
files: test.py
messages: 385366
nosy: Jason Williams
priority: normal
severity: normal
status: open
title: sys.argv incorrectly parses command lines with args in environment variables.
versions: Python 3.8
Added file: https://bugs.python.org/file49753/test.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42983>
_______________________________________

From report at bugs.python.org  Wed Jan 20 15:07:37 2021
From: report at bugs.python.org (Jason Williams)
Date: Wed, 20 Jan 2021 20:07:37 +0000
Subject: [issue42983] sys.argv incorrectly parses command lines with args in
 environment variables.
In-Reply-To: <1611173236.13.0.461370515171.issue42983@roundup.psfhosted.org>
Message-ID: <1611173257.18.0.977235524603.issue42983@roundup.psfhosted.org>


Change by Jason Williams <jasonjwwilliams at gmail.com>:


----------
components: +Library (Lib)
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42983>
_______________________________________

From report at bugs.python.org  Wed Jan 20 15:08:05 2021
From: report at bugs.python.org (Will Noble)
Date: Wed, 20 Jan 2021 20:08:05 +0000
Subject: [issue42980] argparse: GNU-style help formatter
In-Reply-To: <1611168259.85.0.840894983384.issue42980@roundup.psfhosted.org>
Message-ID: <1611173285.68.0.376407392343.issue42980@roundup.psfhosted.org>


Change by Will Noble <author at will.party>:


----------
keywords: +patch
pull_requests: +23098
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24275

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42980>
_______________________________________

From report at bugs.python.org  Wed Jan 20 15:10:48 2021
From: report at bugs.python.org (Jason Williams)
Date: Wed, 20 Jan 2021 20:10:48 +0000
Subject: [issue42983] sys.argv incorrectly parses command lines with args in
 environment variables.
In-Reply-To: <1611173236.13.0.461370515171.issue42983@roundup.psfhosted.org>
Message-ID: <1611173448.42.0.519336125916.issue42983@roundup.psfhosted.org>


Change by Jason Williams <jasonjwwilliams at gmail.com>:


Added file: https://bugs.python.org/file49754/private_key.pem

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42983>
_______________________________________

From report at bugs.python.org  Wed Jan 20 15:16:38 2021
From: report at bugs.python.org (Illia Volochii)
Date: Wed, 20 Jan 2021 20:16:38 +0000
Subject: [issue42982] Update suggested number of iterations for pbkdf2_hmac()
In-Reply-To: <1611173199.26.0.961948207202.issue42982@roundup.psfhosted.org>
Message-ID: <1611173798.89.0.0856392447489.issue42982@roundup.psfhosted.org>


Change by Illia Volochii <illia.volochii at gmail.com>:


----------
keywords: +patch
pull_requests: +23099
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24276

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42982>
_______________________________________

From report at bugs.python.org  Wed Jan 20 15:23:51 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Wed, 20 Jan 2021 20:23:51 +0000
Subject: [issue42972] [C API] Heap types (PyType_FromSpec) must fully
 implement the GC protocol
In-Reply-To: <1611093266.11.0.721387186389.issue42972@roundup.psfhosted.org>
Message-ID: <1611174231.35.0.418605586931.issue42972@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
nosy: +erlendaasland

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42972>
_______________________________________

From report at bugs.python.org  Wed Jan 20 15:39:50 2021
From: report at bugs.python.org (Rob Simsiman)
Date: Wed, 20 Jan 2021 20:39:50 +0000
Subject: [issue42984] Python 3.7 and qt Libraries
Message-ID: <1611175190.18.0.861971223122.issue42984@roundup.psfhosted.org>


New submission from Rob Simsiman <rsimsiman at mitre.org>:

Hello,

I am trying to run an application on CentOS-8 that is unable to find qt4 libraries, namely libQtCore.so.4. My PC has qt5 libraries, namely libQt5Core.so.5. How can I configure my Python 3.7 to look for the qt5 libraries instead of the qt4 libraries. Or, do I simply need to grab a newer version of Python?

Thank you,

Rob Simsiman

----------
components: ctypes
messages: 385367
nosy: rsimsiman
priority: normal
severity: normal
status: open
title: Python 3.7 and qt Libraries
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42984>
_______________________________________

From report at bugs.python.org  Wed Jan 20 15:49:52 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 20 Jan 2021 20:49:52 +0000
Subject: [issue42983] sys.argv incorrectly parses command lines with args in
 environment variables.
In-Reply-To: <1611173236.13.0.461370515171.issue42983@roundup.psfhosted.org>
Message-ID: <1611175792.05.0.735858823499.issue42983@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

That looks like you need to learn more about the shell. It is not a Python bug.

----------
nosy: +gvanrossum
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42983>
_______________________________________

From report at bugs.python.org  Wed Jan 20 15:50:43 2021
From: report at bugs.python.org (paul j3)
Date: Wed, 20 Jan 2021 20:50:43 +0000
Subject: [issue42973] argparse: mixing optional and positional arguments...
 not again
In-Reply-To: <1611094894.69.0.476759327253.issue42973@roundup.psfhosted.org>
Message-ID: <1611175843.39.0.136222047504.issue42973@roundup.psfhosted.org>


paul j3 <ajipanca at gmail.com> added the comment:

Your patch is incomplete, without documentation or tests.

Your example is incomplete.  That is _CustomAction?  What namespace does your patch produce.

It's been a while since I worked on the intermixed patch, but as I recall the OP was happy with the fix.  Also I don't recall any talk about 'matching "optionals" with "positionals" with they relate to. Was that part of the discussion?

On Stackoverflow I have seen questions about pairing arguments, and answered some.  I don't recall the best answers.  The tough version is when some of the grouped inputs may be missing 

In your example I'd suggest making '--tracks' a nargs=2 and 'append' option.  'choices' would have to be replaced with a either a custom 'type', a custom Action, or post-parsing testing.

I haven't had time yet to test your patch.

One question I frequently ask posters who want to parse complex inputs is: 'how are going to explain this to your users?'  'What kind of usage and help do you want see?'

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42973>
_______________________________________

From report at bugs.python.org  Wed Jan 20 15:51:00 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 20 Jan 2021 20:51:00 +0000
Subject: [issue42984] Python 3.7 and qt Libraries
In-Reply-To: <1611175190.18.0.861971223122.issue42984@roundup.psfhosted.org>
Message-ID: <1611175860.83.0.809095272758.issue42984@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

I recommend asking on a user forum, perhaps https://discuss.python.org/c/users/

----------
nosy: +gvanrossum
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42984>
_______________________________________

From report at bugs.python.org  Wed Jan 20 15:55:07 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 20 Jan 2021 20:55:07 +0000
Subject: [issue42978] Improve error message when "self" is missing from the
 method definition
In-Reply-To: <1611157227.52.0.513625976683.issue42978@roundup.psfhosted.org>
Message-ID: <1611176107.06.0.708043803328.issue42978@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

> I use the same heuristic as Pypy: the callable is a bound method, the first name in the definition is not named "self" and it was called with n+1 positional arguments.

Okay, that makes sense, you could have said so in the bug or PR description. :-)

Do you also exclude class and static methods?

I still worry that this might confuse users when a library for some reason uses a different name than 'self'.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42978>
_______________________________________

From report at bugs.python.org  Wed Jan 20 16:00:35 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 20 Jan 2021 21:00:35 +0000
Subject: [issue42978] Improve error message when "self" is missing from the
 method definition
In-Reply-To: <1611157227.52.0.513625976683.issue42978@roundup.psfhosted.org>
Message-ID: <1611176435.76.0.849730196164.issue42978@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> Do you also exclude class and static methods?

Yup, there is a test in the PR for that IIRC

>I still worry that this might confuse users when a library for some reason uses a different name than 'self'.

That's a good point but I think it should be fine because the old error is still there and the new part is formulated as a question (did you forgot ...?). We have other errors where we are not completely sure and we formulate the suggestion as a question. Some examples are the new error for incomplete imports and some missing coma errors.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42978>
_______________________________________

From report at bugs.python.org  Wed Jan 20 16:18:02 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 21:18:02 +0000
Subject: [issue42985] AMD64 Arch Linux Asan 3.x fails: command timed out: 1200
 seconds without output
Message-ID: <1611177482.17.0.749354598383.issue42985@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at python.org>:

The AMD64 Arch Linux Asan 3.x buildbot worker started to fail at build 262:
https://buildbot.python.org/all/#/builders/582/builds/262
-----------
...
0:39:09 load avg: 1.15 running: test_multiprocessing_forkserver (30.0 sec)
0:39:39 load avg: 1.64 running: test_multiprocessing_forkserver (1 min)
0:39:53 load avg: 1.50 [419/420] test_multiprocessing_forkserver passed (1 min 12 sec)
0:39:53 load avg: 1.50 [420/420] test_dynamicclassattribute passed

command timed out: 1200 seconds without output running (...)
process killed by signal 9
program finished with exit code -1
elapsedTime=3595.378040
-----------

----------
components: Tests
messages: 385373
nosy: vstinner
priority: normal
severity: normal
status: open
title: AMD64 Arch Linux Asan 3.x fails: command timed out: 1200 seconds without output
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42985>
_______________________________________

From report at bugs.python.org  Wed Jan 20 16:32:05 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 20 Jan 2021 21:32:05 +0000
Subject: [issue42985] AMD64 Arch Linux Asan 3.x fails: command timed out: 1200
 seconds without output
In-Reply-To: <1611177482.17.0.749354598383.issue42985@roundup.psfhosted.org>
Message-ID: <1611178325.28.0.81377387805.issue42985@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42985>
_______________________________________

From report at bugs.python.org  Wed Jan 20 16:38:57 2021
From: report at bugs.python.org (miss-islington)
Date: Wed, 20 Jan 2021 21:38:57 +0000
Subject: [issue40176] unterminated string literal tokenization error messages
 could be better
In-Reply-To: <1585936724.82.0.54480834244.issue40176@roundup.psfhosted.org>
Message-ID: <1611178737.54.0.916580028696.issue40176@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset a698d52c3975c80b45b139b2f08402ec514dce75 by Batuhan Taskaya in branch 'master':
bpo-40176: Improve error messages for unclosed string literals (GH-19346)
https://github.com/python/cpython/commit/a698d52c3975c80b45b139b2f08402ec514dce75


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40176>
_______________________________________

From report at bugs.python.org  Wed Jan 20 16:56:51 2021
From: report at bugs.python.org (Batuhan Taskaya)
Date: Wed, 20 Jan 2021 21:56:51 +0000
Subject: [issue40176] unterminated string literal tokenization error messages
 could be better
In-Reply-To: <1585936724.82.0.54480834244.issue40176@roundup.psfhosted.org>
Message-ID: <1611179811.1.0.324462599978.issue40176@roundup.psfhosted.org>


Change by Batuhan Taskaya <isidentical at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.10 -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40176>
_______________________________________

From report at bugs.python.org  Wed Jan 20 17:34:51 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 20 Jan 2021 22:34:51 +0000
Subject: [issue42978] Improve error message when "self" is missing from the
 method definition
In-Reply-To: <1611157227.52.0.513625976683.issue42978@roundup.psfhosted.org>
Message-ID: <1611182091.47.0.547507102296.issue42978@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

> Could you list some cases where this will give the wrong advice?

Guido already listed them. Library functions, static and class methods, and names like slf and _self (used either in local classes and wrapper functions to avoid conflict with the self parameter of the outer method or as a poor positional-only parameter).

> We have other errors where we are not completely sure and we formulate the suggestion as a question. Some examples are the new error for incomplete imports and some missing coma errors.

There were reasons for adding that suggestions. An error with partial recursive import is pretty common, but the error message did not have any clue about the prevalent cause of error.

The problem with missing comma in a sequence is that since the code is always multiline, the traceback never contains enough information about the problem. And we are sure that the only case when the suggestion is wrong is when you intentionally wrote incorrect code.

The problem with missing "self" does not look so common and hard to correctly determine as the above examples. We want to keep the interpreter so simple as possible, and the proposed feature looks to me far the bar of compromise.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42978>
_______________________________________

From report at bugs.python.org  Wed Jan 20 17:42:59 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Wed, 20 Jan 2021 22:42:59 +0000
Subject: [issue42862] Use functools.lru_cache iso. _sqlite.Cache in sqlite3
 module
In-Reply-To: <1610066343.94.0.466682345605.issue42862@roundup.psfhosted.org>
Message-ID: <1611182579.7.0.474796775021.issue42862@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

Tried applying bpo-42972 to sqlite and functools, but the error persists.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42862>
_______________________________________

From report at bugs.python.org  Wed Jan 20 17:51:26 2021
From: report at bugs.python.org (neonene)
Date: Wed, 20 Jan 2021 22:51:26 +0000
Subject: [issue42986] pegen parser: Crash on SyntaxError with f-string on
 Windows
Message-ID: <1611183086.81.0.804124765933.issue42986@roundup.psfhosted.org>


New submission from neonene <nicesalmon at gmail.com>:

On Windows, Python master crashes using f-string (which has an invalid char with braces) on line 3 and after.
It seems the issue is from commit (e5fe509054183bed9aef42c92da8407d339e8af8).

I tried

1) exec("f'{.}'")
2) exec("\nf'{.}'")
3) exec("\n\nf'{.}'")

commands and results are

1) expected
    >>> exec("f'{.}'")
    Traceback (most recent call last):
      File "<stdin>", line 1, in <module>
      File "<string>", line 1
        (.)
         ^
    SyntaxError: f-string: invalid syntax

2) unexpected (caret indicates nothing)
    >>> exec("\nf'{.}'")
    Traceback (most recent call last):
      File "<stdin>", line 1, in <module>
      File "<string>", line 2

        ^
    SyntaxError: f-string: invalid syntax

3) python crashes
    >>> exec("\n\nf'{.}'")

----------
components: Interpreter Core
messages: 385377
nosy: lys.nikolaou, neonene, pablogsal
priority: normal
severity: normal
status: open
title: pegen parser: Crash on SyntaxError with f-string on Windows
type: crash
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42986>
_______________________________________

From report at bugs.python.org  Wed Jan 20 18:03:21 2021
From: report at bugs.python.org (cptpcrd)
Date: Wed, 20 Jan 2021 23:03:21 +0000
Subject: [issue42780] os.set_inheritable() fails for O_PATH file descriptors
 on Linux
In-Reply-To: <1609262318.62.0.976413615492.issue42780@roundup.psfhosted.org>
Message-ID: <1611183801.77.0.904691616953.issue42780@roundup.psfhosted.org>


Change by cptpcrd <cptpcrd.enterprise at gmail.com>:


----------
pull_requests: +23100
pull_request: https://github.com/python/cpython/pull/24277

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42780>
_______________________________________

From report at bugs.python.org  Wed Jan 20 18:03:22 2021
From: report at bugs.python.org (cptpcrd)
Date: Wed, 20 Jan 2021 23:03:22 +0000
Subject: [issue42780] os.set_inheritable() fails for O_PATH file descriptors
 on Linux
In-Reply-To: <1609262318.62.0.976413615492.issue42780@roundup.psfhosted.org>
Message-ID: <1611183802.37.0.371040670308.issue42780@roundup.psfhosted.org>


Change by cptpcrd <cptpcrd.enterprise at gmail.com>:


----------
pull_requests: +23101
pull_request: https://github.com/python/cpython/pull/24278

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42780>
_______________________________________

From report at bugs.python.org  Wed Jan 20 18:21:33 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 20 Jan 2021 23:21:33 +0000
Subject: [issue42978] Improve error message when "self" is missing from the
 method definition
In-Reply-To: <1611157227.52.0.513625976683.issue42978@roundup.psfhosted.org>
Message-ID: <1611184893.75.0.262865856429.issue42978@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> Guido already listed them. Library functions, static and class methods, 

PR 24272 will work on all those cases.

>  and names like slf and _self (used either in local classes and wrapper functions to avoid conflict with the self parameter of the outer method or as a poor positional-only parameter).

That's fine, the error is a suggestion (as we do in other parts of the stdlib), and the places where "self" is not used is normally rare. The old error is still there. The cases you mention are valid but I would say there are the exception and if someone is writing them they will probably still be able to make sense of the error.

> The problem with missing "self" does not look so common and hard to correctly determine as the above examples.

Is true, but I think that the cases were this will raise a false positive is very rare and make the benefits of the error message appealing (at least to me). 

>  We want to keep the interpreter so simple as possible, and the proposed feature looks to me far the bar of compromise.

This is an excellent point. THe only reason I am giving this a go is because this error message is super confusing to newcomers and educators are asking us, again and again, to include this hint as pypy is doing currently.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42978>
_______________________________________

From report at bugs.python.org  Wed Jan 20 18:29:13 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 20 Jan 2021 23:29:13 +0000
Subject: [issue42986] pegen parser: Crash on SyntaxError with f-string on
 Windows
In-Reply-To: <1611183086.81.0.804124765933.issue42986@roundup.psfhosted.org>
Message-ID: <1611185353.85.0.909998614561.issue42986@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Seems that this problem was introduced by e5fe509054183bed9aef42c92da8407d339e8af8

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42986>
_______________________________________

From report at bugs.python.org  Wed Jan 20 18:44:01 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 20 Jan 2021 23:44:01 +0000
Subject: [issue42986] pegen parser: Crash on SyntaxError with f-string on
 Windows
In-Reply-To: <1611183086.81.0.804124765933.issue42986@roundup.psfhosted.org>
Message-ID: <1611186241.11.0.442776010251.issue42986@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
keywords: +patch
pull_requests: +23102
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24279

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42986>
_______________________________________

From report at bugs.python.org  Wed Jan 20 18:48:39 2021
From: report at bugs.python.org (Eryk Sun)
Date: Wed, 20 Jan 2021 23:48:39 +0000
Subject: [issue42968] multiprocessing handle leak on Windows when child
 process is killed during startup/unpickling
In-Reply-To: <1611080656.89.0.981627513492.issue42968@roundup.psfhosted.org>
Message-ID: <1611186519.48.0.536668657473.issue42968@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

I'm not fond of the way reduction.DupHandle() expects the receiving process to steal the duplicated handle. I'd prefer using the resource_sharer module, like reduction.DupFd() does in POSIX. Except spawning is a special case, for which reduction.DupHandle() can take advantage of the duplicate_for_child() method of the popen_spawn_win32.Popen instance.

With the resource sharer, the handle still needs to be duplicated in the sending process. But an important difference is the resource_sharer.stop() method, which at least allows closing any handles that no longer need to be shared.

---

Proposed Changes (untested)

resource_sharer.py:

    class DupHandle(object):
        '''Wrapper for a handle that can be used at any time.'''
        def __init__(self, handle):
            dh = reduction.duplicate(handle)
            def send(conn, pid):
                reduction.send_handle(conn, dh, pid)
            def close():
                _winapi.CloseHandle(dh)
            self._id = _resource_sharer.register(send, close)

        def detach(self):
            '''Get the handle. This should only be called once.'''
            with _resource_sharer.get_connection(self._id) as conn:
                return reduction.recv_handle(conn)


reduction.py:

    def send_handle(conn, handle, destination_pid):
        '''Send a handle over a local connection.'''
        proc = _winapi.OpenProcess(_winapi.PROCESS_DUP_HANDLE, False,
            destination_pid)
        try:
            dh = duplicate(handle, proc)
            conn.send(dh)
        finally:
            _winapi.CloseHandle(proc)

    def recv_handle(conn):
        '''Receive a handle over a local connection.'''
        return conn.recv()

    class _DupHandle:
        def __init__(self, handle):
            self.handle = handle
        def detach(self):
            return self.handle

    def DupHandle(handle):
        '''Return a wrapper for a handle.'''
        popen_obj = context.get_spawning_popen()
        if popen_obj is not None:
            return _DupHandle(popen_obj.duplicate_for_child(handle))
        from . import resource_sharer
        return resource_sharer.DupHandle(handle)


connection.py:

    def reduce_pipe_connection(conn):
        dh = reduction.DupHandle(conn.fileno())
        return rebuild_pipe_connection, (dh, conn.readable, conn.writable)

    def rebuild_pipe_connection(dh, readable, writable):
        return PipeConnection(dh.detach(), readable, writable)

    reduction.register(PipeConnection, reduce_pipe_connection)

----------
components: +Library (Lib)
nosy: +eryksun
versions: +Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42968>
_______________________________________

From report at bugs.python.org  Wed Jan 20 19:09:55 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 21 Jan 2021 00:09:55 +0000
Subject: [issue42978] Improve error message when "self" is missing from the
 method definition
In-Reply-To: <1611157227.52.0.513625976683.issue42978@roundup.psfhosted.org>
Message-ID: <1611187795.26.0.940814699922.issue42978@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Of course, being said all this, if the general consensus is that is not worth the trouble, I am happy to retract the PR :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42978>
_______________________________________

From report at bugs.python.org  Wed Jan 20 19:12:03 2021
From: report at bugs.python.org (neonene)
Date: Thu, 21 Jan 2021 00:12:03 +0000
Subject: [issue42986] pegen parser: Crash on SyntaxError with f-string on
 Windows
In-Reply-To: <1611183086.81.0.804124765933.issue42986@roundup.psfhosted.org>
Message-ID: <1611187923.23.0.959045295485.issue42986@roundup.psfhosted.org>


neonene <nicesalmon at gmail.com> added the comment:

For me, I confirmed no crash with PR 24279.
Thanks for the fix in no time.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42986>
_______________________________________

From report at bugs.python.org  Wed Jan 20 19:16:27 2021
From: report at bugs.python.org (miss-islington)
Date: Thu, 21 Jan 2021 00:16:27 +0000
Subject: [issue42392] remove the deprecated 'loop' parameter asyncio API
In-Reply-To: <1605639845.5.0.800535008799.issue42392@roundup.psfhosted.org>
Message-ID: <1611188187.91.0.210102605304.issue42392@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset dcea78ff53d02733ac5983255610b651aa1c0034 by Ken Jin in branch 'master':
bpo-42392: Mention loop removal in whatsnew for 3.10 (GH-24256)
https://github.com/python/cpython/commit/dcea78ff53d02733ac5983255610b651aa1c0034


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42392>
_______________________________________

From report at bugs.python.org  Wed Jan 20 19:38:48 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Thu, 21 Jan 2021 00:38:48 +0000
Subject: [issue42978] Improve error message when "self" is missing from the
 method definition
In-Reply-To: <1611157227.52.0.513625976683.issue42978@roundup.psfhosted.org>
Message-ID: <1611189528.92.0.395797830817.issue42978@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

-0 for this PR.  It would cause more problems than it solves, and traditionally we leave this sort of problem for linters and type checkers.  Also, this kind of error surfaces readily with even minimal testing.  So, I don't think this PR is worth it.

That said, don't stop looking for places where the parser can provide more useful error reporting.  Some parsing errors are truly inscrutable.

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42978>
_______________________________________

From report at bugs.python.org  Wed Jan 20 19:40:42 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 21 Jan 2021 00:40:42 +0000
Subject: [issue42978] Improve error message when "self" is missing from the
 method definition
In-Reply-To: <1611157227.52.0.513625976683.issue42978@roundup.psfhosted.org>
Message-ID: <1611189642.1.0.746301450283.issue42978@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Thanks, everyone for your valuable comments and for explaining your concerns!

I will close the PR as it seems that there is no clear consensus that will be a win after balancing the problems.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42978>
_______________________________________

From report at bugs.python.org  Wed Jan 20 19:43:59 2021
From: report at bugs.python.org (Tadek Kijkowski)
Date: Thu, 21 Jan 2021 00:43:59 +0000
Subject: [issue42973] argparse: mixing optional and positional arguments...
 not again
In-Reply-To: <1611094894.69.0.476759327253.issue42973@roundup.psfhosted.org>
Message-ID: <1611189839.05.0.173028976907.issue42973@roundup.psfhosted.org>


Tadek Kijkowski <tkijkowski at gmail.com> added the comment:

>> Your example is incomplete.  That is _CustomAction?  What namespace does your patch produce.

>> In your example I'd suggest making '--tracks' a nargs=2 and 'append' option.  'choices' would have to be replaced with a either a custom 'type', a custom Action, or post-parsing testing.

My use case and example were oversimplified. The real life use case would be a program that processes multiple sources, with various processing parameters which may change between sources and writes result to destination:

example.py:

#! /usr/bin/python3

import argparse

class _AddSourceAction(argparse.Action):
    def __init__(self, option_strings, dest, nargs=None, const=None,
                 default=None, type=None, choices=None, required=False,
                 help=None, metavar=None):
        super(_AddSourceAction, self).__init__(
            option_strings=option_strings, dest=dest, nargs=nargs,
            const=const, default=default, type=type,
            choices=choices, required=required, help=help,
            metavar=metavar)

    def __call__(self, parser, namespace, values, option_string=None):
        for source in values:
            namespace.sources.append({'name': source,
                'frobnicate': namespace.frobnicate,
                'massage_level': namespace.massage_level})

def process_files(dest, sources):
    for source in sources:
        frob = source["frobnicate"]
        print("processing %s, %sfrobnication, massage level %d " %
              (source["name"],
              "default " if frob is None else "no " if frob == False else "",
              source["massage_level"]))
    print("saving output to %s" % dest)

parser = argparse.ArgumentParser()
if hasattr(parser, "greedy_star"):
    setattr(parser, "greedy_star", True)
parser.add_argument('destination')
parser.add_argument('--frobnicate', action='store_true', dest='frobnicate')
parser.add_argument('--no-frobnicate', action='store_false', dest='frobnicate')
parser.add_argument('--massage-level', type=int, default=5)
parser.add_argument('sources', metavar="source", nargs='*', action=_AddSourceAction)
parser.set_defaults(sources=[])
parser.set_defaults(frobnicate=None)
args = parser.parse_args()

process_files(args.destination, args.sources)

Without patch:

$ ./example.py output.txt --massage-level 4 input1.txt input2.txt --massage-level 5 input3.txt --frobnicate input4.txt input5.txt
example.py: error: unrecognized arguments: input1.txt input2.txt input3.txt input4.txt input5.txt

With patch:

$ PYTHONPATH=patch ./example.py output.txt --massage-level 4 input1.txt input2.txt --massage-level 5 input3.txt --frobnicate input4.txt input5.txt
processing input1.txt, default frobnication, massage level 4
processing input2.txt, default frobnication, massage level 4
processing input3.txt, default frobnication, massage level 5
processing input4.txt, frobnication, massage level 5
processing input5.txt, frobnication, massage level 5
saving output to output.txt

Note that I avoided passing greedy_star to constructor, to avoid error with unpatched argparse. Maybe that should be recommended way to enable this feature? N.b. I don't quite like this name 'greedy_star' seems to informal for me, but I didn't come up with anything better.

In this example frobnicate and massage_level apply to all following sources, but _AddSourceAction could be modified to reset their values, so they would only apply to first following source.

>> It's been a while since I worked on the intermixed patch, but as I recall the OP was happy with the fix.  Also I don't recall any talk about 'matching "optionals" with "positionals" with they relate to. Was that part of the discussion?
>> On Stackoverflow I have seen questions about pairing arguments, and answered some.  I don't recall the best answers.  The tough version is when some of the grouped inputs may be missing 

The use case above seems quite basic and common to me. I'm surprises that I actually didn't find any question on stackoverflow about this exact use case.

>> One question I frequently ask posters who want to parse complex inputs is: 'how are going to explain this to your users?'  'What kind of usage and help do you want see?'

I would (and I will, because I'm really working on a project which will do something like this) put all options which apply to source files into separate option group and add help string to this option group which explains that those options may be specified between source files and that they apply to all (or just first) following source files.

>> Your patch is incomplete, without documentation or tests.

Yeah, I can work on that if there is any chance that this will go anywhere. This is an effort from my side however, because I have quite slow mobile link at this moment. I tried to checkout python sources, but even with -depth 1 it took too long for my patience and I gave up after 'du -sh .git' showed 2G.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42973>
_______________________________________

From report at bugs.python.org  Wed Jan 20 19:45:55 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 21 Jan 2021 00:45:55 +0000
Subject: [issue42978] Improve error message when "self" is missing from the
 method definition
In-Reply-To: <1611157227.52.0.513625976683.issue42978@roundup.psfhosted.org>
Message-ID: <1611189955.14.0.080940400412.issue42978@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> rejected
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42978>
_______________________________________

From report at bugs.python.org  Wed Jan 20 20:52:39 2021
From: report at bugs.python.org (Brian Romanowski)
Date: Thu, 21 Jan 2021 01:52:39 +0000
Subject: [issue42974] tokenize reports incorrect end col offset and line
 string when input ends without explicit newline
In-Reply-To: <1611112437.84.0.130779999528.issue42974@roundup.psfhosted.org>
Message-ID: <1611193959.44.0.48753922556.issue42974@roundup.psfhosted.org>


Brian Romanowski <romanows at gmail.com> added the comment:

Shoot, just realized that consistency isn't the important thing here, the most important thing is that the tokenizer module exactly matches the output of the Python tokenizer.  It's possible that my changes violate that constraint, I'll take a look at that.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42974>
_______________________________________

From report at bugs.python.org  Wed Jan 20 21:08:31 2021
From: report at bugs.python.org (Julien Palard)
Date: Thu, 21 Jan 2021 02:08:31 +0000
Subject: [issue42843] What min_sphinx for Python 3.10
In-Reply-To: <1609951966.97.0.867485424131.issue42843@roundup.psfhosted.org>
Message-ID: <1611194911.76.0.691946467854.issue42843@roundup.psfhosted.org>


Change by Julien Palard <julien+python at palard.fr>:


----------
pull_requests: +23103
pull_request: https://github.com/python/cpython/pull/24282

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42843>
_______________________________________

From report at bugs.python.org  Wed Jan 20 21:51:16 2021
From: report at bugs.python.org (Tadek Kijkowski)
Date: Thu, 21 Jan 2021 02:51:16 +0000
Subject: [issue42973] argparse: mixing optional and positional arguments...
 not again
In-Reply-To: <1611094894.69.0.476759327253.issue42973@roundup.psfhosted.org>
Message-ID: <1611197476.19.0.508763024611.issue42973@roundup.psfhosted.org>


Tadek Kijkowski <tkijkowski at gmail.com> added the comment:

>> I tried to checkout python sources, but even with -depth 1 it took too long for my patience and I gave up after 'du -sh .git' showed 2G.

Ignore that. I must have been doing something worng.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42973>
_______________________________________

From report at bugs.python.org  Wed Jan 20 23:02:35 2021
From: report at bugs.python.org (bfpiaoran)
Date: Thu, 21 Jan 2021 04:02:35 +0000
Subject: [issue42987] HTTP header injection in urllib on windows
Message-ID: <1611201755.22.0.579642102837.issue42987@roundup.psfhosted.org>


New submission from bfpiaoran <bfpiaoran at qq.com>:

Recently,(on windows) I discovered a security issue during a security review due to urllib.I checked the document and found that it has been fixed at https://bugs.python.org/issue22928.but My python version is 3.7.2 over the fix bug version .Then tried to find the reason
The code is probably as follows under the django framework

```
from urllib.request import urlopen



remote_urls = request.POST.getlist("source[]", [])
for remote_url in remote_urls:
    remote_image = urlopen(remote_url)

```
source[]=http://127.0.0.1:6379/%0d%0aset%20ce%20test%0d%0a/1.jpg

Changing the address will make urlopen connect to the local machine 6379 and set the key value

python3 



Python 3.7.2 (tags/v3.7.2:9a3ffc0492, Dec 23 2018, 22:20:52) [MSC v.1916 32 bit (Intel)] on win32
Type "help", "copyright", "credits" or "license" for more information.
>>> from django.utils.six.moves.urllib.request import urlopen
>>> remote_image = urlopen('http://127.0.0.1:6379/\r\nset ce test\r\n/1.jpg')
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "C:\Users\cuijianxiong\AppData\Local\Programs\Python\Python37-32\lib\urllib\request.py", line 222, in urlopen        return opener.open(url, data, timeout)
  File "C:\Users\cuijianxiong\AppData\Local\Programs\Python\Python37-32\lib\urllib\request.py", line 525, in open           response = self._open(req, data)
  File "C:\Users\cuijianxiong\AppData\Local\Programs\Python\Python37-32\lib\urllib\request.py", line 543, in _open          '_open', req)
  File "C:\Users\cuijianxiong\AppData\Local\Programs\Python\Python37-32\lib\urllib\request.py", line 503, in _call_chain    result = func(*args)
  File "C:\Users\cuijianxiong\AppData\Local\Programs\Python\Python37-32\lib\urllib\request.py", line 1345, in http_open
    return self.do_open(http.client.HTTPConnection, req)
  File "C:\Users\cuijianxiong\AppData\Local\Programs\Python\Python37-32\lib\urllib\request.py", line 1320, in do_open
    r = h.getresponse()
  File "C:\Users\cuijianxiong\AppData\Local\Programs\Python\Python37-32\lib\http\client.py", line 1321, in getresponse
    response.begin()
  File "C:\Users\cuijianxiong\AppData\Local\Programs\Python\Python37-32\lib\http\client.py", line 296, in begin
    version, status, reason = self._read_status()
  File "C:\Users\cuijianxiong\AppData\Local\Programs\Python\Python37-32\lib\http\client.py", line 278, in _read_status
    raise BadStatusLine(line)
http.client.BadStatusLine: $-1



Django will encode and decode urlopen because of the url specification, and accept requests with "\r\n" in the url


It is the responsibility of the developer leveraging Python and its HTTP client libraries to ensure that their (web) application acts in accordance to official HTTP specifications and that no threats to security will arise from their code.
However, newlines inside headers are arguably a special case of breaking the conformity with RFC's in regard to the allowed character set. No illegal character used inside a HTTP header is likely to have a compromising side effect on back-end clients and servers and the integrity of their communication, as a result of the leniency of most web servers. However, a newline character (0x0A) embedded in a HTTP header invariably has the semantic consequence of denoting the start of an additional header line. To put it differently, not sanitizing headers in complete accordance to RFC's could be seen as as virtue in that it gives the programmer a maximum amount of freedom, without having to trade it for any likely or severe security ramifications, so that they may use illegal characters in testing environments and environments that are outlined by an expliticly less strict interpretation of the HTTP protocol. Newlines are special in that they enable anyone who is able to influence the header content, to, in effect, perform additional invocations to add_header().


urlopen('http://106.53.251.216:8888/\r\Auth: test\r\n/1.jpg')


Ncat: Version 7.70 ( https://nmap.org/ncat )
Ncat: Listening on :::8888
Ncat: Listening on 0.0.0.0:8888
Ncat: Connection from 111.202.227.139.
Ncat: Connection from 111.202.227.139:14411.
\Auth: test
/1.jpg HTTP/1.1
Accept-Encoding: identity
Host: 106.53.251.216:8888
User-Agent: Python-urllib/3.7
Connection: close



I think https://bugs.python.org/issue22928 is not very thorough and does not fully detect line breaks

----------
messages: 385389
nosy: bfpiaoran, lemburg, orsenthil
priority: normal
severity: normal
status: open
title: HTTP header injection in urllib on windows
type: security
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42987>
_______________________________________

From report at bugs.python.org  Wed Jan 20 23:06:30 2021
From: report at bugs.python.org (Senthil Kumaran)
Date: Thu, 21 Jan 2021 04:06:30 +0000
Subject: [issue42967] [security] urllib.parse.parse_qsl(): Web cache poisoning
 - `; ` as a query args separator
In-Reply-To: <1611068809.96.0.58823274544.issue42967@roundup.psfhosted.org>
Message-ID: <1611201990.32.0.875610961814.issue42967@roundup.psfhosted.org>


Change by Senthil Kumaran <senthil at uthcode.com>:


----------
nosy: +orsenthil

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Wed Jan 20 23:34:28 2021
From: report at bugs.python.org (hai shi)
Date: Thu, 21 Jan 2021 04:34:28 +0000
Subject: [issue42972] [C API] Heap types (PyType_FromSpec) must fully
 implement the GC protocol
In-Reply-To: <1611093266.11.0.721387186389.issue42972@roundup.psfhosted.org>
Message-ID: <1611203668.04.0.662706808603.issue42972@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
nosy: +shihai1991

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42972>
_______________________________________

From report at bugs.python.org  Wed Jan 20 23:35:19 2021
From: report at bugs.python.org (hai shi)
Date: Thu, 21 Jan 2021 04:35:19 +0000
Subject: [issue42980] argparse: GNU-style help formatter
In-Reply-To: <1611168259.85.0.840894983384.issue42980@roundup.psfhosted.org>
Message-ID: <1611203719.31.0.221717844679.issue42980@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
nosy: +paul.j3, rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42980>
_______________________________________

From report at bugs.python.org  Thu Jan 21 00:02:39 2021
From: report at bugs.python.org (hai shi)
Date: Thu, 21 Jan 2021 05:02:39 +0000
Subject: [issue42035] [C API] PyType_GetSlot cannot get tp_name
In-Reply-To: <1602683525.08.0.938781399322.issue42035@roundup.psfhosted.org>
Message-ID: <1611205359.26.0.71808611052.issue42035@roundup.psfhosted.org>


hai shi <shihai1991 at 126.com> added the comment:

> New C API functions must not return borrowed references, but strong references.

Thanks petr, victor for your suggestion. It's more friendly to users.

> Which one should be returned by PyType_GetName()? Is there a warranty that it's always short or always qualified?

Returning short or qualified name depends on how to define the tp_name in PyType_Spec or type object. IMHO, PyType_GetName() return the original defined type name is fine to users.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42035>
_______________________________________

From report at bugs.python.org  Thu Jan 21 00:04:47 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Thu, 21 Jan 2021 05:04:47 +0000
Subject: [issue42980] argparse: GNU-style help formatter
In-Reply-To: <1611168259.85.0.840894983384.issue42980@roundup.psfhosted.org>
Message-ID: <1611205487.18.0.949094903735.issue42980@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

This sounds reasonable to me and the patch is non-invasive.  Paul, what do you think?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42980>
_______________________________________

From report at bugs.python.org  Thu Jan 21 00:19:32 2021
From: report at bugs.python.org (Brian Romanowski)
Date: Thu, 21 Jan 2021 05:19:32 +0000
Subject: [issue42974] tokenize reports incorrect end col offset and line
 string when input ends without explicit newline
In-Reply-To: <1611112437.84.0.130779999528.issue42974@roundup.psfhosted.org>
Message-ID: <1611206372.43.0.290286038428.issue42974@roundup.psfhosted.org>


Brian Romanowski <romanows at gmail.com> added the comment:

I took a look at Parser/tokenizer.c.  From what I can tell, the tokenizer does fake a newline character when the input buffer does not end with actual newline characters and that the returned NEWLINE token has an effective length of 1 because of this faked newline character.  That is, tok->cur - tok->start == 1 when the NEWLINE token is returned.

If this part of the C tokenizer is meant to be modeled exactly by the Python tokenize module, then the current code is correct.  If there is some wiggle room because tok->start and tok->cur are converted into line numbers and column offsets, then maybe it's acceptable to change them?  If not, then the current documentation is misleading because the newline_token_2.end[1] element from my original example is not "... <the> column where the token ends in the source".  There is no such column.

I'm not sure whether the C tokenizer exposes anything like newline_token_2.string, directly.  If so, does it hold the faked newline character or does it hold the empty string like the current tokenize module does?

I'm also not sure whether the C tokenizer exposes anything like newline_token_2.line.  If it does, I'd be surprised if the faked newline would cause this to somehow become the empty string instead of the actual line content.  So I'm guessing that current tokenize module's behavior here is still a real bug?  If not, then this is another case that might benefit from some edge-case documentation.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42974>
_______________________________________

From report at bugs.python.org  Thu Jan 21 03:28:38 2021
From: report at bugs.python.org (Ronald Oussoren)
Date: Thu, 21 Jan 2021 08:28:38 +0000
Subject: [issue42970] File path with blank causes open error in 3.8, not in 3.7
In-Reply-To: <1611087981.59.0.713366355851.issue42970@roundup.psfhosted.org>
Message-ID: <1611217718.85.0.467859266566.issue42970@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

What kind of error do you get?

----------
nosy: +ronaldoussoren

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42970>
_______________________________________

From report at bugs.python.org  Thu Jan 21 03:29:32 2021
From: report at bugs.python.org (Gregory P. Smith)
Date: Thu, 21 Jan 2021 08:29:32 +0000
Subject: [issue42987] HTTP header injection in urllib on windows
In-Reply-To: <1611201755.22.0.579642102837.issue42987@roundup.psfhosted.org>
Message-ID: <1611217772.66.0.579283685387.issue42987@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

Have you tried this on a more recent Python?  works for me on 3.7.8 on macos.

Python 3.7.8 (v3.7.8:4b47a5b6ba, Jun 27 2020, 04:47:50) 
[Clang 6.0 (clang-600.0.57)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> from urllib.request import urlopen
>>> remote_image = urlopen('http://127.0.0.1:6379/\r\nset ce test\r\n/1.jpg')
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/urllib/request.py", line 222, in urlopen
    return opener.open(url, data, timeout)
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/urllib/request.py", line 525, in open
    response = self._open(req, data)
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/urllib/request.py", line 543, in _open
    '_open', req)
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/urllib/request.py", line 503, in _call_chain
    result = func(*args)
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/urllib/request.py", line 1378, in http_open
    return self.do_open(http.client.HTTPConnection, req)
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/urllib/request.py", line 1350, in do_open
    encode_chunked=req.has_header('Transfer-encoding'))
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1262, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1273, in _send_request
    self.putrequest(method, url, **skips)
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1116, in putrequest
    self._validate_path(url)
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1207, in _validate_path
    raise InvalidURL(f"URL can't contain control characters. {url!r} "
http.client.InvalidURL: URL can't contain control characters. '/\r\nset ce test\r\n/1.jpg' (found at least '\r')


If this is somehow Windows specific (that'd be surprising), I don't have windows and someone else will need to confirm.

----------
nosy: +gregory.p.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42987>
_______________________________________

From report at bugs.python.org  Thu Jan 21 03:35:35 2021
From: report at bugs.python.org (Dima Tisnek)
Date: Thu, 21 Jan 2021 08:35:35 +0000
Subject: [issue36456] task.cancel unbound recursion
In-Reply-To: <1553741574.55.0.426835875653.issue36456@roundup.psfhosted.org>
Message-ID: <1611218135.16.0.534789377091.issue36456@roundup.psfhosted.org>


Dima Tisnek <dimaqq at gmail.com> added the comment:

Py3.10: tested on v3.10.0a3:8bae2a958e and v3.10.0a4:445f7f54b1

----------
versions: +Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36456>
_______________________________________

From report at bugs.python.org  Thu Jan 21 03:35:59 2021
From: report at bugs.python.org (Dima Tisnek)
Date: Thu, 21 Jan 2021 08:35:59 +0000
Subject: [issue36456] task.cancel unbound recursion if task is deadlocked
In-Reply-To: <1553741574.55.0.426835875653.issue36456@roundup.psfhosted.org>
Message-ID: <1611218159.91.0.137497914275.issue36456@roundup.psfhosted.org>


Change by Dima Tisnek <dimaqq at gmail.com>:


----------
title: task.cancel unbound recursion -> task.cancel unbound recursion if task is deadlocked

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36456>
_______________________________________

From report at bugs.python.org  Thu Jan 21 03:45:00 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 21 Jan 2021 08:45:00 +0000
Subject: [issue42987] HTTP header injection in urllib on windows
In-Reply-To: <1611201755.22.0.579642102837.issue42987@roundup.psfhosted.org>
Message-ID: <1611218700.75.0.42053791036.issue42987@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> My python version is 3.7.2

Please upgrade, you version contains at least two fixed HTTP Header Injection vulnerabilities:

https://python-security.readthedocs.io/vuln/http-header-injection-method.html
https://python-security.readthedocs.io/vuln/urlopen-host-http-header-injection.html

I close the issue.

----------
nosy: +vstinner
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42987>
_______________________________________

From report at bugs.python.org  Thu Jan 21 03:47:19 2021
From: report at bugs.python.org (bfpiaoran)
Date: Thu, 21 Jan 2021 08:47:19 +0000
Subject: [issue42987] HTTP header injection in urllib on windows
In-Reply-To: <1611201755.22.0.579642102837.issue42987@roundup.psfhosted.org>
Message-ID: <1611218839.74.0.37336853976.issue42987@roundup.psfhosted.org>


bfpiaoran <bfpiaoran at qq.com> added the comment:

ok i tried it, indeed

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42987>
_______________________________________

From report at bugs.python.org  Thu Jan 21 03:48:24 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 21 Jan 2021 08:48:24 +0000
Subject: [issue42987] HTTP header injection in urllib on windows
In-Reply-To: <1611201755.22.0.579642102837.issue42987@roundup.psfhosted.org>
Message-ID: <1611218904.2.0.89861235777.issue42987@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

FYI I wrote https://github.com/vstinner/check_python_vuln tool to check known Python vulnerabilities. But I didn't write a check for all known vulnerabilities. Contributions are welcome ;-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42987>
_______________________________________

From report at bugs.python.org  Thu Jan 21 03:50:42 2021
From: report at bugs.python.org (bfpiaoran)
Date: Thu, 21 Jan 2021 08:50:42 +0000
Subject: [issue42987] HTTP header injection in urllib on windows
In-Reply-To: <1611201755.22.0.579642102837.issue42987@roundup.psfhosted.org>
Message-ID: <1611219042.74.0.0784821440087.issue42987@roundup.psfhosted.org>


bfpiaoran <bfpiaoran at qq.com> added the comment:

I encountered a problem with this project https://github.com/zhangfisher/DjangoUeditor, but it seems that it is no longer maintained :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42987>
_______________________________________

From report at bugs.python.org  Thu Jan 21 04:19:16 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 21 Jan 2021 09:19:16 +0000
Subject: [issue33289] tkinter askcolor returning floats for r, g,
 b values instead of ints
In-Reply-To: <1523915381.82.0.682650639539.issue33289@psf.upfronthosting.co.za>
Message-ID: <1611220756.79.0.201252938562.issue33289@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

https://www.tcl.tk/man/tcl8.6/TkCmd/winfo.htm says
"winfo rgb window color
    Returns a list containing three decimal values in the range 0 to 65535, which are the red, green, and blue intensities that correspond to color in the window given by window. Color may be specified in any of the forms acceptable for a color option."

Since tk represents data as strings, 'decimal value in [0, 65535)' means 'integer value represented by decimal digits'.  'correspond to color in the window' implies that the mapping from color to decimal value could depend on the window.  The mapping *does* differ between systems (see below).

https://www.tcl.tk/man/tcl8.6/TkLib/GetColor.htm
Lists possible return values, hence acceptible forms, as name or '#' followed by 1 to 4 hex digits.  It continues with "Each R, G, or B represents a single hexadecimal digit. The four forms permit colors to be specified with 4-bit, 8-bit, 12-bit or 16-bit values. When fewer than 16 bits are provided for each color, they represent the most significant bits of the color, while the lower unfilled bits will be repeatedly replicated from the available higher bits. For example, #3a7 is the same as #3333aaaa7777."

This omits to say what happens when there are 2 or 3 hex digits.  Windows ignores 3rd and 4th hex digits.  On Windows, dividing by 257 instead of 256 would be correct.  However, 256 works because the 'error', represented by the remainder, is always in [0, 256).  MacOS does not ignore digits.

https://www.tcl.tk/man/tcl8.6/TkCmd/colors.htm
Lists current color names and their values as 16 bit decimals.

The PR is blocked because the new colorchooser tests pass on Windows and macOS but fail on Ubuntu.  Cheryl speculated that the color names values vary across systems.  I think that it might instead be a coding issue, but I want to understand coding on Windows and Mac better before looking into Linux.

----------
versions: +Python 3.10 -Python 3.6, Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33289>
_______________________________________

From report at bugs.python.org  Thu Jan 21 04:22:02 2021
From: report at bugs.python.org (Ryan Hileman)
Date: Thu, 21 Jan 2021 09:22:02 +0000
Subject: [issue42800] Traceback objects allow accessing frame objects without
 triggering audit hooks
In-Reply-To: <1609460218.67.0.01717828776.issue42800@roundup.psfhosted.org>
Message-ID: <1611220922.32.0.494110348317.issue42800@roundup.psfhosted.org>


Ryan Hileman <lunixbochs at gmail.com> added the comment:

I just found out that generator object variants have their own code attributes. I investigated the stdlib usage and it seems to be for debug / dis only, so adding these attributes shouldn't impact performance.

I updated the PR to now cover the following attributes:

PyTracebackObject.tb_frame
PyFrameObject.f_code
PyGenObject.gi_code
PyCoroObject.cr_code
PyAsyncGenObject.ag_code

I have also attached a `check_hooks.py` file which allows for quick visual inspection that all of the hooks are working (It prints each attribute name, then accesses it. Expected output is an AUDIT line after each attribute printed.)

----------
Added file: https://bugs.python.org/file49755/check_hooks.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42800>
_______________________________________

From report at bugs.python.org  Thu Jan 21 04:22:45 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 21 Jan 2021 09:22:45 +0000
Subject: [issue42970] File path with blank causes open error in 3.8, not in 3.7
In-Reply-To: <1611087981.59.0.713366355851.issue42970@roundup.psfhosted.org>
Message-ID: <1611220965.18.0.574053213839.issue42970@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Please provide complete script that reproduces the issue. The provided three lines do not open any file and cannot generate such error.

It could help to add the debug prints:

print(f'mySrcFldr = {mySrcFldr!a}')
print(f'srcFldr = {srcFldr!a}')
print(f'f = {f!a}')

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42970>
_______________________________________

From report at bugs.python.org  Thu Jan 21 04:49:26 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 21 Jan 2021 09:49:26 +0000
Subject: [issue42923] Py_FatalError(): dump the list of extension modules
In-Reply-To: <1610535013.1.0.942204365805.issue42923@roundup.psfhosted.org>
Message-ID: <1611222566.01.0.45071438239.issue42923@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

See also bpo-42955 "Add sys.module_names: list of stdlib module names (Python and extension modules)".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42923>
_______________________________________

From report at bugs.python.org  Thu Jan 21 04:50:21 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 21 Jan 2021 09:50:21 +0000
Subject: [issue42856] ensurepip: add configure --with-wheel-pkg-dir=PATH to
 get wheel packages from a system directory
In-Reply-To: <1610018466.49.0.695886938784.issue42856@roundup.psfhosted.org>
Message-ID: <1611222621.12.0.183343874247.issue42856@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42856>
_______________________________________

From report at bugs.python.org  Thu Jan 21 05:33:36 2021
From: report at bugs.python.org (Ronald Oussoren)
Date: Thu, 21 Jan 2021 10:33:36 +0000
Subject: [issue42970] File path with blank causes open error in 3.8, not in 3.7
In-Reply-To: <1611087981.59.0.713366355851.issue42970@roundup.psfhosted.org>
Message-ID: <1611225216.18.0.574161661197.issue42970@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

This might be a security feature in Big Sur, access to some locations is restricted by default. I'm not sure if that includes ~/Library, it definitely affects access to ~/Documents. I'd expect to see a security pop-up from the system though.

I cannot reproduce this with python 3.9.1 on Big Sur on an M1 system.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42970>
_______________________________________

From report at bugs.python.org  Thu Jan 21 05:47:04 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 21 Jan 2021 10:47:04 +0000
Subject: [issue42780] os.set_inheritable() fails for O_PATH file descriptors
 on Linux
In-Reply-To: <1609262318.62.0.976413615492.issue42780@roundup.psfhosted.org>
Message-ID: <1611226024.03.0.758911962828.issue42780@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 844ec0ba6606b60a59b7da82c54c1e646424259c by cptpcrd in branch '3.8':
bpo-42780: Fix set_inheritable() for O_PATH file descriptors on Linux (GH-24172) (GH-24277)
https://github.com/python/cpython/commit/844ec0ba6606b60a59b7da82c54c1e646424259c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42780>
_______________________________________

From report at bugs.python.org  Thu Jan 21 05:47:04 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 21 Jan 2021 10:47:04 +0000
Subject: [issue42780] os.set_inheritable() fails for O_PATH file descriptors
 on Linux
In-Reply-To: <1609262318.62.0.976413615492.issue42780@roundup.psfhosted.org>
Message-ID: <1611226024.17.0.299956069501.issue42780@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 6893523bed4ad701838715380659c245eec71d48 by cptpcrd in branch '3.9':
bpo-42780: Fix set_inheritable() for O_PATH file descriptors on Linux (GH-24172) (GH-24278)
https://github.com/python/cpython/commit/6893523bed4ad701838715380659c245eec71d48


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42780>
_______________________________________

From report at bugs.python.org  Thu Jan 21 05:48:47 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 21 Jan 2021 10:48:47 +0000
Subject: [issue42780] os.set_inheritable() fails for O_PATH file descriptors
 on Linux
In-Reply-To: <1609262318.62.0.976413615492.issue42780@roundup.psfhosted.org>
Message-ID: <1611226127.84.0.14324004179.issue42780@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Thanks cptpcrd for the bug report, the fix and for the two manual backports ;-)

Note: Python 3.6 and 3.7 no longer accept bugfixes.
https://devguide.python.org/#status-of-python-branches

----------
versions:  -Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42780>
_______________________________________

From report at bugs.python.org  Thu Jan 21 06:27:05 2021
From: report at bugs.python.org (Mark Shannon)
Date: Thu, 21 Jan 2021 11:27:05 +0000
Subject: [issue42951] Random and infinite loop in dealing with recursion error
 for "try-except "
In-Reply-To: <1610943420.56.0.379356825462.issue42951@roundup.psfhosted.org>
Message-ID: <1611228425.07.0.740096088852.issue42951@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

Yes, see PEP 651

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42951>
_______________________________________

From report at bugs.python.org  Thu Jan 21 06:27:29 2021
From: report at bugs.python.org (Mark Shannon)
Date: Thu, 21 Jan 2021 11:27:29 +0000
Subject: [issue42951] Random and infinite loop in dealing with recursion error
 for "try-except "
In-Reply-To: <1610943420.56.0.379356825462.issue42951@roundup.psfhosted.org>
Message-ID: <1611228449.93.0.705038972763.issue42951@roundup.psfhosted.org>


Change by Mark Shannon <mark at hotpy.org>:


----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42951>
_______________________________________

From report at bugs.python.org  Thu Jan 21 06:29:19 2021
From: report at bugs.python.org (Mark Shannon)
Date: Thu, 21 Jan 2021 11:29:19 +0000
Subject: [issue42925] Error trace of else inside class
In-Reply-To: <1610542676.59.0.693705484765.issue42925@roundup.psfhosted.org>
Message-ID: <1611228559.39.0.171828491322.issue42925@roundup.psfhosted.org>


Change by Mark Shannon <mark at hotpy.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42925>
_______________________________________

From report at bugs.python.org  Thu Jan 21 06:31:27 2021
From: report at bugs.python.org (Mark Shannon)
Date: Thu, 21 Jan 2021 11:31:27 +0000
Subject: [issue42917] Block stack size for frame objects should be dynamically
 sizable
In-Reply-To: <1610502849.77.0.30833881241.issue42917@roundup.psfhosted.org>
Message-ID: <1611228687.29.0.260691403152.issue42917@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

I see no advantage of getting rid of the limit of 20.

No one ever gets near 20 deep in practice.
Given the limit has been there for so long, it is likely that some tooling that expects the depth of try-statements to be limited.

Why would a code generator need to nest try statements so deeply? I'm curious.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42917>
_______________________________________

From report at bugs.python.org  Thu Jan 21 06:37:55 2021
From: report at bugs.python.org (mattip)
Date: Thu, 21 Jan 2021 11:37:55 +0000
Subject: [issue42752] multiprocessing Queue leaks a file descriptor associated
 with the pipe writer (#33081 still a problem)
In-Reply-To: <1609023821.09.0.189504509221.issue42752@roundup.psfhosted.org>
Message-ID: <1611229075.87.0.494881667552.issue42752@roundup.psfhosted.org>


Change by mattip <matti.picus at gmail.com>:


----------
nosy: +davin, pitrou

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42752>
_______________________________________

From report at bugs.python.org  Thu Jan 21 06:53:07 2021
From: report at bugs.python.org (Mark Shannon)
Date: Thu, 21 Jan 2021 11:53:07 +0000
Subject: [issue42800] Traceback objects allow accessing frame objects without
 triggering audit hooks
In-Reply-To: <1609460218.67.0.01717828776.issue42800@roundup.psfhosted.org>
Message-ID: <1611229987.38.0.389502725439.issue42800@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

I agree with Victor, we should not be attempting to build a sandbox.
https://www.python.org/dev/peps/pep-0578/#why-not-a-sandbox

Preventing access to global variables is next to impossible. Adding more and more hooks to prevent access to globals, merely adds the illusion of security. Sooner or later, someone will find a path to globals that would have a serious impact on performance to block.

We should assume that globals are accessible from user code, and write the audit function accordingly. Either in C or using a closure.

----------
nosy: +Mark.Shannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42800>
_______________________________________

From report at bugs.python.org  Thu Jan 21 06:54:56 2021
From: report at bugs.python.org (Yonatan Goldschmidt)
Date: Thu, 21 Jan 2021 11:54:56 +0000
Subject: [issue41545] gc API requiring matching number of gc.disable -
 gc.enable calls
In-Reply-To: <1597362741.87.0.831562855057.issue41545@roundup.psfhosted.org>
Message-ID: <1611230096.71.0.717262099229.issue41545@roundup.psfhosted.org>


Yonatan Goldschmidt <yon.goldschmidt at gmail.com> added the comment:

Dennis, you're right. I guess I missed it when I previously searched for matching issues. https://bugs.python.org/issue31356 indeed solves my problem. Closing this as a duplicate.

----------
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41545>
_______________________________________

From report at bugs.python.org  Thu Jan 21 07:18:37 2021
From: report at bugs.python.org (=?utf-8?q?Miro_Hron=C4=8Dok?=)
Date: Thu, 21 Jan 2021 12:18:37 +0000
Subject: [issue42988] Information disclosure via pydoc -p
Message-ID: <1611231517.86.0.296188996897.issue42988@roundup.psfhosted.org>


New submission from Miro Hron?ok <miro at hroncok.cz>:

Hello Python security,
a Fedora user has reported the following security vulnerability to us (I was able to verify it):

Running `pydoc -p` allows other local users to extract arbitrary files.

Steps to Reproduce:
1. start pydoc on a port
2. as a different user guess or extract the port
3. call getfile on the server to extract arbitrary files, e.g. http://localhost:8888/getfile?key=/home/dave/.ssh/id_rsa

Actual results:
any local user on the multi-user system can read all my keys and secrets

Expected results:
Access is prevented.

Additional info:
At least a warning should be printed, that this is insecure on multi-user systems.

Python notebook works around this by providing a token that is required to access the notepad. Depending on the system being able to read arbitrary files can allow to impersonate my, by  e.g. stealing my ssh-key (if it is non-encrypted) 



I've originally reported this to security at python.org but I was asked to open a public issue here.

----------
components: Library (Lib)
messages: 385412
nosy: hroncok
priority: normal
severity: normal
status: open
title: Information disclosure via pydoc -p
type: security
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42988>
_______________________________________

From report at bugs.python.org  Thu Jan 21 07:58:23 2021
From: report at bugs.python.org (Julien Palard)
Date: Thu, 21 Jan 2021 12:58:23 +0000
Subject: [issue42988] Information disclosure via pydoc -p
In-Reply-To: <1611231517.86.0.296188996897.issue42988@roundup.psfhosted.org>
Message-ID: <1611233903.16.0.601883137732.issue42988@roundup.psfhosted.org>


Julien Palard <julien+python at palard.fr> added the comment:

Nice find! I am able to reproduce it too in many Python releases.

I see differnt ways we can fix it:


# Using a random secret generated at startup time

Used any way, like by providing an hmac on getfile urls to ensure they are signed with the server secret.

Con: getfile URLS won't work from a run to another run (the secret should be random and changed at every start), and can't be shared (do someone share them in the first place?)


# Allowlist according to sys.path

In getfile implementation, we can check if the asked path is under a path from sys.path.

Con: If someone have ~/ in sys.path, we still can access all its home, or if someone start it using `python -m pydoc` while being in its home directory as Python will prepend the cwd in sys.path.


# Allowlist populated while generating links

Idea is: each time the server generates a getfile link, the target is added to an allowlist.

Each time a getfile link is requested, if the file is not in the allowlist, request is denied.

Con: Refreshing a page won't work after a server restart (thus having an empty allowlist).


# fnmatch allowlist

We could allow only `.py` files.

Con: Secrets stored in `.py` files under user project could still be leaked.


-----------------

My personal preference goes for the allowlist populated while generating links.

----------
nosy: +mdk

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42988>
_______________________________________

From report at bugs.python.org  Thu Jan 21 08:04:17 2021
From: report at bugs.python.org (cptpcrd)
Date: Thu, 21 Jan 2021 13:04:17 +0000
Subject: [issue42780] os.set_inheritable() fails for O_PATH file descriptors
 on Linux
In-Reply-To: <1609262318.62.0.976413615492.issue42780@roundup.psfhosted.org>
Message-ID: <1611234257.18.0.542809687188.issue42780@roundup.psfhosted.org>


cptpcrd <cptpcrd.enterprise at gmail.com> added the comment:

No problem! I've noticed at least one other (relatively minor) issue in `os`, so I may be submitting further bug reports.

I haven't been keeping close track of 3.6/3.7's status, so I added them in without thinking it. Thanks for the reminder.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42780>
_______________________________________

From report at bugs.python.org  Thu Jan 21 08:09:15 2021
From: report at bugs.python.org (hai shi)
Date: Thu, 21 Jan 2021 13:09:15 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611234555.17.0.844412756257.issue42955@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
nosy: +shihai1991

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Thu Jan 21 08:11:23 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 21 Jan 2021 13:11:23 +0000
Subject: [issue42988] Information disclosure via pydoc -p
In-Reply-To: <1611231517.86.0.296188996897.issue42988@roundup.psfhosted.org>
Message-ID: <1611234683.11.0.807165865888.issue42988@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42988>
_______________________________________

From report at bugs.python.org  Thu Jan 21 08:13:57 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 21 Jan 2021 13:13:57 +0000
Subject: [issue42988] Information disclosure via pydoc -p
In-Reply-To: <1611231517.86.0.296188996897.issue42988@roundup.psfhosted.org>
Message-ID: <1611234837.77.0.516360370009.issue42988@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Downstream Fedora issue: https://bugzilla.redhat.com/show_bug.cgi?id=1917807

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42988>
_______________________________________

From report at bugs.python.org  Thu Jan 21 08:18:05 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 21 Jan 2021 13:18:05 +0000
Subject: [issue42985] AMD64 Arch Linux Asan 3.x fails: command timed out: 1200
 seconds without output
In-Reply-To: <1611177482.17.0.749354598383.issue42985@roundup.psfhosted.org>
Message-ID: <1611235085.09.0.890449957177.issue42985@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

It seems like something changed on the buildbot, not in Python, since it also fails on 3.8 and 3.9.

AMD64 Arch Linux Asan 3.9:
https://buildbot.python.org/all/#builders/579/builds/105

AMD64 Arch Linux Asan 3.8:
https://buildbot.python.org/all/#builders/580/builds/86

IMO we should disable ASAN (handling of signals) at runtime when we trigger a crash on purpose (ex: faulthandler._sigsegv()).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42985>
_______________________________________

From report at bugs.python.org  Thu Jan 21 08:44:38 2021
From: report at bugs.python.org (Marc-Andre Lemburg)
Date: Thu, 21 Jan 2021 13:44:38 +0000
Subject: [issue42988] Information disclosure via pydoc -p
In-Reply-To: <1611231517.86.0.296188996897.issue42988@roundup.psfhosted.org>
Message-ID: <1611236678.56.0.408611827789.issue42988@roundup.psfhosted.org>


Marc-Andre Lemburg <mal at egenix.com> added the comment:

Looking at the _url_handler() code in pydoc.py, this was clearly not written with web server standards in mind. None of the handlers apply security checks on the user input and there are most likely several other vulnerabilities in there to be found.

It's not just the getfile query allowing reading arbitrary files. The user may well have code in his or her Python installation which is not meant to be published to other users on the same server.

I'd suggest to print a big warning on the console, explaining that the web server will potentially make all content accessible by the user visible to anyone else on the same server.

Perhaps adding some extra check to the html_getfile() handler would be good as well, making sure that the path is on sys.path and maps to a Python file (there could be non-Python file resources in package dirs as well).

Alternatively, perhaps the whole getfile logic could be removed and the web server just provide the path to the source file (as file:// link), so that the user can easily open it, but needs access permissions for this to be successful.

----------
nosy: +lemburg

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42988>
_______________________________________

From report at bugs.python.org  Thu Jan 21 08:44:38 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 21 Jan 2021 13:44:38 +0000
Subject: [issue42985] AMD64 Arch Linux Asan 3.x fails: command timed out: 1200
 seconds without output
In-Reply-To: <1611177482.17.0.749354598383.issue42985@roundup.psfhosted.org>
Message-ID: <1611236678.1.0.676738249756.issue42985@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

About SIGSEGV logs, one option is to use ASAN_OPTIONS="handle_segv=0".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42985>
_______________________________________

From report at bugs.python.org  Thu Jan 21 08:48:03 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 21 Jan 2021 13:48:03 +0000
Subject: [issue42985] AMD64 Arch Linux Asan 3.x fails: command timed out: 1200
 seconds without output
In-Reply-To: <1611177482.17.0.749354598383.issue42985@roundup.psfhosted.org>
Message-ID: <1611236883.34.0.73998367784.issue42985@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Documentation of ASAN_OPTIONS:
https://github.com/google/sanitizers/wiki/SanitizerCommonFlags
https://github.com/google/sanitizers/wiki/AddressSanitizerFlags

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42985>
_______________________________________

From report at bugs.python.org  Thu Jan 21 08:53:44 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 21 Jan 2021 13:53:44 +0000
Subject: [issue42988] Information disclosure via pydoc -p: /getfile?key=path
 allows to read arbitrary file on the filesystem
In-Reply-To: <1611231517.86.0.296188996897.issue42988@roundup.psfhosted.org>
Message-ID: <1611237224.95.0.10125478985.issue42988@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I searched for "pydoc by Ka-Ping Yee" in Google and only found two online pydoc services:

* https://gae-pydoc.appspot.com/
* http://www.cc.kyoto-su.ac.jp/~atsushi/Programs/VisualWorks/CSV2HTML/CSV2HTML_PyDoc/index_of_modules.html

The first one runs on Python 2.7 which doesn't have the getfile feature (added in Python 3.6), the second one is a static website.

=> there is no public vulnerable website: good!

I don't think that pydoc is commonly used to run a server on the Internet.

----------
title: Information disclosure via pydoc -p -> Information disclosure via pydoc -p: /getfile?key=path allows to read arbitrary file on the filesystem

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42988>
_______________________________________

From report at bugs.python.org  Thu Jan 21 08:55:20 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 21 Jan 2021 13:55:20 +0000
Subject: [issue42988] Information disclosure via pydoc -p: /getfile?key=path
 allows to read arbitrary file on the filesystem
In-Reply-To: <1611231517.86.0.296188996897.issue42988@roundup.psfhosted.org>
Message-ID: <1611237320.68.0.403417145303.issue42988@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

An option is also to remove the whole getfile feature. It was added in bpo-2001 by:

commit 7bb30b72d8a165f8bacbc480b8d5a15834fa4c35
Author: Nick Coghlan <ncoghlan at gmail.com>
Date:   Fri Dec 3 09:29:11 2010 +0000

    Improve Pydoc interactive browsing (#2001).  Patch by Ron Adam.
    
    * A -b option to start an enhanced browsing session.
    * Allow -b and -p options to be used together.
    * Specifying port 0 will pick an arbitrary unused socket port.
    * A new browse() function to start the new server and browser.
    * Show Python version information in the header.
    * A *Get* field which takes the same input as the help() function.
    * A *Search* field which replaces the Tkinter search box.
    * Links to *Module Index*, *Topics*, and *Keywords*.
    * Improved source file viewing.
    * An HTMLDoc.filelink() method.
    * The -g option and the gui() and serve() functions are deprecated.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42988>
_______________________________________

From report at bugs.python.org  Thu Jan 21 08:57:51 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 21 Jan 2021 13:57:51 +0000
Subject: [issue42988] Information disclosure via pydoc -p: /getfile?key=path
 allows to read arbitrary file on the filesystem
In-Reply-To: <1611231517.86.0.296188996897.issue42988@roundup.psfhosted.org>
Message-ID: <1611237471.68.0.830707402709.issue42988@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The getfile feature is used to display the source code of a Python module.

For example, on the difflib documentation, there a link to difflib.py. If you click, a webpage displays the content of the file.

I suggest to remove the whole feature. I don't think that it's so useful, compared to the vulnerability.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42988>
_______________________________________

From report at bugs.python.org  Thu Jan 21 09:19:29 2021
From: report at bugs.python.org (Jurjen N.E. Bos)
Date: Thu, 21 Jan 2021 14:19:29 +0000
Subject: [issue42911] Addition chains for pow saves 5-20% time for pow(int,
 int)
In-Reply-To: <1610463140.75.0.177431925065.issue42911@roundup.psfhosted.org>
Message-ID: <1611238769.13.0.118198510543.issue42911@roundup.psfhosted.org>


Jurjen N.E. Bos <jneb at users.sourceforge.net> added the comment:

Well, I would argue that there is already quite a work going to for crypto-sized computations in the integer code, as well as the crypto-oriented .bit_count() function that was recently added.

For starters, the arguably crypto-oriented three argument pow() was there from Python 0.1 already, where I used it :-).
There's Karatsuba multiplication, five-ary powering, and quite a few optimizations on the speed of the number conversion.

And then of course the incredible implementation of Decimal, which does include a subquadratic division. I would say this would fit there.

And maybe I'll make a subquadratic division for ints someday...

Tim, your vote please...

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42911>
_______________________________________

From report at bugs.python.org  Thu Jan 21 09:29:57 2021
From: report at bugs.python.org (Jurjen N.E. Bos)
Date: Thu, 21 Jan 2021 14:29:57 +0000
Subject: [issue42911] Addition chains for pow saves 5-20% time for pow(int,
 int)
In-Reply-To: <1610463140.75.0.177431925065.issue42911@roundup.psfhosted.org>
Message-ID: <1611239397.36.0.795760728684.issue42911@roundup.psfhosted.org>


Jurjen N.E. Bos <jneb at users.sourceforge.net> added the comment:

...not to mention the new gcd and lcm functions, and the fact that the number conversion is linear for exponent-of-two bases, and the negative power modulo a prime number!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42911>
_______________________________________

From report at bugs.python.org  Thu Jan 21 09:39:22 2021
From: report at bugs.python.org (Ryan Hileman)
Date: Thu, 21 Jan 2021 14:39:22 +0000
Subject: [issue42800] Traceback objects allow accessing frame objects without
 triggering audit hooks
In-Reply-To: <1609460218.67.0.01717828776.issue42800@roundup.psfhosted.org>
Message-ID: <1611239962.41.0.899782592953.issue42800@roundup.psfhosted.org>


Ryan Hileman <lunixbochs at gmail.com> added the comment:

My personal motivation is not to unilaterally prevent access to globals, but to close a simpler gap in the audit system that affects a currently deployed high performance production system (which is not trying to be a sandbox). I am also already using a C audit hook for my purposes.

If you are referencing vstinner's first message, please remember to read their follow up https://bugs.python.org/msg384988 where they seem to have changed their mind in support of the patch.

The audit attributes I'm chasing here are fairly small in scope, and overwhelmingly only used in debug code. I believe adding them is in the spirit of the original PEP. I have also done extensive testing and CPython C and stdlib code analysis as part of this effort.

If you agree with the original PEP authors that __code__ and sys._getframe() are worth auditing, then I believe this is a natural extension of that concept. My patch improves upon the PEP by increasing the audit coverage to every way I can see of getting a frame and code object from basic CPython types.

This is a simple patch with clear performance metrics. I don't see any reason to expand the scope of this in the future unless CPython adds another basic object type along the same lines (e.g. a new async function type, a new traceback type, or a new frame type).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42800>
_______________________________________

From report at bugs.python.org  Thu Jan 21 09:42:38 2021
From: report at bugs.python.org (E. Paine)
Date: Thu, 21 Jan 2021 14:42:38 +0000
Subject: [issue42977] Tkinter Optionmenu Too Narrow on Mac
In-Reply-To: <1611154134.32.0.566162791222.issue42977@roundup.psfhosted.org>
Message-ID: <1611240158.3.0.971832718751.issue42977@roundup.psfhosted.org>


E. Paine <paineelisha at gmail.com> added the comment:

I suspect this is just a MacOS behaviour, if not then it is a Tk bug. If you really need to enforce the width, you could tell it to expand horizontally in the layout. An example of this would be as follows:

tk.Frame(root, height=1, width=300).pack()
tk.OptionMenu(root, tk.StringVar(), "test").pack(fill="x")

A bit more detail on the Tk side of things:
tkinter doesn't actually use `tk_optionMenu` and instead creates its own menubutton and menu. The issue with the menubutton width not changing also exists when working directly with Tk (`pack [menubutton .p -width 100]`). However, the same behaviour can be shown when using `tk_optionMenu`, so changing tkinter to use that instead would not fix this issue.

----------
nosy: +epaine, serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42977>
_______________________________________

From report at bugs.python.org  Thu Jan 21 10:00:13 2021
From: report at bugs.python.org (Andrew C)
Date: Thu, 21 Jan 2021 15:00:13 +0000
Subject: [issue42989] Bug
Message-ID: <1611241213.49.0.0569603079776.issue42989@roundup.psfhosted.org>


New submission from Andrew C <ASCRong at hotmail.com>:

if playerChoice == "2": reports the ":" as a "syntax error"

----------
components: Windows
messages: 385427
nosy: ASCRong, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: Bug
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42989>
_______________________________________

From report at bugs.python.org  Thu Jan 21 10:00:55 2021
From: report at bugs.python.org (Senthil Kumaran)
Date: Thu, 21 Jan 2021 15:00:55 +0000
Subject: [issue42985] AMD64 Arch Linux Asan 3.x fails: command timed out: 1200
 seconds without output
In-Reply-To: <1611177482.17.0.749354598383.issue42985@roundup.psfhosted.org>
Message-ID: <1611241255.1.0.569589980187.issue42985@roundup.psfhosted.org>


Senthil Kumaran <senthil at uthcode.com> added the comment:

> IMO we should disable ASAN (handling of signals) at runtime when we trigger a crash on purpose (ex: faulthandler._sigsegv()).

> ASAN_OPTIONS="handle_segv=0".

Both sound reasonable. But not sure if they will resolve this crash tough.

----------
nosy: +orsenthil

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42985>
_______________________________________

From report at bugs.python.org  Thu Jan 21 10:11:51 2021
From: report at bugs.python.org (Mark Shannon)
Date: Thu, 21 Jan 2021 15:11:51 +0000
Subject: [issue42800] Traceback objects allow accessing frame objects without
 triggering audit hooks
In-Reply-To: <1609460218.67.0.01717828776.issue42800@roundup.psfhosted.org>
Message-ID: <1611241911.29.0.113840272293.issue42800@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

If the point of the proposed change is not to deny access to globals, then what is the point of it?

You say that this change is to "close a simpler gap in the audit system".
What it is that the audit system is supposed to prevent, that is currently possible, and that your proposed change would prevent?

I'm worried that we end up adding more and more hooks. Performance and maintainability will suffer.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42800>
_______________________________________

From report at bugs.python.org  Thu Jan 21 10:12:28 2021
From: report at bugs.python.org (Christoph Zwerschke)
Date: Thu, 21 Jan 2021 15:12:28 +0000
Subject: [issue1375011] http.cookies,
 Cookie.py: Improper handling of duplicate cookies
Message-ID: <1611241948.49.0.430154870525.issue1375011@roundup.psfhosted.org>


Christoph Zwerschke <cito at online.de> added the comment:

This patch should really be included.

As carl already mentioned, the relevant spec is RFC 6265, see section 5.4.2: "The user agent SHOULD sort the cookie-list in the following order: Cookies with longer paths are listed before cookies with shorter paths. Among cookies that have equal-length path fields, cookies with earlier creation-times are listed before cookies with later creation-times."

Currently, if the cookies are loaded with cookies.load(env['HTTP_COOKIE']) as most web frameworks do, then the cookies will be populated with the least specific or oldest values if there are duplicates. This is really bad.

----------
nosy: +cito

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1375011>
_______________________________________

From report at bugs.python.org  Thu Jan 21 10:20:47 2021
From: report at bugs.python.org (Zachary Ware)
Date: Thu, 21 Jan 2021 15:20:47 +0000
Subject: [issue42989] Bug
In-Reply-To: <1611241213.49.0.0569603079776.issue42989@roundup.psfhosted.org>
Message-ID: <1611242447.98.0.307065063733.issue42989@roundup.psfhosted.org>


Zachary Ware <zachary.ware at gmail.com> added the comment:

That line on its own will cause an IndentationError, which is a subclass of SyntaxError.  However, out of context, without the full traceback, and without a description of your environment, the only thing I have to go on here is the fact that the vast majority of syntax errors are problems in user code, not Python itself.  This is not a forum for getting help with your own program, but you can try out discuss.python.org or the python-list at python.org mailing list for that.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42989>
_______________________________________

From report at bugs.python.org  Thu Jan 21 11:05:52 2021
From: report at bugs.python.org (Mark Shannon)
Date: Thu, 21 Jan 2021 16:05:52 +0000
Subject: [issue42990] Improve the C code for calling Python code
Message-ID: <1611245152.12.0.0348161555926.issue42990@roundup.psfhosted.org>


New submission from Mark Shannon <mark at hotpy.org>:

Currently, to make a call to Python (modules, classes, etc, not just functions) from C has to use the monster that is `_PyEval_EvalCode`.
As Python has adding features over the years, _PyEval_EvalCode has grown and grown. It is time for a refactor.

`_PyEval_EvalCode` takes 16, yes sixteen parameters!
Those 16 parameters fall into two main groups, one describing the function being called, and the other describing the arguments to the call.
Due to the jumbo size and complexity of _PyEval_EvalCode, we also have specialised forms of it, e.g. _PyFunction_Vectorcall that handle common cases and then bail to _PyEval_EvalCode in other cases.

In outline _PyEval_EvalCode performs the following actions:
1. Make a new frame.
2. Fill in that frame using the arguments and defaults provided.
3. If the code object has flags set for a generator, or coroutine, return a new generator or coroutine.
4. Otherwise call the interpreter with the newly created frame.

As _PyEval_EvalCode or its earlier equivalents have gained arguments, they have a left of list of legacy functions. It is not clear what is the "correct" function to use in C extensions. Hopefully extension code uses the `PyObject_Call` API, but `PyEval_EvalCodeEx` is part of the C-API.


To improve this situation, I propose:

A new C struct, the "frame descriptor" which contains the code object, defaults, globals, and names that describe the code to be executed. `PyFunctionObject` would wrap this, to simplify the common case of calling a Python function. 

Split the Eval functions into vector and tuple/dict forms, both forms taking a "frame descriptor", as well as the arguments.

Mark the older forms of the Eval functions as "legacy", creating a local "frame descriptor" and transforming the arguments in vector or tuple/dict forms, in the legacy functions.

Factor out the frame creation part of the Eval functions.


The above changes will be necessary for PEP 651, but I think would be a worthwhile improvement even if PEP 651 is not accepted.

----------
assignee: Mark.Shannon
components: Interpreter Core
messages: 385432
nosy: Mark.Shannon
priority: normal
severity: normal
stage: needs patch
status: open
title: Improve the C code for calling Python code

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42990>
_______________________________________

From report at bugs.python.org  Thu Jan 21 11:22:44 2021
From: report at bugs.python.org (hai shi)
Date: Thu, 21 Jan 2021 16:22:44 +0000
Subject: [issue42035] [C API] PyType_GetSlot cannot get tp_name
In-Reply-To: <1602683525.08.0.938781399322.issue42035@roundup.psfhosted.org>
Message-ID: <1611246164.31.0.502739580103.issue42035@roundup.psfhosted.org>


hai shi <shihai1991 at 126.com> added the comment:

Wait. petr mentioned `_PyType_Name` in PR 23903 which use the short name. So I am not sure which way is better. Lol~

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42035>
_______________________________________

From report at bugs.python.org  Thu Jan 21 11:38:06 2021
From: report at bugs.python.org (hai shi)
Date: Thu, 21 Jan 2021 16:38:06 +0000
Subject: [issue42966] argparse: customizable help formatter
In-Reply-To: <1611066420.6.0.700026495964.issue42966@roundup.psfhosted.org>
Message-ID: <1611247086.89.0.00302937973169.issue42966@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
nosy: +paul.j3, rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42966>
_______________________________________

From report at bugs.python.org  Thu Jan 21 11:59:38 2021
From: report at bugs.python.org (Ken Jin)
Date: Thu, 21 Jan 2021 16:59:38 +0000
Subject: [issue42988] Information disclosure via pydoc -p: /getfile?key=path
 allows to read arbitrary file on the filesystem
In-Reply-To: <1611231517.86.0.296188996897.issue42988@roundup.psfhosted.org>
Message-ID: <1611248378.71.0.857678684677.issue42988@roundup.psfhosted.org>


Change by Ken Jin <kenjin4096 at gmail.com>:


----------
keywords: +patch
nosy: +kj
nosy_count: 4.0 -> 5.0
pull_requests: +23104
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24285

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42988>
_______________________________________

From report at bugs.python.org  Thu Jan 21 12:31:51 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 21 Jan 2021 17:31:51 +0000
Subject: [issue33289] tkinter askcolor returning floats for r, g,
 b values instead of ints
In-Reply-To: <1523915381.82.0.682650639539.issue33289@psf.upfronthosting.co.za>
Message-ID: <1611250311.56.0.0107055117495.issue33289@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

65535 = 35536 - 1 = 256 * 256 - 1 == 255 * 257

On Windows, each r, g, b value is n * 257 for n in range(256) (see attached file).  The precision loss happens when colors are stored, before the division in winfo_rgb.  Perhaps 8 bits/channel (including alpha) is baked in.

Since divmod(n * 257, 257) = (n, 0) and divmod(n * 257, 256) = (n, n),
(n*257) // m = divmod(n*257, m)[0] = n whether m is 256 or 257.
---

macOS appears (from limited experiments) to handle 1 and 2 digits the same as Windows (repeat 4 or 2 times): val('#a00') = val('#aaaa00000000') = 0xaaaa, val('#ab0000') = val('#abab00000000') = 0xabab.  4 digits are left alone while 3 digits use the 1st as the 4th val('#abc000000') = val('#abca00000000') = 0xabca.

----------
Added file: https://bugs.python.org/file49756/tk_rgb.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33289>
_______________________________________

From report at bugs.python.org  Thu Jan 21 12:32:31 2021
From: report at bugs.python.org (Ken Jin)
Date: Thu, 21 Jan 2021 17:32:31 +0000
Subject: [issue42988] Information disclosure via pydoc -p: /getfile?key=path
 allows to read arbitrary file on the filesystem
In-Reply-To: <1611231517.86.0.296188996897.issue42988@roundup.psfhosted.org>
Message-ID: <1611250351.33.0.431917292149.issue42988@roundup.psfhosted.org>


Ken Jin <kenjin4096 at gmail.com> added the comment:

I created a PR to remove the getfile function - now it just places the hyperlinked file path there but clicking on it won't render the file contents.

Personally I agree with Marc-Andre Lemburg's comments on how _url_handler probably has other vulnerabilities somewhere. But I don't really see an easy solution other than removing the web server altogether. It uses http.server, which has a disclaimer on the docs page saying it isn't recommended for production. Someone looking hard enough can probably find a few more vulnerabilities in http.server itself rather than just pydoc.

I think the "Allowlist populated while generating links" suggested by Julien is pretty clever. 

I thought about file: // approach too - it's probably the most secure. But it would require a lot of change (and also generating all the .py files to .html initially).

Maybe I'll make a PR exploring the other approaches if the current one isn't favorable.

Thanks for your time.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42988>
_______________________________________

From report at bugs.python.org  Thu Jan 21 12:46:40 2021
From: report at bugs.python.org (Alexey Izbyshev)
Date: Thu, 21 Jan 2021 17:46:40 +0000
Subject: [issue42606] Support POSIX atomicity guarantee of O_APPEND on Windows
In-Reply-To: <1607483566.95.0.1927829703.issue42606@roundup.psfhosted.org>
Message-ID: <1611251200.58.0.3792964554.issue42606@roundup.psfhosted.org>


Alexey Izbyshev <izbyshev at ispras.ru> added the comment:

> It's possible to query the granted access of a kernel handle via NtQueryObject: ObjectBasicInformation

Ah, thanks for the info. But it wouldn't help for option (1) that I had in mind because open() and os.open() currently set only msvcrt-level O_APPEND.

It probably could be used in my current PR instead of just assuming the default access rights for file handles, but I'm not sure whether it makes sense: can a new handle have non-default access rights? Or can the default change at this point of Windows history?

> Python could implement its own umask value in Windows. os.umask() would set the C umask value as well, but only for the sake of consistency with C extensions and embedding.

Would it be a long shot to ask MS to add the needed functionality to MSVCRT instead? Or at least to declare the bug with _umask_s() that I described a feature. Maybe Steve Dower could help.

> Open attribute flags could also be supported, such as O_ATTR_HIDDEN and O_ATTR_SYSTEM. These are needed because a hidden or system file is required to remain as such when it's overwritten, else CreateFileW fails.

I didn't know that, thanks. Indeed, a simple open(path, 'w') fails on a hidden file with "Permission denied".

> If it's important enough, msvcrt.open() and msvcrt.O_TEXT could be provided.

Yes, I'd be glad to move support for more obscure MSVCRT flags to msvcrt.open() -- the less MSVCRT details we leak in os.open(), the more freedom we have to implement it via proper Win32 APIs.

===

Anyway, even if the blockers for implementing open()/os.open() via CreateFile() are solved, my current PR doesn't seem to conflict with such an implementation (it could just be replaced in the future).

Currently, the only way to achieve atomic append in Python on Windows that I know is to use a custom opener that would call CreateFile() with the right arguments via ctypes/pywin32/etc.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42606>
_______________________________________

From report at bugs.python.org  Thu Jan 21 12:46:33 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 21 Jan 2021 17:46:33 +0000
Subject: [issue33289] tkinter askcolor returning floats for r, g,
 b values instead of ints
In-Reply-To: <1523915381.82.0.682650639539.issue33289@psf.upfronthosting.co.za>
Message-ID: <1611251193.17.0.798279290082.issue33289@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

I do not understand why #abc000000 and #abcd00000000 give 0xabab on my computer (Linux) and even weirder result on Ubuntu on CI. Reading the code I expected the same behavior as on macOS.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33289>
_______________________________________

From report at bugs.python.org  Thu Jan 21 13:09:26 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 21 Jan 2021 18:09:26 +0000
Subject: [issue33289] tkinter askcolor returning floats for r, g,
 b values instead of ints
In-Reply-To: <1523915381.82.0.682650639539.issue33289@psf.upfronthosting.co.za>
Message-ID: <1611252566.42.0.783221776481.issue33289@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Your Linux result is the same as on Windows. Given strings 'abc' or 'abcd', ignore 'c' or 'cd' and expand 'ab' to 'abab', making value 0xabab.  Is your computer Ubuntu (implying that personal Ubuntu != CI Ubuntu) or a different Linux?  Are there tk/tcl compilation flags or X window options that could affect stored color values?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33289>
_______________________________________

From report at bugs.python.org  Thu Jan 21 13:23:07 2021
From: report at bugs.python.org (Tom Goddard)
Date: Thu, 21 Jan 2021 18:23:07 +0000
Subject: [issue42514] Relocatable framework for macOS
In-Reply-To: <1606760917.9.0.450918621788.issue42514@roundup.psfhosted.org>
Message-ID: <1611253387.11.0.402239736623.issue42514@roundup.psfhosted.org>


Change by Tom Goddard <goddard at sonic.net>:


----------
nosy: +tomgoddard

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42514>
_______________________________________

From report at bugs.python.org  Thu Jan 21 13:28:59 2021
From: report at bugs.python.org (Alexey Izbyshev)
Date: Thu, 21 Jan 2021 18:28:59 +0000
Subject: =?utf-8?q?=5Bissue42888=5D_Not_installed_=E2=80=9Clibgcc=5Fs=2Eso=2E1?=
 =?utf-8?q?=E2=80=9D_causes_exit_crash=2E?=
In-Reply-To: <1610350822.34.0.431759793604.issue42888@roundup.psfhosted.org>
Message-ID: <1611253739.95.0.486367100511.issue42888@roundup.psfhosted.org>


Alexey Izbyshev <izbyshev at ispras.ru> added the comment:

Thank you for testing. I've added a NEWS entry to the PR, so it's ready for review by the core devs.

Note that PyThread_exit_thread() can still be called by daemon threads if they try to take the GIL after Py_Finalize(), and also via C APIs like 
PyEval_RestoreThreads() (see bpo-42969), so, in general, libgcc_s is still required for CPython.

----------
versions: +Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42888>
_______________________________________

From report at bugs.python.org  Thu Jan 21 13:29:11 2021
From: report at bugs.python.org (Alexey Izbyshev)
Date: Thu, 21 Jan 2021 18:29:11 +0000
Subject: [issue42969] pthread_exit & PyThread_exit_thread from
 PyEval_RestoreThread etc. are harmful
In-Reply-To: <1611084946.55.0.234619663171.issue42969@roundup.psfhosted.org>
Message-ID: <1611253751.48.0.990539404605.issue42969@roundup.psfhosted.org>


Change by Alexey Izbyshev <izbyshev at ispras.ru>:


----------
nosy: +izbyshev

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42969>
_______________________________________

From report at bugs.python.org  Thu Jan 21 14:03:43 2021
From: report at bugs.python.org (Ryan Hileman)
Date: Thu, 21 Jan 2021 19:03:43 +0000
Subject: [issue42800] Traceback objects allow accessing frame objects without
 triggering audit hooks
In-Reply-To: <1609460218.67.0.01717828776.issue42800@roundup.psfhosted.org>
Message-ID: <1611255823.99.0.779379569189.issue42800@roundup.psfhosted.org>


Ryan Hileman <lunixbochs at gmail.com> added the comment:

My understanding as per the outline in PEP 551 as well as PEP 578, is that the audit system is meant primarily to observe the behavior of code rather than to have good sandbox coverage / directly prevent behavior.

I am using audit hooks to observe the behavior of third party Python, and I identified an indicator of shady behavior which includes code and frame object access (which includes sys._getframe(), and __code__, both of which are part of the original PEP 578).

I looked into it further and realized the CPython's auditing for those attributes/objects is superficial. I understand that auditing isn't perfect, and I'm not trying to change that. This patch just seems to me like a really basic and obvious extension of the existing __code__ and getframe audit points.

----

I ask that if your main hesitation is the impact of future audit hooks, we use this opportunity to establish a basic written precedent we can reference in the future about which kind of audit hook modifications are likely to be accepted without, say, another PEP.

One possible set of criteria:
 - The added hooks should be justified as functionally identical to something the existing PEP(s) suggested.
 - Performance should be measured and it should have very little impact on stdlib or general code.
 - The requester should be expected to justify the change, e.g. how it closes an obvious gap in an existing PEP 578 hook.

And my answers for those criteria:
 - These are functionally equivalent to the existing PEP 578 hooks for sys._getframe() and function.__code__ - they operate on similar types of objects and are used for accessing the exact same information.
 - Performance impact here appears to be only for debugging code, and performance impact on debugging code is infinitesimal when no audit hook is active.
 - I am auditing code for trivial usage of Python frames and code objects, and I can't do that sufficiently with the existing hooks (especially so now that I'm publicly documenting this gap).

----

If the primary complaint is maintenance burden, would it be preferable to add an attribute audit flag to PyMemberDef instead of using one-off PyGetSetDef functions? e.g.:

static PyMemberDef frame_memberlist[] = {
    {"f_code",          T_OBJECT,       OFF(f_code),      READONLY|AUDIT_ACCESS},
}

That would definitely simplify the implementation.

If these additions aren't worth it, I would almost recommend removing or deprecating the existing __code__ and sys._getframe() audit hooks instead, as I find them to be not very useful without this patch.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42800>
_______________________________________

From report at bugs.python.org  Thu Jan 21 14:14:12 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 21 Jan 2021 19:14:12 +0000
Subject: [issue33289] tkinter askcolor returning floats for r, g,
 b values instead of ints
In-Reply-To: <1523915381.82.0.682650639539.issue33289@psf.upfronthosting.co.za>
Message-ID: <1611256452.68.0.483057975053.issue33289@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 6713e869c4989c04318158b406c30a147ea52904 by Cheryl Sabella in branch 'master':
bpo-33289: Return RGB triplet of ints instead of floats from tkinter.colorchooser (GH-6578)
https://github.com/python/cpython/commit/6713e869c4989c04318158b406c30a147ea52904


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33289>
_______________________________________

From report at bugs.python.org  Thu Jan 21 14:14:30 2021
From: report at bugs.python.org (Christian Heimes)
Date: Thu, 21 Jan 2021 19:14:30 +0000
Subject: [issue42982] Update suggested number of iterations for pbkdf2_hmac()
In-Reply-To: <1611173199.26.0.961948207202.issue42982@roundup.psfhosted.org>
Message-ID: <1611256470.73.0.189779655665.issue42982@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

Is there any scientific research or mathematical proof for 250,000 iteration?

----------
nosy: +christian.heimes

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42982>
_______________________________________

From report at bugs.python.org  Thu Jan 21 14:43:34 2021
From: report at bugs.python.org (Ramon)
Date: Thu, 21 Jan 2021 19:43:34 +0000
Subject: [issue42991] support for splitting multichannel audio fragments in
 audioop module
Message-ID: <1611258214.16.0.1675342268.issue42991@roundup.psfhosted.org>


New submission from Ramon <ramonfraterman at gmail.com>:

All functions from the audioop module that work on stereo fragments, provide the same behaviour on multichannel (i.e. 5.1 channel LPCM) fragments. This is, however, not true for the tomono() function, that only makes sense when supplied with a 2-channel fragment.

Therefore, I suggest adding an extra function to the module that demultiplexes any N-channel fragment and returns a given channel as mono fragment:
audioop.demux(fragment, width, nChannels, channel)

When, for example, applied to a 16 bit stereo fragment, audioop.demux(fragment, 2, 2, 0) would give the same result as audioop.tomono(fragment, 2, 1.0, 0).

----------
components: Extension Modules
messages: 385443
nosy: Th4R4
priority: normal
severity: normal
status: open
title: support for splitting multichannel audio fragments in audioop module
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42991>
_______________________________________

From report at bugs.python.org  Thu Jan 21 14:45:16 2021
From: report at bugs.python.org (Ramon)
Date: Thu, 21 Jan 2021 19:45:16 +0000
Subject: [issue42991] support for splitting multichannel audio fragments in
 audioop module
In-Reply-To: <1611258214.16.0.1675342268.issue42991@roundup.psfhosted.org>
Message-ID: <1611258316.24.0.162166421825.issue42991@roundup.psfhosted.org>


Change by Ramon <ramonfraterman at gmail.com>:


----------
keywords: +patch
pull_requests: +23105
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24286

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42991>
_______________________________________

From report at bugs.python.org  Thu Jan 21 14:55:50 2021
From: report at bugs.python.org (=?utf-8?q?Ram=C3=B3n_Fraterman?=)
Date: Thu, 21 Jan 2021 19:55:50 +0000
Subject: [issue42991] support for splitting multichannel audio fragments in
 audioop module
In-Reply-To: <1611258214.16.0.1675342268.issue42991@roundup.psfhosted.org>
Message-ID: <1611258950.4.0.143992783886.issue42991@roundup.psfhosted.org>


Change by Ram?n Fraterman <ramonfraterman at gmail.com>:


----------
status: open -> pending

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42991>
_______________________________________

From report at bugs.python.org  Thu Jan 21 15:13:10 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Thu, 21 Jan 2021 20:13:10 +0000
Subject: [issue42862] Use functools.lru_cache iso. _sqlite.Cache in sqlite3
 module
In-Reply-To: <1610066343.94.0.466682345605.issue42862@roundup.psfhosted.org>
Message-ID: <1611259990.04.0.513808566065.issue42862@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

This works:

1) fully implement GC in connection (bpo-42972)
2) also visit statement_cache
3) explicitly close connections _and_ call GC in problematic tests

The first point might not be needed for this particular fix.
The last point is a workaround, not a solution. Or is it ok to call gc.collect() in the test suite?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42862>
_______________________________________

From report at bugs.python.org  Thu Jan 21 15:14:53 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Thu, 21 Jan 2021 20:14:53 +0000
Subject: [issue42862] Use functools.lru_cache iso. _sqlite.Cache in sqlite3
 module
In-Reply-To: <1610066343.94.0.466682345605.issue42862@roundup.psfhosted.org>
Message-ID: <1611260093.64.0.00709663968961.issue42862@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

> Or is it ok to call gc.collect() in the test suite?

Seems like it's ok:

$ grep -r gc.collect Lib/test | wc -l
    366

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42862>
_______________________________________

From report at bugs.python.org  Thu Jan 21 15:24:05 2021
From: report at bugs.python.org (=?utf-8?q?Ram=C3=B3n_Fraterman?=)
Date: Thu, 21 Jan 2021 20:24:05 +0000
Subject: [issue42991] support for splitting multichannel audio fragments in
 audioop module
In-Reply-To: <1611258214.16.0.1675342268.issue42991@roundup.psfhosted.org>
Message-ID: <1611260645.5.0.821402860217.issue42991@roundup.psfhosted.org>


Change by Ram?n Fraterman <ramonfraterman at gmail.com>:


----------
status: pending -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42991>
_______________________________________

From report at bugs.python.org  Thu Jan 21 15:56:49 2021
From: report at bugs.python.org (Ron Hoffmann)
Date: Thu, 21 Jan 2021 20:56:49 +0000
Subject: [issue42992] Tkinter bbox coordinates incorrectly drawn
Message-ID: <1611262609.83.0.00898948617335.issue42992@roundup.psfhosted.org>


New submission from Ron Hoffmann <rhoffmann at muskokawoods.com>:

position coordinates retrieved from any object on a canvas with
pos = canvas.bbox(object) are returned correctly

but when drawn on the canvas (x0,y0) are correct, but
(x1, y1) are not drawn in the proper positions. x1 has been divided by 2 somewhere and y1 as been multiplied by 2 somewhere.
in order for the bounding box to be drawn correctly
x1 and y1 need to be recalculated as follows

x1 = pos[0] + ( ( pos[2] - pos[0] ) * 2 )
y1 = pos[1] + ( ( pos[3] - pos[1] ) / 2 )

----------
components: Tkinter
messages: 385446
nosy: rhoffmann
priority: normal
severity: normal
status: open
title: Tkinter bbox coordinates incorrectly drawn
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42992>
_______________________________________

From report at bugs.python.org  Thu Jan 21 16:12:38 2021
From: report at bugs.python.org (paul j3)
Date: Thu, 21 Jan 2021 21:12:38 +0000
Subject: [issue42980] argparse: GNU-style help formatter
In-Reply-To: <1611168259.85.0.840894983384.issue42980@roundup.psfhosted.org>
Message-ID: <1611263558.05.0.266755772192.issue42980@roundup.psfhosted.org>


paul j3 <ajipanca at gmail.com> added the comment:

The refactoring looks reasonable.

But while we are tweaking:

    def _format_action_invocation(self, action):

I wonder if we also give users more control over how multiple option strings are formatted.  Currently if 

     parser.add_argument('-f', '--foo', help='something')

the help line will be

     -f FOO, --foo FOO     something

with this alternate formatter it would be (I think)

     -f FOO, --foo=FOO     something

But with longer option strings users often want

     -f, --foo FOO         something

or even just

     -f, --foo             something

we can almost get the last with `metavar=''`

     -f , --foo            something

which has a superfluous space before the comma.

I don't recall if there's already a bug/issue for this or not.  Maybe the fix is a subclass with a complete replacement of this _format_action_invocation method.  I'll have do more research (here and on Stackoverflow).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42980>
_______________________________________

From report at bugs.python.org  Thu Jan 21 16:13:02 2021
From: report at bugs.python.org (Christian Buhtz)
Date: Thu, 21 Jan 2021 21:13:02 +0000
Subject: [issue42993] doc xml.etree.ElementTree.ElementTree.write does not
 mention attribute order
Message-ID: <1611263582.03.0.301072283614.issue42993@roundup.psfhosted.org>


New submission from Christian Buhtz <c.buhtz at posteo.jp>:

The docs for 'xml.etree.ElementTree.ElementTree.write' in Python 3.7 (and possible earlier) does not say a word about the ordering of the attributes.

This makes unittesting hard.

But looking in the code tells me that the attributes are ordered lexically. Important to know. So please upgrade the docu about that.

In Python 3.8 the ordering behavior changed again but is mentioned in the docu. So no need to change in 3.8 or later.

----------
assignee: docs at python
components: Documentation
messages: 385448
nosy: buhtz, docs at python
priority: normal
severity: normal
status: open
title: doc xml.etree.ElementTree.ElementTree.write does not mention attribute order
type: enhancement
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42993>
_______________________________________

From report at bugs.python.org  Thu Jan 21 16:41:52 2021
From: report at bugs.python.org (Nathan Beals)
Date: Thu, 21 Jan 2021 21:41:52 +0000
Subject: [issue42994] Missing MIME types for opus, AAC and 3gpp(2)
Message-ID: <1611265312.85.0.212937423943.issue42994@roundup.psfhosted.org>


New submission from Nathan Beals <nathan.beals1 at gmail.com>:

These are officially recognized MIME types by IANA: https://www.iana.org/assignments/media-types/media-types.xhtml#audio

- .opus: audio/opus (https://www.iana.org/assignments/media-types/audio/opus and https://tools.ietf.org/html/rfc7845 for recommended file extension)
- .aac: audip/aac (https://www.iana.org/assignments/media-types/audio/aac)
- .3gp: audio/3gpp (https://www.iana.org/assignments/media-types/audio/3gpp)
- .3g2: audio/3gpp2 (https://www.iana.org/assignments/media-types/audio/3gpp2)

----------
components: Library (Lib)
messages: 385449
nosy: nbeals
priority: normal
severity: normal
status: open
title: Missing MIME types for opus, AAC and 3gpp(2)
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42994>
_______________________________________

From report at bugs.python.org  Thu Jan 21 16:43:09 2021
From: report at bugs.python.org (Nathan Beals)
Date: Thu, 21 Jan 2021 21:43:09 +0000
Subject: [issue42994] Missing MIME types for opus, AAC, 3gpp and 3gpp2
In-Reply-To: <1611265312.85.0.212937423943.issue42994@roundup.psfhosted.org>
Message-ID: <1611265389.83.0.978298940729.issue42994@roundup.psfhosted.org>


Change by Nathan Beals <nathan.beals1 at gmail.com>:


----------
title: Missing MIME types for opus, AAC and 3gpp(2) -> Missing MIME types for opus, AAC, 3gpp and 3gpp2

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42994>
_______________________________________

From report at bugs.python.org  Thu Jan 21 16:59:10 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 21 Jan 2021 21:59:10 +0000
Subject: [issue42447] robotsparser deny all with some rules
In-Reply-To: <1606154023.13.0.203747153119.issue42447@roundup.psfhosted.org>
Message-ID: <1611266350.67.0.503818118276.issue42447@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42447>
_______________________________________

From report at bugs.python.org  Thu Jan 21 16:59:22 2021
From: report at bugs.python.org (Ryan Hileman)
Date: Thu, 21 Jan 2021 21:59:22 +0000
Subject: [issue42800] Traceback objects allow accessing frame objects without
 triggering audit hooks
In-Reply-To: <1609460218.67.0.01717828776.issue42800@roundup.psfhosted.org>
Message-ID: <1611266362.1.0.916231663957.issue42800@roundup.psfhosted.org>


Ryan Hileman <lunixbochs at gmail.com> added the comment:

How's this for maintainable?

https://github.com/lunixbochs/cpython/commit/2bf1cc93d19a49cbed09b45f7dbb00212229f0a1

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42800>
_______________________________________

From report at bugs.python.org  Thu Jan 21 17:04:11 2021
From: report at bugs.python.org (Brendan Gerrity)
Date: Thu, 21 Jan 2021 22:04:11 +0000
Subject: [issue42995] Add PurePath.with_suffix_appended()
Message-ID: <1611266651.15.0.998031464768.issue42995@roundup.psfhosted.org>


New submission from Brendan Gerrity <bgerrity at ucdavis.edu>:

Appending a new suffix to a file is common operation.

The operations don't come across as elegant:

e.g. `foo_path.with_suffix(foo_path.suffix + ".old")`

----------
components: Library (Lib)
messages: 385451
nosy: bgerrity
priority: normal
severity: normal
status: open
title: Add PurePath.with_suffix_appended()
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42995>
_______________________________________

From report at bugs.python.org  Thu Jan 21 17:05:32 2021
From: report at bugs.python.org (Brendan Gerrity)
Date: Thu, 21 Jan 2021 22:05:32 +0000
Subject: [issue42995] Add PurePath.with_suffix_appended()
In-Reply-To: <1611266651.15.0.998031464768.issue42995@roundup.psfhosted.org>
Message-ID: <1611266732.62.0.0155330493741.issue42995@roundup.psfhosted.org>


Brendan Gerrity <bgerrity at ucdavis.edu> added the comment:

This could addressed with either a new helper or an option in the `PurePath.with_suffix()`.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42995>
_______________________________________

From report at bugs.python.org  Thu Jan 21 17:09:04 2021
From: report at bugs.python.org (Nathan Beals)
Date: Thu, 21 Jan 2021 22:09:04 +0000
Subject: [issue42994] Missing MIME types for opus, AAC, 3gpp and 3gpp2
In-Reply-To: <1611265312.85.0.212937423943.issue42994@roundup.psfhosted.org>
Message-ID: <1611266944.68.0.412050304917.issue42994@roundup.psfhosted.org>


Change by Nathan Beals <nathan.beals1 at gmail.com>:


----------
keywords: +patch
pull_requests: +23107
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24287

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42994>
_______________________________________

From report at bugs.python.org  Thu Jan 21 17:15:58 2021
From: report at bugs.python.org (Will Noble)
Date: Thu, 21 Jan 2021 22:15:58 +0000
Subject: [issue42980] argparse: GNU-style help formatter
In-Reply-To: <1611168259.85.0.840894983384.issue42980@roundup.psfhosted.org>
Message-ID: <1611267358.81.0.541537290704.issue42980@roundup.psfhosted.org>


Will Noble <author at will.party> added the comment:

The main contribution of my PR is simply factoring out _format_option_with_args as an overridable method. Note that this actually enables subclassing HelpFormatter to produce all the examples you presented above with 1-3 trivial lines of code, as opposed to overriding the entire _format_action_invocation which is 20 lines in the base class.

If HelpFormatter had a stable internal structure (i.e. some sort of assurance that it's overridable methods were not subject to change), I wouldn't have bothered including an implementation of GnuStyleLongOptionsHelpFormatter in this PR, since I could just implement it downstream as-needed. However, I chose to push it upstream because a) it's trivial and non-invasive and b) it establishes a use-case of _format_option_with_args for posterity, just in case anybody came in later and saw such a trivial, "private" (underscore-prefixed) method and decided to inline it.

This lack of perceived stability is alluded to in https://bugs.python.org/issue42966. My preferred solution would be to refactor HelpFormatter to have more overridable methods like this, make them non-"private", document them properly, and keep them relatively stable. In order to do that, we'd want to establish all the desired use-cases and be sure to craft the method structure in such a way that they're all supported. Since that would be a somewhat daunting design task and probably not high on the priority list atm, I think this small incremental improvement pushes things in the right direction; establishing a desirable use-case without committing to too many implementation details yet.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42980>
_______________________________________

From report at bugs.python.org  Thu Jan 21 17:23:35 2021
From: report at bugs.python.org (Eryk Sun)
Date: Thu, 21 Jan 2021 22:23:35 +0000
Subject: [issue42606] Support POSIX atomicity guarantee of O_APPEND on Windows
In-Reply-To: <1607483566.95.0.1927829703.issue42606@roundup.psfhosted.org>
Message-ID: <1611267815.59.0.65251593932.issue42606@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> can a new handle have non-default access rights? Or can the 
> default change at this point of Windows history?

I don't know what you mean by default access rights.

C open() requests generic access rights, which map to the standard and file-specific rights in the File type's generic mapping. If all of the requested access rights aren't granted, then the open fails with an access denied error. For example, if FILE_WRITE_DATA isn't granted, then open() can't open for appending. A direct CreateFileW() call can remove FILE_WRITE_DATA from the desired access.

DuplicateHandle() can always request the same or less access than the source handle. For some object types, it can perform an access check to get more access, but not for a File handle.

> Currently, the only way to achieve atomic append in Python on 
> Windows that I know is to use a custom opener that would call
> CreateFile() with the right arguments via ctypes/pywin32/etc.

An opener could also work like your PR via os.open(), msvcrt.get_osfhandle(), _winapi.GetFileType(), _winapi.DuplicateHandle(), os.close(), and msvcrt.open_osfhandle().

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42606>
_______________________________________

From report at bugs.python.org  Thu Jan 21 17:39:09 2021
From: report at bugs.python.org (Illia Volochii)
Date: Thu, 21 Jan 2021 22:39:09 +0000
Subject: [issue42982] Update suggested number of iterations for pbkdf2_hmac()
In-Reply-To: <1611173199.26.0.961948207202.issue42982@roundup.psfhosted.org>
Message-ID: <1611268749.83.0.501974297529.issue42982@roundup.psfhosted.org>


Illia Volochii <illia.volochii at gmail.com> added the comment:

I didn't find any. I think it is based on some benchmarks like `openssl speed sha`.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42982>
_______________________________________

From report at bugs.python.org  Thu Jan 21 17:52:04 2021
From: report at bugs.python.org (Brendan Gerrity)
Date: Thu, 21 Jan 2021 22:52:04 +0000
Subject: [issue42995] Add PurePath.with_suffix_appended()
In-Reply-To: <1611266651.15.0.998031464768.issue42995@roundup.psfhosted.org>
Message-ID: <1611269524.41.0.874211784715.issue42995@roundup.psfhosted.org>


Change by Brendan Gerrity <bgerrity at ucdavis.edu>:


----------
keywords: +patch
pull_requests: +23109
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24288

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42995>
_______________________________________

From report at bugs.python.org  Thu Jan 21 17:56:20 2021
From: report at bugs.python.org (Alexey Izbyshev)
Date: Thu, 21 Jan 2021 22:56:20 +0000
Subject: [issue42606] Support POSIX atomicity guarantee of O_APPEND on Windows
In-Reply-To: <1607483566.95.0.1927829703.issue42606@roundup.psfhosted.org>
Message-ID: <1611269780.08.0.459940292885.issue42606@roundup.psfhosted.org>


Alexey Izbyshev <izbyshev at ispras.ru> added the comment:

> I don't know what you mean by default access rights.

I meant the access rights of the handle created by _wopen(). In my PR I basically assume that _wopen() uses GENERIC_READ/GENERIC_WRITE access rights, but _wopen() doesn't have a contractual obligation to do exactly that AFAIU. For example, if it got some extra access rights, then my code would "drop" them while switching FILE_WRITE_DATA off.

> For example, if FILE_WRITE_DATA isn't granted, then open() can't open for appending. A direct CreateFileW() call can remove FILE_WRITE_DATA from the desired access.

Indeed, I haven't thought about it. Are you aware of a common scenario when a regular file allows appending but not writing?

But, at least, this is not a regression: currently open()/os.open() can't open such files for appending too.

> An opener could also work like your PR via os.open(), msvcrt.get_osfhandle(), _winapi.GetFileType(), _winapi.DuplicateHandle(), os.close(), and msvcrt.open_osfhandle().

True, but it still falls into "etc" category of "ctypes/pywin32/etc" :) Certainly doable, but it seems better to have consistent O_APPEND behavior across platforms out-of-the-box.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42606>
_______________________________________

From report at bugs.python.org  Thu Jan 21 18:24:06 2021
From: report at bugs.python.org (Illia Volochii)
Date: Thu, 21 Jan 2021 23:24:06 +0000
Subject: [issue42996] hashlib documentation references an obsolete RFC 2898
Message-ID: <1611271446.83.0.500119366754.issue42996@roundup.psfhosted.org>


New submission from Illia Volochii <illia.volochii at gmail.com>:

RFC 2898 mentioned in the "See also" section of hashlib documentation was superseded by RFC 8018.

https://docs.python.org/3/library/hashlib.html
https://www.ietf.org/rfc/rfc8018.txt

----------
assignee: docs at python
components: Documentation
messages: 385457
nosy: docs at python, illia-v
priority: normal
severity: normal
status: open
title: hashlib documentation references an obsolete RFC 2898

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42996>
_______________________________________

From report at bugs.python.org  Thu Jan 21 18:32:26 2021
From: report at bugs.python.org (Illia Volochii)
Date: Thu, 21 Jan 2021 23:32:26 +0000
Subject: [issue42996] hashlib documentation references an obsolete RFC 2898
In-Reply-To: <1611271446.83.0.500119366754.issue42996@roundup.psfhosted.org>
Message-ID: <1611271946.56.0.180655652273.issue42996@roundup.psfhosted.org>


Change by Illia Volochii <illia.volochii at gmail.com>:


----------
keywords: +patch
pull_requests: +23110
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24289

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42996>
_______________________________________

From report at bugs.python.org  Thu Jan 21 18:56:50 2021
From: report at bugs.python.org (Barney Gale)
Date: Thu, 21 Jan 2021 23:56:50 +0000
Subject: [issue39950] Add pathlib.Path.hardlink_to()
In-Reply-To: <1584060605.38.0.95953512485.issue39950@roundup.psfhosted.org>
Message-ID: <1611273410.84.0.595885089455.issue39950@roundup.psfhosted.org>


Barney Gale <barney.gale at gmail.com> added the comment:

Makes sense to me. Should I leave the documentation for `link_to` completely alone? With the addition of a similar function, I wonder if that may in itself cause confusion.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39950>
_______________________________________

From report at bugs.python.org  Thu Jan 21 19:24:37 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 22 Jan 2021 00:24:37 +0000
Subject: [issue42985] AMD64 Arch Linux Asan 3.x fails: command timed out: 1200
 seconds without output
In-Reply-To: <1611177482.17.0.749354598383.issue42985@roundup.psfhosted.org>
Message-ID: <1611275077.62.0.97575015519.issue42985@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> Both sound reasonable. But not sure if they will resolve this crash tough.

Many tests do crash *on purpose*. Example on test_concurrent_futures.py:

def _crash(delay=None):
    """Induces a segfault."""
    if delay:
        time.sleep(delay)
    import faulthandler
    faulthandler.disable()
    faulthandler._sigsegv()

Internally, faulthandler._sigsegv() disables crash reports.

There is also test.support.SuppressCrashReport context manager to disable crash reports. But I failed to find a way to disable ASAN signal handler at runtime.

It's possible to disable the ASAN signal handler at runtime using signal.signal(SIGSEGV, signal.SIG_DFT), but that should be done before Python installs its own signal handler for that, like before calling faulthandler.enable(). It would require to inject code in test_faulthandler to restore the default handler *before* calling faulthandler.enable(). Right now, test_faulthandler is skipped on the ASAN buildbots.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42985>
_______________________________________

From report at bugs.python.org  Thu Jan 21 19:28:34 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 22 Jan 2021 00:28:34 +0000
Subject: [issue42988] Information disclosure via pydoc -p: /getfile?key=path
 allows to read arbitrary file on the filesystem
In-Reply-To: <1611231517.86.0.296188996897.issue42988@roundup.psfhosted.org>
Message-ID: <1611275314.71.0.688633049666.issue42988@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> I'd suggest to print a big warning on the console, explaining that the web server will potentially make all content accessible by the user visible to anyone else on the same server.

I dislike this idea. If they are vulnerabilities, they should be fixed. Users usually have no idea what to do when seeing such warning.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42988>
_______________________________________

From report at bugs.python.org  Thu Jan 21 19:55:56 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 22 Jan 2021 00:55:56 +0000
Subject: [issue31904] Python should support VxWorks RTOS
In-Reply-To: <1509393393.78.0.213398074469.issue31904@psf.upfronthosting.co.za>
Message-ID: <1611276956.72.0.580769281192.issue31904@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 5e45f1c8e7bc5f0ab8feba88b9b6e47066203a5c by pxinwr in branch 'master':
bpo-31904: setup.py: fix cross-compilation on VxWorks (GH-24191)
https://github.com/python/cpython/commit/5e45f1c8e7bc5f0ab8feba88b9b6e47066203a5c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31904>
_______________________________________

From report at bugs.python.org  Thu Jan 21 19:58:54 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 22 Jan 2021 00:58:54 +0000
Subject: [issue42780] os.set_inheritable() fails for O_PATH file descriptors
 on Linux
In-Reply-To: <1609262318.62.0.976413615492.issue42780@roundup.psfhosted.org>
Message-ID: <1611277134.38.0.247416958481.issue42780@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> No problem! I've noticed at least one other (relatively minor) issue in `os`, so I may be submitting further bug reports.

Please do. But I suggest to open new issues.

> I haven't been keeping close track of 3.6/3.7's status, so I added them in without thinking it. Thanks for the reminder.

Don't worry (be happy). Everybody is confused by the Versions field.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42780>
_______________________________________

From report at bugs.python.org  Thu Jan 21 20:20:05 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 22 Jan 2021 01:20:05 +0000
Subject: [issue42997] Improve error message for missing : before suites
Message-ID: <1611278405.38.0.0749709348669.issue42997@roundup.psfhosted.org>


New submission from Pablo Galindo Salgado <pablogsal at gmail.com>:

Instead of displaying a generic syntax error:

Python 3.8.6 (default, Oct 10 2020, 18:31:21)
[GCC 10.2.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> for x in range
  File "<stdin>", line 1
    for x in range
                 ^
SyntaxError: invalid syntax
>>>

we could display:

>>> for x in range
  File "<stdin>", line 1
    for x in range
                  ^
SyntaxError: expected ':'

The same idea applies for every suite that has a missing ':'

----------
messages: 385463
nosy: pablogsal
priority: normal
severity: normal
status: open
title: Improve error message for missing : before suites
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42997>
_______________________________________

From report at bugs.python.org  Thu Jan 21 20:20:07 2021
From: report at bugs.python.org (miss-islington)
Date: Fri, 22 Jan 2021 01:20:07 +0000
Subject: [issue42384] Inconsistent sys.path between python and pdb
In-Reply-To: <1605599201.78.0.619329509169.issue42384@roundup.psfhosted.org>
Message-ID: <1611278407.92.0.179928942797.issue42384@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 1.0 -> 2.0
pull_requests: +23111
pull_request: https://github.com/python/cpython/pull/24290

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42384>
_______________________________________

From report at bugs.python.org  Thu Jan 21 20:20:17 2021
From: report at bugs.python.org (miss-islington)
Date: Fri, 22 Jan 2021 01:20:17 +0000
Subject: [issue42384] Inconsistent sys.path between python and pdb
In-Reply-To: <1605599201.78.0.619329509169.issue42384@roundup.psfhosted.org>
Message-ID: <1611278417.41.0.748099110911.issue42384@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 8603dfb4219989644601f6ede75b57e82648cd4e by Andrey Bienkowski in branch 'master':
bpo-42384: pdb: correctly populate sys.path[0] (GH-23338)
https://github.com/python/cpython/commit/8603dfb4219989644601f6ede75b57e82648cd4e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42384>
_______________________________________

From report at bugs.python.org  Thu Jan 21 20:20:14 2021
From: report at bugs.python.org (miss-islington)
Date: Fri, 22 Jan 2021 01:20:14 +0000
Subject: [issue42384] Inconsistent sys.path between python and pdb
In-Reply-To: <1605599201.78.0.619329509169.issue42384@roundup.psfhosted.org>
Message-ID: <1611278414.99.0.249111766634.issue42384@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +23112
pull_request: https://github.com/python/cpython/pull/24291

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42384>
_______________________________________

From report at bugs.python.org  Thu Jan 21 20:24:00 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 22 Jan 2021 01:24:00 +0000
Subject: [issue42997] Improve error message for missing : before suites
In-Reply-To: <1611278405.38.0.0749709348669.issue42997@roundup.psfhosted.org>
Message-ID: <1611278640.09.0.859861164209.issue42997@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
nosy: +lys.nikolaou

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42997>
_______________________________________

From report at bugs.python.org  Thu Jan 21 20:24:11 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 22 Jan 2021 01:24:11 +0000
Subject: [issue42997] Improve error message for missing : before suites
In-Reply-To: <1611278405.38.0.0749709348669.issue42997@roundup.psfhosted.org>
Message-ID: <1611278651.62.0.682822743941.issue42997@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
keywords: +patch
pull_requests: +23113
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24292

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42997>
_______________________________________

From report at bugs.python.org  Thu Jan 21 20:27:20 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 22 Jan 2021 01:27:20 +0000
Subject: [issue42997] Improve error message for missing : before suites
In-Reply-To: <1611278405.38.0.0749709348669.issue42997@roundup.psfhosted.org>
Message-ID: <1611278840.29.0.185730970308.issue42997@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

There are several ways to implement this:

In PR24292 I implemented this idea by adding a new element to the grammar: '&&'. This allows to hard-expect a token: if the token is not there the parsing hard-fails immediately without trying anything else and displays an appropriate error message

The other possibility if we think that PR24292 is overkill is manually adding an "invalid_wathever" for every possible compound statement option that parses the statement with a !':' and then raises appropriately. This option is more verbose in the grammar but requires no new machinery.

----------
stage: patch review -> 

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42997>
_______________________________________

From report at bugs.python.org  Thu Jan 21 20:27:30 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 22 Jan 2021 01:27:30 +0000
Subject: [issue42997] Improve error message for missing : before suites
In-Reply-To: <1611278405.38.0.0749709348669.issue42997@roundup.psfhosted.org>
Message-ID: <1611278850.71.0.14448928424.issue42997@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42997>
_______________________________________

From report at bugs.python.org  Thu Jan 21 20:30:26 2021
From: report at bugs.python.org (Andrea Giudiceandrea)
Date: Fri, 22 Jan 2021 01:30:26 +0000
Subject: [issue41928] ZipFile does not supports Unicode Path Extra Field
 (0x7075) zip header field
In-Reply-To: <1601810501.41.0.603959888811.issue41928@roundup.psfhosted.org>
Message-ID: <1611279026.95.0.087098396656.issue41928@roundup.psfhosted.org>


Andrea Giudiceandrea <andreaerdna at libero.it> added the comment:

I submitted more than a month ago a PR that adds support for Unicode Path Extra Field in ZipFile.
The PR https://github.com/python/cpython/pull/23736 is awaiting a review in order to be merged.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41928>
_______________________________________

From report at bugs.python.org  Thu Jan 21 20:31:39 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Fri, 22 Jan 2021 01:31:39 +0000
Subject: [issue42990] Improve the C code for calling Python code
In-Reply-To: <1611245152.12.0.0348161555926.issue42990@roundup.psfhosted.org>
Message-ID: <1611279099.15.0.847177121814.issue42990@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
nosy: +brett.cannon, petr.viktorin, rhettinger, serhiy.storchaka, vstinner, yselivanov

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42990>
_______________________________________

From report at bugs.python.org  Thu Jan 21 20:46:45 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 22 Jan 2021 01:46:45 +0000
Subject: [issue42997] Improve error message for missing : before suites
In-Reply-To: <1611278405.38.0.0749709348669.issue42997@roundup.psfhosted.org>
Message-ID: <1611280005.8.0.911251201512.issue42997@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
pull_requests: +23115
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24293

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42997>
_______________________________________

From report at bugs.python.org  Thu Jan 21 20:48:35 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 22 Jan 2021 01:48:35 +0000
Subject: [issue42997] Improve error message for missing : before suites
In-Reply-To: <1611278405.38.0.0749709348669.issue42997@roundup.psfhosted.org>
Message-ID: <1611280115.74.0.686904738749.issue42997@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

PR 24293 implements the second idea (only new rules and no new machinery)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42997>
_______________________________________

From report at bugs.python.org  Thu Jan 21 20:52:30 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 22 Jan 2021 01:52:30 +0000
Subject: [issue42985] AMD64 Arch Linux Asan 3.x fails: command timed out: 1200
 seconds without output
In-Reply-To: <1611177482.17.0.749354598383.issue42985@roundup.psfhosted.org>
Message-ID: <1611280350.34.0.534874523778.issue42985@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> About SIGSEGV logs, one option is to use ASAN_OPTIONS="handle_segv=0".

Opened https://github.com/python/buildmaster-config/pull/222

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42985>
_______________________________________

From report at bugs.python.org  Thu Jan 21 22:28:01 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Fri, 22 Jan 2021 03:28:01 +0000
Subject: [issue42384] Inconsistent sys.path between python and pdb
In-Reply-To: <1605599201.78.0.619329509169.issue42384@roundup.psfhosted.org>
Message-ID: <1611286081.86.0.541819104899.issue42384@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Hey Andrey, this has been merged into 3.10, but the backports didn't work because the structure of the tests has changed (os_helper doesn't exist). Do you want to fix these?

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42384>
_______________________________________

From report at bugs.python.org  Thu Jan 21 22:40:31 2021
From: report at bugs.python.org (Jay Chu)
Date: Fri, 22 Jan 2021 03:40:31 +0000
Subject: [issue39950] Add pathlib.Path.hardlink_to()
In-Reply-To: <1584060605.38.0.95953512485.issue39950@roundup.psfhosted.org>
Message-ID: <1611286831.79.0.0509409096866.issue39950@roundup.psfhosted.org>


Jay Chu <tothesong at gmail.com> added the comment:

For me, and as you've pointed out, the current doc of `Path.link_to` is already wrong and misleading. Perhaps a fix of the doc should be made as a first step.

The doc uses the expression "Create a hard link pointing to a path named target." 
But comparing this to the doc of `Path.symlink_to`, which says "Make this path a symbolic link to target.", 
(and the doc of `os.link`, which says, "Create a hard link pointing to src named dst.",)
the current doc should actually be "Create a hard link at `target` pointing to this path." Sadly the argument name can't be changed here already.

And the doc of `Path.symlink_to` even have a helpful note: "Note: The order of arguments (link, target) is the reverse of os.symlink()?s." 
We could also add one for `Path.link_to`, too, like "Note: The order of arguments (link, target) is the consistent with os.link()?s.

Based on that foundation, we could finally continue to implement the correct "Path.hardlink_to". 

We can refer to how people retained `subprocess.call` while adding a newer , preferred `subprocess.run`, by noting people to prefer `Path.hardlink_to` as it's more consistent with the `pathlib` and OOP, along with telling them the obscurity of `Path.link_to` and why it's left here for backward capability.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39950>
_______________________________________

From report at bugs.python.org  Thu Jan 21 22:57:15 2021
From: report at bugs.python.org (Barney Gale)
Date: Fri, 22 Jan 2021 03:57:15 +0000
Subject: [issue42998] pathlib.Path: add `username` argument to `home()`
Message-ID: <1611287835.84.0.363729514225.issue42998@roundup.psfhosted.org>


New submission from Barney Gale <barney.gale at gmail.com>:

The `pathlib.Path.home()` function looks like:

    @classmethod
    def home(cls):
        """Return a new path pointing to the user's home directory (as
        returned by os.path.expanduser('~')).
        """
        return cls(cls()._flavour.gethomedir(None))

If we add a `username=None` parameter and pass this to `gethomedir()` we can easily add a lookup of another user's home directory, so:

    import pathlib
    username = 'phil'
    pathlib.Path.home(username) == pathlib.Path('~' + username).expanduser()

----------
components: Library (Lib)
messages: 385472
nosy: barneygale
priority: normal
severity: normal
status: open
title: pathlib.Path: add `username` argument to `home()`
type: enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42998>
_______________________________________

From report at bugs.python.org  Thu Jan 21 23:11:31 2021
From: report at bugs.python.org (Barney Gale)
Date: Fri, 22 Jan 2021 04:11:31 +0000
Subject: [issue42998] pathlib.Path: add `username` argument to `home()`
In-Reply-To: <1611287835.84.0.363729514225.issue42998@roundup.psfhosted.org>
Message-ID: <1611288691.26.0.324724216651.issue42998@roundup.psfhosted.org>


Barney Gale <barney.gale at gmail.com> added the comment:

I should add that this is part of a plan to spin out some `Path` methods into a new `UserPath` class. Notably, in this case, `UserPath.expanduser()` will call `self.home()` under-the-hood. This is done to reduce the surface area of abstract methods that subclasses of `UserPath` need implement. More discussion here: https://discuss.python.org/t/make-pathlib-extensible/3428

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42998>
_______________________________________

From report at bugs.python.org  Thu Jan 21 23:24:20 2021
From: report at bugs.python.org (Barney Gale)
Date: Fri, 22 Jan 2021 04:24:20 +0000
Subject: [issue42999] `pathlib.Path.link_to()` documentation is misleading
Message-ID: <1611289460.25.0.942447627462.issue42999@roundup.psfhosted.org>


New submission from Barney Gale <barney.gale at gmail.com>:

Compare the documentation of `symlink_to()` and `link_to()`:

.. method:: Path.symlink_to(target, target_is_directory=False)
    Make this path a symbolic link to *target*.

.. method:: Path.link_to(target)
    Create a hard link pointing to a path named *target*.

In fact, `link_to()` does something like:

    Make *target* a hard link to this path.

Which is unexpected given the naming and inconsistency with `symlink_to()`, but it's the way the current implementation works, and so the documentation should reflect that.

Adding a replacement `hardlink_to()` function is covered here in bpo-39950.

----------
assignee: docs at python
components: Documentation
messages: 385474
nosy: barneygale, docs at python
priority: normal
severity: normal
status: open
title: `pathlib.Path.link_to()` documentation is misleading
type: behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42999>
_______________________________________

From report at bugs.python.org  Thu Jan 21 23:26:32 2021
From: report at bugs.python.org (Barney Gale)
Date: Fri, 22 Jan 2021 04:26:32 +0000
Subject: [issue39950] Add pathlib.Path.hardlink_to()
In-Reply-To: <1584060605.38.0.95953512485.issue39950@roundup.psfhosted.org>
Message-ID: <1611289592.74.0.721741033107.issue39950@roundup.psfhosted.org>


Barney Gale <barney.gale at gmail.com> added the comment:

I've logged bpo-42999 to cover fixing the existing `link_to()` docs issues. PR incoming...

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39950>
_______________________________________

From report at bugs.python.org  Thu Jan 21 23:28:17 2021
From: report at bugs.python.org (Barney Gale)
Date: Fri, 22 Jan 2021 04:28:17 +0000
Subject: [issue42999] `pathlib.Path.link_to()` documentation is misleading
In-Reply-To: <1611289460.25.0.942447627462.issue42999@roundup.psfhosted.org>
Message-ID: <1611289697.15.0.730707597504.issue42999@roundup.psfhosted.org>


Change by Barney Gale <barney.gale at gmail.com>:


----------
keywords: +patch
pull_requests: +23116
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/18909

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42999>
_______________________________________

From report at bugs.python.org  Thu Jan 21 23:28:25 2021
From: report at bugs.python.org (Jay Chu)
Date: Fri, 22 Jan 2021 04:28:25 +0000
Subject: [issue42999] `pathlib.Path.link_to()` documentation is misleading
In-Reply-To: <1611289460.25.0.942447627462.issue42999@roundup.psfhosted.org>
Message-ID: <1611289705.78.0.38049990533.issue42999@roundup.psfhosted.org>


Change by Jay Chu <tothesong at gmail.com>:


----------
nosy: +tothesong

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42999>
_______________________________________

From report at bugs.python.org  Thu Jan 21 23:46:13 2021
From: report at bugs.python.org (Darren Skidmore)
Date: Fri, 22 Jan 2021 04:46:13 +0000
Subject: [issue43000] All SSL requests fail with WRONG_VERSION_NUMBER when a
 packet sniffer is open
Message-ID: <1611290773.31.0.124833320524.issue43000@roundup.psfhosted.org>


New submission from Darren Skidmore <darrenrs0515 at gmail.com>:

As of Python 3.9.1, when attempting to perform any SSL requests when a packet sniffer tool (e.g. Telerik Fiddler) is intercepting SSL traffic, the program will hang for about a minute and then crash with a WRONG_VERSION_NUMBER error. This has been tested to occur with urllib2 and requests modules. Alternatives such as verify=False and adding the Fiddler Root Certificate to Python's cacert.pem file do not rectify this error.

This traceback was generated when attempting to access https://example.com:443 while Fiddler 5.0.20204.45441 was open:

Traceback (most recent call last):
  File "C:\Users\Darren\AppData\Local\Programs\Python\Python39\lib\site-packages\urllib3\connectionpool.py", line 696, in urlopen
    self._prepare_proxy(conn)
  File "C:\Users\Darren\AppData\Local\Programs\Python\Python39\lib\site-packages\urllib3\connectionpool.py", line 964, in _prepare_proxy
    conn.connect()
  File "C:\Users\Darren\AppData\Local\Programs\Python\Python39\lib\site-packages\urllib3\connection.py", line 359, in connect
    conn = self._connect_tls_proxy(hostname, conn)
  File "C:\Users\Darren\AppData\Local\Programs\Python\Python39\lib\site-packages\urllib3\connection.py", line 496, in _connect_tls_proxy
    return ssl_wrap_socket(
  File "C:\Users\Darren\AppData\Local\Programs\Python\Python39\lib\site-packages\urllib3\util\ssl_.py", line 432, in ssl_wrap_socket
    ssl_sock = _ssl_wrap_socket_impl(sock, context, tls_in_tls)
  File "C:\Users\Darren\AppData\Local\Programs\Python\Python39\lib\site-packages\urllib3\util\ssl_.py", line 474, in _ssl_wrap_socket_impl
    return ssl_context.wrap_socket(sock)
  File "C:\Users\Darren\AppData\Local\Programs\Python\Python39\lib\ssl.py", line 500, in wrap_socket
    return self.sslsocket_class._create(
  File "C:\Users\Darren\AppData\Local\Programs\Python\Python39\lib\ssl.py", line 1040, in _create
    self.do_handshake()
  File "C:\Users\Darren\AppData\Local\Programs\Python\Python39\lib\ssl.py", line 1309, in do_handshake
    self._sslobj.do_handshake()
ssl.SSLError: [SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:1123)

This exact question has recently been asked on StackOverflow: https://stackoverflow.com/questions/65516325/ssl-wrong-version-number-on-python-request

----------
assignee: christian.heimes
components: SSL
messages: 385476
nosy: christian.heimes, darrenrs
priority: normal
severity: normal
status: open
title: All SSL requests fail with WRONG_VERSION_NUMBER when a packet sniffer is open
type: crash
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43000>
_______________________________________

From report at bugs.python.org  Thu Jan 21 23:52:18 2021
From: report at bugs.python.org (Barney Gale)
Date: Fri, 22 Jan 2021 04:52:18 +0000
Subject: [issue42999] `pathlib.Path.link_to()` documentation is misleading
In-Reply-To: <1611289460.25.0.942447627462.issue42999@roundup.psfhosted.org>
Message-ID: <1611291138.42.0.763376035263.issue42999@roundup.psfhosted.org>


Change by Barney Gale <barney.gale at gmail.com>:


----------
pull_requests: +23117
pull_request: https://github.com/python/cpython/pull/24294

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42999>
_______________________________________

From report at bugs.python.org  Thu Jan 21 23:53:11 2021
From: report at bugs.python.org (Eryk Sun)
Date: Fri, 22 Jan 2021 04:53:11 +0000
Subject: [issue42606] Support POSIX atomicity guarantee of O_APPEND on Windows
In-Reply-To: <1607483566.95.0.1927829703.issue42606@roundup.psfhosted.org>
Message-ID: <1611291191.85.0.551388798793.issue42606@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

FYI, here are the access rights applicable to files, including their membership in generic (R)ead, (W)rite, and e(X)execute access:

    0x0100_0000 --- ACCESS_SYSTEM_SECURITY
    0x0010_0000 RWX SYNCHRONIZE
    0x0008_0000 --- WRITE_OWNER
    0x0004_0000 --- WRITE_DAC
    0x0002_0000 RWX READ_CONTROL
    0x0001_0000 --- DELETE

    0x0000_0001 R-- FILE_READ_DATA
    0x0000_0002 -W- FILE_WRITE_DATA
    0x0000_0004 -W- FILE_APPEND_DATA
    0x0000_0008 R-- FILE_READ_EA
    0x0000_0010 -W- FILE_WRITE_EA
    0x0000_0020 --X FILE_EXECUTE
    0x0000_0040 --- FILE_DELETE_CHILD
    0x0000_0080 R-X FILE_READ_ATTRIBUTES
    0x0000_0100 -W- FILE_WRITE_ATTRIBUTES

> _wopen() uses GENERIC_READ/GENERIC_WRITE access rights, but 
> _wopen() doesn't have a contractual obligation to do exactly 
> that AFAIU. For example, if it got some extra access rights, 
> then my code would "drop" them while switching FILE_WRITE_DATA off.

I overlooked a case that's a complication. For O_TEMPORARY, the open uses FILE_FLAG_DELETE_ON_CLOSE; adds DELETE to the requested access; and adds FILE_SHARE_DELETE to the share mode. 

With delete-on-close, a file gets marked as deleted as soon as the last handle for the kernel File is closed. This is the classic Windows 'deleted' state in which the filename remains linked in the directory but inaccessible for any new access (as opposed to the immediate POSIX style delete that DeleteFileW attempts in Windows 10). Existing opens (i.e. kernel File objects from CreateFileW) are still valid, and, if they have delete access, they can even be used to undelete the file via SetFileInformationByHandle: FileDispositionInfo. 

_Py_wopen_noraise() can easily keep the required DELETE access. The complication is that you have to be careful not to close the original file descriptor until after you've successfully created the duplicate file descriptor. If it fails, you have to return the original file descriptor from _wopen(). If you close all handles for the kernel File and fail the call, the side effect of deleting the file is unacceptable. 

The C runtime itself isn't careful about using O_TEMPORARY in text mode, given how it closes the file if truncation fails or has to open the file twice in O_WRONLY mode in order to read the BOM. But at least it's reliable in binary mode. The file descriptor is pre-allocated with _alloc_osfhnd(), so it won't fail after CreateFileW() is called.

> Are you aware of a common scenario when a regular file allows 
> appending but not writing?

It's certainly not common for regular files. (It's more common for directories, for which append access corresponds to the right to create a subdirectory.) Maybe users are only allowed to append to a given log file. But I think most scenarios will be accidental. 

For example, say an admin wants to deny write access to standard users. Denying simple or generic write access is wrong, since doing so also denies rights required for reading, i.e. synchronize and read-control. So the admin runs the following command to deny only write-data access: `icacls filename /deny *BU:(WD)`. This forgets about append-data (AD) access. It's still sufficient for most applications, which request generic-write access.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42606>
_______________________________________

From report at bugs.python.org  Fri Jan 22 00:47:31 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 22 Jan 2021 05:47:31 +0000
Subject: [issue40304] Classes created using type() don't need to explicitly
 inherit from object
In-Reply-To: <1587058310.07.0.184434541864.issue40304@roundup.psfhosted.org>
Message-ID: <1611294451.31.0.893526427876.issue40304@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset 644d52818a6391535e5838fd57d58ffcb1163056 by ????? ?????????? in branch 'master':
bpo-40304: Correct type(name, bases, dict) doc (GH-19553)
https://github.com/python/cpython/commit/644d52818a6391535e5838fd57d58ffcb1163056


----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40304>
_______________________________________

From report at bugs.python.org  Fri Jan 22 00:47:53 2021
From: report at bugs.python.org (miss-islington)
Date: Fri, 22 Jan 2021 05:47:53 +0000
Subject: [issue40304] Classes created using type() don't need to explicitly
 inherit from object
In-Reply-To: <1587058310.07.0.184434541864.issue40304@roundup.psfhosted.org>
Message-ID: <1611294473.09.0.79491111109.issue40304@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
keywords: +patch
nosy: +miss-islington
nosy_count: 3.0 -> 4.0
pull_requests: +23118
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24295

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40304>
_______________________________________

From report at bugs.python.org  Fri Jan 22 00:48:00 2021
From: report at bugs.python.org (miss-islington)
Date: Fri, 22 Jan 2021 05:48:00 +0000
Subject: [issue40304] Classes created using type() don't need to explicitly
 inherit from object
In-Reply-To: <1587058310.07.0.184434541864.issue40304@roundup.psfhosted.org>
Message-ID: <1611294480.94.0.0541504355121.issue40304@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +23119
pull_request: https://github.com/python/cpython/pull/24296

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40304>
_______________________________________

From report at bugs.python.org  Fri Jan 22 00:58:08 2021
From: report at bugs.python.org (miss-islington)
Date: Fri, 22 Jan 2021 05:58:08 +0000
Subject: [issue40304] Classes created using type() don't need to explicitly
 inherit from object
In-Reply-To: <1587058310.07.0.184434541864.issue40304@roundup.psfhosted.org>
Message-ID: <1611295088.84.0.222404962649.issue40304@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 34f3f4ac70e3ba2e603ba7792addf973c94f90cb by Miss Islington (bot) in branch '3.8':
bpo-40304: Correct type(name, bases, dict) doc (GH-19553)
https://github.com/python/cpython/commit/34f3f4ac70e3ba2e603ba7792addf973c94f90cb


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40304>
_______________________________________

From report at bugs.python.org  Fri Jan 22 01:10:08 2021
From: report at bugs.python.org (miss-islington)
Date: Fri, 22 Jan 2021 06:10:08 +0000
Subject: [issue40304] Classes created using type() don't need to explicitly
 inherit from object
In-Reply-To: <1587058310.07.0.184434541864.issue40304@roundup.psfhosted.org>
Message-ID: <1611295808.56.0.065071833811.issue40304@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 98e1f5c778b9719f6338a3247da95402192bad18 by Miss Islington (bot) in branch '3.9':
bpo-40304: Correct type(name, bases, dict) doc (GH-19553)
https://github.com/python/cpython/commit/98e1f5c778b9719f6338a3247da95402192bad18


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40304>
_______________________________________

From report at bugs.python.org  Fri Jan 22 01:12:48 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 22 Jan 2021 06:12:48 +0000
Subject: [issue40304] Classes created using type() don't need to explicitly
 inherit from object
In-Reply-To: <1587058310.07.0.184434541864.issue40304@roundup.psfhosted.org>
Message-ID: <1611295968.54.0.0108657278737.issue40304@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40304>
_______________________________________

From report at bugs.python.org  Fri Jan 22 02:38:42 2021
From: report at bugs.python.org (Andrey Bienkowski)
Date: Fri, 22 Jan 2021 07:38:42 +0000
Subject: [issue42384] Inconsistent sys.path between python and pdb
In-Reply-To: <1605599201.78.0.619329509169.issue42384@roundup.psfhosted.org>
Message-ID: <1611301122.64.0.142327782326.issue42384@roundup.psfhosted.org>


Andrey Bienkowski <hexagonrecursion at gmail.com> added the comment:

I'll give it a try

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42384>
_______________________________________

From report at bugs.python.org  Fri Jan 22 02:38:40 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 22 Jan 2021 07:38:40 +0000
Subject: [issue42997] Improve error message for missing : before suites
In-Reply-To: <1611278405.38.0.0749709348669.issue42997@roundup.psfhosted.org>
Message-ID: <1611301120.96.0.884735997931.issue42997@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

See also issue1634034.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42997>
_______________________________________

From report at bugs.python.org  Fri Jan 22 03:05:16 2021
From: report at bugs.python.org (Christian Heimes)
Date: Fri, 22 Jan 2021 08:05:16 +0000
Subject: [issue43000] All SSL requests fail with WRONG_VERSION_NUMBER when a
 packet sniffer is open
In-Reply-To: <1611290773.31.0.124833320524.issue43000@roundup.psfhosted.org>
Message-ID: <1611302716.32.0.793560974006.issue43000@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

I'm not familiar with Telerik Fiddler and don't have access to the tool. From the description on its Wikipedia page, it sounds like the tool is an active interceptor that uses a man-in-the-middle attack approach.

Python's ssl module wraps OpenSSL. All steps of the TLS handshake are performed by OpenSSL code. Your connection issue is most likely an incompatibility between recent OpenSSL 1.1.1 and your tool. I recommend that you contact the vendor of your tool.

The ssl module supports passive introspection of TLS connections with SSLKEYLOGFILE. The format is supported by Wireshark and other tools.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43000>
_______________________________________

From report at bugs.python.org  Fri Jan 22 03:27:50 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 22 Jan 2021 08:27:50 +0000
Subject: [issue27477] IDLE: Switch search dialogs to ttk widgets,
 and other refinement
In-Reply-To: <1468181977.57.0.555586182066.issue27477@psf.upfronthosting.co.za>
Message-ID: <1611304070.79.0.498712808853.issue27477@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

#33987 was reopened, 4 patches merged and backported, and reclosed.
This is only open for other possible refinements listed above.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27477>
_______________________________________

From report at bugs.python.org  Fri Jan 22 04:05:05 2021
From: report at bugs.python.org (Marc-Andre Lemburg)
Date: Fri, 22 Jan 2021 09:05:05 +0000
Subject: [issue42988] Information disclosure via pydoc -p: /getfile?key=path
 allows to read arbitrary file on the filesystem
In-Reply-To: <1611275314.71.0.688633049666.issue42988@roundup.psfhosted.org>
Message-ID: <3fb210c2-648e-f858-6ce8-6516de192548@egenix.com>


Marc-Andre Lemburg <mal at egenix.com> added the comment:

On 22.01.2021 01:28, STINNER Victor wrote:
> 
> STINNER Victor <vstinner at python.org> added the comment:
> 
>> I'd suggest to print a big warning on the console, explaining that the web server will potentially make all content accessible by the user visible to anyone else on the same server.
> 
> I dislike this idea. If they are vulnerabilities, they should be fixed. Users usually have no idea what to do when seeing such warning.

The problem is that neither the docs nor the help text in the command
make it clear what exactly is exposed via the web server pydoc
launches.

While the getfile API endpoint can be used to view non-Python files
as well (which is certainly not intended), the tool also makes available
all Python modules which can be found on sys.path of the user starting
pydoc -p. It shows all doc-strings, functions, the class structure and
literal values of any constants found in those modules.

In a corporate environment this can easily result in data leaks
of e.g. unreleased software, personal information, disclosure of
NDA protected code, designs, algorithms and other secrets.

Fixing just getfile or replacing those links with file:// ones will
only address one part of the problem. The other is educating the
user about possible consequences of running a server on the machine
-- just like you warn users about deleting files before going ahead
with it.

Python's http.server at least warns about this in the docs:
https://docs.python.org/3/library/http.server.html
and limits the serving to the current dir (and subdirs).

My guess is that pydoc -p really is just intended to be useful
for the current user. Rather than having it serve files under
a blanket URL, it could restrict browsing to a random URL
token generated at pydoc startup and open this in the browser
via the "b" command or the -b option, e.g.

"""
Server ready at http://localhost:8080/uLy6t87AD-ScPthd/
Server commands: [b]rowser, [q]uit
server>
"""

That would make it harder to guess the base URL and limit
exposure.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42988>
_______________________________________

From report at bugs.python.org  Fri Jan 22 05:07:18 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 22 Jan 2021 10:07:18 +0000
Subject: [issue41798] [C API] Revisit usage of the PyCapsule C API with
 multi-phase initialization API
In-Reply-To: <1600265269.2.0.881235166904.issue41798@roundup.psfhosted.org>
Message-ID: <1611310038.86.0.763606761766.issue41798@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 2f12a1b7ecc9e0cf39b4c6994473e6cb9989f81b by Hai Shi in branch 'master':
bpo-41798: Allocate the _curses._C_API on the heap memory (GH-24186)
https://github.com/python/cpython/commit/2f12a1b7ecc9e0cf39b4c6994473e6cb9989f81b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41798>
_______________________________________

From report at bugs.python.org  Fri Jan 22 05:16:04 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 22 Jan 2021 10:16:04 +0000
Subject: [issue42985] AMD64 Arch Linux Asan 3.x fails: command timed out: 1200
 seconds without output
In-Reply-To: <1611177482.17.0.749354598383.issue42985@roundup.psfhosted.org>
Message-ID: <1611310564.82.0.550526464372.issue42985@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

For faulthandler.enable(), maybe we reset SIGSEGV signal handler to the default handler if __has_feature(address_sanitizer) is true:
https://clang.llvm.org/docs/AddressSanitizer.html#conditional-compilation-with-has-feature-address-sanitizer

But we cannot do that in faulthandler._sigsegv() since this function is used to test_faulthandler to check the signal handler installed by faulthandler previously.

Maybe we should add a function to test.support which resets the signal handler and then trigger a crash.

There are multiple functions which trigger crashes on purpose:

* _testcapi.crash_no_current_thread() => Py_FatalError()
* _testcapi.return_null_without_error() => Py_FatalError()
* _testcapi.return_result_wit_error() => Py_FatalError()
* _testcapi.negative_refcount() => Py_FatalError()
* _testcapi.pymem_buffer_overflow() => Py_FatalError()
* _testcapi.set_nomemory(0) is used to trigger a _PyErr_NormalizeException crash => Py_FatalError()
* etc.

Py_FatalError() calls abort() which raises SIGABRT signal, but ASAN doesn't catch this signal.

More generally, search for support.SuppressCrashReport usage in tests.

See also faulthandler_suppress_crash_report() C function.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42985>
_______________________________________

From report at bugs.python.org  Fri Jan 22 05:34:27 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 22 Jan 2021 10:34:27 +0000
Subject: [issue42988] Information disclosure via pydoc -p: /getfile?key=path
 allows to read arbitrary file on the filesystem
In-Reply-To: <1611231517.86.0.296188996897.issue42988@roundup.psfhosted.org>
Message-ID: <1611311667.47.0.784994872288.issue42988@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Why not limit the serving to sys.path?

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42988>
_______________________________________

From report at bugs.python.org  Fri Jan 22 05:58:14 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 22 Jan 2021 10:58:14 +0000
Subject: [issue42988] Information disclosure via pydoc -p: /getfile?key=path
 allows to read arbitrary file on the filesystem
In-Reply-To: <1611231517.86.0.296188996897.issue42988@roundup.psfhosted.org>
Message-ID: <1611313094.01.0.422048370255.issue42988@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Fidget-Spinner wrote on the PR:
> AFAIK no. However, pydoc currently works by calling inspect on files it sees in path, and this may reveal private code as Marc-Andre Lemburg pointed out on the bpo. I will try the random url token he suggested via secrets.token_urlsafe to see if it helps.

pydoc shows global constant values in the doc. So yes, if you find a settings.py of a Django project, you can discover secrets.

I'm working on bpo-42955 "Add sys.module_names: list of stdlib module names (Python and extension modules)".

One option would be to restrict pydoc to stdlib modules by defaults, and ask to opt-in for discovery of any module installed on the system (sys.path).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42988>
_______________________________________

From report at bugs.python.org  Fri Jan 22 06:35:38 2021
From: report at bugs.python.org (Alexei S)
Date: Fri, 22 Jan 2021 11:35:38 +0000
Subject: [issue43001] python3.9.1 test_embed test_tabnanny failed
Message-ID: <1611315338.64.0.350030617212.issue43001@roundup.psfhosted.org>


New submission from Alexei S <asholomitskiy84 at gmail.com>:

== Tests result: FAILURE then FAILURE ==

396 tests OK.

2 tests failed:
    test_embed test_tabnanny

27 tests skipped:
    test_bz2 test_curses test_dbm_gnu test_dbm_ndbm test_devpoll
    test_gdb test_idle test_ioctl test_kqueue test_lzma test_msilib
    test_ossaudiodev test_readline test_smtpnet test_ssl
    test_startfile test_tcl test_tix test_tk test_ttk_guionly
    test_ttk_textonly test_turtle test_winconsoleio test_winreg
    test_winsound test_zipfile64 test_zoneinfo

2 re-run tests:
    test_embed test_tabnanny

Total duration: 10 min 58 sec
Tests result: FAILURE then FAILURE
make: *** [Makefile:1199: test] Error 2

----------
components: Tests
messages: 385490
nosy: asholomitskiy84
priority: normal
severity: normal
status: open
title: python3.9.1 test_embed test_tabnanny failed
type: compile error
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43001>
_______________________________________

From report at bugs.python.org  Fri Jan 22 06:36:07 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 22 Jan 2021 11:36:07 +0000
Subject: [issue42990] Improve the C code for calling Python code
In-Reply-To: <1611245152.12.0.0348161555926.issue42990@roundup.psfhosted.org>
Message-ID: <1611315367.63.0.94334290189.issue42990@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

PyObject *
_PyEval_EvalCode(PyThreadState *tstate,
           PyObject *_co, PyObject *globals, PyObject *locals,
           PyObject *const *args, Py_ssize_t argcount,
           PyObject *const *kwnames, PyObject *const *kwargs,
           Py_ssize_t kwcount, int kwstep,
           PyObject *const *defs, Py_ssize_t defcount,
           PyObject *kwdefs, PyObject *closure,
           PyObject *name, PyObject *qualname)

Hum no, only 16 arguments, everything is fine! :-D

More seriously, I already considered to rework this code.

The pseudo code is:

  if (...) return <new generator>;
  frame = (...);
  retval = _PyEval_EvalFrame(tstate, f, 0);
  _PyObject_GC_TRACK(f);
  return retval;

I like the idea of splitting these two parts:

  f = create_frame_or_gen(...);
  if (<is generator>) return f;
  retval = _PyEval_EvalFrame(tstate, f, 0);
  _PyObject_GC_TRACK(f);
  return retval;

I see one advantage: stack memory consumation, we don't have to hold the 16 arguments on the stack, only 3 parameters (tstate, f, 0).

> Split the Eval functions into vector and tuple/dict forms, both forms taking a "frame descriptor", as well as the arguments.

Hum, it seems like you have a different idea how to refactor the code.

Would it be worth it to have more specialized create_frame_or_gen() functions for the common cases?

--

I would also be interested by the ability to not create a frame at all, but I guess that it's a way larger refactoring.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42990>
_______________________________________

From report at bugs.python.org  Fri Jan 22 06:36:23 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 22 Jan 2021 11:36:23 +0000
Subject: [issue42990] Improve the C code for calling Python code:
 _PyEval_EvalCode()
In-Reply-To: <1611245152.12.0.0348161555926.issue42990@roundup.psfhosted.org>
Message-ID: <1611315383.28.0.738505841849.issue42990@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
title: Improve the C code for calling Python code -> Improve the C code for calling Python code: _PyEval_EvalCode()

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42990>
_______________________________________

From report at bugs.python.org  Fri Jan 22 06:39:14 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 22 Jan 2021 11:39:14 +0000
Subject: [issue42988] Information disclosure via pydoc -p: /getfile?key=path
 allows to read arbitrary file on the filesystem
In-Reply-To: <1611231517.86.0.296188996897.issue42988@roundup.psfhosted.org>
Message-ID: <1611315554.18.0.638095738943.issue42988@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> Python's http.server at least warns about this in the docs:
> https://docs.python.org/3/library/http.server.html
> and limits the serving to the current dir (and subdirs).

I would be fine with a warning in the pydoc documentation, but I dislike warnings display on the command line. When I see such warning, I feel that the machine considers that I'm dumb and I have no idea of what I am doing.

If it's unsafe, can we make it safe by default?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42988>
_______________________________________

From report at bugs.python.org  Fri Jan 22 06:40:04 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 22 Jan 2021 11:40:04 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611315604.97.0.8529021951.issue42955@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Another potential use case: restrict pydoc web server to stdlib modules, see bpo-42988.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Fri Jan 22 07:06:26 2021
From: report at bugs.python.org (miss-islington)
Date: Fri, 22 Jan 2021 12:06:26 +0000
Subject: [issue42996] hashlib documentation references an obsolete RFC 2898
In-Reply-To: <1611271446.83.0.500119366754.issue42996@roundup.psfhosted.org>
Message-ID: <1611317186.96.0.571202985899.issue42996@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset b745a6143ae79efe00aa46affe5ea31a06b0b532 by Illia Volochii in branch 'master':
bpo-42996: Update a reference to PKCS #5 in hashlib docs to version 2.1 (GH-24289)
https://github.com/python/cpython/commit/b745a6143ae79efe00aa46affe5ea31a06b0b532


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42996>
_______________________________________

From report at bugs.python.org  Fri Jan 22 07:34:49 2021
From: report at bugs.python.org (Adam Goldschmidt)
Date: Fri, 22 Jan 2021 12:34:49 +0000
Subject: [issue42967] [security] urllib.parse.parse_qsl(): Web cache poisoning
 - `; ` as a query args separator
In-Reply-To: <1611068809.96.0.58823274544.issue42967@roundup.psfhosted.org>
Message-ID: <1611318889.87.0.900808805115.issue42967@roundup.psfhosted.org>


Change by Adam Goldschmidt <adamgold7 at gmail.com>:


----------
pull_requests: +23120
pull_request: https://github.com/python/cpython/pull/24297

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Fri Jan 22 07:53:33 2021
From: report at bugs.python.org (Ken Jin)
Date: Fri, 22 Jan 2021 12:53:33 +0000
Subject: [issue42967] [security] urllib.parse.parse_qsl(): Web cache poisoning
 - `; ` as a query args separator
In-Reply-To: <1611068809.96.0.58823274544.issue42967@roundup.psfhosted.org>
Message-ID: <1611320013.47.0.813766328536.issue42967@roundup.psfhosted.org>


Ken Jin <kenjin4096 at gmail.com> added the comment:

Adam, I linked a PR 2 days ago here https://github.com/python/cpython/pull/24271 , it has the test suite passing and the appropriate changes to cgi.py. Would you like to review it? Or since you submitted a PR, would you prefer I close mine instead?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Fri Jan 22 07:58:27 2021
From: report at bugs.python.org (Senthil Kumaran)
Date: Fri, 22 Jan 2021 12:58:27 +0000
Subject: [issue42967] [security] urllib.parse.parse_qsl(): Web cache poisoning
 - `; ` as a query args separator
In-Reply-To: <1611320013.47.0.813766328536.issue42967@roundup.psfhosted.org>
Message-ID: <CAPOVWORnO=jEBx_Ab_6sRud7N40+ESGO0QZ_kGahTXV-=6_WiA@mail.gmail.com>


Senthil Kumaran <senthil at uthcode.com> added the comment:

Ken, Please don't close your PR. I will review it. It has a CLA signed
which is helpful.

On Fri, Jan 22, 2021 at 4:53 AM Ken Jin <report at bugs.python.org> wrote:

>
> Ken Jin <kenjin4096 at gmail.com> added the comment:
>
> Adam, I linked a PR 2 days ago here
> https://github.com/python/cpython/pull/24271 , it has the test suite
> passing and the appropriate changes to cgi.py. Would you like to review it?
> Or since you submitted a PR, would you prefer I close mine instead?
>
> ----------
>
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue42967>
> _______________________________________
>

----------
title: [security] urllib.parse.parse_qsl(): Web cache poisoning - `;` as a query args separator -> [security] urllib.parse.parse_qsl(): Web cache poisoning - `; ` as a query args separator

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Fri Jan 22 08:15:25 2021
From: report at bugs.python.org (Illia Volochii)
Date: Fri, 22 Jan 2021 13:15:25 +0000
Subject: [issue42996] hashlib documentation references an obsolete RFC 2898
In-Reply-To: <1611271446.83.0.500119366754.issue42996@roundup.psfhosted.org>
Message-ID: <1611321325.45.0.454783776949.issue42996@roundup.psfhosted.org>


Change by Illia Volochii <illia.volochii at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42996>
_______________________________________

From report at bugs.python.org  Fri Jan 22 08:18:52 2021
From: report at bugs.python.org (Adam Goldschmidt)
Date: Fri, 22 Jan 2021 13:18:52 +0000
Subject: [issue42967] [security] urllib.parse.parse_qsl(): Web cache poisoning
 - `; ` as a query args separator
In-Reply-To: <1611068809.96.0.58823274544.issue42967@roundup.psfhosted.org>
Message-ID: <1611321532.34.0.786335439666.issue42967@roundup.psfhosted.org>


Adam Goldschmidt <adamgold7 at gmail.com> added the comment:

I haven't noticed, I'm sorry. I don't mind closing mine, just thought it could be a nice first contribution. Our PRs are different though - I feel like if we are to implement this, we should let the developer choose the separator and not limit to just `&` and `;` - but that discussion probably belongs in the PR.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Fri Jan 22 08:23:10 2021
From: report at bugs.python.org (Dominik Vilsmeier)
Date: Fri, 22 Jan 2021 13:23:10 +0000
Subject: [issue42722] Add --debug command line option to unittest to enable
 post-mortem debugging
In-Reply-To: <1608680811.32.0.033035519481.issue42722@roundup.psfhosted.org>
Message-ID: <1611321790.51.0.461252182516.issue42722@roundup.psfhosted.org>


Dominik Vilsmeier <dominik.vilsmeier1123 at gmail.com> added the comment:

Is anybody interested in reviewing the PR? It seems like a useful enhancement to me.

----------
versions: +Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42722>
_______________________________________

From report at bugs.python.org  Fri Jan 22 08:52:41 2021
From: report at bugs.python.org (Ram Rachum)
Date: Fri, 22 Jan 2021 13:52:41 +0000
Subject: [issue43002] Exception chaining accepts exception classes
Message-ID: <1611323561.1.0.365445213907.issue43002@roundup.psfhosted.org>


New submission from Ram Rachum <ram at rachum.com>:

I saw this line of code today: https://github.com/hyperledger/sawtooth-sdk-python/commit/c27b962541c9ae68fd1e6dc691ddee883234f112#diff-eb008203eae2160c5e14c42e5fd2eee164709a93bf5136fa79cc256d4e46eaffR92

I was about to tell this guy that his code is bad since the part after the `from` should be a specific exception, not just an exception class. I thought I should double-check myself first. Lo and behold: 

```
$ cat x.py
def f():
    raise TypeError

try:
    f()
except TypeError:
    raise ValueError from TypeError

$ python x.py
TypeError

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "x.py", line 7, in <module>
    raise ValueError from TypeError
ValueError
```

The line doesn't fail, but it silently trims away the stacktrace of the previous exception. (Normally the stacktrace would include what's inside the `f` function.)

I'm not sure whether this is intended behavior or not. The documentation does say "the second expression must be another exception class or instance" but (a) it's not clear what the use case is when it's a class and (b) I doubt that the person who wrote the code above, and any other person who writes such code, would be aware that their traceback got snipped until it's too late and they're stuck with a bug report with incomplete information.

----------
components: Interpreter Core
messages: 385499
nosy: cool-RR
priority: normal
severity: normal
status: open
title: Exception chaining accepts exception classes
type: behavior
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43002>
_______________________________________

From report at bugs.python.org  Fri Jan 22 09:54:36 2021
From: report at bugs.python.org (Mark Shannon)
Date: Fri, 22 Jan 2021 14:54:36 +0000
Subject: [issue42990] Improve the C code for calling Python code:
 _PyEval_EvalCode()
In-Reply-To: <1611245152.12.0.0348161555926.issue42990@roundup.psfhosted.org>
Message-ID: <1611327276.6.0.943078451365.issue42990@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:

Rather than:

  f = create_frame_or_gen(...);
  if (<is generator>) return f;
  retval = _PyEval_EvalFrame(tstate, f, 0);
  _PyObject_GC_TRACK(f);
  return retval;

I was thinking:

  f = create_frame(...);
  if (<is generator>) return make_gen(f);
  retval = _PyEval_EvalFrame(tstate, f, 0);
  _PyObject_GC_TRACK(f);
  return retval;

The complicated part is create_frame(...), so I want to clean that up first.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42990>
_______________________________________

From report at bugs.python.org  Fri Jan 22 10:01:43 2021
From: report at bugs.python.org (Michael Clerx)
Date: Fri, 22 Jan 2021 15:01:43 +0000
Subject: [issue43003] Parts of the API will be removed in Python 4.0 ?
Message-ID: <1611327703.19.0.312122851749.issue43003@roundup.psfhosted.org>


New submission from Michael Clerx <cell at michaelclerx.com>:

The unicode C-API documentation has a deprecation warning on this page:

  https://docs.python.org/3.9/c-api/unicode.html#deprecated-py-unicode-apis

stating some functions are

  Deprecated since version 3.3, will be removed in version 4.0.

But as far as I understand there are no current plans for a 4.0.
Should the text read "removed in version 3.10" ?

----------
assignee: docs at python
components: Documentation
messages: 385501
nosy: MichaelClerx, docs at python
priority: normal
severity: normal
status: open
title: Parts of the API will be removed in Python 4.0 ?

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43003>
_______________________________________

From report at bugs.python.org  Fri Jan 22 10:01:52 2021
From: report at bugs.python.org (Mark Shannon)
Date: Fri, 22 Jan 2021 15:01:52 +0000
Subject: [issue42990] Improve the C code for calling Python code:
 _PyEval_EvalCode()
In-Reply-To: <1611245152.12.0.0348161555926.issue42990@roundup.psfhosted.org>
Message-ID: <1611327712.18.0.656517249307.issue42990@roundup.psfhosted.org>


Change by Mark Shannon <mark at hotpy.org>:


----------
keywords: +patch
pull_requests: +23121
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/24298

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42990>
_______________________________________

From report at bugs.python.org  Fri Jan 22 11:02:35 2021
From: report at bugs.python.org (Lonny Kapelushnik)
Date: Fri, 22 Jan 2021 16:02:35 +0000
Subject: [issue42504] Failure to build with MACOSX_DEPLOYMENT_TARGET=11 on Big
 Sur
In-Reply-To: <1606662964.61.0.531913261121.issue42504@roundup.psfhosted.org>
Message-ID: <1611331355.93.0.0340688802991.issue42504@roundup.psfhosted.org>


Lonny Kapelushnik <lonny at lonnylot.com> added the comment:

I believe this is causing issues when trying to install pyjq (https://github.com/doloopwhile/pyjq/issues/54).

@ronaldoussoren are you still planning on creating a patch for this? Or should we plan on fixing it downstream?

----------
nosy: +lonnylot

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42504>
_______________________________________

From report at bugs.python.org  Fri Jan 22 11:05:20 2021
From: report at bugs.python.org (Ken Jin)
Date: Fri, 22 Jan 2021 16:05:20 +0000
Subject: [issue42988] Information disclosure via pydoc -p: /getfile?key=path
 allows to read arbitrary file on the filesystem
In-Reply-To: <1611231517.86.0.296188996897.issue42988@roundup.psfhosted.org>
Message-ID: <1611331520.71.0.0954880207091.issue42988@roundup.psfhosted.org>


Ken Jin <kenjin4096 at gmail.com> added the comment:

I have updated the PR to do the following:

- removed html_getfile
- implement a unique secret as suggested above

Now it says:
>>> python.exe -m pydoc -b
Server ready at http://localhost:52035/Y1YzOyEbitE9BB_dtH0YXbMgGXbcg3ytXLpvpg8P7GEM3z1hlCkTXgxaojtAordVqs2s6oHZHPMbXqq9mXq_wbJCVW8jnHrgQeYE5hFUQuI/


FWIW, it seems that Jupyter notebook server deals with the same problems in a similar manner: https://jupyter-notebook.readthedocs.io/en/stable/security.html#security-in-the-jupyter-notebook-server

I removed the warning message in the PR because I think this is secure enough.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42988>
_______________________________________

From report at bugs.python.org  Fri Jan 22 11:23:08 2021
From: report at bugs.python.org (E. Paine)
Date: Fri, 22 Jan 2021 16:23:08 +0000
Subject: [issue42992] Tkinter bbox coordinates incorrectly drawn
In-Reply-To: <1611262609.83.0.00898948617335.issue42992@roundup.psfhosted.org>
Message-ID: <1611332588.52.0.427700071198.issue42992@roundup.psfhosted.org>


E. Paine <paineelisha at gmail.com> added the comment:

I cannot reproduce. Taking a rectangle as an example,
canvas.bbox(canvas.create_rectangle(5, 5, 100, 100, width=1))
returns `(4, 4, 101, 101)` (rather than `(5, 5, 100, 100)`) because of rounding while calculating the outline.

As a result, running
canvas.create_rectangle(canvas.bbox(canvas.create_rectangle(5, 5, 100, 100, width=1)), width=1, outline="yellow")
we see a black outline inside a yellow one (as to be expected).

Could we please have a minimal script to help diagnose the problem?

----------
nosy: +epaine, serhiy.storchaka
versions: +Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42992>
_______________________________________

From report at bugs.python.org  Fri Jan 22 11:58:01 2021
From: report at bugs.python.org (Ron Hoffmann)
Date: Fri, 22 Jan 2021 16:58:01 +0000
Subject: [issue42992] Tkinter bbox coordinates incorrectly drawn
In-Reply-To: <1611262609.83.0.00898948617335.issue42992@roundup.psfhosted.org>
Message-ID: <1611334681.44.0.125464709874.issue42992@roundup.psfhosted.org>


Ron Hoffmann <rhoffmann at muskokawoods.com> added the comment:

Thank you for your response. I have been fighting this issue in a large piece of code for quite some time.
So I wrote a small test script as you asked for and the problem will not reproduce. All behaviour of code is as expected.
I must therefore assume there is no bug in tkinter and the problem lies in my code or with my development environment.
Please consider the issue closed

----------
resolution:  -> not a bug

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42992>
_______________________________________

From report at bugs.python.org  Fri Jan 22 12:20:43 2021
From: report at bugs.python.org (Steve Dower)
Date: Fri, 22 Jan 2021 17:20:43 +0000
Subject: [issue41282] Deprecate and remove distutils
In-Reply-To: <1594542625.3.0.789939298104.issue41282@roundup.psfhosted.org>
Message-ID: <1611336043.71.0.76495074293.issue41282@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
keywords: +patch
pull_requests: +23122
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23142

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41282>
_______________________________________

From report at bugs.python.org  Fri Jan 22 13:00:18 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Fri, 22 Jan 2021 18:00:18 +0000
Subject: [issue42990] Improve the C code for calling Python code:
 _PyEval_EvalCode()
In-Reply-To: <1611245152.12.0.0348161555926.issue42990@roundup.psfhosted.org>
Message-ID: <1611338418.77.0.735765668846.issue42990@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42990>
_______________________________________

From report at bugs.python.org  Fri Jan 22 13:36:01 2021
From: report at bugs.python.org (Glenn Linderman)
Date: Fri, 22 Jan 2021 18:36:01 +0000
Subject: [issue42973] argparse: mixing optional and positional arguments...
 not again
In-Reply-To: <1611094894.69.0.476759327253.issue42973@roundup.psfhosted.org>
Message-ID: <1611340561.36.0.247067185516.issue42973@roundup.psfhosted.org>


Change by Glenn Linderman <v+python at g.nevcal.com>:


----------
nosy: +v+python

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42973>
_______________________________________

From report at bugs.python.org  Fri Jan 22 13:49:35 2021
From: report at bugs.python.org (Andre Roberge)
Date: Fri, 22 Jan 2021 18:49:35 +0000
Subject: [issue42997] Improve error message for missing : before suites
In-Reply-To: <1611278405.38.0.0749709348669.issue42997@roundup.psfhosted.org>
Message-ID: <1611341375.56.0.750991052859.issue42997@roundup.psfhosted.org>


Change by Andre Roberge <andre.roberge at gmail.com>:


----------
nosy: +aroberge

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42997>
_______________________________________

From report at bugs.python.org  Fri Jan 22 13:51:13 2021
From: report at bugs.python.org (Alexey Izbyshev)
Date: Fri, 22 Jan 2021 18:51:13 +0000
Subject: [issue42606] Support POSIX atomicity guarantee of O_APPEND on Windows
In-Reply-To: <1607483566.95.0.1927829703.issue42606@roundup.psfhosted.org>
Message-ID: <1611341473.71.0.74295883981.issue42606@roundup.psfhosted.org>


Alexey Izbyshev <izbyshev at ispras.ru> added the comment:

> FYI, here are the access rights applicable to files

Thanks, I checked that mapping in headers when I was writing _Py_wopen_noraise() as well. But I've found a catch via ProcessHacker: CreateFile() with GENERIC_WRITE (or FILE_GENERIC_WRITE) additionally grants FILE_READ_ATTRIBUTES for some reason. This is why I add FILE_READ_ATTRIBUTES to FILE_GENERIC_WRITE for DuplicateHandle() -- otherwise, the duplicated handle didn't have the same rights in my testing. So basically I have to deal with (a) _wopen() not guaranteeing contractually any specific access rights and (b) CreateFile() not respecting the specified access rights exactly. This is where my distrust and my original question about "default" access rights come from.

> I overlooked a case that's a complication. For O_TEMPORARY, the open uses FILE_FLAG_DELETE_ON_CLOSE; adds DELETE to the requested access; and adds FILE_SHARE_DELETE to the share mode. 
> _Py_wopen_noraise() can easily keep the required DELETE access. The complication is that you have to be careful not to close the original file descriptor until after you've successfully created the duplicate file descriptor. If it fails, you have to return the original file descriptor from _wopen(). If you close all handles for the kernel File and fail the call, the side effect of deleting the file is unacceptable. 

Good catch! But now I realize that the problem with undoing the side effect applies to O_CREAT and O_TRUNC too: we can create and/or truncate the file, but then fail. Even if we could assume that DuplicateHandle() can't fail, _open_osfhandle() can still fail with EMFILE. And since there is no public function in MSVCRT to replace an underlying handle of an existing fd, we can't preallocate an fd to avoid this. There would be no problem if we could just reduce access rights of an existing handle, but it seems there is no such API.

I don't like the idea of silently dropping the atomic append guarantee in case of a failure, so I'm not sure how to proceed with the current approach.

Moreover, the same issue would apply even in case of direct implementation of os.open()/open() via CreateFile() because we still need to wrap the handle with an fd, and this may fail with EMFILE. For O_CREAT/O_TRUNC, it seems like it could be reasonably avoided:

* Truncation can simply be deferred until we have the fd and then performed manually.

* To undo the file creation, we could use GetLastError() to learn whether CreateFile() with OPEN_ALWAYS actually created the file, and then delete it on failure (still non-atomic, and deletion can fail, but probably better than nothing).

But I still don't know how to deal with O_TEMPORARY, unless there is a way to unset FILE_DELETE_ON_CLOSE on a handle.

As an aside, it's also very surprising to me that O_TEMPORARY is allowed for existing files at all. If not for that, there would be no issue on failure apart from non-atomicity.

Maybe I should forgo the idea of supporting O_APPEND for os.open(), and instead just support it in FileIO via WriteFile()-with-OVERLAPPED approach...

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42606>
_______________________________________

From report at bugs.python.org  Fri Jan 22 14:02:26 2021
From: report at bugs.python.org (Andre Roberge)
Date: Fri, 22 Jan 2021 19:02:26 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611342146.74.0.0377799939439.issue42955@roundup.psfhosted.org>


Change by Andre Roberge <andre.roberge at gmail.com>:


----------
nosy: +aroberge

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Fri Jan 22 14:08:35 2021
From: report at bugs.python.org (paul j3)
Date: Fri, 22 Jan 2021 19:08:35 +0000
Subject: [issue42980] argparse: GNU-style help formatter
In-Reply-To: <1611168259.85.0.840894983384.issue42980@roundup.psfhosted.org>
Message-ID: <1611342515.11.0.199917775517.issue42980@roundup.psfhosted.org>


paul j3 <ajipanca at gmail.com> added the comment:

I was thinking of a refactoring that included the ', '.join(...) loop, but on further thought your refactoring might be enough for the case I raised.

For example:

def _format_option_with_args(self, option_string, args_string):
        if option_string.startswith('--'):
            return '%s %s' % (option_string, args_string)
        return '%s' % option_string

would produce a

     -f, --foo FOO    something

and 

def _format_option_with_args(self, option_string, args_string):
        return option_string
       
would produce

     -f, --foo       something

I wonder if this refactoring merits some mention in the documentation.  Or maybe the GnuStyleLongOptionsHelpFormatter subclass is enough of an example.  The details of how other formatter subclasses work aren't documented, but they are available to developers who can read the code.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42980>
_______________________________________

From report at bugs.python.org  Fri Jan 22 14:25:32 2021
From: report at bugs.python.org (paul j3)
Date: Fri, 22 Jan 2021 19:25:32 +0000
Subject: [issue42875] argparse incorrectly shows help string on a new line in
 case of long command string
In-Reply-To: <1610202899.54.0.332342565241.issue42875@roundup.psfhosted.org>
Message-ID: <1611343532.23.0.869144195284.issue42875@roundup.psfhosted.org>


paul j3 <ajipanca at gmail.com> added the comment:

This issue is discussed in:

https://bugs.python.org/issue34724
argparse subparser help indent too short

and

https://stackoverflow.com/questions/32888815/max-help-position-is-not-works-in-python-argparse-library

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42875>
_______________________________________

From report at bugs.python.org  Fri Jan 22 14:42:38 2021
From: report at bugs.python.org (paul j3)
Date: Fri, 22 Jan 2021 19:42:38 +0000
Subject: [issue42966] argparse: customizable help formatter
In-Reply-To: <1611066420.6.0.700026495964.issue42966@roundup.psfhosted.org>
Message-ID: <1611344558.64.0.56077870446.issue42966@roundup.psfhosted.org>


paul j3 <ajipanca at gmail.com> added the comment:

Years ago I proposed a `format_wrapper`, a Format class factory

https://bugs.python.org/issue12806#msg218395

also

https://bugs.python.org/issue39809

There I show that the formatter may be lambda

    formatter = lambda prog: argparse.HelpFormatter(prog, width=100)

The need for improving help customization has been around for a long time:

https://bugs.python.org/issue11695
Improve argparse usage/help customization

https://bugs.python.org/issue32123
Make the API of argparse.HelpFormatter public

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42966>
_______________________________________

From report at bugs.python.org  Fri Jan 22 14:44:43 2021
From: report at bugs.python.org (Steve Dower)
Date: Fri, 22 Jan 2021 19:44:43 +0000
Subject: [issue42957] os.readlink produces wrong result on windows
In-Reply-To: <1610997189.12.0.447653130689.issue42957@roundup.psfhosted.org>
Message-ID: <1611344683.55.0.427644975277.issue42957@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

I agree with Eryk (unsurprisingly, we discussed this change *a lot* back when it was made ~3 years ago).

os.readlink is the lowest-level API that gives a reliable result.

os.path.realpath is the high-level API that probably does what most users want most of the time (and relies on os.readlink being reliable).

We can't change either of these to more of a middle-ground without taking away the ability for users to implement their own behaviour. So there's no behavioural issue here. (The behavioural issue we fixed in 3.8 was that realpath didn't resolve anything at all, so we're not reverting back to that.)

If you'd like a new API added to either retrieve the display path or to read a link and try to partially normalise the result without resolving any more links, please open an issue specifically for that (targeting Python 3.10). You probably also want to prototype a wrapper around readlink() to do it, and be prepared to have many potential edge cases thrown against it.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42957>
_______________________________________

From report at bugs.python.org  Fri Jan 22 15:13:42 2021
From: report at bugs.python.org (Tyler Yep)
Date: Fri, 22 Jan 2021 20:13:42 +0000
Subject: [issue43004] No type variables left in collections.abc.Callable
Message-ID: <1611346422.35.0.0652795827703.issue43004@roundup.psfhosted.org>


New submission from Tyler Yep <tyler.yep at robinhood.com>:

The following code crashes when I try to run it, even though it passes when I use `from typing import Callable` instead.

```
from collections.abc import Callable
from typing import Any, TypeVar

V = TypeVar("V")
Function = Callable[[list[V], V, V], float]


def random_fn(fn: Function[Any]) -> Function[Any]:
    return fn
```

----------
messages: 385511
nosy: tyler.yep
priority: normal
severity: normal
status: open
title: No type variables left in collections.abc.Callable
type: crash
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43004>
_______________________________________

From report at bugs.python.org  Fri Jan 22 15:26:30 2021
From: report at bugs.python.org (Steve Dower)
Date: Fri, 22 Jan 2021 20:26:30 +0000
Subject: [issue42800] Traceback objects allow accessing frame objects without
 triggering audit hooks
In-Reply-To: <1609460218.67.0.01717828776.issue42800@roundup.psfhosted.org>
Message-ID: <1611347190.05.0.706165961533.issue42800@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

I'm fine with either approach, though adding the READ_RESTRICTED flag would also be fine.

The audit trailing leading to a bypass is very important, and traversing frames to find functions in their locals or closures is very useful.

This is nothing like a traditional sandbox, which we can't do because there are (few) legitimate uses and (many) existing users of our internal interpreter state inspection/mutation APIs. This is about tracing internal events - hence _audit_ events - so we want them for all equivalent ways to achieve the same internal inspection/mutation.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42800>
_______________________________________

From report at bugs.python.org  Fri Jan 22 15:55:57 2021
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Fri, 22 Jan 2021 20:55:57 +0000
Subject: [issue42967] [security] urllib.parse.parse_qsl(): Web cache poisoning
 - `; ` as a query args separator
In-Reply-To: <1611068809.96.0.58823274544.issue42967@roundup.psfhosted.org>
Message-ID: <1611348957.27.0.194151916873.issue42967@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

Too bad that semicolon is not recommended nowadays, it was a nice way to avoid ampersand HTML escape issues!

One server software that generates links using semicolons is debbugs: https://bugs.debian.org/cgi-bin/pkgreport.cgi?archive=both;package=gtk3-engines-xfce;package=gtk2-engines-xfce

----------
components: +Library (Lib) -C API
nosy: +eric.araujo

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Fri Jan 22 17:29:37 2021
From: report at bugs.python.org (Steven D'Aprano)
Date: Fri, 22 Jan 2021 22:29:37 +0000
Subject: [issue43002] Exception chaining accepts exception classes
In-Reply-To: <1611323561.1.0.365445213907.issue43002@roundup.psfhosted.org>
Message-ID: <1611354577.4.0.947558962257.issue43002@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

It is intended behaviour. `raise ... from` is a general mechanism that you can call anywhere, it is not just limited to raising from the previous exception. It is designed for explicitly setting the chained exception to some arbitrary exception. See the PEP:

https://www.python.org/dev/peps/pep-3134/#explicit-exception-chaining

>>> raise ValueError('bad value') from IndexError('bad index')
IndexError: bad index

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ValueError: bad value


If you wish to chain from the current exception, you have to chain from the current exception, and not create a new one.

This is not an interpreter bug, it's working fine. Your first instinct was correct: your colleague had written "bad code" and his intention was probably to raise from the exception he had just caught. 

Or just don't do anything. A `raise exception` inside an except block will be automatically chained with the current exception unless you explicitly disable it with `raise exception from None`.

----------
nosy: +steven.daprano
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43002>
_______________________________________

From report at bugs.python.org  Fri Jan 22 18:19:42 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Fri, 22 Jan 2021 23:19:42 +0000
Subject: [issue43004] No type variables left in collections.abc.Callable
In-Reply-To: <1611346422.35.0.0652795827703.issue43004@roundup.psfhosted.org>
Message-ID: <1611357582.81.0.179259966854.issue43004@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
nosy: +kj

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43004>
_______________________________________

From report at bugs.python.org  Fri Jan 22 18:22:37 2021
From: report at bugs.python.org (Ixio)
Date: Fri, 22 Jan 2021 23:22:37 +0000
Subject: [issue43005] Package Relative Imports - double dot doc example not
 working
Message-ID: <1611357757.62.0.234693814777.issue43005@roundup.psfhosted.org>


New submission from Ixio <ektech at gmx.com>:

I've been trying to do a double dot import without success, I've tried going back to the official documentation in order to figure it out however even the example shown does not work.

Official example : https://docs.python.org/3/reference/import.html#package-relative-imports

The following instructions mimic pretty well the doc example :

```bash
mkdir package
cd package
touch __init__.py
mkdir subpackage1
touch subpackage1/__init__.py
mkdir subpackage2
touch subpackage2/__init__.py
echo "eggs = 42" > subpackage2/moduleZ.py
echo "from ..subpackage2.moduleZ import eggs" > subpackage1/moduleX.py
python subpackage1/moduleX.py
cd subpackage1
python moduleX.py

cd ..
echo "from subpackage1 import moduleX" > moduleA.py
python moduleA.py
```

However I get 3 times the following error :
    from ..subpackage2.moduleZ import eggs
ImportError: attempted relative import beyond top-level package

Even though the docs say "In [...] subpackage1/moduleX.py [...] the following are valid relative imports: [...] from ..subpackage2.moduleZ import eggs".

I have no idea how to fix the doc as I would love to do "from ..subpackage2.moduleZ import eggs" from "subpackage1/moduleX.py" since that's the structure I'm trying to set up for a Python project of mine but obviously it does not seem to work.

My system uses Python 3.9 and I've used Docker to try this scenario on Python 3.8, 3.5 and even 3.2: it does not work either. I've also tried on another machine and asked a friend to try, no luck.

I'm hoping someone here can explain how double dot imports work and fix the documentation accordingly.

----------
assignee: docs at python
components: Documentation
messages: 385515
nosy: Ixio, brett.cannon, docs at python, eric.snow, ncoghlan
priority: normal
severity: normal
status: open
title: Package Relative Imports - double dot doc example not working
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43005>
_______________________________________

From report at bugs.python.org  Fri Jan 22 18:32:43 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Fri, 22 Jan 2021 23:32:43 +0000
Subject: [issue43005] Package Relative Imports - double dot doc example not
 working
In-Reply-To: <1611357757.62.0.234693814777.issue43005@roundup.psfhosted.org>
Message-ID: <1611358363.39.0.173059256864.issue43005@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

This is not a bug in Python. Please ask a user forum for help understanding (for example, https://discuss.python.org/c/users/7).

----------
nosy: +gvanrossum
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43005>
_______________________________________

From report at bugs.python.org  Fri Jan 22 19:01:01 2021
From: report at bugs.python.org (Ryan Hileman)
Date: Sat, 23 Jan 2021 00:01:01 +0000
Subject: [issue42800] Traceback objects allow accessing frame objects without
 triggering audit hooks
In-Reply-To: <1609460218.67.0.01717828776.issue42800@roundup.psfhosted.org>
Message-ID: <1611360061.44.0.985597923993.issue42800@roundup.psfhosted.org>


Ryan Hileman <lunixbochs at gmail.com> added the comment:

I agree that READ_RESTRICTED would work, and I'm strongly in support of refactoring my patch around that kind of flag, as it simplifies it quite a bit and the if statement is already there.

However, using the seemingly legacy RESTRICTED flag names for audit is confusing in my opinion:

- The audit subsystem does something entirely different from the long deprecated "Restricted execution" feature (removed in 3.0?)
- Nothing in the stdlib uses RESTRICTED that I can see.
- The documentation for RESTRICTED flags (Doc/extending/newtypes.rst) doesn't say anything about the audit system for READ_RESTRICTED, and talks about restricted mode as though it still exists.
- RESTRICTED only supports __getattr__ (PY_WRITE_RESTRICTED does nothing at all, and there is no delattr equivalent). This doesn't actually matter for this patch, it's just confusing in the context of audit, as there are `object.__setattr__` and `object.__delattr__` audit points but no corresponding flags.

I think it could make sense to:
1. Alias READ_RESTRICTED to a new READ_AUDIT flag and use the latter instead, as it is more clear.
2. Update the newtype docs to mention READ_AUDIT and remove documentation for the the unused RESTRICTED flags.
3. Deprecate the non-functional RESTRICTED flags if that's possible?
4. Only cross the setattr/delattr audit flag bridge if a future refactor calls for it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42800>
_______________________________________

From report at bugs.python.org  Fri Jan 22 19:33:41 2021
From: report at bugs.python.org (Steve Dower)
Date: Sat, 23 Jan 2021 00:33:41 +0000
Subject: [issue42800] Traceback objects allow accessing frame objects without
 triggering audit hooks
In-Reply-To: <1611360061.44.0.985597923993.issue42800@roundup.psfhosted.org>
Message-ID: <ef94cb11-3cba-658f-8188-8ea87f415308@python.org>


Steve Dower <steve.dower at python.org> added the comment:

> I think it could make sense to:
> 1. Alias READ_RESTRICTED to a new READ_AUDIT flag and use the latter instead, as it is more clear.
> 2. Update the newtype docs to mention READ_AUDIT and remove documentation for the the unused RESTRICTED flags.
> 3. Deprecate the non-functional RESTRICTED flags if that's possible?
> 4. Only cross the setattr/delattr audit flag bridge if a future refactor calls for it.

Sounds good to me. We can deprecate RESTRICTED with no intention to 
remove it, since it's documented.

Do you want to prepare a PR for this?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42800>
_______________________________________

From report at bugs.python.org  Fri Jan 22 19:37:10 2021
From: report at bugs.python.org (Ryan Hileman)
Date: Sat, 23 Jan 2021 00:37:10 +0000
Subject: [issue42800] Traceback objects allow accessing frame objects without
 triggering audit hooks
In-Reply-To: <1609460218.67.0.01717828776.issue42800@roundup.psfhosted.org>
Message-ID: <1611362230.64.0.322791074235.issue42800@roundup.psfhosted.org>


Ryan Hileman <lunixbochs at gmail.com> added the comment:

Just updated the PR with another much simpler attempt, using a new READ_AUDIT flag (aliased to READ_RESTRICTED, and newtypes documentation updated).

I re-ran timings for the new build, and in all cases they match or slightly beat my previous reported timings.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42800>
_______________________________________

From report at bugs.python.org  Fri Jan 22 21:57:48 2021
From: report at bugs.python.org (Will Noble)
Date: Sat, 23 Jan 2021 02:57:48 +0000
Subject: [issue42980] argparse: GNU-style help formatter
In-Reply-To: <1611168259.85.0.840894983384.issue42980@roundup.psfhosted.org>
Message-ID: <1611370668.5.0.682338029842.issue42980@roundup.psfhosted.org>


Will Noble <author at will.party> added the comment:

Ya I was following the precedent of non-documentation figuring that formal documentation should be done for the entire class and that would be a much larger undertaking and maybe involve further refactoring. I could potentially undertake that task in the future but I think it's out-of-scope for this change.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42980>
_______________________________________

From report at bugs.python.org  Fri Jan 22 23:01:46 2021
From: report at bugs.python.org (Ken Jin)
Date: Sat, 23 Jan 2021 04:01:46 +0000
Subject: [issue43004] No type variables left in collections.abc.Callable
In-Reply-To: <1611346422.35.0.0652795827703.issue43004@roundup.psfhosted.org>
Message-ID: <1611374506.26.0.26236256753.issue43004@roundup.psfhosted.org>


Ken Jin <kenjin4096 at gmail.com> added the comment:

This seems to be a duplicate of Issue40494. It has already been fixed in Python 3.10, and in Python 3.9.2 (which isn't out yet). You can see the what's new for it here https://docs.python.org/3/whatsnew/3.9.html#notable-changes-in-python-3-9-2.

The expected release date for Python 3.9.2 is Monday, 2021-02-15 according to PEP 596 https://www.python.org/dev/peps/pep-0596/.

For now, I guess you'll have to use the old typing.Callable, then update it in newer versions of Python.

I'm assuming you are currently using python 3.9.0/3.9.1, which has this bug. I'm unable to reproduce it on Python 3.10.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43004>
_______________________________________

From report at bugs.python.org  Fri Jan 22 23:12:23 2021
From: report at bugs.python.org (Tyler Yep)
Date: Sat, 23 Jan 2021 04:12:23 +0000
Subject: [issue43004] No type variables left in collections.abc.Callable
In-Reply-To: <1611346422.35.0.0652795827703.issue43004@roundup.psfhosted.org>
Message-ID: <1611375143.98.0.0976373670252.issue43004@roundup.psfhosted.org>


Tyler Yep <tyler.yep at robinhood.com> added the comment:

Got it, thanks!

----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43004>
_______________________________________

From report at bugs.python.org  Fri Jan 22 23:47:50 2021
From: report at bugs.python.org (Eryk Sun)
Date: Sat, 23 Jan 2021 04:47:50 +0000
Subject: [issue42606] Support POSIX atomicity guarantee of O_APPEND on Windows
In-Reply-To: <1607483566.95.0.1927829703.issue42606@roundup.psfhosted.org>
Message-ID: <1611377270.52.0.101548374938.issue42606@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> I've found a catch via ProcessHacker: CreateFile() with 
> GENERIC_WRITE (or FILE_GENERIC_WRITE) additionally grants 
> FILE_READ_ATTRIBUTES for some reason. 

CreateFileW always requests at least SYNCHRONIZE and FILE_READ_ATTRIBUTES access.

The I/O manager requires synchronize access if a file is opened in synchronous mode. CreateFileW goes a step further. It always requests synchronize access, even with asynchronous mode (overlapped). The File object gest signaled when an I/O request completes, but it's not very useful in the context of overlapping requests.

Requesting read-attributes access supports API functions that query certain file information. Here are some of the more common queries that require read-attributes access:

    FileBasicInformation (GetFileInformationByHandleEx, GetFileTime)
    FileAllInformation (GetFileInformationByHandle)
    FileAttributeTagInformation (GetFileInformationByHandleEx)

Thus os.fstat(fd) can succeed even if the file is opened in O_WRONLY mode.

CreateFileW also implicitly requests DELETE access if FILE_FLAG_DELETE_ON_CLOSE is used, instead of letting the call fail with an invalid-parameter error if delete access isn't requested. This behavior isn't documented.

> undoing the side effect applies to O_CREAT and O_TRUNC too: we can create and/or 
> truncate the file, but then fail. 

I think truncation via TRUNCATE_EXISTING (O_TRUNC, with O_WRONLY or O_RDWR) or overwriting with CREATE_ALWAYS (O_CREAT | O_TRUNC) is at least tolerable because the caller doesn't care about the existing data. When overwriting, the caller also wants to remove any alternate data streams and extended attributes in the file. Nothing important is lost. Also, since both cases retain the original file's security descriptor, at least failure after truncation or overwriting isn't a security hole.

Unless we require CREATE_NEW (O_CREAT | O_EXCL) whenever O_TEMPORARY is used (i.e. as the tempfile module uses it), there is a potential for an existing file to be deleted if all handles are closed on failure, as discussed previously. This is unacceptable not only because of potential unrecoverable data loss, but also because the security descriptor is lost. 

With OPEN_ALWAYS (O_CREAT), CREATE_ALWAYS or CREATE_NEW, there's the chance of leaving behind a new empty file or alternate data stream on failure, which is a problem, but at least nothing is lost.

> _open_osfhandle() can still fail with EMFILE. 

The CRT supports 8192 open file descriptors (128 arrays of 64 fds), so failing with EMFILE should be rare, in extreme cases. There's also a remote possibility of memory corruption that causes __acrt_lowio_set_os_handle() to fail with EBADF because the fd value is negative, or its handle value isn't the default INVALID_HANDLE_VALUE, or the CRT _nhandle count is corrupt. These aren't practical concerns, just as DuplicateHandle() failing isn't a practical concern, but failure should be handled conservatively.

> the same issue would apply even in case of direct implementation of 
> os.open()/open() via CreateFile() 

Migrating to CreateFileW() might need to be shelved until Python uses native OS File handles instead of CRT file descriptors. The remaining reliance on the CRT low I/O layer ties our hands for now.

> Truncation can simply be deferred until we have the fd and then performed manually.

What if it fails after overwriting an existing file? Manually overwriting only after getting the new fd is complicated. To match CREATE_ALWAYS (O_CREAT | O_TRUNC), before overwriting it would have to query the existing file attributes and fail the call if FILE_ATTRIBUTE_HIDDEN or FILE_ATTRIBUTE_SYSTEM is set. If the file itself has to be overwritten (i.e. the default, anonymous data stream), as opposed to a named data stream, it would have to delete all named data streams and extended attributes in the file. Normally that's all implemented atomically in the filesystem. 

In contrast, TRUNCATE_EXISTING (O_TRUNC) is simple to emulate, since CreateFileW implents it non-atomically with a subsequent NtSetInformationFile: FileAllocationInformation system call. 

> But I still don't know how to deal with O_TEMPORARY, unless there is a 
> way to unset FILE_DELETE_ON_CLOSE on a handle.

For now, that's possible with NTFS and the Windows API in all supported versions of Windows by using a second kernel File with DELETE access, which is opened before the last handle to the first kernel File is closed. After you close the first open, use the second one to call SetFileInformation: FileDispositionInfo to undelete the file. That said, if NTFS changes the default for delete-on-close to use a POSIX-style delete (immediate unlink), it won't be possible to 'undelete' the file.

Windows 10 supports additional flags with FileDispositionInfoEx (21), or NTAPI FileDispositionInformationEx [1]. This provides a better way to disable or modify the delete-on-close state per kernel File object, if the filesystem supports it. If FILE_DISPOSITION_ON_CLOSE (8) is set with FILE_DISPOSITION_DO_NOT_DELETE (0), the on-close disposition will be disabled. It is not possible, as far as I know, to enable it again. For example:

    >>> fd = os.open('spam.txt', os.O_TEMPORARY|os.O_CREAT)
    >>> h = msvcrt.get_osfhandle(fd)
    >>> info = ctypes.c_ulong(8)
    >>> kernel32.SetFileInformationByHandle(h, 21, ctypes.byref(info), ctypes.sizeof(info))
    1
    >>> os.close(fd)
    >>> os.path.exists('spam.txt')
    True

If FILE_DISPOSITION_ON_CLOSE is set with FILE_DISPOSITION_DELETE (1) and FILE_DISPOSITION_POSIX_SEMANTICS (2), the delete-on-close behavior is changed to use POSIX semantics, which immediately unlinks the file even if there are existing opens. For example:

    >>> fd = os.open('spam.txt', os.O_TEMPORARY|os.O_CREAT)
    >>> h = msvcrt.get_osfhandle(fd)
    >>> info = ctypes.c_ulong(8|2|1)
    >>> kernel32.SetFileInformationByHandle(h, 21, ctypes.byref(info), ctypes.sizeof(info))
    1

Add a second open:

    >>> fd2 = os.open('spam.txt', os.O_TEMPORARY)

Normally the second open would keep the file linked in the directory after it's 'deleted', but not with POSIX semantics:

    >>> os.close(fd)
    >>> os.path.exists('spam.txt')
    False
    >>> 'spam.txt' in os.listdir('.')
    False

---

[1] https://docs.microsoft.com/en-us/windows-hardware/drivers/ddi/ntddk/ns-ntddk-_file_disposition_information_ex

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42606>
_______________________________________

From report at bugs.python.org  Sat Jan 23 01:24:23 2021
From: report at bugs.python.org (Zac Hatfield-Dodds)
Date: Sat, 23 Jan 2021 06:24:23 +0000
Subject: [issue43006] Changed behaviour of inspect.signature() in Python 3.10
Message-ID: <1611383063.08.0.672499153283.issue43006@roundup.psfhosted.org>


New submission from Zac Hatfield-Dodds <zac.hatfield.dodds at gmail.com>:

Consider the following snippet, which passes on Python 3.9 and earlier:


    import inspect

    def f(x: int = None):
        pass

    print(inspect.signature(constructor))
    assert inspect.signature(constructor).parameters["a"].annotation == int


But under Python 3.10 (alpha 4), the annotation is instead read as Optional[int].  This is correct for typing.get_type_hints(), but *not* for inspect.signature().

I therefore suspect that this is an accidental side-effect from support for PEP-563 deferred evaluation of annotations.

----------
components: Library (Lib)
messages: 385524
nosy: Zac Hatfield-Dodds
priority: normal
severity: normal
status: open
title: Changed behaviour of inspect.signature() in Python 3.10
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43006>
_______________________________________

From report at bugs.python.org  Sat Jan 23 02:06:29 2021
From: report at bugs.python.org (Ram Rachum)
Date: Sat, 23 Jan 2021 07:06:29 +0000
Subject: [issue43002] Exception chaining accepts exception classes
In-Reply-To: <1611323561.1.0.365445213907.issue43002@roundup.psfhosted.org>
Message-ID: <1611385589.59.0.246022540076.issue43002@roundup.psfhosted.org>


Ram Rachum <ram at rachum.com> added the comment:

People barely know how to use the right form of this feature. Providing them with a wrong form that's confusingly similar to the right form and fails silently is an unfortunate choice. 

"Or just don't do anything. A `raise exception` inside an except block will be automatically chained with the current exception [...]"

With the wrong message, yes.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43002>
_______________________________________

From report at bugs.python.org  Sat Jan 23 02:41:32 2021
From: report at bugs.python.org (Arfrever Frehtes Taifersar Arahesis)
Date: Sat, 23 Jan 2021 07:41:32 +0000
Subject: [issue41282] Deprecate and remove distutils
In-Reply-To: <1594542625.3.0.789939298104.issue41282@roundup.psfhosted.org>
Message-ID: <1611387692.13.0.50488379147.issue41282@roundup.psfhosted.org>


Change by Arfrever Frehtes Taifersar Arahesis <Arfrever.FTA at GMail.Com>:


----------
nosy: +Arfrever

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41282>
_______________________________________

From report at bugs.python.org  Sat Jan 23 04:56:07 2021
From: report at bugs.python.org (Ken Jin)
Date: Sat, 23 Jan 2021 09:56:07 +0000
Subject: [issue43006] Changed behaviour of inspect.signature() in Python 3.10
In-Reply-To: <1611383063.08.0.672499153283.issue43006@roundup.psfhosted.org>
Message-ID: <1611395767.42.0.0631957479213.issue43006@roundup.psfhosted.org>


Ken Jin <kenjin4096 at gmail.com> added the comment:

> This is correct for typing.get_type_hints(), but *not* for inspect.signature(). I therefore suspect that this is an accidental side-effect from support for PEP-563 deferred evaluation of annotations.

Spot on about PEP 563 becoming the default being the culprit!

The what's new for Python 3.10 states that inspect.signature will try to resolve types https://docs.python.org/3.10/whatsnew/3.10.html#pep-563-postponed-evaluation-of-annotations-becomes-default.

For annotations, inspect.signature internally calls get_type_hints: https://github.com/python/cpython/blob/master/Lib/inspect.py#L2194

A simple solution I can think of is to add a flag to get_type_hints to disable converting to Optional[int] for inspect.signature.

I nosied some people involved in issue38605 so that they can give their opinions on this.

----------
nosy: +BTaskaya, gvanrossum, kj

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43006>
_______________________________________

From report at bugs.python.org  Sat Jan 23 05:13:39 2021
From: report at bugs.python.org (Ken Jin)
Date: Sat, 23 Jan 2021 10:13:39 +0000
Subject: [issue42967] [security] urllib.parse.parse_qsl(): Web cache poisoning
 - `; ` as a query args separator
In-Reply-To: <1611068809.96.0.58823274544.issue42967@roundup.psfhosted.org>
Message-ID: <1611396819.53.0.454909896806.issue42967@roundup.psfhosted.org>


Ken Jin <kenjin4096 at gmail.com> added the comment:

@Adam:

>I haven't noticed, I'm sorry. I don't mind closing mine, just thought it could be a nice first contribution. 

No worries :), please don't close yours.

> Our PRs are different though - I feel like if we are to implement this, we should let the developer choose the separator and not limit to just `&` and `;` - but that discussion probably belongs in the PR.

You're right, I think that's an elegant solution. In the unlikely event web standards change again in another 5 years, the user can change the arguments themselves and cpython won't have to change. And like Eric pointed out, some people do need ';'.

@senthil
I might make some changes soon, so it may not be ready for review yet. If I go ahead with the separator idea, I'll credit Adam as a co-author in the PR, which will require them to sign the CLA too.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Sat Jan 23 05:40:30 2021
From: report at bugs.python.org (MeneMeneTekel)
Date: Sat, 23 Jan 2021 10:40:30 +0000
Subject: [issue43007] set_wakeup_fd() only works in main thread
Message-ID: <1611398430.41.0.0624041377425.issue43007@roundup.psfhosted.org>


New submission from MeneMeneTekel <mail at evation.eu>:

This problem is marked as solved in issue38563, BUT the solution refers to some signal issues being solved - I'm using Python 3.8.7 on windows 10, where a signal solution may not work. I.e. my django (vers. 3.1.5) website crashes every second call with the message:

  File "C:\Winpython\WPy64-3870\python-3.8.7.amd64\lib\asyncio\proactor_events.py", line 632, in __init__
    signal.set_wakeup_fd(self._csock.fileno())
ValueError: set_wakeup_fd only works in main thread

----------
components: asyncio
messages: 385528
nosy: MeneMeneTekel, asvetlov, yselivanov
priority: normal
severity: normal
status: open
title: set_wakeup_fd() only works in main thread
type: crash
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43007>
_______________________________________

From report at bugs.python.org  Sat Jan 23 06:30:46 2021
From: report at bugs.python.org (Ken Hilton)
Date: Sat, 23 Jan 2021 11:30:46 +0000
Subject: [issue43008] IDLE ignores sys.excepthook
Message-ID: <1611401446.12.0.0532585832167.issue43008@roundup.psfhosted.org>


New submission from Ken Hilton <kenny2minecraft at gmail.com>:

Similar to https://bugs.python.org/issue12643 - IDLE ignores sys.excepthook and always prints exceptions.

----------
assignee: terry.reedy
components: IDLE
files: bpo-43008.patch
keywords: patch
messages: 385529
nosy: kenny2minecraft, terry.reedy
priority: normal
pull_requests: 23123
severity: normal
status: open
title: IDLE ignores sys.excepthook
type: behavior
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9
Added file: https://bugs.python.org/file49757/bpo-43008.patch

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43008>
_______________________________________

From report at bugs.python.org  Sat Jan 23 07:05:10 2021
From: report at bugs.python.org (Steven D'Aprano)
Date: Sat, 23 Jan 2021 12:05:10 +0000
Subject: [issue43002] Exception chaining accepts exception classes
In-Reply-To: <1611385589.59.0.246022540076.issue43002@roundup.psfhosted.org>
Message-ID: <20210123120349.GC4609@ando.pearwood.info>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

How do you "the wrong message" to implicitly chain exceptions rather 
than explicitly?

The difference between:

     try:
         len(1)
     except TypeError as e:
         raise ValueError(msg) from e

and

     try:
         len(1)
     except TypeError as e:
       	 raise ValueError(msg)

is that the first traceback says:

"The above exception was the direct cause of the following exception"

and the second says:

"During handling of the above exception, another exception occurred"

Both messages are correct, but if the difference beween the two matters 
to you, feel free to use whichever form you prefer.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43002>
_______________________________________

From report at bugs.python.org  Sat Jan 23 07:08:30 2021
From: report at bugs.python.org (Mark Dickinson)
Date: Sat, 23 Jan 2021 12:08:30 +0000
Subject: [issue43002] Exception chaining accepts exception classes
In-Reply-To: <1611323561.1.0.365445213907.issue43002@roundup.psfhosted.org>
Message-ID: <1611403710.11.0.552470383388.issue43002@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

Ram: I think you're conflating two separate things, here:

(1) The ability to use an exception *class* instead of an exception *instance* in the "from" clause - that is, the ability to do "raise ValueError from TypeError" in place of "raise ValueError from TypeError()"

(2) The lack of a traceback from the local exception-handling context when doing raise from.

The two are independent: you'll see the same lack of traceback that you described if you do "raise ValueError from TypeError()" instead of "raise ValueError from TypeError".

Both behaviours are by design (as Steven already pointed out for (2)). However, on point (1), there may be a documentation bug here. The reference manual, under https://docs.python.org/3/reference/simple_stmts.html#the-raise-statement, says:

> The from clause is used for exception chaining: if given, the second expression must be another exception class or instance, which will then be attached to the raised exception as the __cause__ attribute (which is writable).

However, this description appears not to match the implementation. In the case that the second expression is an exception class, it's *not* attached to the raised exception as the __cause__ attribute. Instead, the exception class is first instantiated, and then the resulting exception *instance* is attached to the raised exception as the __cause__ attribute.

The corresponding part of the implementation is here: https://github.com/python/cpython/blob/b745a6143ae79efe00aa46affe5ea31a06b0b532/Python/ceval.c#L4758-L4763

Demonstration:

    >>> try:
    ...     raise ZeroDivisionError() from RuntimeError
    ... except Exception as e:
    ...     exc = e
    ... 
    >>> exc.__cause__
    RuntimeError()
    >>> exc.__cause__ is RuntimeError  # reference manual would suggest this is True
    False
    >>> isinstance(exc.__cause__, RuntimeError)  # actual behaviour
    True

----------
nosy: +mark.dickinson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43002>
_______________________________________

From report at bugs.python.org  Sat Jan 23 07:32:40 2021
From: report at bugs.python.org (Mark Dickinson)
Date: Sat, 23 Jan 2021 12:32:40 +0000
Subject: [issue43002] Exception chaining accepts exception classes
In-Reply-To: <1611323561.1.0.365445213907.issue43002@roundup.psfhosted.org>
Message-ID: <1611405160.63.0.265137139451.issue43002@roundup.psfhosted.org>


Change by Mark Dickinson <dickinsm at gmail.com>:


----------
pull_requests: +23124
pull_request: https://github.com/python/cpython/pull/24303

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43002>
_______________________________________

From report at bugs.python.org  Sat Jan 23 07:33:41 2021
From: report at bugs.python.org (hai shi)
Date: Sat, 23 Jan 2021 12:33:41 +0000
Subject: [issue43009] Port curses capi pointer array to a struct
Message-ID: <1611405221.76.0.555112594998.issue43009@roundup.psfhosted.org>


New submission from hai shi <shihai1991 at 126.com>:

As the title mentioned. A entire py_curses capi struct would be better than pointer array.

Related PR: PR 24186

----------
assignee: shihai1991
messages: 385532
nosy: shihai1991, vstinner
priority: normal
severity: normal
status: open
title: Port curses capi pointer array to a struct
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43009>
_______________________________________

From report at bugs.python.org  Sat Jan 23 07:36:43 2021
From: report at bugs.python.org (hai shi)
Date: Sat, 23 Jan 2021 12:36:43 +0000
Subject: [issue43009] Port curses capi pointer array to a struct
In-Reply-To: <1611405221.76.0.555112594998.issue43009@roundup.psfhosted.org>
Message-ID: <1611405403.7.0.730910582392.issue43009@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
keywords: +patch
pull_requests: +23125
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24304

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43009>
_______________________________________

From report at bugs.python.org  Sat Jan 23 07:49:36 2021
From: report at bugs.python.org (hai shi)
Date: Sat, 23 Jan 2021 12:49:36 +0000
Subject: [issue41798] [C API] Revisit usage of the PyCapsule C API with
 multi-phase initialization API
In-Reply-To: <1600265269.2.0.881235166904.issue41798@roundup.psfhosted.org>
Message-ID: <1611406176.73.0.992906275137.issue41798@roundup.psfhosted.org>


hai shi <shihai1991 at 126.com> added the comment:

I have checked all capi instances have been allocated in the heap memory.
So I think this bpo can be closed ;)

Thanks Erlend for your contribution.
Thanks victor, petr for your review&merge.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41798>
_______________________________________

From report at bugs.python.org  Sat Jan 23 08:18:37 2021
From: report at bugs.python.org (Zac Hatfield-Dodds)
Date: Sat, 23 Jan 2021 13:18:37 +0000
Subject: [issue43006] Changed behaviour of inspect.signature() in Python 3.10
In-Reply-To: <1611383063.08.0.672499153283.issue43006@roundup.psfhosted.org>
Message-ID: <1611407917.28.0.133129877517.issue43006@roundup.psfhosted.org>


Zac Hatfield-Dodds <zac.hatfield.dodds at gmail.com> added the comment:

A closely related problem, also via https://github.com/HypothesisWorks/hypothesis/issues/2767


    import inspect

    def f(x) -> None:
        pass

    annotations = inspect.getfullargspec(f).annotations
    assert annotations == {"return": None}, annotations


Under Python 3.10, annotations is now {"return": <class 'NoneType'>}

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43006>
_______________________________________

From report at bugs.python.org  Sat Jan 23 08:37:58 2021
From: report at bugs.python.org (Zac Hatfield-Dodds)
Date: Sat, 23 Jan 2021 13:37:58 +0000
Subject: [issue43006] Changed behaviour of inspect.signature() in Python 3.10
In-Reply-To: <1611383063.08.0.672499153283.issue43006@roundup.psfhosted.org>
Message-ID: <1611409078.38.0.543896874226.issue43006@roundup.psfhosted.org>


Zac Hatfield-Dodds <zac.hatfield.dodds at gmail.com> added the comment:

Aaaand it looks like another problem I'm having is also related:


    import inspect

    class T(typing.TypedDict):
        a: int

    print(inspect.signature(T))

was `(*args, **kwargs)` and now raises `ValueError: no signature found for builtin type <class 'dict'>`

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43006>
_______________________________________

From report at bugs.python.org  Sat Jan 23 08:45:35 2021
From: report at bugs.python.org (Zac Hatfield-Dodds)
Date: Sat, 23 Jan 2021 13:45:35 +0000
Subject: [issue43006] Changed behaviour of inspect.signature() in Python 3.10
In-Reply-To: <1611383063.08.0.672499153283.issue43006@roundup.psfhosted.org>
Message-ID: <1611409535.64.0.0663219661728.issue43006@roundup.psfhosted.org>


Zac Hatfield-Dodds <zac.hatfield.dodds at gmail.com> added the comment:

And I promise this is the last one:


    import inspect
    import typing

    def f():
        A = typing.TypeVar("A")

        def same_type_args(a: A, b: A):
            assert type(a) == type(b)

        print(inspect.signature(same_type_args))
        print(typing.get_type_hints(same_type_args))

    f()


$ python3 t.py 
(a: ~A, b: ~A)
{'a': ~A, 'b': ~A}

$ python3.10 t.py 
(a: 'A', b: 'A')
Traceback (most recent call last):
  ...
NameError: name 'A' is not defined


My apologies to everyone involved here; I'm looking forward to postponed annotation evaluation, appreciate all your work on this, and regret that I have such bizzare bugs to report <3

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43006>
_______________________________________

From report at bugs.python.org  Sat Jan 23 08:52:23 2021
From: report at bugs.python.org (Kent Watsen)
Date: Sat, 23 Jan 2021 13:52:23 +0000
Subject: [issue42628] binascii doesn't work on some base64
In-Reply-To: <1607808198.75.0.933631782561.issue42628@roundup.psfhosted.org>
Message-ID: <1611409943.15.0.262040518211.issue42628@roundup.psfhosted.org>


Kent Watsen <kent+python at watsen.net> added the comment:

No activity in 3 weeks.  Selecting a couple components to give it a bump.

----------
components: +C API, Library (Lib)
nosy: +kwatsen

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42628>
_______________________________________

From report at bugs.python.org  Sat Jan 23 08:52:59 2021
From: report at bugs.python.org (Kent Watsen)
Date: Sat, 23 Jan 2021 13:52:59 +0000
Subject: [issue42628] binascii doesn't work on some base64
In-Reply-To: <1607808198.75.0.933631782561.issue42628@roundup.psfhosted.org>
Message-ID: <1611409979.55.0.244982037003.issue42628@roundup.psfhosted.org>


Change by Kent Watsen <kent+python at watsen.net>:


----------
nosy:  -kwatsen2

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42628>
_______________________________________

From report at bugs.python.org  Sat Jan 23 09:26:11 2021
From: report at bugs.python.org (Erez Zinman)
Date: Sat, 23 Jan 2021 14:26:11 +0000
Subject: [issue43010] @functools.wraps and abc.abstractmethod interoperability
Message-ID: <1611411971.69.0.738980453065.issue43010@roundup.psfhosted.org>


New submission from Erez Zinman <erezinman.programmer at gmail.com>:

Consider the following code:

```
from abc import ABC, abstractmethod
from functools import wraps

class A(ABC):
    @abstractmethod
    def f(self):
        pass
    
    @wraps(f)
    def wrapper(self):
        print('f is called!')
        f()
        
class B(A):
    def f(self):
        print('f!')

B()
```

The last line of code results in the following error:
>>> TypeError: Can't instantiate abstract class B with abstract methods wrapper

That happens because `wraps` copies the `__dict__` of the original function. The problem is that at the point of declaration, the `__dict__` also contained `__isabstractmethod__=True` so it was copied as well, and it caused an error on the class' instantiation even though it contained no abstract methods. 
Moreover, this behavior is misleading because the the wrapper function is not abstract. 

Thanks.

----------
components: Extension Modules, Library (Lib)
messages: 385538
nosy: erezinman
priority: normal
severity: normal
status: open
title: @functools.wraps and abc.abstractmethod interoperability
type: behavior
versions: Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43010>
_______________________________________

From report at bugs.python.org  Sat Jan 23 09:28:06 2021
From: report at bugs.python.org (Zackery Spytz)
Date: Sat, 23 Jan 2021 14:28:06 +0000
Subject: [issue43011] DeprecationWarnings in test_ctypes
Message-ID: <1611412086.36.0.506119389141.issue43011@roundup.psfhosted.org>


New submission from Zackery Spytz <zspytz at gmail.com>:

./python -m test test_ctypes
0:00:00 load avg: 1.65 Run tests sequentially
0:00:00 load avg: 1.65 [1/1] test_ctypes
/home/lubuntu2/cpython/Lib/ctypes/test/test_parameters.py:243: DeprecationWarning: invalid escape sequence \(
  self.assertRegex(repr(c_char_p.from_param(b'hihi')), "^<cparam 'z' \(0x[A-Fa-f0-9]+\)>$")
/home/lubuntu2/cpython/Lib/ctypes/test/test_parameters.py:244: DeprecationWarning: invalid escape sequence \(
  self.assertRegex(repr(c_wchar_p.from_param('hihi')), "^<cparam 'Z' \(0x[A-Fa-f0-9]+\)>$")

== Tests result: SUCCESS ==

1 test OK.

Total duration: 2.4 sec
Tests result: SUCCESS


These warnings were introduced in bpo-42938 / 916610ef90a0d0761f08747f7b0905541f0977c7.

----------
components: Tests, ctypes
messages: 385539
nosy: ZackerySpytz
priority: normal
severity: normal
status: open
title: DeprecationWarnings in test_ctypes
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43011>
_______________________________________

From report at bugs.python.org  Sat Jan 23 09:31:03 2021
From: report at bugs.python.org (Zackery Spytz)
Date: Sat, 23 Jan 2021 14:31:03 +0000
Subject: [issue43011] DeprecationWarnings in test_ctypes
In-Reply-To: <1611412086.36.0.506119389141.issue43011@roundup.psfhosted.org>
Message-ID: <1611412263.29.0.559910766768.issue43011@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
keywords: +patch
pull_requests: +23126
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24305

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43011>
_______________________________________

From report at bugs.python.org  Sat Jan 23 09:31:57 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 23 Jan 2021 14:31:57 +0000
Subject: [issue43008] IDLE ignores sys.excepthook in normal, subprocess mode
In-Reply-To: <1611401446.12.0.0532585832167.issue43008@roundup.psfhosted.org>
Message-ID: <1611412317.45.0.148820379474.issue43008@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

I looked at all 4 hooks.

sys.breakpointhook is invoked by breakpoint() in user code, so is not IDLE's concern at present.

sys.unraiseablehook is invoked by the interpreter when user code messes up badly, so is not IDLE's condern.  (And it is an expert feature that beginners should ignore.)

sys.displayhook is set to rpc.displayhook in run.py or, if started with -n no subprocess, pyshell.py.  IDLE executes user code with exec().  Shell entries are compiled in 'single' mode.  Exec invokes displayhook for expression statements so compiled.  In both normal and -n mode, displayhook exceptions are displayed  and processed as user code exceptions, with the last traceback line giving the bad line.

sys.excepthook is invoked by the interpreter for uncaught exceptions.
In IDLE's -n mode, sys.excepthook *is* invoked.  If it raises, both tracebacks are printed, separated by "\nDuring handling of the above exception, another exception occurred:\n".  This issue is about having the same effect in normal 2-process mode.

Since, in the subprocess, IDLE catches all user exceptions for its custom handling, there are no uncaught user exceptions.  I believe your patch calls the user hook in the proper place, but an uncaught exception in sys.excepthook would be nasty.  Replace the call with something like

        try:
            sys.e...k(...)
        except BaseException as e:
            print_exception()
            print("\nDuring handling of the above exception, another exception occurred:\n", file=sys.stderr)
            self.usr_exc_info = sys.exc_info()
            print_exception()

If possible, I want a unittest added in test_run.py.  (I am not sure exactly how as I don't think we have yet directly faked receipt of compiled user code.)

class Executive(unittest.TextCase):

    def test_good_excepthook(self):

    def test_bad_excepthook(self):


A blurb is needed (and always is for anything non-trivial).

In Doc/library/idle.rst, I want to insert " and reset display and exception handling" before the period ending the current Shell entry.

Restart Shell
  Restart the shell to clean the environment.

----------
stage:  -> test needed
title: IDLE ignores sys.excepthook -> IDLE ignores sys.excepthook in normal, subprocess mode
versions:  -Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43008>
_______________________________________

From report at bugs.python.org  Sat Jan 23 10:40:55 2021
From: report at bugs.python.org (Ken Jin)
Date: Sat, 23 Jan 2021 15:40:55 +0000
Subject: [issue43006] Changed behaviour of inspect.signature() in Python 3.10
In-Reply-To: <1611383063.08.0.672499153283.issue43006@roundup.psfhosted.org>
Message-ID: <1611416455.76.0.903607091686.issue43006@roundup.psfhosted.org>


Ken Jin <kenjin4096 at gmail.com> added the comment:

For anyone interested, I went to do some digging on the 3 issues Zac listed:

1. Similar to the first message, this is caused by inspect.getfullarg/signature using get_type_hints in Py 3.10. get_type_hints internally converts None to NoneType.

2. I don't know what's causing that TypeDict signature to fail.

3. I'm not too sure, but maybe this is intentional according to https://www.python.org/dev/peps/pep-0563/#keeping-the-ability-to-use-function-local-state-when-defining-annotations ? You can fix it by passing in locals() to get_type_hints (this should work all the way back to 3.6)::

import typing

def f():
    A = typing.TypeVar("A")
    def same_type_args(a: A, b: A):
        assert type(a) == type(b)
    print(typing.get_type_hints(same_type_args, localns=locals()))

>>> f()
{'a': ~A, 'b': ~A}

The whatsnew should probably be updated to mention this, this is a backwards incompatible change after all.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43006>
_______________________________________

From report at bugs.python.org  Sat Jan 23 11:19:32 2021
From: report at bugs.python.org (Ken Hilton)
Date: Sat, 23 Jan 2021 16:19:32 +0000
Subject: [issue43008] IDLE ignores sys.excepthook in normal, subprocess mode
In-Reply-To: <1611401446.12.0.0532585832167.issue43008@roundup.psfhosted.org>
Message-ID: <1611418772.65.0.178817751305.issue43008@roundup.psfhosted.org>


Ken Hilton <kenny2minecraft at gmail.com> added the comment:

Made requested changes, besides the tests. I didn't manage to figure out how to go about testing an excepthook in the first place, let alone a good or bad one. Hope that's not an issue.

----------
Added file: https://bugs.python.org/file49758/bpo-43008.patch.2

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43008>
_______________________________________

From report at bugs.python.org  Sat Jan 23 11:34:31 2021
From: report at bugs.python.org (Benjamin Peterson)
Date: Sat, 23 Jan 2021 16:34:31 +0000
Subject: [issue43011] DeprecationWarnings in test_ctypes
In-Reply-To: <1611412086.36.0.506119389141.issue43011@roundup.psfhosted.org>
Message-ID: <1611419671.41.0.126396036144.issue43011@roundup.psfhosted.org>


Benjamin Peterson <benjamin at python.org> added the comment:


New changeset f7fa64f0e87edc61d990ed51b4da722906a10928 by Zackery Spytz in branch 'master':
closes bpo-43011: Fix DeprecationWarnings in test_ctypes (GH-24305)
https://github.com/python/cpython/commit/f7fa64f0e87edc61d990ed51b4da722906a10928


----------
nosy: +benjamin.peterson
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43011>
_______________________________________

From report at bugs.python.org  Sat Jan 23 11:34:48 2021
From: report at bugs.python.org (miss-islington)
Date: Sat, 23 Jan 2021 16:34:48 +0000
Subject: [issue43011] DeprecationWarnings in test_ctypes
In-Reply-To: <1611412086.36.0.506119389141.issue43011@roundup.psfhosted.org>
Message-ID: <1611419688.9.0.259930367247.issue43011@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 2.0 -> 3.0
pull_requests: +23127
pull_request: https://github.com/python/cpython/pull/24306

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43011>
_______________________________________

From report at bugs.python.org  Sat Jan 23 11:34:59 2021
From: report at bugs.python.org (miss-islington)
Date: Sat, 23 Jan 2021 16:34:59 +0000
Subject: [issue43011] DeprecationWarnings in test_ctypes
In-Reply-To: <1611412086.36.0.506119389141.issue43011@roundup.psfhosted.org>
Message-ID: <1611419699.16.0.908401801539.issue43011@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +23128
pull_request: https://github.com/python/cpython/pull/24307

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43011>
_______________________________________

From report at bugs.python.org  Sat Jan 23 11:42:00 2021
From: report at bugs.python.org (Ken Jin)
Date: Sat, 23 Jan 2021 16:42:00 +0000
Subject: [issue42967] [security] urllib.parse.parse_qsl(): Web cache poisoning
 - `; ` as a query args separator
In-Reply-To: <1611068809.96.0.58823274544.issue42967@roundup.psfhosted.org>
Message-ID: <1611420120.1.0.631449097139.issue42967@roundup.psfhosted.org>


Ken Jin <kenjin4096 at gmail.com> added the comment:

I updated the PR to take in a sequence of separators from the user - eg:

>>> urllib.parse.parse_qsl('a=1&b=2;c=3', separators=('&', ';'))
[('a', '1'), ('b', '2'), ('c', '3')]
>>> urllib.parse.parse_qsl('a=1&b=2;c=3', separators=('&',))
[('a', '1'), ('b', '2;c=3')]

I _didn't_ change the default - it will allow both '&' and ';' still. Eric showed a link above that still uses semicolon. So I feel that it's strange to break backwards compatibility in a patch update. Maybe we can make just '&' the default in Python 3.10, while backporting the ability to specify separators to older versions so it's up to users?

I'm not sure, any thoughts on this? Opinions would be greatly appreciated.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Sat Jan 23 11:55:54 2021
From: report at bugs.python.org (miss-islington)
Date: Sat, 23 Jan 2021 16:55:54 +0000
Subject: [issue43011] DeprecationWarnings in test_ctypes
In-Reply-To: <1611412086.36.0.506119389141.issue43011@roundup.psfhosted.org>
Message-ID: <1611420954.69.0.351971073977.issue43011@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset dce86c230bb91722e84cd3618c1ee9cb55cc220f by Miss Islington (bot) in branch '3.8':
closes bpo-43011: Fix DeprecationWarnings in test_ctypes (GH-24305)
https://github.com/python/cpython/commit/dce86c230bb91722e84cd3618c1ee9cb55cc220f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43011>
_______________________________________

From report at bugs.python.org  Sat Jan 23 11:56:11 2021
From: report at bugs.python.org (miss-islington)
Date: Sat, 23 Jan 2021 16:56:11 +0000
Subject: [issue43011] DeprecationWarnings in test_ctypes
In-Reply-To: <1611412086.36.0.506119389141.issue43011@roundup.psfhosted.org>
Message-ID: <1611420971.22.0.00150297145649.issue43011@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 00e24cdca422f792b80016287562b6b3bccab239 by Miss Islington (bot) in branch '3.9':
closes bpo-43011: Fix DeprecationWarnings in test_ctypes (GH-24305)
https://github.com/python/cpython/commit/00e24cdca422f792b80016287562b6b3bccab239


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43011>
_______________________________________

From report at bugs.python.org  Sat Jan 23 12:04:23 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 23 Jan 2021 17:04:23 +0000
Subject: [issue43008] IDLE ignores sys.excepthook in normal, subprocess mode
In-Reply-To: <1611401446.12.0.0532585832167.issue43008@roundup.psfhosted.org>
Message-ID: <1611421463.42.0.580594904467.issue43008@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Andre: while I would like friendlier tracebacks available in IDLE without 3rd party installation, I doubt this will happen soon.  In the meanwhile, I see that you are working to polish Friendly Traceback with a friendly contest.  I presume FT uses sys.excepthook.  If so, this issue is opportune for supporting your package.  Feel free to test the minimal patch as is, or when fleshed out, and let us know how it works.

----------
nosy: +aroberge

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43008>
_______________________________________

From report at bugs.python.org  Sat Jan 23 12:09:40 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 23 Jan 2021 17:09:40 +0000
Subject: [issue43008] IDLE ignores sys.excepthook in normal, subprocess mode
In-Reply-To: <1611401446.12.0.0532585832167.issue43008@roundup.psfhosted.org>
Message-ID: <1611421780.63.0.666504440104.issue43008@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Ken: I will probably work on tests, perhaps as a followup or parallel issue.  I will likely do a bit or refactoring to make testing easier.

I just looked at print_exception and discovered that the double traceback can likely by handled by properly setting exc.context for the 2nd exception.  But getting that right will be aided by having something that already works.

Possible manual test protocol in Shell

>>> import sys
>>> def egood(a,b,c): print('Exception traceback', file=sys.stderr)

>>> sys.excepthook = egood
>>> 1/0
# "Exception traceback"
>>> def ebad(a,b,c): z

>>> sys.excepthook = ebad
>>> 1/0
# Double traceback for ZeroDivisionError and NameError

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43008>
_______________________________________

From report at bugs.python.org  Sat Jan 23 12:12:21 2021
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Sat, 23 Jan 2021 17:12:21 +0000
Subject: [issue42967] [security] urllib.parse.parse_qsl(): Web cache poisoning
 - `; ` as a query args separator
In-Reply-To: <1611068809.96.0.58823274544.issue42967@roundup.psfhosted.org>
Message-ID: <1611421941.63.0.374632043308.issue42967@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

> I feel like if we are to implement this, we should let the developer choose the separator and not limit to just `&` and `;`

That doesn?t feel necessary to me.   I suspect most links use &, some use ;, nothing else is valid at the moment and I don?t expect a new separator to suddenly appear.  IMO the boolean parameter to also recognize ; was better.

> but that discussion probably belongs in the PR.

PR discussions are generally about how to achieve the goal (fix or new feature) and quality of implementation, but tickets is where we agree on what the goal is and how to fix it (big picture).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Sat Jan 23 12:14:10 2021
From: report at bugs.python.org (Andre Roberge)
Date: Sat, 23 Jan 2021 17:14:10 +0000
Subject: [issue43008] IDLE ignores sys.excepthook in normal, subprocess mode
In-Reply-To: <1611401446.12.0.0532585832167.issue43008@roundup.psfhosted.org>
Message-ID: <1611422050.21.0.808015642949.issue43008@roundup.psfhosted.org>


Andre Roberge <andre.roberge at gmail.com> added the comment:

Terry: I will put it on my todo list. 

Friendly-traceback can currently work (indirectly) with IDLE; see https://aroberge.github.io/friendly-traceback-docs/docs/html/editor.html

I am not sure what benefit this patch will yield when it comes to using Friendly-traceback with IDLE compared with what is currently possible.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43008>
_______________________________________

From report at bugs.python.org  Sat Jan 23 12:26:32 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 23 Jan 2021 17:26:32 +0000
Subject: [issue42948] bytearray.copy is undocumented
In-Reply-To: <1610908912.39.0.795030432727.issue42948@roundup.psfhosted.org>
Message-ID: <1611422792.39.0.787959660052.issue42948@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
keywords: +patch
nosy: +terry.reedy
nosy_count: 3.0 -> 4.0
pull_requests: +23129
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24308

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42948>
_______________________________________

From report at bugs.python.org  Sat Jan 23 12:32:22 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 23 Jan 2021 17:32:22 +0000
Subject: [issue42962] Windows: SystemError during os.kill(...,
 signal.CTRL_C_EVENT)
In-Reply-To: <1611007954.59.0.488720921329.issue42962@roundup.psfhosted.org>
Message-ID: <1611423142.9.0.984634509818.issue42962@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

If I understand correctly, this is open for someone to evaluate Eryk's suggestion in msg385291 that a 'missing' return be added to win32_kill.

----------
nosy: +terry.reedy
versions:  -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42962>
_______________________________________

From report at bugs.python.org  Sat Jan 23 12:34:34 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 23 Jan 2021 17:34:34 +0000
Subject: [issue42971] Some errnos for BSD/OSX are missing from errno module
In-Reply-To: <1611089796.05.0.463787343348.issue42971@roundup.psfhosted.org>
Message-ID: <1611423274.97.0.335305523858.issue42971@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
type:  -> enhancement
versions: +Python 3.10 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42971>
_______________________________________

From report at bugs.python.org  Sat Jan 23 12:44:54 2021
From: report at bugs.python.org (Eryk Sun)
Date: Sat, 23 Jan 2021 17:44:54 +0000
Subject: [issue42962] Windows: SystemError during os.kill(...,
 signal.CTRL_C_EVENT)
In-Reply-To: <1611007954.59.0.488720921329.issue42962@roundup.psfhosted.org>
Message-ID: <1611423894.47.0.047862150988.issue42962@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

Thanks, Terry. I should have followed up with a short message asking for a core developer to sign off on that suggestion, in which case this is an "easy (C)" issue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42962>
_______________________________________

From report at bugs.python.org  Sat Jan 23 12:50:19 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 23 Jan 2021 17:50:19 +0000
Subject: [issue42974] tokenize reports incorrect end col offset and line
 string when input ends without explicit newline
In-Reply-To: <1611112437.84.0.130779999528.issue42974@roundup.psfhosted.org>
Message-ID: <1611424219.58.0.374242716352.issue42974@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

The question in the issue for tokenizer and virtual newlines is mimicking the C tokenizer versus consistency between and within token 5-tuples.

As a tokenizer user, I would lean toward consistency but it is definitely not my call.

https://github.com/python/cpython/pull/24260/files has several tokenize.c warnings like this:
'=': conversion from '__int64' to 'int', possible loss of data

----------
nosy: +gvanrossum, lys.nikolaou, pablogsal, terry.reedy
type:  -> behavior
versions:  -Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42974>
_______________________________________

From report at bugs.python.org  Sat Jan 23 12:53:43 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 23 Jan 2021 17:53:43 +0000
Subject: [issue43006] Changed behaviour of inspect.signature() in Python 3.10
In-Reply-To: <1611383063.08.0.672499153283.issue43006@roundup.psfhosted.org>
Message-ID: <1611424423.92.0.326560704799.issue43006@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Note that this may be solved in a different way *if* PEP 649 is accepted. This was discussed extensively on python-dev last week. It would roll back the stringification of PEP 563 (unless `from __future__ import annotations` is used, which would be deprecated).

----------
nosy: +larry

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43006>
_______________________________________

From report at bugs.python.org  Sat Jan 23 13:00:36 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 23 Jan 2021 18:00:36 +0000
Subject: [issue42977] Tkinter Optionmenu Too Narrow on Mac
In-Reply-To: <1611154134.32.0.566162791222.issue42977@roundup.psfhosted.org>
Message-ID: <1611424836.89.0.0673045278269.issue42977@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

This should likely be closed as 3rd party

 zjdavid Which python release, which macOS, which installer, which tk patchlevel?  (IDLE Help=>About displays it).

At least one of the 3.9.1 python.org mac installers installs 8.6.10.  We cannot be responsible for problems fixed in this release.

----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42977>
_______________________________________

From report at bugs.python.org  Sat Jan 23 13:08:14 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 23 Jan 2021 18:08:14 +0000
Subject: [issue42992] Tkinter bbox coordinates incorrectly drawn
In-Reply-To: <1611262609.83.0.00898948617335.issue42992@roundup.psfhosted.org>
Message-ID: <1611425294.0.0.383347971161.issue42992@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42992>
_______________________________________

From report at bugs.python.org  Sat Jan 23 13:15:55 2021
From: report at bugs.python.org (Barney Gale)
Date: Sat, 23 Jan 2021 18:15:55 +0000
Subject: [issue43012] Remove pathlib accessors
Message-ID: <1611425755.47.0.494853383169.issue43012@roundup.psfhosted.org>


New submission from Barney Gale <barney.gale at gmail.com>:

Per Pitrou:

> The original intent for the ?accessor? thing was to have a variant that did all accesses under a filesystem tree in a race condition-free way using openat and friends. It turned out to be much too hairy to actually implement, so was entirely abandoned, but the accessor abstraction was left there.

https://discuss.python.org/t/make-pathlib-extensible/3428/2

Accessors are:

- Lacking any internal purpose - '_NormalAccessor' is the only implementation
- Lacking any firm conceptual difference to `Path` objects themselves (inc. subclasses)
- Non-public, i.e. underscore prefixed - '_Accessor' and '_NormalAccessor' 
- Unofficially used to implement customized `Path` objects, but once once bpo-24132 lands there will be a supported route for that.

When bpo-24132 lands, I think we're free to remove accessors and simplify some code

----------
components: Library (Lib)
messages: 385556
nosy: barneygale
priority: normal
severity: normal
status: open
title: Remove pathlib accessors

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43012>
_______________________________________

From report at bugs.python.org  Sat Jan 23 13:16:45 2021
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 23 Jan 2021 18:16:45 +0000
Subject: [issue42300] Typo in translation to portuguese
In-Reply-To: <1604971818.8.0.290636952844.issue42300@roundup.psfhosted.org>
Message-ID: <1611425805.14.0.555573275639.issue42300@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This was fixed here: https://github.com/python/python-docs-pt-br/commit/9c1465ae8a93a2e1814618993fbe32a4078bd23e

----------
nosy: +iritkatriel
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42300>
_______________________________________

From report at bugs.python.org  Sat Jan 23 13:29:41 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 23 Jan 2021 18:29:41 +0000
Subject: [issue42948] bytearray.copy is undocumented
In-Reply-To: <1610908912.39.0.795030432727.issue42948@roundup.psfhosted.org>
Message-ID: <1611426581.55.0.78643209072.issue42948@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Patrick, I am not sure what you are saying.  All the methods listed is this section are for both, as with

bytes.count(sub[, start[, end]])
bytearray.count(sub[, start[, end]])?

but only bytearray has .copy (since there is never a need to copy an immutable).  This appears to be only methods like this.  PR created.

----------
stage: patch review -> 
type: enhancement -> behavior
versions:  -Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42948>
_______________________________________

From report at bugs.python.org  Sat Jan 23 13:34:16 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 23 Jan 2021 18:34:16 +0000
Subject: [issue43001] python3.9.1 test_embed test_tabnanny failed
In-Reply-To: <1611315338.64.0.350030617212.issue43001@roundup.psfhosted.org>
Message-ID: <1611426856.84.0.0815757924792.issue43001@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

What system, what errors (copy-paste failure blocks)?

----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43001>
_______________________________________

From report at bugs.python.org  Sat Jan 23 14:12:55 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 23 Jan 2021 19:12:55 +0000
Subject: [issue43008] IDLE ignores sys.excepthook in normal, subprocess mode
In-Reply-To: <1611401446.12.0.0532585832167.issue43008@roundup.psfhosted.org>
Message-ID: <1611429175.17.0.812557705882.issue43008@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Andre: with this patch, you could potentially add a function or submodule that would point sys.excepthook to a function that would print the exception and then interact before returning.  If this worked, one could add, for instance, 'import friendly_traceback.idle' at the top of a file or at a Shell prompt and have friendly-traceback only activate when there is an exception.  So it would work in Shell.

I hope by 3.10 to have IDLE '>>>' prompts moved into a sidebar (instead of line numbers.  F-T prompts would be distinctly different.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43008>
_______________________________________

From report at bugs.python.org  Sat Jan 23 14:16:08 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 23 Jan 2021 19:16:08 +0000
Subject: [issue43008] IDLE ignores sys.excepthook in normal, subprocess mode
In-Reply-To: <1611401446.12.0.0532585832167.issue43008@roundup.psfhosted.org>
Message-ID: <1611429368.48.0.82218267108.issue43008@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Ken, I read on another issue that an exception in an except suite is automatically linked to the caught exception, though the printed result may not be exactly the same.  Once your CLA is 'activated', I will experiment with the options.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43008>
_______________________________________

From report at bugs.python.org  Sat Jan 23 14:34:29 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 23 Jan 2021 19:34:29 +0000
Subject: [issue43003] Parts of the API will be removed in Python 4.0 ?
In-Reply-To: <1611327703.19.0.312122851749.issue43003@roundup.psfhosted.org>
Message-ID: <1611430469.8.0.955023854499.issue43003@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Questions should be asked on Q&A forums, like python_list.
Check Removed section of What's New in 3.10.
https://docs.python.org/3.10/whatsnew/3.10.html#removed

----------
nosy: +terry.reedy
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43003>
_______________________________________

From report at bugs.python.org  Sat Jan 23 14:37:43 2021
From: report at bugs.python.org (Patrick Haller)
Date: Sat, 23 Jan 2021 19:37:43 +0000
Subject: [issue42948] bytearray.copy is undocumented
In-Reply-To: <1610908912.39.0.795030432727.issue42948@roundup.psfhosted.org>
Message-ID: <1611430663.4.0.839694467149.issue42948@roundup.psfhosted.org>


Patrick Haller <patrickhaller40 at googlemail.com> added the comment:

Terry, I am sorry. You are of course right. I was somehow looking at count not copy.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42948>
_______________________________________

From report at bugs.python.org  Sat Jan 23 14:37:46 2021
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 23 Jan 2021 19:37:46 +0000
Subject: [issue40745] Typo in library/typing
In-Reply-To: <1590252952.01.0.421861710026.issue40745@roundup.psfhosted.org>
Message-ID: <1611430666.87.0.211882454839.issue40745@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40745>
_______________________________________

From report at bugs.python.org  Sat Jan 23 16:20:31 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 23 Jan 2021 21:20:31 +0000
Subject: [issue43013] IDLE:  update code,
 mostly by cleanups of 2.x or 2to3 artifacts
Message-ID: <1611436831.18.0.743701112328.issue43013@roundup.psfhosted.org>


New submission from Terry J. Reedy <tjreedy at udel.edu>:

Tal, just so you know in case you see a resulting merge conflict.  I've been waiting for years to do these until most PRs were closed.  Has not happened, and annoyances continue.

Since there is no search option I can find to search for PRs with a merge conflict, I assume that they are not discovered until a PR is accessed.  So when some of these are done, I will search with 'idle in:title', open, scroll down, and fix.

1. 9 leftover 'object's from 2.x "class C(object):" headers.

2. 6 unneeded 'list's added by 2to3 to make 'for item in list(iterable):'.

3. import 3.x-tkinter name as 2.x-tkinter; needs some care but fixes will be easy to verify.

4. builtin names like 'object', 'dict', and 'type' used as parameter names; I am open to opinion of adding '_' versus abbreviating versus alternative.  

5. ??

----------
assignee: terry.reedy
components: IDLE
messages: 385564
nosy: taleinat, terry.reedy
priority: normal
severity: normal
status: open
title: IDLE:  update code, mostly by cleanups of 2.x or 2to3 artifacts
type: enhancement
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43013>
_______________________________________

From report at bugs.python.org  Sat Jan 23 17:22:17 2021
From: report at bugs.python.org (Adam Goldschmidt)
Date: Sat, 23 Jan 2021 22:22:17 +0000
Subject: [issue42967] [security] urllib.parse.parse_qsl(): Web cache poisoning
 - `; ` as a query args separator
In-Reply-To: <1611068809.96.0.58823274544.issue42967@roundup.psfhosted.org>
Message-ID: <1611440537.83.0.195208858638.issue42967@roundup.psfhosted.org>


Adam Goldschmidt <adamgold7 at gmail.com> added the comment:

> I _didn't_ change the default - it will allow both '&' and ';' still. Eric showed a link above that still uses semicolon. So I feel that it's strange to break backwards compatibility in a patch update. Maybe we can make just '&' the default in Python 3.10, while backporting the ability to specify separators to older versions so it's up to users?

I like this implementation. I definitely think we should not break backwards compatibility and only change the default in Python 3.10.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Sat Jan 23 17:25:20 2021
From: report at bugs.python.org (Adam Goldschmidt)
Date: Sat, 23 Jan 2021 22:25:20 +0000
Subject: [issue42967] [security] urllib.parse.parse_qsl(): Web cache poisoning
 - `; ` as a query args separator
In-Reply-To: <1611068809.96.0.58823274544.issue42967@roundup.psfhosted.org>
Message-ID: <1611440720.84.0.522913575559.issue42967@roundup.psfhosted.org>


Adam Goldschmidt <adamgold7 at gmail.com> added the comment:

> That doesn?t feel necessary to me.   I suspect most links use &, some use ;, nothing else is valid at the moment and I don?t expect a new separator to suddenly appear.  IMO the boolean parameter to also recognize ; was better.

That's reasonable. However, I think that we are making this change in order to treat the semicolon as a "custom" separator. In that case, why not let the developer decide on a different custom separator for their own use cases? What's the difference between a semicolon and something else?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Sat Jan 23 17:28:26 2021
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Sat, 23 Jan 2021 22:28:26 +0000
Subject: [issue42967] [security] urllib.parse.parse_qsl(): Web cache poisoning
 - `; ` as a query args separator
In-Reply-To: <1611068809.96.0.58823274544.issue42967@roundup.psfhosted.org>
Message-ID: <1611440906.05.0.578733406936.issue42967@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

The difference is that semicolon is defined in a previous specification.

I don?t see this change as providing support for custom delimiters in URL parsing, but offering an option to pick between two specifications.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Sat Jan 23 20:38:13 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Sun, 24 Jan 2021 01:38:13 +0000
Subject: [issue43007] set_wakeup_fd() only works in main thread
In-Reply-To: <1611398430.41.0.0624041377425.issue43007@roundup.psfhosted.org>
Message-ID: <1611452293.36.0.110274525343.issue43007@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43007>
_______________________________________

From report at bugs.python.org  Sat Jan 23 21:21:32 2021
From: report at bugs.python.org (Josh Rosenberg)
Date: Sun, 24 Jan 2021 02:21:32 +0000
Subject: [issue42948] bytearray.copy is undocumented
In-Reply-To: <1610908912.39.0.795030432727.issue42948@roundup.psfhosted.org>
Message-ID: <1611454892.52.0.486387261182.issue42948@roundup.psfhosted.org>


Josh Rosenberg <shadowranger+python at gmail.com> added the comment:

Does this need specific documentation? bytearray itself is documented with:

> As bytearray objects are mutable, they support the mutable sequence operations in addition to the common bytes and bytearray operations described in Bytes and Bytearray Operations.

where "mutable" is a link to all the mutable sequence operations ( https://docs.python.org/3/library/stdtypes.html#typesseq-mutable ), including copy. Specifically documenting copy for bytearray is pointless; are we going to add specific documentation for append and remove and all the other mutable sequence operations as well?

----------
nosy: +josh.r

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42948>
_______________________________________

From report at bugs.python.org  Sat Jan 23 23:07:36 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 24 Jan 2021 04:07:36 +0000
Subject: [issue42948] bytearray.copy is undocumented
In-Reply-To: <1610908912.39.0.795030432727.issue42948@roundup.psfhosted.org>
Message-ID: <1611461256.45.0.625801590378.issue42948@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Josh, you are right.  I closed the PR.  Before closing, I will think about whether to propose a change to make this more prominent.

I notice the issubclass(array.array, collections.abc.MutableSequence ) is True even though some of the methods  (like clear, copy) are missing.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42948>
_______________________________________

From report at bugs.python.org  Sat Jan 23 23:23:13 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 24 Jan 2021 04:23:13 +0000
Subject: [issue43013] IDLE:  update code,
 mostly by cleanups of 2.x or 2to3 artifacts
In-Reply-To: <1611436831.18.0.743701112328.issue43013@roundup.psfhosted.org>
Message-ID: <1611462193.27.0.590187423584.issue43013@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

5. Extraneous () after class name in class header: 'class name():'.  Never done in idlelib itself, 27 in test files, mostly in 1 file.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43013>
_______________________________________

From report at bugs.python.org  Sun Jan 24 02:58:14 2021
From: report at bugs.python.org (hai shi)
Date: Sun, 24 Jan 2021 07:58:14 +0000
Subject: [issue42979] _zoneinfo: zoneinfomodule_exec() doesn't check for
 PyDateTime_IMPORT failure
In-Reply-To: <1611163566.26.0.253539458839.issue42979@roundup.psfhosted.org>
Message-ID: <1611475094.95.0.448588140811.issue42979@roundup.psfhosted.org>


hai shi <shihai1991 at 126.com> added the comment:

> If PyCapsule_Import() fails, zoneinfomodule_exec() returns 0 (success) with an exception raised.

Why not return -1 directly when PyCapsule_Import() fails?
It looks like more simpler. Do I miss something?

----------
nosy: +shihai1991

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42979>
_______________________________________

From report at bugs.python.org  Sun Jan 24 03:34:14 2021
From: report at bugs.python.org (Anthony Sottile)
Date: Sun, 24 Jan 2021 08:34:14 +0000
Subject: [issue43014] tokenize spends a lot of time in `re.compile(...)`
Message-ID: <1611477254.42.0.0381684920705.issue43014@roundup.psfhosted.org>


New submission from Anthony Sottile <asottile at umich.edu>:

I did some profiling (attached a few files here with svgs) of running this script:

```python
import io
import tokenize

# picked as the second longest file in cpython
with open('Lib/test/test_socket.py', 'rb') as f:
    bio = io.BytesIO(f.read())


def main():
    for _ in range(10):
        bio.seek(0)
        for _ in tokenize.tokenize(bio.readline):
            pass

if __name__ == '__main__':
    exit(main())
```


the first profile is before the optimization, the second is after the optimization

The optimization takes the execution from ~6300ms to ~4500ms on my machine (representing a 28% - 39% improvement depending on how you calculate it)

(I'll attach the pstats and svgs after creation, seems I can only attach one file at once)

----------
components: Library (Lib)
files: out.pstats
messages: 385572
nosy: Anthony Sottile
priority: normal
severity: normal
status: open
title: tokenize spends a lot of time in `re.compile(...)`
type: performance
versions: Python 3.10, Python 3.9
Added file: https://bugs.python.org/file49759/out.pstats

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43014>
_______________________________________

From report at bugs.python.org  Sun Jan 24 03:34:23 2021
From: report at bugs.python.org (Anthony Sottile)
Date: Sun, 24 Jan 2021 08:34:23 +0000
Subject: [issue43014] tokenize spends a lot of time in `re.compile(...)`
In-Reply-To: <1611477254.42.0.0381684920705.issue43014@roundup.psfhosted.org>
Message-ID: <1611477263.37.0.788911741687.issue43014@roundup.psfhosted.org>


Change by Anthony Sottile <asottile at umich.edu>:


Added file: https://bugs.python.org/file49760/out.svg

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43014>
_______________________________________

From report at bugs.python.org  Sun Jan 24 03:34:29 2021
From: report at bugs.python.org (Anthony Sottile)
Date: Sun, 24 Jan 2021 08:34:29 +0000
Subject: [issue43014] tokenize spends a lot of time in `re.compile(...)`
In-Reply-To: <1611477254.42.0.0381684920705.issue43014@roundup.psfhosted.org>
Message-ID: <1611477269.33.0.790352754754.issue43014@roundup.psfhosted.org>


Change by Anthony Sottile <asottile at umich.edu>:


Added file: https://bugs.python.org/file49761/out2.pstats

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43014>
_______________________________________

From report at bugs.python.org  Sun Jan 24 03:34:35 2021
From: report at bugs.python.org (Anthony Sottile)
Date: Sun, 24 Jan 2021 08:34:35 +0000
Subject: [issue43014] tokenize spends a lot of time in `re.compile(...)`
In-Reply-To: <1611477254.42.0.0381684920705.issue43014@roundup.psfhosted.org>
Message-ID: <1611477275.49.0.42045542939.issue43014@roundup.psfhosted.org>


Change by Anthony Sottile <asottile at umich.edu>:


Added file: https://bugs.python.org/file49762/out2.svg

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43014>
_______________________________________

From report at bugs.python.org  Sun Jan 24 03:38:32 2021
From: report at bugs.python.org (Anthony Sottile)
Date: Sun, 24 Jan 2021 08:38:32 +0000
Subject: [issue43014] tokenize spends a lot of time in `re.compile(...)`
In-Reply-To: <1611477254.42.0.0381684920705.issue43014@roundup.psfhosted.org>
Message-ID: <1611477512.65.0.591830654105.issue43014@roundup.psfhosted.org>


Change by Anthony Sottile <asottile at umich.edu>:


----------
keywords: +patch
pull_requests: +23130
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24311

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43014>
_______________________________________

From report at bugs.python.org  Sun Jan 24 03:47:45 2021
From: report at bugs.python.org (Anthony Sottile)
Date: Sun, 24 Jan 2021 08:47:45 +0000
Subject: [issue43014] tokenize spends a lot of time in `re.compile(...)`
In-Reply-To: <1611477254.42.0.0381684920705.issue43014@roundup.psfhosted.org>
Message-ID: <1611478065.37.0.124629294283.issue43014@roundup.psfhosted.org>


Anthony Sottile <asottile at umich.edu> added the comment:

admittedly anecdotal but here's another data point in addition to the profiles attached

test.test_tokenize suite before:

$ ./python -m test.test_tokenize
..............................................................................
----------------------------------------------------------------------
Ran 78 tests in 77.148s

OK


test.test_tokenize suite after:

$ ./python -m test.test_tokenize
..............................................................................
----------------------------------------------------------------------
Ran 78 tests in 61.269s

OK

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43014>
_______________________________________

From report at bugs.python.org  Sun Jan 24 03:59:45 2021
From: report at bugs.python.org (Anthony Sottile)
Date: Sun, 24 Jan 2021 08:59:45 +0000
Subject: [issue43014] tokenize spends a lot of time in `re.compile(...)`
In-Reply-To: <1611477254.42.0.0381684920705.issue43014@roundup.psfhosted.org>
Message-ID: <1611478785.27.0.695372919023.issue43014@roundup.psfhosted.org>


Change by Anthony Sottile <asottile at umich.edu>:


Added file: https://bugs.python.org/file49763/out3.pstats

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43014>
_______________________________________

From report at bugs.python.org  Sun Jan 24 04:00:06 2021
From: report at bugs.python.org (Anthony Sottile)
Date: Sun, 24 Jan 2021 09:00:06 +0000
Subject: [issue43014] tokenize spends a lot of time in `re.compile(...)`
In-Reply-To: <1611477254.42.0.0381684920705.issue43014@roundup.psfhosted.org>
Message-ID: <1611478806.89.0.0149610784719.issue43014@roundup.psfhosted.org>


Anthony Sottile <asottile at umich.edu> added the comment:

attached out3.pstats / out3.svg which represent the optimization using lru_cache instead

----------
Added file: https://bugs.python.org/file49764/out3.svg

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43014>
_______________________________________

From report at bugs.python.org  Sun Jan 24 04:23:21 2021
From: report at bugs.python.org (Batuhan Taskaya)
Date: Sun, 24 Jan 2021 09:23:21 +0000
Subject: [issue43014] tokenize spends a lot of time in `re.compile(...)`
In-Reply-To: <1611477254.42.0.0381684920705.issue43014@roundup.psfhosted.org>
Message-ID: <1611480201.12.0.104698684137.issue43014@roundup.psfhosted.org>


Batuhan Taskaya <isidentical at gmail.com> added the comment:


New changeset 15bd9efd01e44087664e78bf766865a6d2e06626 by Anthony Sottile in branch 'master':
bpo-43014: Improve performance of tokenize.tokenize by 20-30%
https://github.com/python/cpython/commit/15bd9efd01e44087664e78bf766865a6d2e06626


----------
nosy: +BTaskaya

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43014>
_______________________________________

From report at bugs.python.org  Sun Jan 24 04:23:55 2021
From: report at bugs.python.org (Batuhan Taskaya)
Date: Sun, 24 Jan 2021 09:23:55 +0000
Subject: [issue43014] tokenize spends a lot of time in `re.compile(...)`
In-Reply-To: <1611477254.42.0.0381684920705.issue43014@roundup.psfhosted.org>
Message-ID: <1611480235.93.0.98094554132.issue43014@roundup.psfhosted.org>


Change by Batuhan Taskaya <isidentical at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43014>
_______________________________________

From report at bugs.python.org  Sun Jan 24 04:38:57 2021
From: report at bugs.python.org (Steven D'Aprano)
Date: Sun, 24 Jan 2021 09:38:57 +0000
Subject: [issue43014] tokenize spends a lot of time in `re.compile(...)`
In-Reply-To: <1611477254.42.0.0381684920705.issue43014@roundup.psfhosted.org>
Message-ID: <1611481137.18.0.703214579228.issue43014@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

Just for the record:

> The optimization takes the execution from ~6300ms to ~4500ms on my machine (representing a 28% - 39% improvement depending on how you calculate it)

The correct answer is 28%, which uses the initial value as the base: (6300-4500)/6300 ? 28%. You are starting at 6300ms and speeding it up by 28%:

>>> 6300 - 28/100*6300
4536.0

Using 4500 as the base would only make sense if you were calculating a slowdown from 4500ms to 6300ms: we started at 4500 and *increase* the time by 39%:

>>> 4500 + 39/100*4500
6255.0


Hope this helps.

----------
nosy: +steven.daprano

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43014>
_______________________________________

From report at bugs.python.org  Sun Jan 24 07:09:16 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 24 Jan 2021 12:09:16 +0000
Subject: [issue43014] tokenize spends a lot of time in `re.compile(...)`
In-Reply-To: <1611477254.42.0.0381684920705.issue43014@roundup.psfhosted.org>
Message-ID: <1611490155.99.0.95279801009.issue43014@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

re.compile() already uses caching. But it is less efficient for some reasons.

To Steven: the time is *reduced* by 28%, but the speed is *increased* by 39%.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43014>
_______________________________________

From report at bugs.python.org  Sun Jan 24 07:18:36 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 24 Jan 2021 12:18:36 +0000
Subject: [issue42977] Tkinter Optionmenu Too Narrow on Mac
In-Reply-To: <1611154134.32.0.566162791222.issue42977@roundup.psfhosted.org>
Message-ID: <1611490716.59.0.0653583270226.issue42977@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

I concur with E. Paine that you should use pack(fill="x") if you want to stretch a widget. And in any case Tkinter itself does not manage layout, it is just a wrapper around Tk, so if you think that the default layout of a button is wrong on some platforms, you should report it to the Tk team.

----------
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42977>
_______________________________________

From report at bugs.python.org  Sun Jan 24 07:23:52 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 24 Jan 2021 12:23:52 +0000
Subject: [issue42992] Tkinter bbox coordinates incorrectly drawn
In-Reply-To: <1611262609.83.0.00898948617335.issue42992@roundup.psfhosted.org>
Message-ID: <1611491032.05.0.449072830126.issue42992@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Even if there is something wrong with the returned values, Tkinter is just mostly a thin wrap around Tk. It does not change the returned value, it just converts it to appropriate Python type (a tuple of 4 integers (4, 4, 101, 101) instead of a string "4 4 101 101").

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42992>
_______________________________________

From report at bugs.python.org  Sun Jan 24 07:48:19 2021
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 24 Jan 2021 12:48:19 +0000
Subject: [issue42743] pdb vanishing breakpoints
In-Reply-To: <1608915736.39.0.746707238377.issue42743@roundup.psfhosted.org>
Message-ID: <1611492499.81.0.955999734878.issue42743@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Daniel, can you provide a recipe to reproduce what you are seeing? There are different ways to enter pdb, and different ways to set breakpoints. If you provide accurate instructions it will help to be sure that the issue has indeed been fixed.

----------
components: +Library (Lib)
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42743>
_______________________________________

From report at bugs.python.org  Sun Jan 24 07:50:42 2021
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 24 Jan 2021 12:50:42 +0000
Subject: [issue42565] Traceback (most recent call last):   File "<stdin>",
 line 1, in <module> NameError: name 'python' is not defined
In-Reply-To: <1607058568.23.0.920174193073.issue42565@roundup.psfhosted.org>
Message-ID: <1611492642.43.0.864527219886.issue42565@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> not a bug
stage:  -> resolved
status: pending -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42565>
_______________________________________

From report at bugs.python.org  Sun Jan 24 09:20:03 2021
From: report at bugs.python.org (Nathaniel Manista)
Date: Sun, 24 Jan 2021 14:20:03 +0000
Subject: [issue43015] Add str.replaceall?
Message-ID: <1611498003.08.0.308752741743.issue43015@roundup.psfhosted.org>


New submission from Nathaniel Manista <nathaniel at google.com>:

Chained str.replace calls can sometimes be pretty unattractive; what are the chances that we could have an str.replaceall method? Of type Callable[[Mapping[str, str]], str]?

Check out absl::StrReplaceAll (https://github.com/abseil/abseil-cpp/blob/22771d471930ce88e1e75d0ca9dd8c65a7b0f895/absl/strings/str_replace.h#L73-L98) for a similarly useful function in C++.

----------
components: Unicode
messages: 385581
nosy: Nathaniel Manista, ezio.melotti, vstinner
priority: normal
severity: normal
status: open
title: Add str.replaceall?
type: enhancement
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43015>
_______________________________________

From report at bugs.python.org  Sun Jan 24 09:51:09 2021
From: report at bugs.python.org (Ken Jin)
Date: Sun, 24 Jan 2021 14:51:09 +0000
Subject: [issue42967] [security] urllib.parse.parse_qsl(): Web cache poisoning
 - `; ` as a query args separator
In-Reply-To: <1611068809.96.0.58823274544.issue42967@roundup.psfhosted.org>
Message-ID: <1611499869.35.0.211380529743.issue42967@roundup.psfhosted.org>


Ken Jin <kenjin4096 at gmail.com> added the comment:

Dear all, now that Adam has signed the CLA, I have closed my PR in favor of Adam's because I think 2 open PRs might split everyone's attention. Instead, I'll focus on reviewing Adam's PR. Sorry for any inconvenience caused.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Sun Jan 24 11:02:25 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 24 Jan 2021 16:02:25 +0000
Subject: [issue43016] Improve tests for curses
Message-ID: <1611504145.81.0.962541791137.issue43016@roundup.psfhosted.org>


New submission from Serhiy Storchaka <storchaka+cpython at gmail.com>:

Currently tests for curses mainly call different functions and methods in random order. Not all argument combinations are covered by tests and results are not checked. I also ran tests with 1750 different values of TERM supported by ncurses, and some tests were failed because not all features are supported on all terminals.

The proposed PR rewrites tests for curses.

* Added tests for every function or group of related functions.

* Added separate tests for optional functions, so that skipped tests are shown it output.

* Optionally skipped tests for functions like beep() and flush() which do not supported an all terminals (surprisingly!).

* Every function which takes variable number of arguments is now tested with all combination of arguments.

* Functions which support different types of argument (str/bytes/int) are now tested with all supported types.

* Function which change the global state are now called in order which restores presumably default value.

* Checked values and types of results of functions.

* Some tests serve role of demos. They call some function in some order and check how it affects results of other functions.

* Tests now work on terminals with small size (15 lines or less). Some terminals have very small default size.

It could still be improved (for example not all functions are tested with non-ASCII strings), but I spent several weekends (including a New Year and both Christmases) on this work and want to take a break.

----------
components: Tests
messages: 385583
nosy: serhiy.storchaka, twouters
priority: normal
severity: normal
status: open
title: Improve tests for curses
type: enhancement
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43016>
_______________________________________

From report at bugs.python.org  Sun Jan 24 11:04:26 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 24 Jan 2021 16:04:26 +0000
Subject: [issue43016] Improve tests for curses
In-Reply-To: <1611504145.81.0.962541791137.issue43016@roundup.psfhosted.org>
Message-ID: <1611504266.49.0.188005882877.issue43016@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
keywords: +patch
pull_requests: +23131
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24312

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43016>
_______________________________________

From report at bugs.python.org  Sun Jan 24 11:24:51 2021
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 24 Jan 2021 16:24:51 +0000
Subject: [issue42647] Unable to use concurrent.futures in atexit hook
In-Reply-To: <1608040750.56.0.960217977665.issue42647@roundup.psfhosted.org>
Message-ID: <1611505491.75.0.589615048363.issue42647@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

b61b818d916942aad1f8f3e33181801c4a1ed14b is the first bad commit
commit b61b818d916942aad1f8f3e33181801c4a1ed14b
Author: Kyle Stanley <aeros167 at gmail.com>
Date:   Fri Mar 27 15:31:22 2020 -0400

    bpo-39812: Remove daemon threads in concurrent.futures (GH-19149)
    
    Remove daemon threads from :mod:`concurrent.futures` by adding
    an internal `threading._register_atexit()`, which calls registered functions
    prior to joining all non-daemon threads. This allows for compatibility
    with subinterpreters, which don't support daemon threads.

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42647>
_______________________________________

From report at bugs.python.org  Sun Jan 24 11:25:34 2021
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 24 Jan 2021 16:25:34 +0000
Subject: [issue42647] Unable to use concurrent.futures in atexit hook
In-Reply-To: <1608040750.56.0.960217977665.issue42647@roundup.psfhosted.org>
Message-ID: <1611505534.99.0.71727020957.issue42647@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
nosy: +aeros

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42647>
_______________________________________

From report at bugs.python.org  Sun Jan 24 11:33:48 2021
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 24 Jan 2021 16:33:48 +0000
Subject: [issue41962] Make threading._register_atexit public?
In-Reply-To: <1602032984.5.0.326433134447.issue41962@roundup.psfhosted.org>
Message-ID: <1611506028.62.0.421011662209.issue41962@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
components: +Library (Lib)
nosy: +aeros, vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41962>
_______________________________________

From report at bugs.python.org  Sun Jan 24 12:15:38 2021
From: report at bugs.python.org (Adam Goldschmidt)
Date: Sun, 24 Jan 2021 17:15:38 +0000
Subject: [issue42967] [security] urllib.parse.parse_qsl(): Web cache poisoning
 - `; ` as a query args separator
In-Reply-To: <1611068809.96.0.58823274544.issue42967@roundup.psfhosted.org>
Message-ID: <1611508538.41.0.190818746629.issue42967@roundup.psfhosted.org>


Adam Goldschmidt <adamgold7 at gmail.com> added the comment:

> The difference is that semicolon is defined in a previous specification.

I understand, but this will limit us in the future if the spec changes - though I don't have strong feelings regarding this one.

> Dear all, now that Adam has signed the CLA, I have closed my PR in favor of Adam's because I think 2 open PRs might split everyone's attention. Instead, I'll focus on reviewing Adam's PR. Sorry for any inconvenience caused.

?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Sun Jan 24 12:32:38 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 24 Jan 2021 17:32:38 +0000
Subject: [issue43014] tokenize spends a lot of time in `re.compile(...)`
In-Reply-To: <1611477254.42.0.0381684920705.issue43014@roundup.psfhosted.org>
Message-ID: <1611509558.73.0.102544388609.issue43014@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
nosy: +pablogsal
nosy_count: 4.0 -> 5.0
pull_requests: +23132
pull_request: https://github.com/python/cpython/pull/24313

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43014>
_______________________________________

From report at bugs.python.org  Sun Jan 24 13:00:46 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 24 Jan 2021 18:00:46 +0000
Subject: [issue43017] Improve error message in the parser when using
 un-parenthesised tuples in comprehensions
Message-ID: <1611511246.56.0.166169475648.issue43017@roundup.psfhosted.org>


New submission from Pablo Galindo Salgado <pablogsal at gmail.com>:

I have seen this confusion many users over the years. Instead of showing:

? python -c '[x,z for x,y in something]'
  File "<string>", line 1
    [x,z for x,y in something]
         ^
SyntaxError: invalid syntax

We can show:

? ./python -c '[x,z for x,y in something]'
  File "<string>", line 1
    [x,z for x,y in something]
     ^
SyntaxError: did you forgot parentheses around the comprehension target?

----------
messages: 385586
nosy: pablogsal
priority: normal
severity: normal
status: open
title: Improve error message in the parser when using un-parenthesised tuples in comprehensions

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43017>
_______________________________________

From report at bugs.python.org  Sun Jan 24 13:02:26 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 24 Jan 2021 18:02:26 +0000
Subject: [issue43017] Improve error message in the parser when using
 un-parenthesised tuples in comprehensions
In-Reply-To: <1611511246.56.0.166169475648.issue43017@roundup.psfhosted.org>
Message-ID: <1611511346.6.0.165329227489.issue43017@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
keywords: +patch
pull_requests: +23133
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24314

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43017>
_______________________________________

From report at bugs.python.org  Sun Jan 24 13:02:34 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 24 Jan 2021 18:02:34 +0000
Subject: [issue43017] Improve error message in the parser when using
 un-parenthesised tuples in comprehensions
In-Reply-To: <1611511246.56.0.166169475648.issue43017@roundup.psfhosted.org>
Message-ID: <1611511354.35.0.887846229672.issue43017@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
nosy: +lys.nikolaou

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43017>
_______________________________________

From report at bugs.python.org  Sun Jan 24 13:29:17 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 24 Jan 2021 18:29:17 +0000
Subject: [issue43013] IDLE:  update code,
 mostly by cleanups of 2.x or 2to3 artifacts
In-Reply-To: <1611436831.18.0.743701112328.issue43013@roundup.psfhosted.org>
Message-ID: <1611512957.24.0.0829092819516.issue43013@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Delete 2. 'list' is needed if for-suite mutates the dict all 6 either directly or maybe indirectly do so.  Not worth checking unless otherwise editing the function.

6. N unneeded .keys() (out of 13 occurrences) when iterating dict.  Low priority.

First patch does 1. and 5.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43013>
_______________________________________

From report at bugs.python.org  Sun Jan 24 13:38:58 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 24 Jan 2021 18:38:58 +0000
Subject: [issue43013] IDLE:  update code,
 mostly by cleanups of 2.x or 2to3 artifacts
In-Reply-To: <1611436831.18.0.743701112328.issue43013@roundup.psfhosted.org>
Message-ID: <1611513538.76.0.922387777098.issue43013@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
keywords: +patch
pull_requests: +23134
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24315

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43013>
_______________________________________

From report at bugs.python.org  Sun Jan 24 14:09:13 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 24 Jan 2021 19:09:13 +0000
Subject: [issue43013] IDLE:  update code,
 mostly by cleanups of 2.x or 2to3 artifacts
In-Reply-To: <1611436831.18.0.743701112328.issue43013@roundup.psfhosted.org>
Message-ID: <1611515353.6.0.737923613139.issue43013@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset 8dfe15625e6ea4357a13fec7989a0e6ba2bf1359 by Terry Jan Reedy in branch 'master':
 bpo-43013: Update idlelib code to 3.x  (GH-24315)
https://github.com/python/cpython/commit/8dfe15625e6ea4357a13fec7989a0e6ba2bf1359


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43013>
_______________________________________

From report at bugs.python.org  Sun Jan 24 14:09:18 2021
From: report at bugs.python.org (miss-islington)
Date: Sun, 24 Jan 2021 19:09:18 +0000
Subject: [issue43013] IDLE:  update code,
 mostly by cleanups of 2.x or 2to3 artifacts
In-Reply-To: <1611436831.18.0.743701112328.issue43013@roundup.psfhosted.org>
Message-ID: <1611515358.15.0.0442072315114.issue43013@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 2.0 -> 3.0
pull_requests: +23135
pull_request: https://github.com/python/cpython/pull/24316

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43013>
_______________________________________

From report at bugs.python.org  Sun Jan 24 14:09:24 2021
From: report at bugs.python.org (miss-islington)
Date: Sun, 24 Jan 2021 19:09:24 +0000
Subject: [issue43013] IDLE:  update code,
 mostly by cleanups of 2.x or 2to3 artifacts
In-Reply-To: <1611436831.18.0.743701112328.issue43013@roundup.psfhosted.org>
Message-ID: <1611515364.93.0.619881066671.issue43013@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +23136
pull_request: https://github.com/python/cpython/pull/24317

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43013>
_______________________________________

From report at bugs.python.org  Sun Jan 24 14:30:22 2021
From: report at bugs.python.org (Kyle Stanley)
Date: Sun, 24 Jan 2021 19:30:22 +0000
Subject: [issue41962] Make threading._register_atexit public?
In-Reply-To: <1602032984.5.0.326433134447.issue41962@roundup.psfhosted.org>
Message-ID: <1611516622.76.0.611691817616.issue41962@roundup.psfhosted.org>


Kyle Stanley <aeros167 at gmail.com> added the comment:

> I'm dealing with a subtle deadlock involving concurrent.futures.ThreadPoolExecutor, and my solution that worked in Python 3.8 broke with 3.9. I'm running some long-running (possibly infinite) tasks in the thread pool, and I cancel them in an `atexit` callback so that everything can shut down cleanly (before ThreadPoolExecutor joins all worker threads in its own `atexit` hook).

IMO, a better practice would be providing those potentially infinite running tasks a direct method of escape and invoking it before calling executor.shutdown(), it would be a more reliable approach. But, perhaps there is some convenience utility in being able to provide custom atexit hooks. It also might help the user to separate the shutdown logic from the rest of the program. 

Since you worked with me in adding threading._register_atexit(), Do you have any thoughts, Antoine? I would personally not be opposed to it being made public assuming there's real utility present in doing so.

My only concern is that it might be a potential foot-gun. If the user submits an atexit hook that deadlocks, it might prevent threads from shutting down safely prior to interpreter finalization. I'm presently undecided if explicitly mentioning that it in the docs would be sufficient warning.

----------
nosy: +pitrou

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41962>
_______________________________________

From report at bugs.python.org  Sun Jan 24 15:05:42 2021
From: report at bugs.python.org (=?utf-8?q?=C3=89ric_Araujo?=)
Date: Sun, 24 Jan 2021 20:05:42 +0000
Subject: [issue42967] [security] urllib.parse.parse_qsl(): Web cache poisoning
 - `; ` as a query args separator
In-Reply-To: <1611068809.96.0.58823274544.issue42967@roundup.psfhosted.org>
Message-ID: <1611518742.97.0.229839943193.issue42967@roundup.psfhosted.org>


?ric Araujo <merwok at netwok.org> added the comment:

Senthil, what is your opinion here?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Sun Jan 24 15:20:49 2021
From: report at bugs.python.org (Akuli)
Date: Sun, 24 Jan 2021 20:20:49 +0000
Subject: [issue43018] unwanted label showing up in ttk.LabeledScale
Message-ID: <1611519649.12.0.740627257832.issue43018@roundup.psfhosted.org>


New submission from Akuli <akuviljanen17 at gmail.com>:

import tkinter
from tkinter import ttk
root = tkinter.Tk()
ttk.LabeledScale(root).pack()
root.mainloop()


Run this code and move the slider to center. You see something in front of the number. The problem is this line in ttk.py:

        tmp = Label(self).pack(side=label_side) # place holder

I tried deleting it, but then the label doesn't show up at all, and what remains is just a scale. Packing with a different side works, but that feels like a hack.

----------
components: Tkinter
files: ssss.png
messages: 385591
nosy: Akuli
priority: normal
severity: normal
status: open
title: unwanted label showing up in ttk.LabeledScale
versions: Python 3.9
Added file: https://bugs.python.org/file49765/ssss.png

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43018>
_______________________________________

From report at bugs.python.org  Sun Jan 24 16:09:36 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 24 Jan 2021 21:09:36 +0000
Subject: [issue43018] unwanted label showing up in ttk.LabeledScale
In-Reply-To: <1611519649.12.0.740627257832.issue43018@roundup.psfhosted.org>
Message-ID: <1611522576.29.0.383870991093.issue43018@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

It has already been fixed in issue40219. Just wait next bugfix release.

----------
nosy: +serhiy.storchaka
resolution:  -> out of date
stage:  -> resolved
status: open -> closed
superseder:  -> ttk LabeledScale: label covered by hidden element

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43018>
_______________________________________

From report at bugs.python.org  Sun Jan 24 16:45:51 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 24 Jan 2021 21:45:51 +0000
Subject: [issue33289] tkinter askcolor returning floats for r, g,
 b values instead of ints
In-Reply-To: <1523915381.82.0.682650639539.issue33289@psf.upfronthosting.co.za>
Message-ID: <1611524751.05.0.76308561878.issue33289@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +23137
pull_request: https://github.com/python/cpython/pull/24318

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33289>
_______________________________________

From report at bugs.python.org  Sun Jan 24 17:16:32 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 24 Jan 2021 22:16:32 +0000
Subject: [issue43013] IDLE:  update code,
 mostly by cleanups of 2.x or 2to3 artifacts
In-Reply-To: <1611436831.18.0.743701112328.issue43013@roundup.psfhosted.org>
Message-ID: <1611526592.81.0.8599171863.issue43013@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset 63ebba0d9430a0bc18fd8551ad27b9b25709a4be by Miss Islington (bot) in branch '3.8':
bpo-43013: Update idlelib code to 3.x  (GH-24315) (#24317)
https://github.com/python/cpython/commit/63ebba0d9430a0bc18fd8551ad27b9b25709a4be


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43013>
_______________________________________

From report at bugs.python.org  Sun Jan 24 17:49:41 2021
From: report at bugs.python.org (Berker Peksag)
Date: Sun, 24 Jan 2021 22:49:41 +0000
Subject: [issue42916] Support for DICOM image file format in imghdr module
In-Reply-To: <1610497726.98.0.199039272928.issue42916@roundup.psfhosted.org>
Message-ID: <1611528581.44.0.101395168566.issue42916@roundup.psfhosted.org>


Berker Peksag <berker.peksag at gmail.com> added the comment:

Copying my comment from GitHub:

> I think DICOM is too specific to be added to the stdlib. I'd prefer
> improving documentation of imghdr.tests to make adding custom file
> types clearer.

----------
nosy: +berker.peksag

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42916>
_______________________________________

From report at bugs.python.org  Sun Jan 24 18:13:30 2021
From: report at bugs.python.org (miss-islington)
Date: Sun, 24 Jan 2021 23:13:30 +0000
Subject: [issue43013] IDLE:  update code,
 mostly by cleanups of 2.x or 2to3 artifacts
In-Reply-To: <1611436831.18.0.743701112328.issue43013@roundup.psfhosted.org>
Message-ID: <1611530010.87.0.670332064529.issue43013@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +23138
pull_request: https://github.com/python/cpython/pull/24319

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43013>
_______________________________________

From report at bugs.python.org  Sun Jan 24 18:36:36 2021
From: report at bugs.python.org (miss-islington)
Date: Sun, 24 Jan 2021 23:36:36 +0000
Subject: [issue43013] IDLE:  update code,
 mostly by cleanups of 2.x or 2to3 artifacts
In-Reply-To: <1611436831.18.0.743701112328.issue43013@roundup.psfhosted.org>
Message-ID: <1611531396.51.0.388274666749.issue43013@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset ff06957710aa849f3402b082a7ddd34b0325d6de by Miss Islington (bot) in branch '3.9':
bpo-43013: Update idlelib code to 3.x  (GH-24315)
https://github.com/python/cpython/commit/ff06957710aa849f3402b082a7ddd34b0325d6de


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43013>
_______________________________________

From report at bugs.python.org  Sun Jan 24 20:49:21 2021
From: report at bugs.python.org (Campbell Barton)
Date: Mon, 25 Jan 2021 01:49:21 +0000
Subject: [issue35523] Remove old ctypes callback workaround: creating the
 first instance of a callback
In-Reply-To: <1545134641.38.0.788709270274.issue35523@psf.upfronthosting.co.za>
Message-ID: <1611539361.68.0.0689528332189.issue35523@roundup.psfhosted.org>


Campbell Barton <ideasman42 at gmail.com> added the comment:

Could this fix be applied to Python 3.7x?

Currently the visual effects platform for 2021 is using Python 3.7.x, see: https://vfxplatform.com

Which means anyone using the VFX platform can run into this bug.

----------
nosy: +ideasman42

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35523>
_______________________________________

From report at bugs.python.org  Sun Jan 24 20:51:01 2021
From: report at bugs.python.org (Campbell Barton)
Date: Mon, 25 Jan 2021 01:51:01 +0000
Subject: [issue35523] Remove old ctypes callback workaround: creating the
 first instance of a callback
In-Reply-To: <1545134641.38.0.788709270274.issue35523@psf.upfronthosting.co.za>
Message-ID: <1611539461.42.0.0919278908879.issue35523@roundup.psfhosted.org>


Campbell Barton <ideasman42 at gmail.com> added the comment:

Note, this bug is something we ran into in Blender, see: https://developer.blender.org/T84752

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35523>
_______________________________________

From report at bugs.python.org  Sun Jan 24 22:09:07 2021
From: report at bugs.python.org (Ben Darnell)
Date: Mon, 25 Jan 2021 03:09:07 +0000
Subject: [issue41962] Make threading._register_atexit public?
In-Reply-To: <1602032984.5.0.326433134447.issue41962@roundup.psfhosted.org>
Message-ID: <1611544147.98.0.0351407221414.issue41962@roundup.psfhosted.org>


Ben Darnell <ben.darnell at gmail.com> added the comment:

> IMO, a better practice would be providing those potentially infinite running tasks a direct method of escape and invoking it before calling executor.shutdown(), it would be a more reliable approach.

Agreed, but the problem is that I'm in a library (so I don't control the main module), and the library's interface does not mandate any sort of explicit shutdown method. There is a shutdown method, but almost no one calls it, and it's never caused a problem until Python 3.9 changed things so it deadlocks. 

> My only concern is that it might be a potential foot-gun. If the user submits an atexit hook that deadlocks, it might prevent threads from shutting down safely prior to interpreter finalization. 

Yes, and that is exactly the problem. concurrent.futures submits an atexit hook whose behavior depends on application code, and through that I have inadvertently caused a deadlock.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41962>
_______________________________________

From report at bugs.python.org  Sun Jan 24 22:30:14 2021
From: report at bugs.python.org (wim glenn)
Date: Mon, 25 Jan 2021 03:30:14 +0000
Subject: [issue42948] bytearray.copy is undocumented
In-Reply-To: <1610908912.39.0.795030432727.issue42948@roundup.psfhosted.org>
Message-ID: <1611545414.41.0.415711796009.issue42948@roundup.psfhosted.org>


wim glenn <wim.glenn at gmail.com> added the comment:

Oh, I've missed that part. Although the note (5) seems to indicate that the copy method refers to sequence types which don't support slicing, it still seems adequately documented under the mutable sequence operations.

I'll close this.

----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42948>
_______________________________________

From report at bugs.python.org  Sun Jan 24 22:57:26 2021
From: report at bugs.python.org (DDavid)
Date: Mon, 25 Jan 2021 03:57:26 +0000
Subject: [issue42977] Tkinter Optionmenu Too Narrow on Mac
In-Reply-To: <1611154134.32.0.566162791222.issue42977@roundup.psfhosted.org>
Message-ID: <1611547046.55.0.0474152111541.issue42977@roundup.psfhosted.org>


DDavid <zjdavid.2003 at gmail.com> added the comment:

Thanks for your help! I agree that it is probably a Tk issue. I will contact them and back with more information.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42977>
_______________________________________

From report at bugs.python.org  Sun Jan 24 23:31:03 2021
From: report at bugs.python.org (Anthony Sottile)
Date: Mon, 25 Jan 2021 04:31:03 +0000
Subject: [issue43013] IDLE:  update code,
 mostly by cleanups of 2.x or 2to3 artifacts
In-Reply-To: <1611436831.18.0.743701112328.issue43013@roundup.psfhosted.org>
Message-ID: <1611549063.39.0.582327012337.issue43013@roundup.psfhosted.org>


Anthony Sottile <asottile at umich.edu> added the comment:

just noticed this PR -- you might be interested in pyupgrade which automates some of these things -- here's (for example) `git ls-files -- Lib/idlelib | grep '\.py$' | xargs pyupgrade --py36-plus

```diff
diff --git a/Lib/idlelib/calltip_w.py b/Lib/idlelib/calltip_w.py
index 1e0404aa49..278546064a 100644
--- a/Lib/idlelib/calltip_w.py
+++ b/Lib/idlelib/calltip_w.py
@@ -25,7 +25,7 @@ def __init__(self, text_widget):
         text_widget: a Text widget with code for which call-tips are desired
         """
         # Note: The Text widget will be accessible as self.anchor_widget
-        super(CalltipWindow, self).__init__(text_widget)
+        super().__init__(text_widget)
 
         self.label = self.text = None
         self.parenline = self.parencol = self.lastline = None
@@ -54,7 +54,7 @@ def position_window(self):
             return
         self.lastline = curline
         self.anchor_widget.see("insert")
-        super(CalltipWindow, self).position_window()
+        super().position_window()
 
     def showtip(self, text, parenleft, parenright):
         """Show the call-tip, bind events which will close it and reposition it.
@@ -73,7 +73,7 @@ def showtip(self, text, parenleft, parenright):
         self.parenline, self.parencol = map(
             int, self.anchor_widget.index(parenleft).split("."))
 
-        super(CalltipWindow, self).showtip()
+        super().showtip()
 
         self._bind_events()
 
@@ -143,7 +143,7 @@ def hidetip(self):
             # ValueError may be raised by MultiCall
             pass
 
-        super(CalltipWindow, self).hidetip()
+        super().hidetip()
 
     def _bind_events(self):
         """Bind event handlers."""
diff --git a/Lib/idlelib/debugger.py b/Lib/idlelib/debugger.py
index ccd03e46e1..53dba376af 100644
--- a/Lib/idlelib/debugger.py
+++ b/Lib/idlelib/debugger.py
@@ -49,9 +49,9 @@ def __frame2message(self, frame):
         filename = code.co_filename
         lineno = frame.f_lineno
         basename = os.path.basename(filename)
-        message = "%s:%s" % (basename, lineno)
+        message = f"{basename}:{lineno}"
         if code.co_name != "?":
-            message = "%s: %s()" % (message, code.co_name)
+            message = f"{message}: {code.co_name}()"
         return message
 
 
@@ -213,7 +213,7 @@ def interaction(self, message, frame, info=None):
                 m1 = "%s" % str(type)
             if value is not None:
                 try:
-                    m1 = "%s: %s" % (m1, str(value))
+                    m1 = "{}: {}".format(m1, str(value))
                 except:
                     pass
             bg = "yellow"
diff --git a/Lib/idlelib/debugobj.py b/Lib/idlelib/debugobj.py
index 5a4c997884..71d01c7070 100644
--- a/Lib/idlelib/debugobj.py
+++ b/Lib/idlelib/debugobj.py
@@ -87,7 +87,7 @@ def GetSubList(self):
                 continue
             def setfunction(value, key=key, object=self.object):
                 object[key] = value
-            item = make_objecttreeitem("%r:" % (key,), value, setfunction)
+            item = make_objecttreeitem(f"{key!r}:", value, setfunction)
             sublist.append(item)
         return sublist
 
diff --git a/Lib/idlelib/editor.py b/Lib/idlelib/editor.py
index a4d0c95362..5faebb5742 100644
--- a/Lib/idlelib/editor.py
+++ b/Lib/idlelib/editor.py
@@ -37,12 +37,12 @@
 def _sphinx_version():
     "Format sys.version_info to produce the Sphinx version string used to install the chm docs"
     major, minor, micro, level, serial = sys.version_info
-    release = '%s%s' % (major, minor)
-    release += '%s' % (micro,)
+    release = f'{major}{minor}'
+    release += f'{micro}'
     if level == 'candidate':
-        release += 'rc%s' % (serial,)
+        release += f'rc{serial}'
     elif level != 'final':
-        release += '%s%s' % (level[0], serial)
+        release += '{}{}'.format(level[0], serial)
     return release
 
 
@@ -939,7 +939,7 @@ def update_recent_files_list(self, new_file=None):
         rf_list = []
         file_path = self.recent_files_path
         if file_path and os.path.exists(file_path):
-            with open(file_path, 'r',
+            with open(file_path,
                       encoding='utf_8', errors='replace') as rf_list_file:
                 rf_list = rf_list_file.readlines()
         if new_file:
@@ -1446,7 +1446,7 @@ def newline_and_indent_event(self, event):
                     else:
                         self.reindent_to(y.compute_backslash_indent())
                 else:
-                    assert 0, "bogus continuation type %r" % (c,)
+                    assert 0, f"bogus continuation type {c!r}"
                 return "break"
 
             # This line starts a brand new statement; indent relative to
diff --git a/Lib/idlelib/filelist.py b/Lib/idlelib/filelist.py
index 0d200854ef..9b863698a0 100644
--- a/Lib/idlelib/filelist.py
+++ b/Lib/idlelib/filelist.py
@@ -22,7 +22,7 @@ def open(self, filename, action=None):
             # This can happen when bad filename is passed on command line:
             tkMessageBox.showerror(
                 "File Error",
-                "%r is a directory." % (filename,),
+                f"{filename!r} is a directory.",
                 master=self.root)
             return None
         key = os.path.normcase(filename)
@@ -90,7 +90,7 @@ def filename_changed_edit(self, edit):
             self.inversedict[conflict] = None
             tkMessageBox.showerror(
                 "Name Conflict",
-                "You now have multiple edit windows open for %r" % (filename,),
+                f"You now have multiple edit windows open for {filename!r}",
                 master=self.root)
         self.dict[newkey] = edit
         self.inversedict[edit] = newkey
diff --git a/Lib/idlelib/idle_test/test_config.py b/Lib/idlelib/idle_test/test_config.py
index 697fda5279..08ed76fe28 100644
--- a/Lib/idlelib/idle_test/test_config.py
+++ b/Lib/idlelib/idle_test/test_config.py
@@ -191,7 +191,7 @@ def setUpClass(cls):
             idle_dir = os.path.abspath(sys.path[0])
         for ctype in conf.config_types:
             config_path = os.path.join(idle_dir, '../config-%s.def' % ctype)
-            with open(config_path, 'r') as f:
+            with open(config_path) as f:
                 cls.config_string[ctype] = f.read()
 
         cls.orig_warn = config._warn
diff --git a/Lib/idlelib/idle_test/test_text.py b/Lib/idlelib/idle_test/test_text.py
index 0f31179e04..43a9ba02c3 100644
--- a/Lib/idlelib/idle_test/test_text.py
+++ b/Lib/idlelib/idle_test/test_text.py
@@ -6,7 +6,7 @@
 from test.support import requires
 from _tkinter import TclError
 
-class TextTest(object):
+class TextTest:
     "Define items common to both sets of tests."
 
     hw = 'hello\nworld'  # Several tests insert this after initialization.
diff --git a/Lib/idlelib/macosx.py b/Lib/idlelib/macosx.py
index eeaab59ae8..fbc6499faa 100644
--- a/Lib/idlelib/macosx.py
+++ b/Lib/idlelib/macosx.py
@@ -81,7 +81,7 @@ def tkVersionWarning(root):
         patchlevel = root.tk.call('info', 'patchlevel')
         if patchlevel not in ('8.5.7', '8.5.9'):
             return False
-        return ("WARNING: The version of Tcl/Tk ({0}) in use may"
+        return ("WARNING: The version of Tcl/Tk ({}) in use may"
                 " be unstable.\n"
                 "Visit http://www.python.org/download/mac/tcltk/"
                 " for current information.".format(patchlevel))
diff --git a/Lib/idlelib/multicall.py b/Lib/idlelib/multicall.py
index dc02001292..0200f445cc 100644
--- a/Lib/idlelib/multicall.py
+++ b/Lib/idlelib/multicall.py
@@ -52,9 +52,9 @@
     _modifier_masks = (MC_CONTROL, MC_ALT, MC_SHIFT, MC_META)
 
 # a dictionary to map a modifier name into its number
-_modifier_names = dict([(name, number)
+_modifier_names = {name: number
                          for number in range(len(_modifiers))
-                         for name in _modifiers[number]])
+                         for name in _modifiers[number]}
 
 # In 3.4, if no shell window is ever open, the underlying Tk widget is
 # destroyed before .__del__ methods here are called.  The following
@@ -134,7 +134,7 @@ def nbits(n):
         return nb
     statelist = []
     for state in states:
-        substates = list(set(state & x for x in states))
+        substates = list({state & x for x in states})
         substates.sort(key=nbits, reverse=True)
         statelist.append(substates)
     return statelist
@@ -258,9 +258,9 @@ def __del__(self):
 _binder_classes = (_ComplexBinder,) * 4 + (_SimpleBinder,) * (len(_types)-4)
 
 # A dictionary to map a type name into its number
-_type_names = dict([(name, number)
+_type_names = {name: number
                      for number in range(len(_types))
-                     for name in _types[number]])
+                     for name in _types[number]}
 
 _keysym_re = re.compile(r"^\w+$")
 _button_re = re.compile(r"^[1-5]$")
diff --git a/Lib/idlelib/outwin.py b/Lib/idlelib/outwin.py
index 5ab08bbaf4..ac67c904ab 100644
--- a/Lib/idlelib/outwin.py
+++ b/Lib/idlelib/outwin.py
@@ -42,7 +42,7 @@ def file_line_helper(line):
         if match:
             filename, lineno = match.group(1, 2)
             try:
-                f = open(filename, "r")
+                f = open(filename)
                 f.close()
                 break
             except OSError:
diff --git a/Lib/idlelib/pyshell.py b/Lib/idlelib/pyshell.py
index abe8a85952..6cae951698 100755
--- a/Lib/idlelib/pyshell.py
+++ b/Lib/idlelib/pyshell.py
@@ -245,7 +245,7 @@ def store_file_breaks(self):
         breaks = self.breakpoints
         filename = self.io.filename
         try:
-            with open(self.breakpointPath, "r") as fp:
+            with open(self.breakpointPath) as fp:
                 lines = fp.readlines()
         except OSError:
             lines = []
@@ -275,7 +275,7 @@ def restore_file_breaks(self):
         if filename is None:
             return
         if os.path.isfile(self.breakpointPath):
-            with open(self.breakpointPath, "r") as fp:
+            with open(self.breakpointPath) as fp:
                 lines = fp.readlines()
             for line in lines:
                 if line.startswith(filename + '='):
@@ -431,7 +431,7 @@ def build_subprocess_arglist(self):
         # run from the IDLE source directory.
         del_exitf = idleConf.GetOption('main', 'General', 'delete-exitfunc',
                                        default=False, type='bool')
-        command = "__import__('idlelib.run').run.main(%r)" % (del_exitf,)
+        command = f"__import__('idlelib.run').run.main({del_exitf!r})"
         return [sys.executable] + w + ["-c", command, str(self.port)]
 
     def start_subprocess(self):
@@ -564,9 +564,9 @@ def transfer_path(self, with_cwd=False):
 
         self.runcommand("""if 1:
         import sys as _sys
-        _sys.path = %r
+        _sys.path = {!r}
         del _sys
-        \n""" % (path,))
+        \n""".format(path))
 
     active_seq = None
 
@@ -693,14 +693,14 @@ def stuffsource(self, source):
     def prepend_syspath(self, filename):
         "Prepend sys.path with file's directory if not already included"
         self.runcommand("""if 1:
-            _filename = %r
+            _filename = {!r}
             import sys as _sys
             from os.path import dirname as _dirname
             _dir = _dirname(_filename)
             if not _dir in _sys.path:
                 _sys.path.insert(0, _dir)
             del _filename, _sys, _dirname, _dir
-            \n""" % (filename,))
+            \n""".format(filename))
 
     def showsyntaxerror(self, filename=None):
         """Override Interactive Interpreter method: Use Colorizing
@@ -1407,7 +1407,7 @@ def main():
     try:
         opts, args = getopt.getopt(sys.argv[1:], "c:deihnr:st:")
     except getopt.error as msg:
-        print("Error: %s\n%s" % (msg, usage_msg), file=sys.stderr)
+        print(f"Error: {msg}\n{usage_msg}", file=sys.stderr)
         sys.exit(2)
     for o, a in opts:
         if o == '-c':
@@ -1539,9 +1539,9 @@ def main():
     if cmd or script:
         shell.interp.runcommand("""if 1:
             import sys as _sys
-            _sys.argv = %r
+            _sys.argv = {!r}
             del _sys
-            \n""" % (sys.argv,))
+            \n""".format(sys.argv))
         if cmd:
             shell.interp.execsource(cmd)
         elif script:
diff --git a/Lib/idlelib/redirector.py b/Lib/idlelib/redirector.py
index 9ab34c5acf..9891d256f7 100644
--- a/Lib/idlelib/redirector.py
+++ b/Lib/idlelib/redirector.py
@@ -47,7 +47,7 @@ def __init__(self, widget):
         tk.createcommand(w, self.dispatch)
 
     def __repr__(self):
-        return "%s(%s<%s>)" % (self.__class__.__name__,
+        return "{}({}<{}>)".format(self.__class__.__name__,
                                self.widget.__class__.__name__,
                                self.widget._w)
 
@@ -143,7 +143,7 @@ def __init__(self, redir, operation):
         self.orig_and_operation = (redir.orig, operation)
 
     def __repr__(self):
-        return "%s(%r, %r)" % (self.__class__.__name__,
+        return "{}({!r}, {!r})".format(self.__class__.__name__,
                                self.redir, self.operation)
 
     def __call__(self, *args):
diff --git a/Lib/idlelib/rpc.py b/Lib/idlelib/rpc.py
index 8efcf048fa..062e2502de 100644
--- a/Lib/idlelib/rpc.py
+++ b/Lib/idlelib/rpc.py
@@ -174,7 +174,7 @@ def localcall(self, seq, request):
         except TypeError:
             return ("ERROR", "Bad request format")
         if oid not in self.objtable:
-            return ("ERROR", "Unknown object id: %r" % (oid,))
+            return ("ERROR", f"Unknown object id: {oid!r}")
         obj = self.objtable[oid]
         if methodname == "__methods__":
             methods = {}
@@ -185,7 +185,7 @@ def localcall(self, seq, request):
             _getattributes(obj, attributes)
             return ("OK", attributes)
         if not hasattr(obj, methodname):
-            return ("ERROR", "Unsupported method name: %r" % (methodname,))
+            return ("ERROR", f"Unsupported method name: {methodname!r}")
         method = getattr(obj, methodname)
         try:
             if how == 'CALL':
diff --git a/Lib/idlelib/run.py b/Lib/idlelib/run.py
index ec575c3d48..099240d56b 100644
--- a/Lib/idlelib/run.py
+++ b/Lib/idlelib/run.py
@@ -43,13 +43,13 @@ def idle_formatwarning(message, category, filename, lineno, line=None):
     """Format warnings the IDLE way."""
 
     s = "\nWarning (from warnings module):\n"
-    s += '  File \"%s\", line %s\n' % (filename, lineno)
+    s += f'  File \"{filename}\", line {lineno}\n'
     if line is None:
         line = linecache.getline(filename, lineno)
     line = line.strip()
     if line:
         s += "    %s\n" % line
-    s += "%s: %s\n" % (category.__name__, message)
+    s += f"{category.__name__}: {message}\n"
     return s
 
 def idle_showwarning_subproc(
diff --git a/Lib/idlelib/textview.py b/Lib/idlelib/textview.py
index a66c1a4309..23f0f4cb50 100644
--- a/Lib/idlelib/textview.py
+++ b/Lib/idlelib/textview.py
@@ -169,7 +169,7 @@ def view_file(parent, title, filename, encoding, modal=True, wrap='word',
     with contents of the file.
     """
     try:
-        with open(filename, 'r', encoding=encoding) as file:
+        with open(filename, encoding=encoding) as file:
             contents = file.read()
     except OSError:
         showerror(title='File Load Error',
diff --git a/Lib/idlelib/tooltip.py b/Lib/idlelib/tooltip.py
index d714318dae..3983690dd4 100644
--- a/Lib/idlelib/tooltip.py
+++ b/Lib/idlelib/tooltip.py
@@ -92,7 +92,7 @@ def __init__(self, anchor_widget, hover_delay=1000):
         e.g. after hovering over the anchor widget with the mouse for enough
         time.
         """
-        super(OnHoverTooltipBase, self).__init__(anchor_widget)
+        super().__init__(anchor_widget)
         self.hover_delay = hover_delay
 
         self._after_id = None
@@ -107,7 +107,7 @@ def __del__(self):
             self.anchor_widget.unbind("<Button>", self._id3) # pragma: no cover
         except TclError:
             pass
-        super(OnHoverTooltipBase, self).__del__()
+        super().__del__()
 
     def _show_event(self, event=None):
         """event handler to display the tooltip"""
@@ -139,7 +139,7 @@ def hidetip(self):
             self.unschedule()
         except TclError:  # pragma: no cover
             pass
-        super(OnHoverTooltipBase, self).hidetip()
+        super().hidetip()
 
 
 class Hovertip(OnHoverTooltipBase):
@@ -154,7 +154,7 @@ def __init__(self, anchor_widget, text, hover_delay=1000):
         e.g. after hovering over the anchor widget with the mouse for enough
         time.
         """
-        super(Hovertip, self).__init__(anchor_widget, hover_delay=hover_delay)
+        super().__init__(anchor_widget, hover_delay=hover_delay)
         self.text = text
 
     def showcontents(self):
diff --git a/Lib/idlelib/tree.py b/Lib/idlelib/tree.py
index 5947268f5c..5f30f0f609 100644
--- a/Lib/idlelib/tree.py
+++ b/Lib/idlelib/tree.py
@@ -32,7 +32,7 @@
 if os.path.isdir(_icondir):
     ICONDIR = _icondir
 elif not os.path.isdir(ICONDIR):
-    raise RuntimeError("can't find icon directory (%r)" % (ICONDIR,))
+    raise RuntimeError(f"can't find icon directory ({ICONDIR!r})")
 
 def listicons(icondir=ICONDIR):
     """Utility to display the available icons."""
diff --git a/Lib/idlelib/undo.py b/Lib/idlelib/undo.py
index 85ecffecb4..5f10c0f05c 100644
--- a/Lib/idlelib/undo.py
+++ b/Lib/idlelib/undo.py
@@ -309,7 +309,7 @@ def __repr__(self):
         s = self.__class__.__name__
         strs = []
         for cmd in self.cmds:
-            strs.append("    %r" % (cmd,))
+            strs.append(f"    {cmd!r}")
         return s + "(\n" + ",\n".join(strs) + "\n)"
 
     def __len__(self):
```

----------
nosy: +Anthony Sottile

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43013>
_______________________________________

From report at bugs.python.org  Mon Jan 25 00:32:51 2021
From: report at bugs.python.org (Felipe Faria)
Date: Mon, 25 Jan 2021 05:32:51 +0000
Subject: [issue43019] wait_for(to_thread)) does not work as expected. Extra
 documentation or fix needed.
Message-ID: <1611552771.11.0.601335924509.issue43019@roundup.psfhosted.org>


New submission from Felipe Faria <felipefaria at me.com>:

Consider the following:

```
import asyncio
import time

async def async_test():
    while True:
        await asyncio.sleep(1)
        print("in here - async")

def sync_test():
    while True:
        time.sleep(1)
        print("in here - sync")

async def main():
    async def tryexcept(func):
        try:
            await func
        except asyncio.exceptions.TimeoutError:
            print("error thrown")

    await tryexcept(asyncio.wait_for(async_test(), timeout=5))
    await tryexcept(asyncio.wait_for(asyncio.to_thread(sync_test), timeout=5))
    print("back in the main thread")

asyncio.run(main())
```

The above will lead to:

```
in here - async
error thrown
in here - sync
error thrown
back in the main thread
in here - sync
in here - sync
in here - sync
[... continues on forever ...]
```

It seems that the new thread created by `to_thread` is never cancelled and continues running forever despite the timeout error thrown. This might lead to some unwarranted (and hidden) behavior depending on the application.

Frankly, I'm unsure if a possible bug fix is even viable as from my knowledge cancelling threads in Python is not recommended. However, if not, I think a documentation update would be helpful. 

On my end messing with an existing sync library + `to_thread` + `wait_for` led me to believe that the execution had been cancelled, when instead it kept on shooting unexpected web requests. 

Thank you.

----------
components: asyncio
messages: 385602
nosy: asvetlov, felipefaria, yselivanov
priority: normal
severity: normal
status: open
title: wait_for(to_thread)) does not work as expected. Extra documentation or fix needed.
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43019>
_______________________________________

From report at bugs.python.org  Mon Jan 25 01:59:06 2021
From: report at bugs.python.org (Emir)
Date: Mon, 25 Jan 2021 06:59:06 +0000
Subject: =?utf-8?q?=5Bissue43020=5D_str=2Elower_method_with_=22=C4=B0=22_character?=
Message-ID: <1611557946.62.0.291810743958.issue43020@roundup.psfhosted.org>


New submission from Emir <emiryegnidemir7 at gmail.com>:

In Turkish there is a character when you capitalize "i" and it's written as "?". When I use str.lower method, it seems like it works just fine because it prints the character I expected(i). But the problem is when I compare it to normal "i" character (without lowering), the character which is "?" then became "i" has 2 digits(or length) so same words are no more the same. (ex. the word "issue" and the word "?ssue"-->"issue" are not the same when compared) This is a big issue in terms of word counter softwares.

----------
components: Build
messages: 385603
nosy: emiryegnidemir7
priority: normal
severity: normal
status: open
title: str.lower method with "?" character
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43020>
_______________________________________

From report at bugs.python.org  Mon Jan 25 02:03:43 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 25 Jan 2021 07:03:43 +0000
Subject: [issue43013] IDLE:  update code,
 mostly by cleanups of 2.x or 2to3 artifacts
In-Reply-To: <1611436831.18.0.743701112328.issue43013@roundup.psfhosted.org>
Message-ID: <1611558223.19.0.214215168693.issue43013@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Interesting.  I would prefer to make fewer changes per pre-PR branch commit, but I see from the doc that I could split changes into at least 4 batches from the existing options.  Has this been run/tested on projects better tested than IDLE?  Anyway

7. Run pyupgrade.  On Windows, use pyupgrade-directories or try git bash to run on idlelib and recurse.

----------
stage: patch review -> 

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43013>
_______________________________________

From report at bugs.python.org  Mon Jan 25 02:15:34 2021
From: report at bugs.python.org (techfixya)
Date: Mon, 25 Jan 2021 07:15:34 +0000
Subject: [issue25567] shlex.quote doesn't work on bytestrings
In-Reply-To: <1446814343.82.0.823951892686.issue25567@psf.upfronthosting.co.za>
Message-ID: <1611558934.13.0.772701661655.issue25567@roundup.psfhosted.org>


techfixya <printerofflinehelpus at gmail.com> added the comment:

How to Install Brother mfc-l2740dw driver on Windows
https://techfixya.com/how-to-install-brother-mfc-l2740dw-driver-on-windows/

----------
nosy: +techfixya

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue25567>
_______________________________________

From report at bugs.python.org  Mon Jan 25 02:27:49 2021
From: report at bugs.python.org (Kubilay Kocak)
Date: Mon, 25 Jan 2021 07:27:49 +0000
Subject: [issue42960] resources module,
 FreeBSD update adding RLIMIT_KQUEUES constant
Message-ID: <1611559669.48.0.777933743407.issue42960@roundup.psfhosted.org>


New submission from Kubilay Kocak <koobs.freebsd at gmail.com>:

Thank you for the PR David.

If there's anything I can do to help support you with respect to Python on FreeBSD (such as accounts on the official freebsd python buildbot workers) let me know :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42960>
_______________________________________

From report at bugs.python.org  Mon Jan 25 02:43:58 2021
From: report at bugs.python.org (Andrey Bienkowski)
Date: Mon, 25 Jan 2021 07:43:58 +0000
Subject: [issue42384] Inconsistent sys.path between python and pdb
In-Reply-To: <1605599201.78.0.619329509169.issue42384@roundup.psfhosted.org>
Message-ID: <1611560638.93.0.0590058114083.issue42384@roundup.psfhosted.org>


Change by Andrey Bienkowski <hexagonrecursion at gmail.com>:


----------
pull_requests: +23139
pull_request: https://github.com/python/cpython/pull/24320

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42384>
_______________________________________

From report at bugs.python.org  Mon Jan 25 03:10:32 2021
From: report at bugs.python.org (Andrey Bienkowski)
Date: Mon, 25 Jan 2021 08:10:32 +0000
Subject: [issue42384] Inconsistent sys.path between python and pdb
In-Reply-To: <1605599201.78.0.619329509169.issue42384@roundup.psfhosted.org>
Message-ID: <1611562232.96.0.901836492077.issue42384@roundup.psfhosted.org>


Change by Andrey Bienkowski <hexagonrecursion at gmail.com>:


----------
pull_requests: +23140
pull_request: https://github.com/python/cpython/pull/24321

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42384>
_______________________________________

From report at bugs.python.org  Mon Jan 25 03:42:55 2021
From: report at bugs.python.org (Wietse Jacobs)
Date: Mon, 25 Jan 2021 08:42:55 +0000
Subject: [issue43021] Unpacking tuple argument in combination with inline if
 statement
Message-ID: <1611564175.96.0.494312223598.issue43021@roundup.psfhosted.org>


New submission from Wietse Jacobs <wietse.j at gmail.com>:

I suspect that I found a bug. If I run the following script:

```
def f(t=None):
    t0, t1 = t if t is not None else [], []
    return t0, t1


def g(t=None):
    if t is None:
        t = [], []
    t0, t1 = t
    return t0, t1


def test():
    res_f = f(t=([1, 1], [2, 2]))
    res_g = g(t=([1, 1], [2, 2]))
    assert res_f == res_g, f'{res_f=} != {res_g=}'


test()
```

I get an assertion error, with:

```
res_f=(([1, 1], [2, 2]), []) != res_g=([1, 1], [2, 2])
```

I expected them to be equal.

----------
messages: 385607
nosy: wietse.j
priority: normal
severity: normal
status: open
title: Unpacking tuple argument in combination with inline if statement
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43021>
_______________________________________

From report at bugs.python.org  Mon Jan 25 03:47:33 2021
From: report at bugs.python.org (Andrey Bienkowski)
Date: Mon, 25 Jan 2021 08:47:33 +0000
Subject: [issue42384] Inconsistent sys.path between python and pdb
In-Reply-To: <1605599201.78.0.619329509169.issue42384@roundup.psfhosted.org>
Message-ID: <1611564453.72.0.486198068818.issue42384@roundup.psfhosted.org>


Change by Andrey Bienkowski <hexagonrecursion at gmail.com>:


----------
pull_requests: +23141
pull_request: https://github.com/python/cpython/pull/23412

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42384>
_______________________________________

From report at bugs.python.org  Mon Jan 25 03:55:18 2021
From: report at bugs.python.org (Andrey Bienkowski)
Date: Mon, 25 Jan 2021 08:55:18 +0000
Subject: [issue42383] Pdb does not correclty restart the target if it changes
 the current directory
In-Reply-To: <1605597991.66.0.0396733980212.issue42383@roundup.psfhosted.org>
Message-ID: <1611564918.4.0.678712268531.issue42383@roundup.psfhosted.org>


Change by Andrey Bienkowski <hexagonrecursion at gmail.com>:


----------
pull_requests: +23142
pull_request: https://github.com/python/cpython/pull/24322

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42383>
_______________________________________

From report at bugs.python.org  Mon Jan 25 03:58:59 2021
From: report at bugs.python.org (Andrey Bienkowski)
Date: Mon, 25 Jan 2021 08:58:59 +0000
Subject: [issue42383] Pdb does not correclty restart the target if it changes
 the current directory
In-Reply-To: <1605597991.66.0.0396733980212.issue42383@roundup.psfhosted.org>
Message-ID: <1611565139.23.0.397982577229.issue42383@roundup.psfhosted.org>


Change by Andrey Bienkowski <hexagonrecursion at gmail.com>:


----------
pull_requests: +23143
pull_request: https://github.com/python/cpython/pull/24323

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42383>
_______________________________________

From report at bugs.python.org  Mon Jan 25 04:31:35 2021
From: report at bugs.python.org (Steven D'Aprano)
Date: Mon, 25 Jan 2021 09:31:35 +0000
Subject: [issue43021] Unpacking tuple argument in combination with inline if
 statement
In-Reply-To: <1611564175.96.0.494312223598.issue43021@roundup.psfhosted.org>
Message-ID: <1611567095.09.0.407569032865.issue43021@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

This is a operation precedence issue.

The line:

    t0, t1 = t if t is not None else [], []

is parsed as:

    (t if t is not None else []), []


so you need brackets around the "else" operand to get the effect you want.

    t0, t1 = t if t is not None else ([], [])

----------
nosy: +steven.daprano
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43021>
_______________________________________

From report at bugs.python.org  Mon Jan 25 04:45:59 2021
From: report at bugs.python.org (miss-islington)
Date: Mon, 25 Jan 2021 09:45:59 +0000
Subject: [issue33289] tkinter askcolor returning floats for r, g,
 b values instead of ints
In-Reply-To: <1523915381.82.0.682650639539.issue33289@psf.upfronthosting.co.za>
Message-ID: <1611567959.56.0.775056240217.issue33289@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 5.0 -> 6.0
pull_requests: +23144
pull_request: https://github.com/python/cpython/pull/24325

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33289>
_______________________________________

From report at bugs.python.org  Mon Jan 25 04:46:03 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 25 Jan 2021 09:46:03 +0000
Subject: [issue33289] tkinter askcolor returning floats for r, g,
 b values instead of ints
In-Reply-To: <1523915381.82.0.682650639539.issue33289@psf.upfronthosting.co.za>
Message-ID: <1611567963.54.0.320094439929.issue33289@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 3d5434d5cbc945c58be663e3dbd5ef4875677b7a by Serhiy Storchaka in branch '3.9':
[3.9] bpo-33289: Return RGB triplet of ints instead of floats from tkinter.colorchooser (GH-6578). (GH-24318)
https://github.com/python/cpython/commit/3d5434d5cbc945c58be663e3dbd5ef4875677b7a


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33289>
_______________________________________

From report at bugs.python.org  Mon Jan 25 04:46:36 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 25 Jan 2021 09:46:36 +0000
Subject: [issue41798] [C API] Revisit usage of the PyCapsule C API with
 multi-phase initialization API
In-Reply-To: <1600265269.2.0.881235166904.issue41798@roundup.psfhosted.org>
Message-ID: <1611567996.6.0.111161693807.issue41798@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

hai shi: "I have checked all capi instances have been allocated in the heap memory. So I think this bpo can be closed ;)"

I also checks and I confirm that PyCapsule_New() is no longer used with a pointer pointing to static data. Well, there is one last case, in an unit test on the API itself (in _testcapi). This corner case is acceptable ;-)

Thanks all for the fixes!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41798>
_______________________________________

From report at bugs.python.org  Mon Jan 25 04:56:54 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 25 Jan 2021 09:56:54 +0000
Subject: =?utf-8?q?=5Bissue27772=5D_Refer_to_actual_format_string_when_creating_?=
 =?utf-8?q?=E2=80=9Czero_padding=E2=80=9D_error_message?=
In-Reply-To: <1471322118.97.0.225723730885.issue27772@psf.upfronthosting.co.za>
Message-ID: <1611568614.95.0.320627594428.issue27772@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset cf19cc3b920ca5995e1c202d2c3dd7a59ac8eac8 by Serhiy Storchaka in branch 'master':
bpo-27772: Make preceding width with 0 valid in string format. (GH-11270)
https://github.com/python/cpython/commit/cf19cc3b920ca5995e1c202d2c3dd7a59ac8eac8


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27772>
_______________________________________

From report at bugs.python.org  Mon Jan 25 04:58:07 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 25 Jan 2021 09:58:07 +0000
Subject: =?utf-8?q?=5Bissue27772=5D_Refer_to_actual_format_string_when_creating_?=
 =?utf-8?q?=E2=80=9Czero_padding=E2=80=9D_error_message?=
In-Reply-To: <1471322118.97.0.225723730885.issue27772@psf.upfronthosting.co.za>
Message-ID: <1611568687.58.0.872176305044.issue27772@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.10 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27772>
_______________________________________

From report at bugs.python.org  Mon Jan 25 05:03:02 2021
From: report at bugs.python.org (miss-islington)
Date: Mon, 25 Jan 2021 10:03:02 +0000
Subject: [issue33289] tkinter askcolor returning floats for r, g,
 b values instead of ints
In-Reply-To: <1523915381.82.0.682650639539.issue33289@psf.upfronthosting.co.za>
Message-ID: <1611568982.9.0.792484894567.issue33289@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 96bcf6f4d4bed1cdf97883eb43e872ff1a92013d by Miss Islington (bot) in branch '3.8':
[3.9] bpo-33289: Return RGB triplet of ints instead of floats from tkinter.colorchooser (GH-6578). (GH-24318)
https://github.com/python/cpython/commit/96bcf6f4d4bed1cdf97883eb43e872ff1a92013d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33289>
_______________________________________

From report at bugs.python.org  Mon Jan 25 05:05:25 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 25 Jan 2021 10:05:25 +0000
Subject: [issue33289] tkinter askcolor returning floats for r, g,
 b values instead of ints
In-Reply-To: <1523915381.82.0.682650639539.issue33289@psf.upfronthosting.co.za>
Message-ID: <1611569125.93.0.883387632872.issue33289@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33289>
_______________________________________

From report at bugs.python.org  Mon Jan 25 05:20:00 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 25 Jan 2021 10:20:00 +0000
Subject: [issue35523] Remove old ctypes callback workaround: creating the
 first instance of a callback
In-Reply-To: <1545134641.38.0.788709270274.issue35523@psf.upfronthosting.co.za>
Message-ID: <1611570000.32.0.619577935741.issue35523@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Ned Deily (Python 3.7 release manager): do you want an exception to backport a bugfix?

Campbell: Python 3.7 no longer accept bug fixes, only security fixes.
https://devguide.python.org/#status-of-python-branches

As I wrote previously, I'm not comfortable to make such change in a 3.7.x minor release, even if we didn't get any bug report since this change was done in Python 3.8.

----------
nosy: +ned.deily

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35523>
_______________________________________

From report at bugs.python.org  Mon Jan 25 05:22:55 2021
From: report at bugs.python.org (Steven D'Aprano)
Date: Mon, 25 Jan 2021 10:22:55 +0000
Subject: =?utf-8?q?=5Bissue43020=5D_str=2Elower_method_with_=22=C4=B0=22_character?=
In-Reply-To: <1611557946.62.0.291810743958.issue43020@roundup.psfhosted.org>
Message-ID: <1611570175.95.0.637862597213.issue43020@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

This is not a bug, but an issue with the way the Unicode standard defines the lowercase of dotted I.

See #34723

Fortunately, Unicode will (hopefully!) fix this in revision 14.0, which is scheduled to be included in Python 3.10.

Until then, perhaps the simplest way to solve this is that if you are processing Turkish text, change your call to .lower() to .replace('?', 'I').lower()

----------
nosy: +steven.daprano
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43020>
_______________________________________

From report at bugs.python.org  Mon Jan 25 05:25:34 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 25 Jan 2021 10:25:34 +0000
Subject: [issue42979] _zoneinfo: zoneinfomodule_exec() doesn't check for
 PyDateTime_IMPORT failure
In-Reply-To: <1611163566.26.0.253539458839.issue42979@roundup.psfhosted.org>
Message-ID: <1611570334.05.0.891680868524.issue42979@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> Why not return -1 directly when PyCapsule_Import() fails?

That would work.

I opened an issue since there is a bug.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42979>
_______________________________________

From report at bugs.python.org  Mon Jan 25 05:41:44 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 25 Jan 2021 10:41:44 +0000
Subject: [issue43015] Add str.replaceall?
In-Reply-To: <1611498003.08.0.308752741743.issue43015@roundup.psfhosted.org>
Message-ID: <1611571304.45.0.827664730046.issue43015@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Hi, the bug tracker is not the right place to propose to add a new method to the builtin str type. I suggest to propose it on the python-ideas list. I'm quite sure that it was proposed at least once, so please search in the archives.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43015>
_______________________________________

From report at bugs.python.org  Mon Jan 25 05:43:44 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 25 Jan 2021 10:43:44 +0000
Subject: [issue43015] Add str.replaceall?
In-Reply-To: <1611498003.08.0.308752741743.issue43015@roundup.psfhosted.org>
Message-ID: <1611571424.76.0.936962928027.issue43015@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

https://mail.python.org/mailman3/lists/python-ideas.python.org/

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43015>
_______________________________________

From report at bugs.python.org  Mon Jan 25 06:08:45 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 25 Jan 2021 11:08:45 +0000
Subject: [issue43013] IDLE:  update code,
 mostly by cleanups of 2.x or 2to3 artifacts
In-Reply-To: <1611436831.18.0.743701112328.issue43013@roundup.psfhosted.org>
Message-ID: <1611572925.49.0.997070087741.issue43013@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
pull_requests: +23145
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24326

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43013>
_______________________________________

From report at bugs.python.org  Mon Jan 25 06:33:31 2021
From: report at bugs.python.org (miss-islington)
Date: Mon, 25 Jan 2021 11:33:31 +0000
Subject: [issue43013] IDLE:  update code,
 mostly by cleanups of 2.x or 2to3 artifacts
In-Reply-To: <1611436831.18.0.743701112328.issue43013@roundup.psfhosted.org>
Message-ID: <1611574411.0.0.738746297322.issue43013@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +23146
pull_request: https://github.com/python/cpython/pull/24327

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43013>
_______________________________________

From report at bugs.python.org  Mon Jan 25 06:33:39 2021
From: report at bugs.python.org (miss-islington)
Date: Mon, 25 Jan 2021 11:33:39 +0000
Subject: [issue43013] IDLE:  update code,
 mostly by cleanups of 2.x or 2to3 artifacts
In-Reply-To: <1611436831.18.0.743701112328.issue43013@roundup.psfhosted.org>
Message-ID: <1611574419.5.0.416459584726.issue43013@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +23147
pull_request: https://github.com/python/cpython/pull/24328

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43013>
_______________________________________

From report at bugs.python.org  Mon Jan 25 06:33:54 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 25 Jan 2021 11:33:54 +0000
Subject: [issue43013] IDLE:  update code,
 mostly by cleanups of 2.x or 2to3 artifacts
In-Reply-To: <1611436831.18.0.743701112328.issue43013@roundup.psfhosted.org>
Message-ID: <1611574434.01.0.276757640935.issue43013@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset 879986d8a932c4524cb6ff822afc9537de16e28d by Terry Jan Reedy in branch 'master':
bpo-43013: Fix old tkinter module names in idlelib (GH-24326)
https://github.com/python/cpython/commit/879986d8a932c4524cb6ff822afc9537de16e28d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43013>
_______________________________________

From report at bugs.python.org  Mon Jan 25 06:39:06 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 25 Jan 2021 11:39:06 +0000
Subject: [issue43013] IDLE:  update code,
 mostly by cleanups of 2.x or 2to3 artifacts
In-Reply-To: <1611436831.18.0.743701112328.issue43013@roundup.psfhosted.org>
Message-ID: <1611574746.73.0.672837513813.issue43013@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

PR for 3. For 2.x, tkinter comprised several modules that became tkinter submodules. For 3.0, 'import tkOld' was replaced by 'import tkinter.new as tkOld', where 'new' is lowercase version of 'Old'.  Fix remaining instances of tkColorChooser, tkFileDialog, tkSimpleDialog, and tkMessageBox by replacing 'tkOld' with 'new' and import with 'from tkinter import new'.  Replace 'tkFont' with 'tkfont' instead of 'font' since 'font' is already used and leave import in 'as' form.  There are no remaining instances of SimpleDialog or tkCommonDialog.

----------
stage: patch review -> 

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43013>
_______________________________________

From report at bugs.python.org  Mon Jan 25 06:51:55 2021
From: report at bugs.python.org (miss-islington)
Date: Mon, 25 Jan 2021 11:51:55 +0000
Subject: [issue43013] IDLE:  update code,
 mostly by cleanups of 2.x or 2to3 artifacts
In-Reply-To: <1611436831.18.0.743701112328.issue43013@roundup.psfhosted.org>
Message-ID: <1611575515.15.0.742113956773.issue43013@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 7370be30017f81d2f41f1b4b2abf31dd9a3f8fb1 by Miss Islington (bot) in branch '3.8':
bpo-43013: Fix old tkinter module names in idlelib (GH-24326)
https://github.com/python/cpython/commit/7370be30017f81d2f41f1b4b2abf31dd9a3f8fb1


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43013>
_______________________________________

From report at bugs.python.org  Mon Jan 25 07:14:42 2021
From: report at bugs.python.org (Paul Moore)
Date: Mon, 25 Jan 2021 12:14:42 +0000
Subject: [issue43022] Unable to dynamically load functions from python3.dll
Message-ID: <1611576882.72.0.213255422964.issue43022@roundup.psfhosted.org>


New submission from Paul Moore <p.f.moore at gmail.com>:

I am writing a small application using the embedded distribution to run a script supplied by the user. The requirements are very simple, so all I need to do is set up argv and call Py_Main.

I'm trying to load the Py_Main function dynamically (for flexibility - see below) but GetProcAddress returns 0 when loading the function from python3.dll (the stable ABI). This seems to be because the symbols in python3.dll are special "fowarding" symbols, that GetProcAddress can't handle.

Is there a way to dynamically load the Python API from the stable ABI? If there isn't currently, could one be added?

To explain my requirements in a bit more detail, I don't want to statically link, because I want to put the Python distribution in a subdirectory, so that it isn't visible on PATH along with my executable, but I'd rather avoid the complexities involved in adding a dedicated SxS manifest to point the loader to the correct subdirectory for the python3.dll.

Furthermore, I want to provide a graceful fallback if the Python distribution is missing (initially, just a friendly error message, but in future maybe locating an alternative Python installation to use) and static linking won't allow that as I can't recover control if the expected Python DLL isn't present.

The reason I want to use the stable ABI is so that I can upgrade the embedded distribution without needing to rebuild the C code. I could search for python3X.dll, and just ignore the stable ABI. But that's more filesystem code than I really want to write in C... And honestly, I feel that dynamically linking is a perfect use case for the stable ABI, so it really should be supported.

----------
components: Windows
messages: 385621
nosy: paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: Unable to dynamically load functions from python3.dll
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43022>
_______________________________________

From report at bugs.python.org  Mon Jan 25 07:19:58 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 25 Jan 2021 12:19:58 +0000
Subject: [issue36086] Split IDLE into separate feature in Windows installer
In-Reply-To: <1550883782.51.0.779365974532.issue36086@roundup.psfhosted.org>
Message-ID: <1611577198.52.0.976832967428.issue36086@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

turtledemo currently requires a couple of modules from idlelib.  One to syntax color examples, another to display the help file.  So turtledemo would have to be patched if IDLE were separate from tkinter.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36086>
_______________________________________

From report at bugs.python.org  Mon Jan 25 07:25:14 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 25 Jan 2021 12:25:14 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611577514.38.0.911463186041.issue42955@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset db584bdad32d81e42b71871077a8008036f5c048 by Victor Stinner in branch 'master':
bpo-42955: Add sys.modules_names (GH-24238)
https://github.com/python/cpython/commit/db584bdad32d81e42b71871077a8008036f5c048


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Mon Jan 25 07:29:16 2021
From: report at bugs.python.org (Jeremy Kloth)
Date: Mon, 25 Jan 2021 12:29:16 +0000
Subject: [issue43022] Unable to dynamically load functions from python3.dll
In-Reply-To: <1611576882.72.0.213255422964.issue43022@roundup.psfhosted.org>
Message-ID: <1611577756.7.0.895143404018.issue43022@roundup.psfhosted.org>


Change by Jeremy Kloth <jeremy.kloth+python-tracker at gmail.com>:


----------
nosy: +jkloth

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43022>
_______________________________________

From report at bugs.python.org  Mon Jan 25 07:30:06 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 25 Jan 2021 12:30:06 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611577806.18.0.179460265842.issue42955@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I merged my PR, thanks for the feedback and reviews.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Mon Jan 25 07:40:37 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 25 Jan 2021 12:40:37 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611578437.04.0.867316259879.issue42955@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +23148
pull_request: https://github.com/python/cpython/pull/24329

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Mon Jan 25 07:59:10 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 25 Jan 2021 12:59:10 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611579550.16.0.573777862022.issue42955@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 483359174e92489e13959977824806734f1a8cdd by Victor Stinner in branch 'master':
bpo-42955: Fix sys.module_names doc (GH-24329)
https://github.com/python/cpython/commit/483359174e92489e13959977824806734f1a8cdd


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Mon Jan 25 08:14:36 2021
From: report at bugs.python.org (Ma Lin)
Date: Mon, 25 Jan 2021 13:14:36 +0000
Subject: [issue43023] Remove a redundant check in _PyBytes_Resize()
Message-ID: <1611580476.8.0.756071230609.issue43023@roundup.psfhosted.org>


New submission from Ma Lin <malincns at 163.com>:

Above code already cover this check:

    if (Py_SIZE(v) == newsize) {
        /* return early if newsize equals to v->ob_size */
        return 0;
    }
    if (Py_SIZE(v) == 0) {
-       if (newsize == 0) {
-           return 0;
-       }
        *pv = _PyBytes_FromSize(newsize, 0);
        Py_DECREF(v);
        return (*pv == NULL) ? -1 : 0;
    }

----------
messages: 385626
nosy: malin
priority: normal
severity: normal
status: open
title: Remove a redundant check in _PyBytes_Resize()
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43023>
_______________________________________

From report at bugs.python.org  Mon Jan 25 08:16:09 2021
From: report at bugs.python.org (Ma Lin)
Date: Mon, 25 Jan 2021 13:16:09 +0000
Subject: [issue43023] Remove a redundant check in _PyBytes_Resize()
In-Reply-To: <1611580476.8.0.756071230609.issue43023@roundup.psfhosted.org>
Message-ID: <1611580569.47.0.954659231704.issue43023@roundup.psfhosted.org>


Change by Ma Lin <malincns at 163.com>:


----------
keywords: +patch
pull_requests: +23149
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24330

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43023>
_______________________________________

From report at bugs.python.org  Mon Jan 25 08:25:44 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 25 Jan 2021 13:25:44 +0000
Subject: [issue43013] IDLE:  update code,
 mostly by cleanups of 2.x or 2to3 artifacts
In-Reply-To: <1611436831.18.0.743701112328.issue43013@roundup.psfhosted.org>
Message-ID: <1611581144.56.0.0724696837677.issue43013@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset 26af2fae189629d22a87aaf01b92d6f4de92b958 by Miss Islington (bot) in branch '3.9':
bpo-43013: Fix old tkinter module names in idlelib (GH-24326)
https://github.com/python/cpython/commit/26af2fae189629d22a87aaf01b92d6f4de92b958


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43013>
_______________________________________

From report at bugs.python.org  Mon Jan 25 08:37:04 2021
From: report at bugs.python.org (Ma Lin)
Date: Mon, 25 Jan 2021 13:37:04 +0000
Subject: [issue43023] Remove a redundant check in _PyBytes_Resize()
In-Reply-To: <1611580476.8.0.756071230609.issue43023@roundup.psfhosted.org>
Message-ID: <1611581824.04.0.747877932495.issue43023@roundup.psfhosted.org>


Ma Lin <malincns at 163.com> added the comment:

Found a new issue, can be combined with this issue.

----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43023>
_______________________________________

From report at bugs.python.org  Mon Jan 25 08:56:00 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 25 Jan 2021 13:56:00 +0000
Subject: [issue43013] IDLE:  update code,
 mostly by cleanups of 2.x or 2to3 artifacts
In-Reply-To: <1611436831.18.0.743701112328.issue43013@roundup.psfhosted.org>
Message-ID: <1611582960.66.0.937341925746.issue43013@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

There are about 40 open PRs with 'idle' or 'idlelib' in title.  I only found 2 or 3 with merge conflicts related to this issue -- and they are easy to fix.  There are more conflicts from other patches (some fixed).  These are usually more difficult to fix as when a PR adds code where another patch later adds code and both additions need to be kept, in the proper order.

TODO: 4 built-in name parameters, 6 .keys(), 7 pyupgrade.  The latter found fixups in about 15 idlelib files and a few test files.  I may do these for individual files that are well tested or are being worked on.
---

Anthony: removing 'set' from 'list(set(interable))' is wrong if 'set' were added to remove duplicates.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43013>
_______________________________________

From report at bugs.python.org  Mon Jan 25 09:01:10 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 25 Jan 2021 14:01:10 +0000
Subject: [issue12669] test_curses skipped on buildbots
In-Reply-To: <1312149135.76.0.0319517534091.issue12669@psf.upfronthosting.co.za>
Message-ID: <1611583270.39.0.925773349318.issue12669@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

It was fixed in other way in issue42789. If __stdout__ is not a terminal, the code falls back to __stderr__, and it is not terminal either, it tries to open /dev/tty. If neither works, it uses a regular temporary file as terminal, but savetty()/resetty() and few tests are skipped.

It would be better to use pty, but I found that it does not work if tests output more than 2 KB. For now I do not know how to fix it.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue12669>
_______________________________________

From report at bugs.python.org  Mon Jan 25 09:46:17 2021
From: report at bugs.python.org (Julien Palard)
Date: Mon, 25 Jan 2021 14:46:17 +0000
Subject: [issue42843] What min_sphinx for Python 3.10
In-Reply-To: <1609951966.97.0.867485424131.issue42843@roundup.psfhosted.org>
Message-ID: <1611585977.22.0.811512475699.issue42843@roundup.psfhosted.org>


Julien Palard <julien+python at palard.fr> added the comment:


New changeset 5c1f15b4b1024cbf0acc85832f0c623d1a4605fd by Julien Palard in branch 'master':
bpo-42843: Keep Sphinx 1.8 and Sphinx 2 compatibility (GH-24282)
https://github.com/python/cpython/commit/5c1f15b4b1024cbf0acc85832f0c623d1a4605fd


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42843>
_______________________________________

From report at bugs.python.org  Mon Jan 25 09:47:16 2021
From: report at bugs.python.org (Julien Palard)
Date: Mon, 25 Jan 2021 14:47:16 +0000
Subject: [issue42843] What min_sphinx for Python 3.10
In-Reply-To: <1609951966.97.0.867485424131.issue42843@roundup.psfhosted.org>
Message-ID: <1611586036.52.0.307210408369.issue42843@roundup.psfhosted.org>


Change by Julien Palard <julien+python at palard.fr>:


----------
resolution:  -> not a bug
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42843>
_______________________________________

From report at bugs.python.org  Mon Jan 25 09:49:03 2021
From: report at bugs.python.org (Julien Palard)
Date: Mon, 25 Jan 2021 14:49:03 +0000
Subject: [issue36675] Doctest directives and comments missing from code samples
In-Reply-To: <1555757030.56.0.8094269644.issue36675@roundup.psfhosted.org>
Message-ID: <1611586143.11.0.727430285423.issue36675@roundup.psfhosted.org>


Julien Palard <julien+python at palard.fr> added the comment:

Due to https://github.com/python/cpython/pull/24282 this is sadly un-fixed.

Either we find another way to fix this, either we wait 3 releases and we re-commit https://github.com/python/cpython/pull/23620.

----------
resolution: fixed -> later
stage: resolved -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36675>
_______________________________________

From report at bugs.python.org  Mon Jan 25 09:50:23 2021
From: report at bugs.python.org (Julien Palard)
Date: Mon, 25 Jan 2021 14:50:23 +0000
Subject: [issue42869] pydoc does not append .html to documentation
In-Reply-To: <1610142955.15.0.664460414569.issue42869@roundup.psfhosted.org>
Message-ID: <1611586223.17.0.00279355606359.issue42869@roundup.psfhosted.org>


Julien Palard <julien+python at palard.fr> added the comment:


New changeset eb9983c59b0683270328b5c40a115bb028209511 by Julien Palard in branch 'master':
bpo-42869: Avoid an HTTP redirection. (GH-24174)
https://github.com/python/cpython/commit/eb9983c59b0683270328b5c40a115bb028209511


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42869>
_______________________________________

From report at bugs.python.org  Mon Jan 25 09:50:41 2021
From: report at bugs.python.org (Julien Palard)
Date: Mon, 25 Jan 2021 14:50:41 +0000
Subject: [issue42869] pydoc does not append .html to documentation
In-Reply-To: <1610142955.15.0.664460414569.issue42869@roundup.psfhosted.org>
Message-ID: <1611586241.21.0.457418809967.issue42869@roundup.psfhosted.org>


Change by Julien Palard <julien+python at palard.fr>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42869>
_______________________________________

From report at bugs.python.org  Mon Jan 25 10:03:19 2021
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 25 Jan 2021 15:03:19 +0000
Subject: [issue43024] improve signature (in help,
 etc) for functions taking sentinel defaults
Message-ID: <1611586999.49.0.965290563696.issue43024@roundup.psfhosted.org>


New submission from Irit Katriel <iritkatriel at yahoo.com>:

The "sentinel" default value don't render nicely in the signature:

>>> help(traceback.print_exception)
Help on function print_exception in module traceback:

print_exception(exc, /, value=<traceback._Sentinel object at 0x000002402B6EA6A0>, tb=<traceback._Sentinel object at 0x000002402B6EA6A0>, limit=None, file=None, chain=True)

----------
components: Library (Lib)
messages: 385634
nosy: iritkatriel
priority: normal
severity: normal
status: open
title: improve signature (in help, etc) for functions taking sentinel defaults
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43024>
_______________________________________

From report at bugs.python.org  Mon Jan 25 10:03:28 2021
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 25 Jan 2021 15:03:28 +0000
Subject: [issue43024] improve signature (in help,
 etc) for functions taking sentinel defaults
In-Reply-To: <1611586999.49.0.965290563696.issue43024@roundup.psfhosted.org>
Message-ID: <1611587008.15.0.420125290293.issue43024@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
type:  -> enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43024>
_______________________________________

From report at bugs.python.org  Mon Jan 25 10:05:24 2021
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 25 Jan 2021 15:05:24 +0000
Subject: [issue43024] improve signature (in help,
 etc) for functions taking sentinel defaults
In-Reply-To: <1611586999.49.0.965290563696.issue43024@roundup.psfhosted.org>
Message-ID: <1611587124.74.0.855051973439.issue43024@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
keywords: +patch
pull_requests: +23150
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24331

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43024>
_______________________________________

From report at bugs.python.org  Mon Jan 25 10:07:11 2021
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 25 Jan 2021 15:07:11 +0000
Subject: [issue43024] improve signature (in help,
 etc) for functions taking sentinel defaults
In-Reply-To: <1611586999.49.0.965290563696.issue43024@roundup.psfhosted.org>
Message-ID: <1611587231.45.0.30090295451.issue43024@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

The PR changes the output to:

>>> help(traceback.print_exception)
Help on function print_exception in module traceback:

print_exception(exc, /, value=<optional>, tb=<optional>, limit=None, file=None, chain=True)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43024>
_______________________________________

From report at bugs.python.org  Mon Jan 25 10:13:07 2021
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 25 Jan 2021 15:13:07 +0000
Subject: [issue43024] improve signature (in help,
 etc) for functions taking sentinel defaults
Message-ID: <1611587587.72.0.850021955957.issue43024@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
Removed message: https://bugs.python.org/msg385635

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43024>
_______________________________________

From report at bugs.python.org  Mon Jan 25 10:13:02 2021
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 25 Jan 2021 15:13:02 +0000
Subject: [issue43024] improve signature (in help,
 etc) for functions taking sentinel defaults
In-Reply-To: <1611587231.45.0.30090295451.issue43024@roundup.psfhosted.org>
Message-ID: <1611587582.37.0.343080349996.issue43024@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
Removed message: https://bugs.python.org/msg385634

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43024>
_______________________________________

From report at bugs.python.org  Mon Jan 25 10:14:00 2021
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 25 Jan 2021 15:14:00 +0000
Subject: [issue43024] improve signature (in help,
 etc) for functions taking sentinel defaults
Message-ID: <1611587640.53.0.195201731083.issue43024@roundup.psfhosted.org>


New submission from Irit Katriel <iritkatriel at yahoo.com>:

The "sentinel" default value don't render nicely in the signature:

>>> import traceback
>>> help(traceback.print_exception)
Help on function print_exception in module traceback:

print_exception(exc, /, value=<object object at 0x000002825DF09650>, tb=<object object at 0x000002825DF09650>, limit=None, file=None, chain=True)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43024>
_______________________________________

From report at bugs.python.org  Mon Jan 25 10:14:23 2021
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 25 Jan 2021 15:14:23 +0000
Subject: [issue43024] improve signature (in help,
 etc) for functions taking sentinel defaults
In-Reply-To: <1611587640.53.0.195201731083.issue43024@roundup.psfhosted.org>
Message-ID: <1611587663.49.0.648807293673.issue43024@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

The PR changes the output to:

>>> help(traceback.print_exception)
Help on function print_exception in module traceback:

print_exception(exc, /, value=<optional>, tb=<optional>, limit=None, file=None, chain=True)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43024>
_______________________________________

From report at bugs.python.org  Mon Jan 25 10:44:14 2021
From: report at bugs.python.org (Daniel Romberg)
Date: Mon, 25 Jan 2021 15:44:14 +0000
Subject: [issue35615] "RuntimeError: Dictionary changed size during iteration"
 when copying a WeakValueDictionary
In-Reply-To: <1546116337.91.0.423915840639.issue35615@roundup.psfhosted.org>
Message-ID: <1611589454.89.0.926845290948.issue35615@roundup.psfhosted.org>


Daniel Romberg <daniel at romberg.io> added the comment:

I think this issue needs to be reopened. The problem has not been solved completely. We experience a lot fewer crashes in weakref than before this fix, however, there are recursive situations in which copy() is invoked while iterating the WeakValueDictionary (e.g., in our case it is a signal/slot implementation where the slots are stored in a WeakValueDictionary). _commit_removals(), which is called at the beginning of the copy operation, might change the dictionary if there are items that are to be removed. If there is an ongoing iteration, the corresponding RuntimeError is raised.

I haven't thought that through entirely, but I wonder whether the copy (and also deepcopy) operation could just blindly copy everything without "committing removals". After the copy, both instances would do their _commit_removals on their own upon access.

----------
nosy: +djromberg

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35615>
_______________________________________

From report at bugs.python.org  Mon Jan 25 11:29:29 2021
From: report at bugs.python.org (Anthony Sottile)
Date: Mon, 25 Jan 2021 16:29:29 +0000
Subject: [issue43013] IDLE:  update code,
 mostly by cleanups of 2.x or 2to3 artifacts
In-Reply-To: <1611436831.18.0.743701112328.issue43013@roundup.psfhosted.org>
Message-ID: <1611592169.87.0.200127270914.issue43013@roundup.psfhosted.org>


Anthony Sottile <asottile at umich.edu> added the comment:

> Anthony: removing 'set' from 'list(set(interable))' is wrong if 'set' were added to remove duplicates.

It's not removed, it's changed to a set comprehension (which was added in 2.7 and 3.0)

pyupgrade is very battle tested, having been run on pip, pytest, and many open source projects

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43013>
_______________________________________

From report at bugs.python.org  Mon Jan 25 12:15:01 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 25 Jan 2021 17:15:01 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611594901.98.0.774789269032.issue42955@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +23151
pull_request: https://github.com/python/cpython/pull/24332

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Mon Jan 25 12:31:22 2021
From: report at bugs.python.org (hai shi)
Date: Mon, 25 Jan 2021 17:31:22 +0000
Subject: [issue42979] _zoneinfo: zoneinfomodule_exec() doesn't check for
 PyDateTime_IMPORT failure
In-Reply-To: <1611163566.26.0.253539458839.issue42979@roundup.psfhosted.org>
Message-ID: <1611595882.34.0.381338440923.issue42979@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
keywords: +patch
pull_requests: +23152
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24333

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42979>
_______________________________________

From report at bugs.python.org  Mon Jan 25 12:51:29 2021
From: report at bugs.python.org (Eryk Sun)
Date: Mon, 25 Jan 2021 17:51:29 +0000
Subject: [issue43022] Unable to dynamically load functions from python3.dll
In-Reply-To: <1611576882.72.0.213255422964.issue43022@roundup.psfhosted.org>
Message-ID: <1611597089.24.0.705795334905.issue43022@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

"python3.dll" doesn't directly depend on "python39.dll", so the loader waits to load it until first accessed via GetProcAddress(). It should remember the activation context of "python3.dll", such as whether it was loaded with a fully-qualified path and LOAD_LIBRARY_SEARCH_DLL_LOAD_DIR | LOAD_LIBRARY_SEARCH_DEFAULT_DIRS -- or LOAD_WITH_ALTERED_SEARCH_PATH. It works for me.

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43022>
_______________________________________

From report at bugs.python.org  Mon Jan 25 13:45:50 2021
From: report at bugs.python.org (Bhuvanesh Bhatt)
Date: Mon, 25 Jan 2021 18:45:50 +0000
Subject: [issue43025] Use normal 'i
Message-ID: <1611600350.32.0.540433161176.issue43025@roundup.psfhosted.org>


New submission from Bhuvanesh Bhatt <bhuvaneshbhatt at gmail.com>:

In Python, the letter 'j' denotes the imaginary unit. It would be great if we would follow mathematics in this regard and let the imaginary unit be denoted with an 'i'.

----------
messages: 385641
nosy: bhuvaneshbhatt
priority: normal
severity: normal
status: open
title: Use normal 'i

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43025>
_______________________________________

From report at bugs.python.org  Mon Jan 25 13:47:47 2021
From: report at bugs.python.org (Bhuvanesh Bhatt)
Date: Mon, 25 Jan 2021 18:47:47 +0000
Subject: [issue43025] Use normal 'i' character to denote imaginary part of
 complex numbers
In-Reply-To: <1611600350.32.0.540433161176.issue43025@roundup.psfhosted.org>
Message-ID: <1611600467.07.0.132312870947.issue43025@roundup.psfhosted.org>


Bhuvanesh Bhatt <bhuvaneshbhatt at gmail.com> added the comment:

Nobody these days uses j to represent the imaginary part of complex numbers. Regardless of what Guido wrote earlier, this issue should be fixed.

----------
title: Use normal 'i -> Use normal 'i' character to denote imaginary part of complex numbers
type:  -> enhancement
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43025>
_______________________________________

From report at bugs.python.org  Mon Jan 25 13:50:30 2021
From: report at bugs.python.org (Paul Moore)
Date: Mon, 25 Jan 2021 18:50:30 +0000
Subject: [issue43022] Unable to dynamically load functions from python3.dll
In-Reply-To: <1611576882.72.0.213255422964.issue43022@roundup.psfhosted.org>
Message-ID: <1611600630.92.0.28258904442.issue43022@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:

So I need to dynamically load *both* python3.dll and python39.dll, but if I do that I can get the functions from python3.dll? What's the point in doing that? Surely I might as well just load python39.dll and get the functions from there, in that case.

I hoped that by using python3.dll, I'd be able to avoid needing to deal with the version-specific DLL at all, so making my code portable to any version of Python 3. I'm pretty sure that's how it works if I statically link to python3.dll...

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43022>
_______________________________________

From report at bugs.python.org  Mon Jan 25 13:55:41 2021
From: report at bugs.python.org (Christian Heimes)
Date: Mon, 25 Jan 2021 18:55:41 +0000
Subject: [issue43025] Use normal 'i' character to denote imaginary part of
 complex numbers
In-Reply-To: <1611600350.32.0.540433161176.issue43025@roundup.psfhosted.org>
Message-ID: <1611600941.48.0.79288953194.issue43025@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

Your statement is not correct. A lot of people use "j" in fields of electrical engineering and signal processing to express the imaginary part. The letter "i" is commonly used for electric current in these fields.

----------
nosy: +christian.heimes

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43025>
_______________________________________

From report at bugs.python.org  Mon Jan 25 14:02:16 2021
From: report at bugs.python.org (Paul Moore)
Date: Mon, 25 Jan 2021 19:02:16 +0000
Subject: [issue43022] Unable to dynamically load functions from python3.dll
In-Reply-To: <1611576882.72.0.213255422964.issue43022@roundup.psfhosted.org>
Message-ID: <1611601336.71.0.34252217072.issue43022@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:

Thinking about what you said, "the loader waits to load it until first accessed via GetProcAddress()" did you mean by that, that the following code should work:

    h = LoadLibraryW(L"some/path/to/python3.dll")
    py_main = GetProcAddress(h, "Py_Main")

(with some/path/to/python39.dll being loaded on the second line)? Because if so, then that's what doesn't work for me.

Or are you suggesting that I do

    AddDllDirectoryW(L"some/path/to");
    h = LoadLibraryW(L"python3.dll");
    py_main = GetProcAddress(h, "Py_Main");


Because I didn't think to try that - and I'm not 100% sure how I'd have to do stuff like LOAD_LIBRARY_SEARCH_USER_DIRS and/or SetDefaultDllDirectories to make that work. I find the Microsoft docs on all of this really complex and hard to follow if you're a non-expert :-(

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43022>
_______________________________________

From report at bugs.python.org  Mon Jan 25 14:07:43 2021
From: report at bugs.python.org (Eryk Sun)
Date: Mon, 25 Jan 2021 19:07:43 +0000
Subject: [issue43022] Unable to dynamically load functions from python3.dll
In-Reply-To: <1611576882.72.0.213255422964.issue43022@roundup.psfhosted.org>
Message-ID: <1611601663.0.0.0479752614855.issue43022@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> So I need to dynamically load *both* python3.dll and python39.dll, 
> but if I do that I can get the functions from python3.dll? 

No, just load the fully-qualified name of "python3.dll", with the loader flags LOAD_LIBRARY_SEARCH_DLL_LOAD_DIR | LOAD_LIBRARY_SEARCH_DEFAULT_DIRS -- or LOAD_WITH_ALTERED_SEARCH_PATH.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43022>
_______________________________________

From report at bugs.python.org  Mon Jan 25 14:09:40 2021
From: report at bugs.python.org (Eryk Sun)
Date: Mon, 25 Jan 2021 19:09:40 +0000
Subject: [issue43022] Unable to dynamically load functions from python3.dll
In-Reply-To: <1611576882.72.0.213255422964.issue43022@roundup.psfhosted.org>
Message-ID: <1611601780.45.0.210486699603.issue43022@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> h = LoadLibraryW(L"some/path/to/python3.dll")

You should be using LoadLibraryExW(). It's a one-time call. You do not need to set the default flags via SetDefaultDllDirectories().

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43022>
_______________________________________

From report at bugs.python.org  Mon Jan 25 14:17:55 2021
From: report at bugs.python.org (Eric V. Smith)
Date: Mon, 25 Jan 2021 19:17:55 +0000
Subject: [issue43025] Use normal 'i' character to denote imaginary part of
 complex numbers
In-Reply-To: <1611600350.32.0.540433161176.issue43025@roundup.psfhosted.org>
Message-ID: <1611602275.11.0.688193168809.issue43025@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

Even if we wanted to switch to "i" we'd have to continue to also support "j": there's a ton of existing code that uses it. Since "j" is used by some fields (including my own) for the imaginary part of complex numbers, and since I don't think we want to have two ways to do the same thing, I think this proposal should be objected.

But if you really want to pursue it, I suggest starting a discussion on the python-ideas mailing list.

----------
nosy: +eric.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43025>
_______________________________________

From report at bugs.python.org  Mon Jan 25 14:24:41 2021
From: report at bugs.python.org (Emmanuel Arias)
Date: Mon, 25 Jan 2021 19:24:41 +0000
Subject: [issue43025] Use normal 'i' character to denote imaginary part of
 complex numbers
In-Reply-To: <1611600350.32.0.540433161176.issue43025@roundup.psfhosted.org>
Message-ID: <1611602681.28.0.503039857896.issue43025@roundup.psfhosted.org>


Emmanuel Arias <eamanu at yaerobi.com> added the comment:

Personally, it's more natural use 'j' for complex number, but it's true that in many math book (or that I used) letter 'i' is used.

Now, it's feasible change i for j on cpython? Asking from my ignorance on this case.

----------
nosy: +eamanu

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43025>
_______________________________________

From report at bugs.python.org  Mon Jan 25 14:31:11 2021
From: report at bugs.python.org (Ned Deily)
Date: Mon, 25 Jan 2021 19:31:11 +0000
Subject: [issue35523] Remove old ctypes callback workaround: creating the
 first instance of a callback
In-Reply-To: <1545134641.38.0.788709270274.issue35523@psf.upfronthosting.co.za>
Message-ID: <1611603071.36.0.107724364077.issue35523@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

It is certainly not good that some of the vfx users are seeing a crash. On the other hand, at this stage of Python 3.7's life cycle only security-related fixes are accepted as a primary goal is to keep 3.7 as stable and unchanged as possible for those users still using it. We always recommend using a fully supported version, today either 3.8.7 (for several more months) or 3.9.1. It is unfortunate that the Fedora patch wasn't applied upstream earlier when it would have been exposed across all platforms. If we could be more certain that applying it now would have no side effects on other platforms, it might be an easier call. As long as the vfx project is building and supporting its own copies of Python 3.7, I think it would be better for them to carry the Fedora patch locally if they want it until they migrate to a newer version of Python.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35523>
_______________________________________

From report at bugs.python.org  Mon Jan 25 14:32:07 2021
From: report at bugs.python.org (Emmanuel Arias)
Date: Mon, 25 Jan 2021 19:32:07 +0000
Subject: [issue43025] Use normal 'i' character to denote imaginary part of
 complex numbers
In-Reply-To: <1611600350.32.0.540433161176.issue43025@roundup.psfhosted.org>
Message-ID: <1611603127.98.0.235421997907.issue43025@roundup.psfhosted.org>


Emmanuel Arias <eamanu at yaerobi.com> added the comment:

> Now, it's feasible change i for j on cpython? Asking from my ignorance on this case.

j for i, sorry

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43025>
_______________________________________

From report at bugs.python.org  Mon Jan 25 14:34:18 2021
From: report at bugs.python.org (Eric V. Smith)
Date: Mon, 25 Jan 2021 19:34:18 +0000
Subject: [issue43025] Use normal 'i' character to denote imaginary part of
 complex numbers
In-Reply-To: <1611600350.32.0.540433161176.issue43025@roundup.psfhosted.org>
Message-ID: <1611603258.66.0.863701651811.issue43025@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

As I said in msg385648, I don't think it's feasible.

Maybe I'll write a PEP just to get it rejected so we can point to it when this discussion comes up, which it does a few times a year.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43025>
_______________________________________

From report at bugs.python.org  Mon Jan 25 14:36:42 2021
From: report at bugs.python.org (Eryk Sun)
Date: Mon, 25 Jan 2021 19:36:42 +0000
Subject: [issue43022] Unable to dynamically load functions from python3.dll
In-Reply-To: <1611576882.72.0.213255422964.issue43022@roundup.psfhosted.org>
Message-ID: <1611603402.63.0.187450248116.issue43022@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

I noted that the path to "python3.dll" must be fully qualified. But let me stress that point. You cannot use the relative path "path/to/python3.dll" with LOAD_LIBRARY_SEARCH_DLL_LOAD_DIR. The loader will fail the call as an invalid parameter.

Unlike POSIX, a Windows path that contains slashes may be handled as a relative path in search contexts, if it lacks a drive or leading slash. In the case of LoadLibraryW(L"path/to/python3.dll"), the loader will try to resolve "path/to/python3.dll" against every directory in the DLL search path, which may not even include the current working directory.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43022>
_______________________________________

From report at bugs.python.org  Mon Jan 25 14:44:18 2021
From: report at bugs.python.org (Andre Roberge)
Date: Mon, 25 Jan 2021 19:44:18 +0000
Subject: [issue36086] Split IDLE into separate feature in Windows installer
In-Reply-To: <1550883782.51.0.779365974532.issue36086@roundup.psfhosted.org>
Message-ID: <1611603858.82.0.365622881397.issue36086@roundup.psfhosted.org>


Andre Roberge <andre.roberge at gmail.com> added the comment:

I do not use IDLE (except for testing) and would not be affected by such a change.

However, many tutorials and books intended for beginners instruct users to use IDLE, with the assumption that it is available out of the box. Removing IDLE would immediately make instructions from those tutorials and books obsolete and needlessly confuse beginners who often struggle installing anything additional to a basic Python installation.

I just checked and if I right-click on a Python file, I see 29 entries in the contextual menu, 28 of which would be unaffected if IDLE would be removed.

If IDLE were not included by default (or if it required clicking on a checkbox), I think that the number of questions in various beginners forum about installing IDLE would quickly become a real annoyance for people that strive to help beginners.

----------
nosy: +aroberge

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36086>
_______________________________________

From report at bugs.python.org  Mon Jan 25 14:49:33 2021
From: report at bugs.python.org (Andre Roberge)
Date: Mon, 25 Jan 2021 19:49:33 +0000
Subject: [issue43017] Improve error message in the parser when using
 un-parenthesised tuples in comprehensions
In-Reply-To: <1611511246.56.0.166169475648.issue43017@roundup.psfhosted.org>
Message-ID: <1611604173.87.0.502240195976.issue43017@roundup.psfhosted.org>


Andre Roberge <andre.roberge at gmail.com> added the comment:

Such a change would be very useful and appreciated by other users as reported on https://github.com/aroberge/friendly-traceback/issues/167 and asked about on StackOverflow
https://stackoverflow.com/questions/60986850/why-does-creating-a-list-of-tuples-using-list-comprehension-requires-parentheses

----------
nosy: +aroberge

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43017>
_______________________________________

From report at bugs.python.org  Mon Jan 25 14:57:14 2021
From: report at bugs.python.org (Aviral Srivastava)
Date: Mon, 25 Jan 2021 19:57:14 +0000
Subject: [issue42920] How to add end_lineno in pyclbr?
In-Reply-To: <1610651547.29.0.257354369066.issue42920@roundup.psfhosted.org>
Message-ID: <CADf1F307FVMFvCO-yFtfgk2oddu13O-ynuBbEcMvb8WZj9GQ3w@mail.gmail.com>


Aviral Srivastava <avi.srivastava254084 at gmail.com> added the comment:

But how do I generate the endline no? Initially, I could
do, stack[-1][0].end_lineno = start[0] - 1 but how do I this now?

Best,
Aviral Srivastava
LinkedIn
<https://mailtrack.io/trace/link/c4502b41561cd995471aa8291b55e07212663a68?url=https%3A%2F%2Fwww.linkedin.com%2Fin%2Fsriavi%2F&userId=762683&signature=7970b62394c71d67>
| Website
<https://mailtrack.io/trace/link/91745120231e6a5490b7cad9769cf43b37257fe4?url=https%3A%2F%2Faviralsrivastava.com%2F&userId=762683&signature=b0d6da90458944b7>

On Thu, Jan 14, 2021 at 11:12 AM Batuhan Taskaya <report at bugs.python.org>
wrote:

>
> Batuhan Taskaya <isidentical at gmail.com> added the comment:
>
> It is actually much easier now, considering that we are operating on the
> AST instead of the token stream. You probably only have to add a new field
> to Function/Class classes for end_lineno and access .end_lineno attribute
> here just like how we do for .lineno
>
> https://github.com/python/cpython/blob/971235827754eee6c0d9f7d39b52fecdfd4cb7b4/Lib/pyclbr.py#L212-L214
> <https://mailtrack.io/trace/link/fcde5f4006527669633139919288094eb35d4671?url=https%3A%2F%2Fgithub.com%2Fpython%2Fcpython%2Fblob%2F971235827754eee6c0d9f7d39b52fecdfd4cb7b4%2FLib%2Fpyclbr.py%23L212-L214&userId=762683&signature=3181a7c4de5a239b>
>
> ----------
>
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue42920
> <https://mailtrack.io/trace/link/a14e8d641bc2744efb70ac68058359d310914537?url=https%3A%2F%2Fbugs.python.org%2Fissue42920&userId=762683&signature=ef176fb5cb5491fd>
> >
> _______________________________________
>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42920>
_______________________________________

From report at bugs.python.org  Mon Jan 25 15:07:54 2021
From: report at bugs.python.org (Paul Moore)
Date: Mon, 25 Jan 2021 20:07:54 +0000
Subject: [issue43022] Unable to dynamically load functions from python3.dll
In-Reply-To: <1611576882.72.0.213255422964.issue43022@roundup.psfhosted.org>
Message-ID: <1611605274.56.0.95705485187.issue43022@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:

Thanks, I'll give that a try. It sounds like I'm just using the APIs incorrectly, which would be good (in the sense that I can do what I wanted, I just didn't know how ;-))

I wonder whether it would be worth having a section in the docs somewhere explaining how to do this, or more generally what the "best practices" are for embedding? If I were to try to put something together, would that be worthwhile?

> I noted that the path to "python3.dll" must be fully qualified.

Just to note, my actual code does use an absolute path, I was over-simplifying here. But it's worth being clear on it, particularly if I do write something for the docs.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43022>
_______________________________________

From report at bugs.python.org  Mon Jan 25 15:07:53 2021
From: report at bugs.python.org (Aviral Srivastava)
Date: Mon, 25 Jan 2021 20:07:53 +0000
Subject: [issue38307] Provide Class' end line in pyclbr module
In-Reply-To: <1569691590.29.0.185701662636.issue38307@roundup.psfhosted.org>
Message-ID: <1611605273.33.0.394462034871.issue38307@roundup.psfhosted.org>


Aviral Srivastava <avi.srivastava254084 at gmail.com> added the comment:

How do I generate the endline no? Initially, I could
do, stack[-1][0].end_lineno = start[0] - 1 but how do I this now given that the recent changes are operating on the AST instead of the token stream?

----------
nosy: +kebab-mai-haddi

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38307>
_______________________________________

From report at bugs.python.org  Mon Jan 25 15:43:21 2021
From: report at bugs.python.org (Tadek Kijkowski)
Date: Mon, 25 Jan 2021 20:43:21 +0000
Subject: [issue42973] argparse: mixing optional and positional arguments...
 not again
In-Reply-To: <1611094894.69.0.476759327253.issue42973@roundup.psfhosted.org>
Message-ID: <1611607401.64.0.971813856618.issue42973@roundup.psfhosted.org>


Tadek Kijkowski <tkijkowski at gmail.com> added the comment:

I added tests and docs to the PR. How does it look now?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42973>
_______________________________________

From report at bugs.python.org  Mon Jan 25 15:49:02 2021
From: report at bugs.python.org (Steve Dower)
Date: Mon, 25 Jan 2021 20:49:02 +0000
Subject: [issue43022] Unable to dynamically load functions from python3.dll
In-Reply-To: <1611576882.72.0.213255422964.issue43022@roundup.psfhosted.org>
Message-ID: <1611607742.39.0.66476331243.issue43022@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

> I wonder whether it would be worth having a section in the docs somewhere explaining how to do this, or more generally what the "best practices" are for embedding?

Yes, it would be great. I think there are a few pieces in Doc/using/windows.rst already, and maybe a few bits in the embedding/extending section, but more would be valuable here.

> If I were to try to put something together, would that be worthwhile?

It would give us something concrete to argue about, at least ;) Speaking of arguing...

(Earlier post)
> The reason I want to use the stable ABI is so that I can upgrade the embedded distribution without needing to rebuild the C code.

I think here you're in a very small minority who could get away with this, and so I'd hesitate to make it sound like the recommended approach.

What I'd actually recommend (on Windows) is to bundle a copy of Python with your application. The embeddable distro is specifically for this purpose, and once you've done that then there's no need to worry about the version changing at all (unless you do it yourself).

What's missing *here* is any kind of guide or walkthrough on how to do it. I think I imagined that I'd have the time and inclination to do some myself, but obviously I never have. Ultimately, I'd definitely be suggesting "just fix your Python version and load it directly" for embedders, so probably wouldn't have helped with what you're trying to do here anyway, Paul.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43022>
_______________________________________

From report at bugs.python.org  Mon Jan 25 15:57:41 2021
From: report at bugs.python.org (Jim DeLaHunt)
Date: Mon, 25 Jan 2021 20:57:41 +0000
Subject: [issue36675] Doctest directives and comments missing from code samples
In-Reply-To: <1555757030.56.0.8094269644.issue36675@roundup.psfhosted.org>
Message-ID: <1611608261.03.0.688946243946.issue36675@roundup.psfhosted.org>


Jim DeLaHunt <from+python at jdlh.com> added the comment:

My goodness, things get complex sometimes. 

If we cannot make Sphinx preserve doctest directives and comments, perhaps we should go back to the historical bug discussion to look at workarounds which we considered earlier. For instance, maybe we should modify the text surrounding the examples to explain that doctests directives should appear there, but that our tool chain currently removes them.

At the moment, I see doctest directives in the doctest source code at: 
https://github.com/python/cpython/blob/master/Doc/library/doctest.rst#directives 
which do not appear in the corresponding HTML output at:
https://docs.python.org/3/library/doctest.html#directives 

How about rewording the text before each of those examples? Or maybe finding some way to show those examples as literal text which Sphinx won't modify, even if it is not formatted like Python code examples?

By the way, the discussion of this same problem back in 2011-2012 is at #12947 . At that time, we applied a "monkey patch" to the Sphinx code. I haven't read the discussion closely enough to figure out if such a patch would help now.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36675>
_______________________________________

From report at bugs.python.org  Mon Jan 25 16:02:20 2021
From: report at bugs.python.org (Paul Moore)
Date: Mon, 25 Jan 2021 21:02:20 +0000
Subject: [issue43022] Unable to dynamically load functions from python3.dll
In-Reply-To: <1611576882.72.0.213255422964.issue43022@roundup.psfhosted.org>
Message-ID: <1611608540.9.0.500872109484.issue43022@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:

Confirmed. The following code works as I want:

Py_Main_t get_pymain(wchar_t *base_dir) {
    wchar_t *dll_path;
    HRESULT hr = PathAllocCombine(
        base_dir, L"python\\python3.dll",
        PATHCCH_ALLOW_LONG_PATHS, &dll_path
    );
    if (hr != S_OK) {
        error(L"Could not construct Python DLL path");
    }

    HMODULE py_dll = LoadLibraryExW(dll_path, 0, LOAD_LIBRARY_SEARCH_DLL_LOAD_DIR | LOAD_LIBRARY_SEARCH_DEFAULT_DIRS);
    if (!py_dll) {
        error(L"Could not load Python DLL %ls", dll_path);
    }
    LocalFree(dll_path);

    Py_Main_t py_main = (Py_Main_t)GetProcAddress(py_dll, "Py_Main");
    if (!py_main) {
        error(L"Could not locate Py_Main function");
    }

    return py_main;
}


If people think it's worthwhile, I can put together a change to https://docs.python.org/3/extending/embedding.html#embedding-python-in-another-application (maybe a new section, "Embedding on Windows by dynamically loading the stable ABI"?) that uses a code snippet like this.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43022>
_______________________________________

From report at bugs.python.org  Mon Jan 25 16:02:28 2021
From: report at bugs.python.org (Paul Bryan)
Date: Mon, 25 Jan 2021 21:02:28 +0000
Subject: [issue33129] Add kwarg-only option to dataclass
In-Reply-To: <1521847997.9.0.467229070634.issue33129@psf.upfronthosting.co.za>
Message-ID: <1611608548.41.0.413494100872.issue33129@roundup.psfhosted.org>


Change by Paul Bryan <pbryan at anode.ca>:


----------
nosy: +pbryan

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33129>
_______________________________________

From report at bugs.python.org  Mon Jan 25 16:02:38 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 25 Jan 2021 21:02:38 +0000
Subject: [issue37319] Deprecate using random.randrange() with non-integers
In-Reply-To: <1560801155.55.0.20318571261.issue37319@roundup.psfhosted.org>
Message-ID: <1611608558.84.0.12850448815.issue37319@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset f066bd94b9225a5a3c4ade5fc3ff81e3c49b7b32 by Serhiy Storchaka in branch 'master':
bpo-37319: Improve documentation, code and tests of randrange. (GH-19112)
https://github.com/python/cpython/commit/f066bd94b9225a5a3c4ade5fc3ff81e3c49b7b32


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37319>
_______________________________________

From report at bugs.python.org  Mon Jan 25 16:03:11 2021
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 25 Jan 2021 21:03:11 +0000
Subject: [issue33387] Simplify bytecodes for try-finally,
 try-except and with blocks.
In-Reply-To: <1525026522.22.0.682650639539.issue33387@psf.upfronthosting.co.za>
Message-ID: <1611608591.65.0.548683226182.issue33387@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

I'm reopening this to delete an obsolete comment left behind.

----------
nosy: +iritkatriel
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33387>
_______________________________________

From report at bugs.python.org  Mon Jan 25 16:03:21 2021
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 25 Jan 2021 21:03:21 +0000
Subject: [issue33387] Simplify bytecodes for try-finally,
 try-except and with blocks.
In-Reply-To: <1525026522.22.0.682650639539.issue33387@psf.upfronthosting.co.za>
Message-ID: <1611608601.59.0.296212320744.issue33387@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
pull_requests: +23153
stage: resolved -> patch review
pull_request: https://github.com/python/cpython/pull/24334

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33387>
_______________________________________

From report at bugs.python.org  Mon Jan 25 16:03:21 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 25 Jan 2021 21:03:21 +0000
Subject: [issue37319] Deprecate using random.randrange() with non-integers
In-Reply-To: <1560801155.55.0.20318571261.issue37319@roundup.psfhosted.org>
Message-ID: <1611608601.92.0.693348037926.issue37319@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37319>
_______________________________________

From report at bugs.python.org  Mon Jan 25 16:08:10 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Mon, 25 Jan 2021 21:08:10 +0000
Subject: [issue42383] Pdb does not correclty restart the target if it changes
 the current directory
In-Reply-To: <1605597991.66.0.0396733980212.issue42383@roundup.psfhosted.org>
Message-ID: <1611608890.68.0.547788397272.issue42383@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:


New changeset 501d4a51e32c7bbba255598adc307660b5af891a by Andrey Bienkowski in branch 'master':
bpo-42383: pdb: do not fail to restart the target if the current directory changed (#23412)
https://github.com/python/cpython/commit/501d4a51e32c7bbba255598adc307660b5af891a


----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42383>
_______________________________________

From report at bugs.python.org  Mon Jan 25 16:08:50 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Mon, 25 Jan 2021 21:08:50 +0000
Subject: [issue42384] Inconsistent sys.path between python and pdb
In-Reply-To: <1605599201.78.0.619329509169.issue42384@roundup.psfhosted.org>
Message-ID: <1611608930.69.0.3198788722.issue42384@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:


New changeset f2df7958fb82cd927e17152b3a1bd2823a76dd3e by Andrey Bienkowski in branch '3.9':
[3.9] bpo-42384: pdb: correctly populate sys.path[0] (GH-23338) (#24321)
https://github.com/python/cpython/commit/f2df7958fb82cd927e17152b3a1bd2823a76dd3e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42384>
_______________________________________

From report at bugs.python.org  Mon Jan 25 16:10:49 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Mon, 25 Jan 2021 21:10:49 +0000
Subject: [issue42384] Inconsistent sys.path between python and pdb
In-Reply-To: <1605599201.78.0.619329509169.issue42384@roundup.psfhosted.org>
Message-ID: <1611609049.02.0.101963916576.issue42384@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:


New changeset c10180ea1458aa0ffd7793cb75629ebffe8a257e by Andrey Bienkowski in branch '3.8':
[3.8] bpo-42384: pdb: correctly populate sys.path[0] (GH-23338) (#24320)
https://github.com/python/cpython/commit/c10180ea1458aa0ffd7793cb75629ebffe8a257e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42384>
_______________________________________

From report at bugs.python.org  Mon Jan 25 16:23:12 2021
From: report at bugs.python.org (Paul Moore)
Date: Mon, 25 Jan 2021 21:23:12 +0000
Subject: [issue43022] Unable to dynamically load functions from python3.dll
In-Reply-To: <1611576882.72.0.213255422964.issue43022@roundup.psfhosted.org>
Message-ID: <1611609792.51.0.994927133685.issue43022@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:

> I think here you're in a very small minority who could get away with this, and so I'd hesitate to make it sound like the recommended approach.

Well, the evidence here is that maybe even I shouldn't be doing this :-)

> What I'd actually recommend (on Windows) is to bundle a copy of Python with your application.

That's actually precisely what I'm doing. But I don't exactly have an "application", in the sense that I suspect you mean, which is the difficulty.

I'm trying to address the problem that it's a real pain to ship Python scripts as "utilities" on a Windows system. You want such scripts to still be plain text, because you typically hack on them a lot. You can't rely on shebangs and the launcher, because I continually find that PATHEXT doesn't include ".py" so they don't run properly, and "py name_of_script.py" doesn't do path searches. And anyway, I don't want to run the scripts with my system Python, because I don't want to dump all my dependencies in there.

So what I have is a small stub, that looks for a .py file of the same name, alongside the executable (so myutil.exe looks for myutil.py). Rather than using the system Python, it looks for a copy of Python in a subdirectory next to the script, and uses that. I can then install dependencies in the dedicated interpreter.

(And yes, PEP 582 would help make things easier in this area, too, but it never gained enough traction.)

I use the embedded distribution as that interpreter. I may be able to use a virtualenv instead, but I've not tried that yet.

Multiple copies of the launcher, one per script, and you're done :-)

To be honest, it really sucks that this is the most reliable way of managing small utility scripts in Python on Windows. But every other solution I've tried has had its own issues. I'd *much* prefer something standard, but I don't know how to bundle this in a way that makes it straightforward for "ordinary" users, so I've decided just to solve my own problem and leave it at that :-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43022>
_______________________________________

From report at bugs.python.org  Mon Jan 25 16:43:14 2021
From: report at bugs.python.org (Eryk Sun)
Date: Mon, 25 Jan 2021 21:43:14 +0000
Subject: [issue43022] Unable to dynamically load functions from python3.dll
In-Reply-To: <1611576882.72.0.213255422964.issue43022@roundup.psfhosted.org>
Message-ID: <1611610994.89.0.927282008765.issue43022@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> uses a code snippet like this.

PathAllocCombine() is Windows 8+, so sample code that uses it would only be for Python 3.9+.

I'd prefer the function pointer to be returned as an out parameter, and return an HRESULT status as the result. If LoadLibraryExW() or GetProcAddress() fails, map the error code via HRESULT_FROM_WIN32(GetLastError()). And log to stderr instead of exiting with an error() call.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43022>
_______________________________________

From report at bugs.python.org  Mon Jan 25 17:13:19 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 25 Jan 2021 22:13:19 +0000
Subject: [issue42955] Add sys.module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611612799.02.0.16244470666.issue42955@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 9852cb38112a4f8d11e26c3423643ea994d5a14f by Victor Stinner in branch 'master':
bpo-42955: Rename module_names to sys.stdlib_module_names (GH-24332)
https://github.com/python/cpython/commit/9852cb38112a4f8d11e26c3423643ea994d5a14f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Mon Jan 25 17:13:40 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 25 Jan 2021 22:13:40 +0000
Subject: [issue42955] Add sys.stdlib_module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611612820.97.0.614903145996.issue42955@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Update: attribute renamed to sys.stdlib_module_names.

----------
title: Add sys.module_names: list of stdlib module names (Python and extension modules) -> Add sys.stdlib_module_names: list of stdlib module names (Python and extension modules)

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Mon Jan 25 17:26:37 2021
From: report at bugs.python.org (Ethan Furman)
Date: Mon, 25 Jan 2021 22:26:37 +0000
Subject: [issue38250] enum.Flag should be more set-like
In-Reply-To: <1569150842.66.0.799345616323.issue38250@roundup.psfhosted.org>
Message-ID: <1611613597.19.0.526337726884.issue38250@roundup.psfhosted.org>


Ethan Furman <ethan at stoneleaf.us> added the comment:


New changeset 7aaeb2a3d682ecba125c33511e4b4796021d2f82 by Ethan Furman in branch 'master':
bpo-38250: [Enum] single-bit flags are canonical (GH-24215)
https://github.com/python/cpython/commit/7aaeb2a3d682ecba125c33511e4b4796021d2f82


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38250>
_______________________________________

From report at bugs.python.org  Mon Jan 25 17:26:47 2021
From: report at bugs.python.org (Paul Moore)
Date: Mon, 25 Jan 2021 22:26:47 +0000
Subject: [issue43022] Unable to dynamically load functions from python3.dll
In-Reply-To: <1611576882.72.0.213255422964.issue43022@roundup.psfhosted.org>
Message-ID: <1611613607.75.0.683669589293.issue43022@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:

> PathAllocCombine() is Windows 8+, so sample code that uses it would only be for Python 3.9+.

Yeah, I'm probably going to remove that. I mainly used it because I'm *so* spoiled by Python, writing code in C where I have to actually implement stuff for myself rather than just using a stdlib function, just feels so tiresome these days :-)

Thanks for the other suggestions.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43022>
_______________________________________

From report at bugs.python.org  Mon Jan 25 17:30:27 2021
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 25 Jan 2021 22:30:27 +0000
Subject: [issue2636] Adding a new regex module (compatible with re)
In-Reply-To: <1208260672.14.0.711874677361.issue2636@psf.upfronthosting.co.za>
Message-ID: <1611613827.31.0.318070912788.issue2636@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

It's now a third party project: https://pypi.org/project/regex/

If someone wants to move it into the Python stdlib, I suggest to start on the python-ideas list first.

I close the issue as REJECTED.

----------
nosy: +vstinner
resolution:  -> rejected
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue2636>
_______________________________________

From report at bugs.python.org  Mon Jan 25 17:30:37 2021
From: report at bugs.python.org (Glenn Linderman)
Date: Mon, 25 Jan 2021 22:30:37 +0000
Subject: [issue42973] argparse: mixing optional and positional arguments...
 not again
In-Reply-To: <1611607401.64.0.971813856618.issue42973@roundup.psfhosted.org>
Message-ID: <caf77b0d-474d-2e64-50bd-4ababf071225@g.nevcal.com>


Glenn Linderman <v+python at g.nevcal.com> added the comment:

On 1/25/2021 12:43 PM, Tadek Kijkowski wrote:
> Tadek Kijkowski <tkijkowski at gmail.com> added the comment:
>
> I added tests and docs to the PR. How does it look now?
Could you send me the docs privately?

I'm trying to understand what you are suggesting, without reading the code.

I realize that you are trying to apply different values of optional 
parameters to positional parameters... how are you saving that context? 
Is it up to the special handler of the positional parameter to read and? 
save the values of the optional parameters specified so far? What about 
the ones unspecified so far? Can one even read and save the default value?

And where does it get stored? Is the value of the positional parameter 
turned into a dict or class containing its own value + the saved 
optional parameters?

I do agree that the even though the parse_intermixed_args was sufficient 
for the use case I had at the time, and has been sufficient for me so 
far, that it? not fully flexible, and I think I have seen Unix command 
line programs that had rich semantics similar to what you are proposing, 
where the sequence of repeated optional args could affect handling of 
later positionals but not earlier ones.

So I applaud your efforts here, but simply reading the issue, and having 
forgotten most of the internal workings of argument parser since getting 
the compromise going, I think reading your docs would help clarify it 
for me.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42973>
_______________________________________

From report at bugs.python.org  Mon Jan 25 17:32:28 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Mon, 25 Jan 2021 22:32:28 +0000
Subject: [issue42986] pegen parser: Crash on SyntaxError with f-string on
 Windows
In-Reply-To: <1611183086.81.0.804124765933.issue42986@roundup.psfhosted.org>
Message-ID: <1611613948.46.0.249909598918.issue42986@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
priority: normal -> release blocker

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42986>
_______________________________________

From report at bugs.python.org  Mon Jan 25 17:47:46 2021
From: report at bugs.python.org (Jen Garcia)
Date: Mon, 25 Jan 2021 22:47:46 +0000
Subject: [issue42369] Reading ZipFile not thread-safe
In-Reply-To: <1605524871.74.0.395089652548.issue42369@roundup.psfhosted.org>
Message-ID: <1611614866.19.0.689006455573.issue42369@roundup.psfhosted.org>


Change by Jen Garcia <jen at haverstack.com>:


----------
nosy: +cuibonobo

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42369>
_______________________________________

From report at bugs.python.org  Mon Jan 25 17:47:48 2021
From: report at bugs.python.org (Mitchell Young)
Date: Mon, 25 Jan 2021 22:47:48 +0000
Subject: [issue31405] shutil.which doesn't find files without PATHEXT
 extension on Windows
In-Reply-To: <1504980729.07.0.774720722316.issue31405@psf.upfronthosting.co.za>
Message-ID: <1611614868.85.0.979989894499.issue31405@roundup.psfhosted.org>


Mitchell Young <mitchelly at gmail.com> added the comment:

I am struggling with the same issue as Anthony. To provide a more direct response to Manjusaka's query:

python -c "import os; print(os.environ.get(\"PATHEXT\", \"\").split(os.pathsep))"
['.COM', '.EXE', '.BAT', '.CMD', '.VBS', '.VBE', '.JS', '.JSE', '.WSF', '.WSH', '.MSC']

Like Anthony, wondering if this should be it's own issue. Simply supporting paths with separators shouldn't, I think, lead to any of the ambiguities of matching a file exactly, without PATHEXT treatment.

----------
nosy: +mitchelly

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31405>
_______________________________________

From report at bugs.python.org  Mon Jan 25 18:01:15 2021
From: report at bugs.python.org (Ethan Furman)
Date: Mon, 25 Jan 2021 23:01:15 +0000
Subject: [issue38250] enum.Flag should be more set-like
In-Reply-To: <1569150842.66.0.799345616323.issue38250@roundup.psfhosted.org>
Message-ID: <1611615675.24.0.339096609078.issue38250@roundup.psfhosted.org>


Ethan Furman <ethan at stoneleaf.us> added the comment:

Thank you to everyone involved.  :-)

To answer the first three points that started this issue:

1. iteration -> each single-bit flag in the entire flag, or a
   combinations of flags, is returned one at a time -- not the
   empty set, not other multi-bit values

2. length is implemented -> `len(Color.BLUE | Color.RED) == 2`

3. subset is implemented as containment checking:
   `Color.BLUE in (Color.RED | Color.BLUE) is True`

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38250>
_______________________________________

From report at bugs.python.org  Mon Jan 25 18:10:52 2021
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 25 Jan 2021 23:10:52 +0000
Subject: [issue33387] Simplify bytecodes for try-finally,
 try-except and with blocks.
In-Reply-To: <1525026522.22.0.682650639539.issue33387@psf.upfronthosting.co.za>
Message-ID: <1611616252.74.0.664738360728.issue33387@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33387>
_______________________________________

From report at bugs.python.org  Mon Jan 25 18:11:52 2021
From: report at bugs.python.org (Ethan Furman)
Date: Mon, 25 Jan 2021 23:11:52 +0000
Subject: [issue42915] enum.Flag ~ bitwise negation is very slow and can't be
 defined as a Flag value
In-Reply-To: <1610494273.49.0.733516574302.issue42915@roundup.psfhosted.org>
Message-ID: <1611616312.43.0.111929810818.issue42915@roundup.psfhosted.org>


Ethan Furman <ethan at stoneleaf.us> added the comment:

Fixed in 3.10 in issue38250.

Also fixed in my 3rd-party library, aenum 3.0:

   (https://pypi.org/project/aenum/)

----------
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed
superseder:  -> enum.Flag should be more set-like
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42915>
_______________________________________

From report at bugs.python.org  Mon Jan 25 18:13:30 2021
From: report at bugs.python.org (Ethan Furman)
Date: Mon, 25 Jan 2021 23:13:30 +0000
Subject: [issue42901] [Enum] move member creation to __set_name__ in order to
 support __init_subclass__
In-Reply-To: <1610414848.42.0.389708219553.issue42901@roundup.psfhosted.org>
Message-ID: <1611616410.09.0.601400245311.issue42901@roundup.psfhosted.org>


Change by Ethan Furman <ethan at stoneleaf.us>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42901>
_______________________________________

From report at bugs.python.org  Mon Jan 25 18:14:57 2021
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 25 Jan 2021 23:14:57 +0000
Subject: [issue33387] Simplify bytecodes for try-finally,
 try-except and with blocks.
In-Reply-To: <1525026522.22.0.682650639539.issue33387@psf.upfronthosting.co.za>
Message-ID: <1611616497.87.0.117515535152.issue33387@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33387>
_______________________________________

From report at bugs.python.org  Mon Jan 25 18:23:07 2021
From: report at bugs.python.org (Irit Katriel)
Date: Mon, 25 Jan 2021 23:23:07 +0000
Subject: [issue33387] Simplify bytecodes for try-finally,
 try-except and with blocks.
In-Reply-To: <1525026522.22.0.682650639539.issue33387@psf.upfronthosting.co.za>
Message-ID: <1611616987.11.0.424518557394.issue33387@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

There's another place that needs to be updated: https://docs.python.org/3/library/dis.html#opcode-SETUP_WITH

need to replace WITH_CLEANUP_START by WITH_EXCEPT_START

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33387>
_______________________________________

From report at bugs.python.org  Mon Jan 25 18:46:46 2021
From: report at bugs.python.org (Ezra)
Date: Mon, 25 Jan 2021 23:46:46 +0000
Subject: [issue43026] Missing words renders meaning unclear in fcntl.html
Message-ID: <1611618406.29.0.452944472841.issue43026@roundup.psfhosted.org>


New submission from Ezra <ezrabc at gmail.com>:

At https://docs.python.org/3/library/fcntl.html the docs read:

the fcntl module exposes the F_OFD_GETLK, F_OFD_SETLK and F_OFD_SETLKW constants, which working with open file description locks.

The exact intended meaning is unclear, perhaps:

the fcntl module exposes the F_OFD_GETLK, F_OFD_SETLK and F_OFD_SETLKW constants, which are used for working with open file description locks.

----------
assignee: docs at python
components: Documentation
files: meaning_unclear.png
messages: 385680
nosy: EzraBC, docs at python
priority: normal
severity: normal
status: open
title: Missing words renders meaning unclear in fcntl.html
type: behavior
versions: Python 3.9
Added file: https://bugs.python.org/file49766/meaning_unclear.png

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43026>
_______________________________________

From report at bugs.python.org  Mon Jan 25 18:56:19 2021
From: report at bugs.python.org (Steven D'Aprano)
Date: Mon, 25 Jan 2021 23:56:19 +0000
Subject: [issue43025] Use normal 'i
In-Reply-To: <1611600350.32.0.540433161176.issue43025@roundup.psfhosted.org>
Message-ID: <20210125235444.GM4609@ando.pearwood.info>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

https://mathworld.wolfram.com/j.html

D and SmartBASIC use a literal suffix "i" for imaginary numbers. I can't 
find any other languages which support literal syntax for complex 
numbers, but I haven't looked very far.

https://www.researchgate.net/profile/Ken_Hawick/publication/267386724_Notes_on_Complex_Numbers_for_Computer_Scientists/links/54c7474f0cf238bb7d0a5c67/Notes-on-Complex-Numbers-for-Computer-Scientists.pdf

https://en.wikipedia.org/wiki/Complex_data_type

----------
nosy: +steven.daprano
title: Use normal 'i' character to denote imaginary part of complex numbers -> Use normal 'i

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43025>
_______________________________________

From report at bugs.python.org  Mon Jan 25 19:14:48 2021
From: report at bugs.python.org (Eric V. Smith)
Date: Tue, 26 Jan 2021 00:14:48 +0000
Subject: [issue43025] Use normal 'i' character to denote imaginary part of
 complex numbers
In-Reply-To: <1611600350.32.0.540433161176.issue43025@roundup.psfhosted.org>
Message-ID: <1611620088.7.0.68769673597.issue43025@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

I don't think it really matters what other languages do. We're not designing this from scratch. We need to reflect that state we're in, which is many, many lines of working code using 'j'. I see the two options as: support 'i' and 'j', or break existing code and switch to 'i'. I don't think either option makes sense.

----------
title: Use normal 'i -> Use normal 'i' character to denote imaginary part of complex numbers

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43025>
_______________________________________

From report at bugs.python.org  Mon Jan 25 19:20:30 2021
From: report at bugs.python.org (Tadek Kijkowski)
Date: Tue, 26 Jan 2021 00:20:30 +0000
Subject: [issue42973] argparse: mixing optional and positional arguments...
 not again
In-Reply-To: <1611094894.69.0.476759327253.issue42973@roundup.psfhosted.org>
Message-ID: <1611620430.74.0.810245544638.issue42973@roundup.psfhosted.org>


Tadek Kijkowski <tkijkowski at gmail.com> added the comment:

>> Is it up to the special handler of the positional parameter to read and save the values of the optional parameters specified so far?

Yes, in order to get anything more that just concatenated list of positional parameters, one has to provide specialized action class. Basic functionality is easy to implement, as you can see in the fruits.py example.

>> ... how are you saving that context?

Entire context is stored in the namespace object. Action class has access to all previous parameters via the namespace and it can modify the namespace as needed. Standard 'store' action just adds value to the namespace, but specialized action can anything.

>> What about the ones unspecified so far?

They are obviously not available for the action processing positional parameters preceeding them, but will be present in the resulting namespace and can be processed after parsing is done.

>> Can one even read and save the default value?

I'm not sure what do you mean, but it all depend on how action class deals with it.

>> And where does it get stored? Is the value of the positional parameter turned into a dict or class containing its own value + the saved optional parameters?

It all gets stored in the namespace. Turning positionals + optionals into a dict or class seems most reasonable, but it all depends on how action class will deal with them.

>> I think I have seen Unix command line programs that had rich semantics similar to what you are proposing, where the sequence of repeated optional args could affect handling of later positionals but not earlier ones.

For example 'tar' with '-C' parameter which applies to all files following it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42973>
_______________________________________

From report at bugs.python.org  Mon Jan 25 19:30:11 2021
From: report at bugs.python.org (Tadek Kijkowski)
Date: Tue, 26 Jan 2021 00:30:11 +0000
Subject: [issue42973] argparse: mixing optional and positional arguments...
 not again
In-Reply-To: <1611094894.69.0.476759327253.issue42973@roundup.psfhosted.org>
Message-ID: <1611621011.84.0.528186355507.issue42973@roundup.psfhosted.org>


Tadek Kijkowski <tkijkowski at gmail.com> added the comment:

This is, I think, smallest functional example for matching optional parameters with positionals - fruits.py:

  import argparse
  
  DEFAULT_COLOR="plain"
  
  class AddFruitAction(argparse.Action):
     def __call__(self, parser, namespace, values, option_string=None):
        for fruit in values:
           namespace.fruits.append({'name': fruit, 'color': namespace.color})
           namespace.color = DEFAULT_COLOR
  
  def show_fruits(fruits):
     for fruit in fruits:
        print(f"{fruit['color']} {fruit['name']}")
  
  parser = argparse.ArgumentParser(greedy=True)
  parser.add_argument('--color', default=DEFAULT_COLOR)
  parser.add_argument('fruits', nargs='*', action=AddFruitAction, default=[])
  args = parser.parse_args()
  show_fruits(args.fruits)

It starts with 'namespace.color' set to 'DEFAULT_COLOR' - 'default=DEFAULT_COLOR' takes care of that, and with 'namespace.fruits' set to empty list - via 'default=[]'.

For each group of positional command-line arguments, AddFruitAction is called with one or more fruit names in 'value'. The method iterates over them adding series of dicts to the 'fruits' list. The 'namespace.color' is immediately reset to default value, because we want the 'color' to apply to one following 'fruit'. If we wanted the 'color' to apply to all following 'fruits' the action class could just leave it alone.

After parsing is done, we get our namespace assigned to args, with list of color + fruit name pairs in 'args.fruits'.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42973>
_______________________________________

From report at bugs.python.org  Mon Jan 25 19:54:37 2021
From: report at bugs.python.org (Steven D'Aprano)
Date: Tue, 26 Jan 2021 00:54:37 +0000
Subject: [issue43025] Use normal 'i' character to denote imaginary part of
 complex numbers
In-Reply-To: <1611620088.7.0.68769673597.issue43025@roundup.psfhosted.org>
Message-ID: <20210126005302.GR4609@ando.pearwood.info>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

I think it always helps to look at what other languages do. It doesn't 
mean that we must follow them, but it may help us decide that the choice 
made in Python 1 was a mistake and it is worth going through the pain of 
deprecation, or that it is still justified and we should stick to the 
current design. If everyone else is making a different decision, it pays 
to at least consider why. If they're making the same decision we did, 
that helps justify what we did.

For what it's worth, although my personal preference would be for i, I 
think that going through a disruptive deprecation period is not 
justified. j is good enough. I haven't got an opinion on supporting both 
i and j.

Eric, if you do follow through with writing a PEP, remember that you 
have to make the best case that you can for the change. And you might be 
surprised: when Guido volunteered me to write the dict addition PEP, I 
initially intended it to be rejected. I never expected that it would be 
accepted with a change of operator.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43025>
_______________________________________

From report at bugs.python.org  Mon Jan 25 20:07:29 2021
From: report at bugs.python.org (Eric V. Smith)
Date: Tue, 26 Jan 2021 01:07:29 +0000
Subject: [issue43025] Use normal 'i' character to denote imaginary part of
 complex numbers
In-Reply-To: <1611600350.32.0.540433161176.issue43025@roundup.psfhosted.org>
Message-ID: <1611623249.48.0.820405018197.issue43025@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

Good point on surveying other languages for a PEP. You're further along in your thinking than I am!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43025>
_______________________________________

From report at bugs.python.org  Mon Jan 25 20:22:47 2021
From: report at bugs.python.org (Ezra)
Date: Tue, 26 Jan 2021 01:22:47 +0000
Subject: [issue43026] Missing words renders meaning unclear in fcntl.html
In-Reply-To: <1611618406.29.0.452944472841.issue43026@roundup.psfhosted.org>
Message-ID: <1611624167.44.0.0800967437992.issue43026@roundup.psfhosted.org>


Change by Ezra <ezrabc at gmail.com>:


----------
versions: +Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43026>
_______________________________________

From report at bugs.python.org  Mon Jan 25 20:44:59 2021
From: report at bugs.python.org (Steven D'Aprano)
Date: Tue, 26 Jan 2021 01:44:59 +0000
Subject: [issue43015] Add str.replaceall?
In-Reply-To: <1611498003.08.0.308752741743.issue43015@roundup.psfhosted.org>
Message-ID: <1611625499.91.0.45548187443.issue43015@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

Versions 3.6-3.9 are all in feature-freeze, so the earliest this could be added is version 3.10.

----------
nosy: +steven.daprano
versions:  -Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43015>
_______________________________________

From report at bugs.python.org  Mon Jan 25 20:50:38 2021
From: report at bugs.python.org (Ben Darnell)
Date: Tue, 26 Jan 2021 01:50:38 +0000
Subject: [issue41962] Make threading._register_atexit public?
In-Reply-To: <1602032984.5.0.326433134447.issue41962@roundup.psfhosted.org>
Message-ID: <1611625838.15.0.589864925809.issue41962@roundup.psfhosted.org>


Ben Darnell <ben.darnell at gmail.com> added the comment:

I have resolved my issue here by moving from ThreadPoolExecutor to a plain threading.Thread that I manage by hand (https://github.com/tornadoweb/tornado/commit/15832bc423c33c9280564770046dd6918f3a31b4). Therefore I no longer need this for myself and I leave it up to you to decide whether there's anything worth doing at this point.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41962>
_______________________________________

From report at bugs.python.org  Mon Jan 25 22:52:05 2021
From: report at bugs.python.org (Ma Lin)
Date: Tue, 26 Jan 2021 03:52:05 +0000
Subject: [issue43027] Calling _PyBytes_Resize() on 1-byte bytes may raise error
Message-ID: <1611633125.01.0.24786462439.issue43027@roundup.psfhosted.org>


New submission from Ma Lin <malincns at 163.com>:

PyBytes_FromStringAndSize() uses a global cache for 1-byte bytes:
https://github.com/python/cpython/blob/v3.10.0a4/Objects/bytesobject.c#L147

    if (size == 1 && str != NULL) {
        struct _Py_bytes_state *state = get_bytes_state();
        op = state->characters[*str & UCHAR_MAX];
        if (op != NULL) {
            Py_INCREF(op);
            return (PyObject *)op;
        }
    }

_PyBytes_Resize() will raise an error when (refcount != 1):
https://github.com/python/cpython/blob/v3.10.0a4/Objects/bytesobject.c#L3029

Then this code will raise an exception:

    obj1 = PyBytes_FromStringAndSize("a", 1);
    obj2 = PyBytes_FromStringAndSize("a", 1);
    ret = _PyBytes_Resize(&obj2, 2);  // ret is -1

BTW, 0-byte bytes comes from a global singleton, but _PyBytes_Resize() processes it before checking refcount:
https://github.com/python/cpython/blob/v3.10.0a4/Objects/bytesobject.c#L3021

    if (Py_SIZE(v) == 0) {
        if (newsize == 0) {
            return 0;
        }
        *pv = _PyBytes_FromSize(newsize, 0);
        Py_DECREF(v);
        return (*pv == NULL) ? -1 : 0;
    }
    if (Py_REFCNT(v) != 1) {
        goto error;
    }

_PyBytes_Resize() doc:
    
    Only use this to build up a brand new bytes object; don?t use this if the
    bytes may already be known in other parts of the code. It is an error to
    call this function if the refcount on the input bytes object is not one.

----------
components: Interpreter Core
messages: 385689
nosy: malin
priority: normal
severity: normal
status: open
title: Calling _PyBytes_Resize() on 1-byte bytes may raise error
type: behavior
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43027>
_______________________________________

From report at bugs.python.org  Mon Jan 25 22:59:18 2021
From: report at bugs.python.org (Glenn Linderman)
Date: Tue, 26 Jan 2021 03:59:18 +0000
Subject: [issue42973] argparse: mixing optional and positional arguments...
 not again
In-Reply-To: <1611094894.69.0.476759327253.issue42973@roundup.psfhosted.org>
Message-ID: <1611633558.15.0.407033703616.issue42973@roundup.psfhosted.org>


Glenn Linderman <v+python at g.nevcal.com> added the comment:

OK, I think I see what you are doing here. Thanks for your responses.

And probably it is the bare-bones minimum feature that allows user-implementation of "as complex as desired" combinations of optionals and context-sensitive positionals.

In the docs fruits example, though, I think the input and output are inconsistent: you have a brown banana reported as yellow?

I guess I could think of enhancements to simplify common cases. For example, each positional might want to track/save values for some number of optionals. So one could write custom code to do that, like your fruit basket, or one could imagine a canned approach, where the list of optionals was passed as a parameter when defining the positionals.  This could be built as a wrapper for add_argument, that would call a more general version of the AddFruit Action.  Perhaps a special parameter could also indicate saving the values of all optionals at the point of parsing the positional, giving each positional a complete set of optionals that apply.

Your feature of having the optional apply to only one positional would be a harder thing, especially if you wanted to have both kinds of optionals: that apply to the next positional, or that apply to all following positionals. But hmm.  Maybe not much harder: just have two lists of optionals passed to the positional: a list of each kind.

Does the namespace still contain the default value for an optional after it has been used?  It looks like it might, so your fruit example could be reduced to not needing the DEFAULT_COLOR variable, but rather change references to it to use 

  self._get_default_metavar_for_positional(action) 

?  That avoids using a global variable, and is for more helpful for the "list of optionals to be reset on each use" rather than re-creating the more complex data structure required to hold all the defaults.

I'm not sure how that plays with optionals that use append or append_const storage methods, nor do I fully understand the comment in "def _copy_items(items):"

I think if you could avoid the global variable, your implementation would be stronger. And if you provide, either as a sample subclass, or argparse new feature, the ability to do the things I mention here, it would be even stronger, as it would allow the user to deal with the more powerful capabilities without needing as much understanding of argparse internals.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42973>
_______________________________________

From report at bugs.python.org  Mon Jan 25 23:07:07 2021
From: report at bugs.python.org (Glenn Linderman)
Date: Tue, 26 Jan 2021 04:07:07 +0000
Subject: [issue42973] argparse: mixing optional and positional arguments...
 not again
In-Reply-To: <1611094894.69.0.476759327253.issue42973@roundup.psfhosted.org>
Message-ID: <1611634027.12.0.302563550596.issue42973@roundup.psfhosted.org>


Glenn Linderman <v+python at g.nevcal.com> added the comment:

for more helpful  => far more helpful

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42973>
_______________________________________

From report at bugs.python.org  Tue Jan 26 00:29:12 2021
From: report at bugs.python.org (Cotton Seed)
Date: Tue, 26 Jan 2021 05:29:12 +0000
Subject: [issue43028] seeking past the end of a file unexpected behavior
Message-ID: <1611638952.77.0.560549779185.issue43028@roundup.psfhosted.org>


New submission from Cotton Seed <cotton.seed at gmail.com>:

Seeking past the end of a file with file objects does not match the same code implemented in terms of file descriptors.  Is this the intended behavior?

Smallest example I could find:

f = open('new_file', 'ab')
print(f.seek(1))
print(f.write(b'foo'))
print(f.tell())
f.close()

This program outputs: 1, 3, 4 as expected, but only creates a 3-byte file:

and creates a 3-byte file:
$ hexdump -C new_file
00000000  66 6f 6f                                          |foo|
00000003

If I use open(..., buffering=0), or flush before the tell, it outputs: 1, 3, 3.

The obvious code with file descriptors:

fd = os.open('log', os.O_WRONLY | os.O_CREAT)
print(os.lseek(fd, 1, os.SEEK_SET))
os.write(fd, b'foo')
os.close(fd)

works as expected, creating a 4-byte file.

Could this be related this issue:

https://bugs.python.org/issue36411

?

----------
components: IO
messages: 385692
nosy: cotton.seed
priority: normal
severity: normal
status: open
title: seeking past the end of a file unexpected behavior
versions: Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43028>
_______________________________________

From report at bugs.python.org  Tue Jan 26 00:38:32 2021
From: report at bugs.python.org (Christian Heimes)
Date: Tue, 26 Jan 2021 05:38:32 +0000
Subject: [issue43028] seeking past the end of a file unexpected behavior
In-Reply-To: <1611638952.77.0.560549779185.issue43028@roundup.psfhosted.org>
Message-ID: <1611639512.03.0.762101489848.issue43028@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

The high level and low level variants behave the same if you pass in the same flags. You are using the append flag in "open()", but you don't pass the os.O_APPEND flag to "os.open()".

>>> import os
>>> fd = os.open('log', os.O_WRONLY | os.O_APPEND | os.O_CREAT)
>>> os.lseek(fd, 1, os.SEEK_SET)
1
>>> os.write(fd, b'foo')
3
>>> os.close(fd)
>>> os.stat('log').st_size
3

>>> fd = os.open('log2', os.O_WRONLY | os.O_CREAT)
>>> os.lseek(fd, 1, os.SEEK_SET)
1
>>> os.write(fd, b'foo')
3
>>> os.close(fd)
>>> os.stat('log2').st_size
4

----------
nosy: +christian.heimes

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43028>
_______________________________________

From report at bugs.python.org  Tue Jan 26 00:48:04 2021
From: report at bugs.python.org (Cotton Seed)
Date: Tue, 26 Jan 2021 05:48:04 +0000
Subject: [issue43028] seeking past the end of a file unexpected behavior
In-Reply-To: <1611638952.77.0.560549779185.issue43028@roundup.psfhosted.org>
Message-ID: <1611640084.74.0.189177961922.issue43028@roundup.psfhosted.org>


Cotton Seed <cotton.seed at gmail.com> added the comment:

Christian, thanks for the quick response and the clarification. I understand my mistake now.  Thanks!

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43028>
_______________________________________

From report at bugs.python.org  Tue Jan 26 03:38:12 2021
From: report at bugs.python.org (Mark Dickinson)
Date: Tue, 26 Jan 2021 08:38:12 +0000
Subject: [issue43025] Use normal 'i' character to denote imaginary part of
 complex numbers
In-Reply-To: <1611600350.32.0.540433161176.issue43025@roundup.psfhosted.org>
Message-ID: <1611650292.72.0.815330022287.issue43025@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

See also #10562.

Conceivably, we could add support for `i` on parsing (along with adding `cmath.infi` and `cmath.nanj`). We can probably also find a way to extend the format specification to allow use of `i` in place of `j` on output. The harder problem would be changing the repr and str of complex without breaking existing code. I doubt that the OP would be satisfied with the following:

>>> 3 + 4i
(3+4j)

----------
nosy: +mark.dickinson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43025>
_______________________________________

From report at bugs.python.org  Tue Jan 26 03:39:00 2021
From: report at bugs.python.org (Mark Dickinson)
Date: Tue, 26 Jan 2021 08:39:00 +0000
Subject: [issue43025] Use normal 'i' character to denote imaginary part of
 complex numbers
In-Reply-To: <1611600350.32.0.540433161176.issue43025@roundup.psfhosted.org>
Message-ID: <1611650340.09.0.354998239054.issue43025@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

> cmath.nanj

That should be cmath.nani, of course. Sorry.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43025>
_______________________________________

From report at bugs.python.org  Tue Jan 26 03:54:37 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 26 Jan 2021 08:54:37 +0000
Subject: [issue42985] AMD64 Arch Linux Asan 3.x fails: command timed out: 1200
 seconds without output
In-Reply-To: <1611177482.17.0.749354598383.issue42985@roundup.psfhosted.org>
Message-ID: <1611651277.22.0.120933880603.issue42985@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Pablo added ASAN_OPTIONS=handle_segv=0 env var to his buildbot worker:
https://github.com/python/buildmaster-config/commit/3ae3e1b21a20a06628a225579174e2aa46830583

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42985>
_______________________________________

From report at bugs.python.org  Tue Jan 26 04:00:44 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 26 Jan 2021 09:00:44 +0000
Subject: [issue42985] AMD64 Arch Linux Asan 3.x fails: command timed out: 1200
 seconds without output
In-Reply-To: <1611177482.17.0.749354598383.issue42985@roundup.psfhosted.org>
Message-ID: <1611651644.92.0.119780299794.issue42985@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> The AMD64 Arch Linux Asan 3.x buildbot worker started to fail at build 262:
> https://buildbot.python.org/all/#/builders/582/builds/262

It no longer fails, so I close the issue:
https://buildbot.python.org/all/#/builders/582/builds/278

----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42985>
_______________________________________

From report at bugs.python.org  Tue Jan 26 04:22:27 2021
From: report at bugs.python.org (Tadek Kijkowski)
Date: Tue, 26 Jan 2021 09:22:27 +0000
Subject: [issue42973] argparse: mixing optional and positional arguments...
 not again
In-Reply-To: <1611094894.69.0.476759327253.issue42973@roundup.psfhosted.org>
Message-ID: <1611652947.39.0.0205122048678.issue42973@roundup.psfhosted.org>


Tadek Kijkowski <tkijkowski at gmail.com> added the comment:

>> In the docs fruits example, though, I think the input and output are inconsistent: you have a brown banana reported as yellow?

Yeah, I noticed that and fixed already :)


I agree with your ideas. My goal was just to provide bare minimum that would allow users to implement this functionality on their own, but turning it into something useful out of the box sounds like a good idea.

There could be new predefined action, e.g. 'extend_with_capture' (or just 'extend_capture') which could be used like this:

  parser.add_argument('fruits', nargs='*', action='extend_capture', capture_once=['color'])

Where 'capture' would be one of: a list of parameters to capture (could be a string instead of a list if it's just one parameter) or '*' to capture all optional parameters and 'capture_once' would be similar list of parameters to capture and reset to default.

>> Does the namespace still contain the default value for an optional after it has been used?  It looks like it might

I think it does - not the namespace, but ArgumentParser, which is also available in Action.__call__, has 'get_defaults'.

>> I'm not sure how that plays with optionals that use append or append_const storage methods, nor do I fully understand the comment in "def _copy_items(items):"

I don't see any danger here, the action will just have to make sure to capture copy of the array, rather than reference to it. The same applies to 'extend'.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42973>
_______________________________________

From report at bugs.python.org  Tue Jan 26 04:30:56 2021
From: report at bugs.python.org (Denis Roussel)
Date: Tue, 26 Jan 2021 09:30:56 +0000
Subject: [issue43029] unittest: Add assertUniqeIn
Message-ID: <1611653456.39.0.201138075595.issue43029@roundup.psfhosted.org>


New submission from Denis Roussel <roussel2nis at gmail.com>:

Allows to test uniqueness of members of a list

----------
components: Tests
messages: 385700
nosy: rousseldenis
priority: normal
severity: normal
status: open
title: unittest: Add assertUniqeIn

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43029>
_______________________________________

From report at bugs.python.org  Tue Jan 26 04:31:24 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 26 Jan 2021 09:31:24 +0000
Subject: [issue38250] enum.Flag should be more set-like
In-Reply-To: <1569150842.66.0.799345616323.issue38250@roundup.psfhosted.org>
Message-ID: <1611653484.94.0.618649216134.issue38250@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

test_enum fails when Python is installed:

PPC64LE Fedora Rawhide Clang Installed 3.x:
https://buildbot.python.org/all/#builders/312/builds/597

0:01:37 load avg: 8.99 [232/426/1] test_enum failed -- running: test_tokenize (1 min 37 sec), test_unparse (31.7 sec), test_concurrent_futures (37.5 sec)
Failed to call load_tests:
Traceback (most recent call last):
  File "/home/buildbot/buildarea/3.x.cstratak-fedora-rawhide-ppc64le.clang-installed/build/target/lib/python3.10/unittest/loader.py", line 130, in loadTestsFromModule
    return load_tests(self, tests, pattern)
  File "/home/buildbot/buildarea/3.x.cstratak-fedora-rawhide-ppc64le.clang-installed/build/target/lib/python3.10/test/test_enum.py", line 20, in load_tests
    tests.addTests(doctest.DocFileSuite(
  File "/home/buildbot/buildarea/3.x.cstratak-fedora-rawhide-ppc64le.clang-installed/build/target/lib/python3.10/doctest.py", line 2511, in DocFileSuite
    suite.addTest(DocFileTest(path, **kw))
  File "/home/buildbot/buildarea/3.x.cstratak-fedora-rawhide-ppc64le.clang-installed/build/target/lib/python3.10/doctest.py", line 2433, in DocFileTest
    doc, path = _load_testfile(path, package, module_relative,
  File "/home/buildbot/buildarea/3.x.cstratak-fedora-rawhide-ppc64le.clang-installed/build/target/lib/python3.10/doctest.py", line 231, in _load_testfile
    file_contents = loader.get_data(filename)
  File "<frozen importlib._bootstrap_external>", line 1023, in get_data
FileNotFoundError: [Errno 2] No such file or directory: '/home/buildbot/buildarea/3.x.cstratak-fedora-rawhide-ppc64le.clang-installed/build/target/lib/python3.10/test/../../Doc/library/enum.rst'

test test_enum crashed -- Traceback (most recent call last):
  File "/home/buildbot/buildarea/3.x.cstratak-fedora-rawhide-ppc64le.clang-installed/build/target/lib/python3.10/test/libregrtest/runtest.py", line 272, in _runtest_inner
    refleak = _runtest_inner2(ns, test_name)
  File "/home/buildbot/buildarea/3.x.cstratak-fedora-rawhide-ppc64le.clang-installed/build/target/lib/python3.10/test/libregrtest/runtest.py", line 236, in _runtest_inner2
    test_runner()
  File "/home/buildbot/buildarea/3.x.cstratak-fedora-rawhide-ppc64le.clang-installed/build/target/lib/python3.10/test/libregrtest/runtest.py", line 210, in _test_module
    raise Exception("errors while loading tests")
Exception: errors while loading tests


Tests are loaded by Lib/test/test_enum.py with:

def load_tests(loader, tests, ignore):
    tests.addTests(doctest.DocTestSuite(enum))
    tests.addTests(doctest.DocFileSuite(
            '../../Doc/library/enum.rst',
            optionflags=doctest.ELLIPSIS|doctest.NORMALIZE_WHITESPACE,
            ))
    return tests

----------
nosy: +vstinner
resolution: fixed -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38250>
_______________________________________

From report at bugs.python.org  Tue Jan 26 04:31:44 2021
From: report at bugs.python.org (Denis Roussel)
Date: Tue, 26 Jan 2021 09:31:44 +0000
Subject: [issue43029] unittest: Add assertUniqeIn
In-Reply-To: <1611653456.39.0.201138075595.issue43029@roundup.psfhosted.org>
Message-ID: <1611653504.22.0.979357048972.issue43029@roundup.psfhosted.org>


Change by Denis Roussel <roussel2nis at gmail.com>:


----------
keywords: +patch
pull_requests: +23154
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24336

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43029>
_______________________________________

From report at bugs.python.org  Tue Jan 26 04:56:36 2021
From: report at bugs.python.org (John Mark Vandenberg)
Date: Tue, 26 Jan 2021 09:56:36 +0000
Subject: [issue12734] Request for property support in Python re lib
In-Reply-To: <1313093654.08.0.307115391635.issue12734@psf.upfronthosting.co.za>
Message-ID: <1611654996.22.0.263059481797.issue12734@roundup.psfhosted.org>


Change by John Mark Vandenberg <jayvdb at gmail.com>:


----------
nosy: +jayvdb

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue12734>
_______________________________________

From report at bugs.python.org  Tue Jan 26 05:06:16 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 26 Jan 2021 10:06:16 +0000
Subject: [issue43025] Use normal 'i' character to denote imaginary part of
 complex numbers
In-Reply-To: <1611600350.32.0.540433161176.issue43025@roundup.psfhosted.org>
Message-ID: <1611655576.29.0.697682364364.issue43025@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Only yesterday I thought about proposing this idea. I used to think using "i" or "j" was a type of local feature, like using a comma or a period as a decimal separator, or different writing for less-or-equal, but it looks like even in the English-speaking world mathematics use "i", and "j" is only used by electric engineers.

Possible argument against the "i" suffix is that its capital form "I" can be confused with the "l" suffix for longs (but it is no longer applicable in Python 3) and digit "1". Although there is more similarity between "l" and "1" them between them both and "I", and there are other pairs of potentially confusing characters: "O" (for octals) and "0", "B" (for binaries) and "8".

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43025>
_______________________________________

From report at bugs.python.org  Tue Jan 26 05:17:17 2021
From: report at bugs.python.org (Mark Shannon)
Date: Tue, 26 Jan 2021 10:17:17 +0000
Subject: [issue33387] Simplify bytecodes for try-finally,
 try-except and with blocks.
In-Reply-To: <1525026522.22.0.682650639539.issue33387@psf.upfronthosting.co.za>
Message-ID: <1611656237.71.0.790487235259.issue33387@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:


New changeset dea5bf9d15999bfcc58095b157c0678d45b00bdd by Irit Katriel in branch 'master':
bpo-33387: update documentation for exception handling opcode changes (GH-24334)
https://github.com/python/cpython/commit/dea5bf9d15999bfcc58095b157c0678d45b00bdd


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33387>
_______________________________________

From report at bugs.python.org  Tue Jan 26 05:27:14 2021
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 26 Jan 2021 10:27:14 +0000
Subject: [issue33387] Simplify bytecodes for try-finally,
 try-except and with blocks.
In-Reply-To: <1525026522.22.0.682650639539.issue33387@psf.upfronthosting.co.za>
Message-ID: <1611656834.39.0.531766743668.issue33387@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33387>
_______________________________________

From report at bugs.python.org  Tue Jan 26 05:33:18 2021
From: report at bugs.python.org (Mark Dickinson)
Date: Tue, 26 Jan 2021 10:33:18 +0000
Subject: [issue43025] Use normal 'i' character to denote imaginary part of
 complex numbers
In-Reply-To: <1611600350.32.0.540433161176.issue43025@roundup.psfhosted.org>
Message-ID: <1611657198.03.0.971241070202.issue43025@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

Serhiy: what *specific* proposal were you considering? If your proposal includes changing the complex str/repr to use "i" instead of "j", how do you propose to address the backwards compatibility problem?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43025>
_______________________________________

From report at bugs.python.org  Tue Jan 26 06:10:13 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 26 Jan 2021 11:10:13 +0000
Subject: [issue43025] Use normal 'i' character to denote imaginary part of
 complex numbers
In-Reply-To: <1611600350.32.0.540433161176.issue43025@roundup.psfhosted.org>
Message-ID: <1611659413.02.0.155896060818.issue43025@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Just making the parser (and the complex constructor) recognizing "i" as well as "j" as complex number suffix. Others already proposed more complex changes like adding options for formatting complex numbers, but I did not though about it. It is just a coincidence that I though about this idea in the same day as the OP opened the issue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43025>
_______________________________________

From report at bugs.python.org  Tue Jan 26 06:10:22 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 26 Jan 2021 11:10:22 +0000
Subject: [issue43025] Use normal 'i' character to denote imaginary part of
 complex numbers
In-Reply-To: <1611600350.32.0.540433161176.issue43025@roundup.psfhosted.org>
Message-ID: <1611659422.2.0.808684411534.issue43025@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
versions: +Python 3.10 -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43025>
_______________________________________

From report at bugs.python.org  Tue Jan 26 06:20:53 2021
From: report at bugs.python.org (Alexey Izbyshev)
Date: Tue, 26 Jan 2021 11:20:53 +0000
Subject: [issue42606] Support POSIX atomicity guarantee of O_APPEND on Windows
In-Reply-To: <1607483566.95.0.1927829703.issue42606@roundup.psfhosted.org>
Message-ID: <1611660053.85.0.382827635524.issue42606@roundup.psfhosted.org>


Alexey Izbyshev <izbyshev at ispras.ru> added the comment:

> I think truncation via TRUNCATE_EXISTING (O_TRUNC, with O_WRONLY or O_RDWR) or overwriting with CREATE_ALWAYS (O_CREAT | O_TRUNC) is at least tolerable because the caller doesn't care about the existing data. 

Yes, I had a thought that creating or truncating a file when asked is in some sense "less wrong" than deleting an existing file on open() failure, but I'm still not comfortable with it. It would be nice, for example, if an open() with O_CREAT | O_EXCL failed, then the file would indeed not be created in all cases.

>> Truncation can simply be deferred until we have the fd and then performed manually.

> If the file itself has to be overwritten (i.e. the default, anonymous data stream), as opposed to a named data stream, it would have to delete all named data streams and extended attributes in the file. Normally that's all implemented atomically in the filesystem. 

> In contrast, TRUNCATE_EXISTING (O_TRUNC) is simple to emulate, since CreateFileW implents it non-atomically with a subsequent NtSetInformationFile: FileAllocationInformation system call. 

Oh. So CREATE_ALWAYS for an existing file has a very different semantics than TRUNCATE_EXISTING, which means we can't easily use OPEN_ALWAYS with a deferred manual truncation, I see.

>> But I still don't know how to deal with O_TEMPORARY, unless there is a 
>> way to unset FILE_DELETE_ON_CLOSE on a handle.

> For now, that's possible with NTFS and the Windows API in all supported versions of Windows by using a second kernel File with DELETE access, which is opened before the last handle to the first kernel File is closed. After you close the first open, use the second one to call SetFileInformation: FileDispositionInfo to undelete the file.

So the idea is to delete the file for a brief period, but then undelete it. As I understand it, any attempt to open the file while it's in the deleted state (but still has a directory entry) will fail. This is probably not critical since it could happen only on an unlikely failure of _open_oshandle(), but is still less than perfect.

> Windows 10 supports additional flags with FileDispositionInfoEx (21), or NTAPI FileDispositionInformationEx [1]. This provides a better way to disable or modify the delete-on-close state per kernel File object, if the filesystem supports it.

This is nice and would reduce our non-atomicity to just the following: if _wopen() would have failed even before CreateFile() (e.g. due to EMFILE), our reimplementation could still create a handle with FILE_DELETE_ON_CLOSE, so if our process is terminated before we unset it, we'll still lose the file. But it seems like the best we can get in any situation when we need to wrap a handle with an fd.

===

Regarding using WriteFile()-with-OVERLAPPED approach in FileIO, I've looked at edge cases of error remapping in MSVCRT write() again. If the underlying WriteFile() fails, it only remaps ERROR_ACCESS_DENIED to EBADF, presumably to deal with write() on a O_RDONLY fd. But if WriteFile() writes zero bytes and does not fail, it gets more interesting:

* If the file type is FILE_TYPE_CHAR and the first byte to write was 26 (Ctrl-Z), it's treated as success. I don't think I understand: it *seems* like it's handling something like writing to the *input* of a console, but I'm not sure it's even possible in this manner.

* Anything else is a failure with ENOSPC. This is mysterious too.

I've checked how java.io.FileOutputStream deals with WriteFile() succeeding with zero size (just to compare with another language runtime) and haven't found any special handling[1]. Moreover, it seems like FileOutputStream.write(bytes[]) will enter an infinite loop if WriteFile() always returns 0 for a non-empty byte array[2]. So it's unclear to me what MSVCRT is up to here and whether FileIO should do the same.

[1] https://github.com/openjdk/jdk/blob/b4ace3e9799dab5970d84094a0fd1b2d64c7f923/src/java.base/windows/native/libjava/io_util_md.c#L522
[2] https://github.com/openjdk/jdk/blob/b4ace3e9799dab5970d84094a0fd1b2d64c7f923/src/java.base/share/native/libjava/io_util.c#L195

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42606>
_______________________________________

From report at bugs.python.org  Tue Jan 26 07:40:22 2021
From: report at bugs.python.org (Matthias Klose)
Date: Tue, 26 Jan 2021 12:40:22 +0000
Subject: [issue43030] signed/unsigned mismatch in Py_UNICODE_ISSPACE macro
Message-ID: <1611664822.48.0.67078426677.issue43030@roundup.psfhosted.org>


New submission from Matthias Klose <doko at debian.org>:

[forwarded from https://bugs.debian.org/961396]

$ cat > foo.c
#include <Python.h>

int main(int argc, char *argv[])
{
        Py_UNICODE x = 0;

        return Py_UNICODE_ISSPACE(x);
}

$ gcc -Wsign-compare -Werror $(pkg-config --cflags python3) foo.c
In file included from /usr/include/python3.9/unicodeobject.h:1026,
                 from /usr/include/python3.9/Python.h:97,
                 from foo.c:1:
foo.c: In function ?main?:
/usr/include/python3.9/cpython/unicodeobject.h:25:11: error: comparison of integer expressions of different signedness: ?Py_UNICODE? {aka ?int?} and ?unsigned int? [-Werror=sign-compare]
   25 |     ((ch) < 128U ? _Py_ascii_whitespace[(ch)] : _PyUnicode_IsWhitespace(ch))
      |           ^
foo.c:7:16: note: in expansion of macro ?Py_UNICODE_ISSPACE?
    7 |         return Py_UNICODE_ISSPACE(x);
      |                ^~~~~~~~~~~~~~~~~~
cc1: all warnings being treated as errors

----------
components: Extension Modules
messages: 385707
nosy: doko
priority: normal
severity: normal
status: open
title: signed/unsigned mismatch in Py_UNICODE_ISSPACE macro
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43030>
_______________________________________

From report at bugs.python.org  Tue Jan 26 07:50:36 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 26 Jan 2021 12:50:36 +0000
Subject: [issue43030] signed/unsigned mismatch in Py_UNICODE_ISSPACE macro
In-Reply-To: <1611664822.48.0.67078426677.issue43030@roundup.psfhosted.org>
Message-ID: <1611665436.67.0.193852057215.issue43030@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> ?Py_UNICODE? {aka ?int?}

Python defines Py_UNICODE as wchar_t: typedef wchar_t Py_UNICODE;

Is wchar_t signed (int type) on Debian? Which is your architecture?

> [forwarded from https://bugs.debian.org/961396]

It says amd64.

----------
nosy: +methane, vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43030>
_______________________________________

From report at bugs.python.org  Tue Jan 26 08:01:32 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 26 Jan 2021 13:01:32 +0000
Subject: [issue42988] Information disclosure via pydoc -p: /getfile?key=path
 allows to read arbitrary file on the filesystem
In-Reply-To: <1611231517.86.0.296188996897.issue42988@roundup.psfhosted.org>
Message-ID: <1611666092.96.0.112817805487.issue42988@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +23156
pull_request: https://github.com/python/cpython/pull/24337

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42988>
_______________________________________

From report at bugs.python.org  Tue Jan 26 08:02:54 2021
From: report at bugs.python.org (Mark Dickinson)
Date: Tue, 26 Jan 2021 13:02:54 +0000
Subject: [issue43025] Use normal 'i' character to denote imaginary part of
 complex numbers
In-Reply-To: <1611600350.32.0.540433161176.issue43025@roundup.psfhosted.org>
Message-ID: <1611666174.13.0.901360551249.issue43025@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

[Serhiy]

> Just making the parser [...] recognizing "i" as well as "j" as complex number suffix.

Okay, thanks. I doubt that that will be enough to silence the repeated requests: people are still going to complain that the value that was entered as `1i` is being displayed as `1j`. I don't see a sane path towards changing that.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43025>
_______________________________________

From report at bugs.python.org  Tue Jan 26 08:04:03 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 26 Jan 2021 13:04:03 +0000
Subject: [issue42988] Information disclosure via pydoc -p: /getfile?key=path
 allows to read arbitrary file on the filesystem
In-Reply-To: <1611231517.86.0.296188996897.issue42988@roundup.psfhosted.org>
Message-ID: <1611666243.05.0.11488880272.issue42988@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

PR 24337 uses different approach. It keeps compatibility, but checks that the argument is a file path of the source of one of modules (using the same algorithm as /search).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42988>
_______________________________________

From report at bugs.python.org  Tue Jan 26 08:06:26 2021
From: report at bugs.python.org (Matthias Klose)
Date: Tue, 26 Jan 2021 13:06:26 +0000
Subject: [issue43030] signed/unsigned mismatch in Py_UNICODE_ISSPACE macro
In-Reply-To: <1611664822.48.0.67078426677.issue43030@roundup.psfhosted.org>
Message-ID: <1611666386.42.0.287919808704.issue43030@roundup.psfhosted.org>


Matthias Klose <doko at debian.org> added the comment:

# 26 "/usr/include/stdlib.h" 2 3 4
# 1 "/usr/lib/gcc/x86_64-linux-gnu/10/include/stddef.h" 1 3 4
# 321 "/usr/lib/gcc/x86_64-linux-gnu/10/include/stddef.h" 3 4
typedef int wchar_t;
# 32 "/usr/include/stdlib.h" 2 3 4

[...]

# 1 "/usr/include/python3.9/cpython/unicodeobject.h" 1
# 14 "/usr/include/python3.9/cpython/unicodeobject.h"
                         typedef wchar_t Py_UNICODE;
# 53 "/usr/include/python3.9/cpython/unicodeobject.h"

yes, x86_64-linux-gnu.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43030>
_______________________________________

From report at bugs.python.org  Tue Jan 26 08:46:19 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 26 Jan 2021 13:46:19 +0000
Subject: [issue43031] aarch64 RHEL7 LTO + PGO 3.7: "make" hangs when running
 test_asyncio
Message-ID: <1611668779.87.0.585376079425.issue43031@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at python.org>:

test_asyncio hangs randomly on Python 3.7 on aarch64 RHEL7 LTO + PGO 3.7. The symptom is a failed build failing with:

   retry lost connection compile (retry)

Full error:

   remoteFailed: [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionLost'>: Connection to the other side was lost in a non-clean fashion.

Example of failed build:

   https://buildbot.python.org/all/#/builders/42/builds/4703

Configure command:

   ./configure --prefix '$(PWD)/target' --with-lto --enable-optimizations

Compile command:

   make -j10 all

End of the make output:
--------
make run_profile_task
make[1]: Entering directory `/home/buildbot/buildarea/3.7.cstratak-RHEL7-aarch64.lto-pgo/build'
./python -m test.regrtest --pgo || true
0:00:00 load avg: 1.07 Run tests sequentially
0:00:00 load avg: 1.07 [  1/416] test_grammar
(...)
0:01:40 load avg: 1.07 [ 24/416] test_asynchat
0:01:42 load avg: 1.07 [ 25/416] test_asyncio

remoteFailed: [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionLost'>: Connection to the other side was lost in a non-clean fashion.
]
--------

I ran manually "./configure --prefix '$(PWD)/target' --with-lto --enable-optimizations && make -j10 all" twice on the worker directly, but test_asyncio passed successfully (I tried it twice).

----------
components: Tests
messages: 385712
nosy: vstinner
priority: normal
severity: normal
status: open
title: aarch64 RHEL7 LTO + PGO 3.7: "make" hangs when running test_asyncio
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43031>
_______________________________________

From report at bugs.python.org  Tue Jan 26 08:46:44 2021
From: report at bugs.python.org (Robert)
Date: Tue, 26 Jan 2021 13:46:44 +0000
Subject: [issue43032] Size of pie chart in matplotlib (frame affects it)
Message-ID: <1611668804.53.0.845816677703.issue43032@roundup.psfhosted.org>


New submission from Robert <r.rauterkus at posteo.net>:

Hi all.

Is it an issue or on purpose that enabling and disabling the frame in plt.pie() results in different sized pie charts? In my opinion the code below should provide identical sized charts. If it is on purpose, can you give me a reference? I am using the conda version of pyhton but colleagues experience the same behavior.

import matplotlib.pyplot as plt
f = plt.figure(figsize=(10,5),dpi=300)
ax1 = f.add_axes([0,0,0.5,1])
ax2 = f.add_axes([0.5,0,0.5,1])
ax1.pie([180,180],center=(0.5,0.5),radius=0.5,frame=False)
ax2.pie([180,180],center=(0.5,0.5),radius=0.5,frame=True)
plt.show()

----------
messages: 385713
nosy: twisterior
priority: normal
severity: normal
status: open
title: Size of pie chart in matplotlib (frame affects it)
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43032>
_______________________________________

From report at bugs.python.org  Tue Jan 26 08:49:37 2021
From: report at bugs.python.org (Mark Dickinson)
Date: Tue, 26 Jan 2021 13:49:37 +0000
Subject: [issue43032] Size of pie chart in matplotlib (frame affects it)
In-Reply-To: <1611668804.53.0.845816677703.issue43032@roundup.psfhosted.org>
Message-ID: <1611668977.07.0.616001909428.issue43032@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

Wrong tracker, I'm afraid. This tracker is for the Python core language. Try https://github.com/matplotlib/matplotlib/issues

----------
nosy: +mark.dickinson
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43032>
_______________________________________

From report at bugs.python.org  Tue Jan 26 08:49:35 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 26 Jan 2021 13:49:35 +0000
Subject: [issue42988] Information disclosure via pydoc -p: /getfile?key=path
 allows to read arbitrary file on the filesystem
In-Reply-To: <1611231517.86.0.296188996897.issue42988@roundup.psfhosted.org>
Message-ID: <1611668975.95.0.135664441932.issue42988@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +23157
pull_request: https://github.com/python/cpython/pull/24339

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42988>
_______________________________________

From report at bugs.python.org  Tue Jan 26 08:50:54 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 26 Jan 2021 13:50:54 +0000
Subject: [issue42988] Information disclosure via pydoc -p: /getfile?key=path
 allows to read arbitrary file on the filesystem
In-Reply-To: <1611231517.86.0.296188996897.issue42988@roundup.psfhosted.org>
Message-ID: <1611669054.89.0.860437933359.issue42988@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests:  -23157

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42988>
_______________________________________

From report at bugs.python.org  Tue Jan 26 08:51:11 2021
From: report at bugs.python.org (Ronald Oussoren)
Date: Tue, 26 Jan 2021 13:51:11 +0000
Subject: [issue42504] Failure to build with MACOSX_DEPLOYMENT_TARGET=11 on Big
 Sur
In-Reply-To: <1606662964.61.0.531913261121.issue42504@roundup.psfhosted.org>
Message-ID: <1611669071.14.0.0554890079076.issue42504@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

I will create a PR later today, I've already committed the work in a branch of my clone of cpython.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42504>
_______________________________________

From report at bugs.python.org  Tue Jan 26 08:51:19 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 26 Jan 2021 13:51:19 +0000
Subject: [issue43031] aarch64 RHEL7 LTO + PGO 3.7: "make" hangs when running
 test_asyncio
In-Reply-To: <1611668779.87.0.585376079425.issue43031@roundup.psfhosted.org>
Message-ID: <1611669079.81.0.538635486157.issue43031@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
keywords: +patch
pull_requests: +23158
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24339

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43031>
_______________________________________

From report at bugs.python.org  Tue Jan 26 08:51:19 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 26 Jan 2021 13:51:19 +0000
Subject: [issue42988] Information disclosure via pydoc -p: /getfile?key=path
 allows to read arbitrary file on the filesystem
In-Reply-To: <1611231517.86.0.296188996897.issue42988@roundup.psfhosted.org>
Message-ID: <1611669079.88.0.446933988813.issue42988@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +23159
pull_request: https://github.com/python/cpython/pull/24339

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42988>
_______________________________________

From report at bugs.python.org  Tue Jan 26 08:54:04 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 26 Jan 2021 13:54:04 +0000
Subject: [issue43031] aarch64 RHEL7 LTO + PGO 3.7: "make" hangs when running
 test_asyncio
In-Reply-To: <1611668779.87.0.585376079425.issue43031@roundup.psfhosted.org>
Message-ID: <1611669244.15.0.746883845386.issue43031@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Python 3.7 no longer accept bugfixes, only security fixes:
https://devguide.python.org/#status-of-python-branches

Maybe we should just remove this PGO worker (but keep other Python 3.7 workers).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43031>
_______________________________________

From report at bugs.python.org  Tue Jan 26 09:10:10 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 26 Jan 2021 14:10:10 +0000
Subject: [issue42988] Information disclosure via pydoc -p: /getfile?key=path
 allows to read arbitrary file on the filesystem
In-Reply-To: <1611231517.86.0.296188996897.issue42988@roundup.psfhosted.org>
Message-ID: <1611670210.04.0.00863362287795.issue42988@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests:  -23159

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42988>
_______________________________________

From report at bugs.python.org  Tue Jan 26 09:23:37 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 26 Jan 2021 14:23:37 +0000
Subject: [issue40692] Adjust test_concurrent_futures to run more of its tests
 if multiprocessing.synchronize is missing
In-Reply-To: <1589922464.68.0.792694033918.issue40692@roundup.psfhosted.org>
Message-ID: <1611671017.47.0.788986780124.issue40692@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Is there any update on this issue? If not, I suggest to close it. It doesn't seem to consider enough people and nobody seems to want to implement it.

See also: https://github.com/python/buildmaster-config/issues/203

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40692>
_______________________________________

From report at bugs.python.org  Tue Jan 26 09:39:12 2021
From: report at bugs.python.org (Ronald Oussoren)
Date: Tue, 26 Jan 2021 14:39:12 +0000
Subject: [issue42504] Failure to build with MACOSX_DEPLOYMENT_TARGET=11 on Big
 Sur
In-Reply-To: <1606662964.61.0.531913261121.issue42504@roundup.psfhosted.org>
Message-ID: <1611671952.21.0.594989018277.issue42504@roundup.psfhosted.org>


Change by Ronald Oussoren <ronaldoussoren at mac.com>:


----------
pull_requests: +23160
pull_request: https://github.com/python/cpython/pull/24341

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42504>
_______________________________________

From report at bugs.python.org  Tue Jan 26 09:39:49 2021
From: report at bugs.python.org (Ronald Oussoren)
Date: Tue, 26 Jan 2021 14:39:49 +0000
Subject: [issue42504] Failure to build with MACOSX_DEPLOYMENT_TARGET=11 on Big
 Sur
In-Reply-To: <1606662964.61.0.531913261121.issue42504@roundup.psfhosted.org>
Message-ID: <1611671989.96.0.283929005838.issue42504@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

see PR 24341.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42504>
_______________________________________

From report at bugs.python.org  Tue Jan 26 10:07:32 2021
From: report at bugs.python.org (Carlton Gibson)
Date: Tue, 26 Jan 2021 15:07:32 +0000
Subject: [issue42775] __init_subclass__ should be called in __init__
In-Reply-To: <1609211209.61.0.873859112725.issue42775@roundup.psfhosted.org>
Message-ID: <1611673652.12.0.88733668161.issue42775@roundup.psfhosted.org>


Change by Carlton Gibson <carlton.gibson at noumenal.es>:


----------
nosy: +carltongibson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42775>
_______________________________________

From report at bugs.python.org  Tue Jan 26 10:08:51 2021
From: report at bugs.python.org (Ken Hilton)
Date: Tue, 26 Jan 2021 15:08:51 +0000
Subject: [issue43008] IDLE ignores sys.excepthook in normal, subprocess mode
In-Reply-To: <1611401446.12.0.0532585832167.issue43008@roundup.psfhosted.org>
Message-ID: <1611673731.43.0.293937688037.issue43008@roundup.psfhosted.org>


Ken Hilton <kenny2minecraft at gmail.com> added the comment:

CLA registers as signed now.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43008>
_______________________________________

From report at bugs.python.org  Tue Jan 26 10:49:51 2021
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Tue, 26 Jan 2021 15:49:51 +0000
Subject: [issue42997] Improve error message for missing : before suites
In-Reply-To: <1611278405.38.0.0749709348669.issue42997@roundup.psfhosted.org>
Message-ID: <1611676191.35.0.603377413112.issue42997@roundup.psfhosted.org>


Lysandros Nikolaou <lisandrosnik at gmail.com> added the comment:

I propose to go with the first approach. I really like that and I can see us using it in various place in the future. It's basically a positive lookahead with a cut, but the extra feature that it raises a SyntaxError, right?

I'll have a look at the PR now.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42997>
_______________________________________

From report at bugs.python.org  Tue Jan 26 10:52:43 2021
From: report at bugs.python.org (Ken Jin)
Date: Tue, 26 Jan 2021 15:52:43 +0000
Subject: [issue42988] Information disclosure via pydoc -p: /getfile?key=path
 allows to read arbitrary file on the filesystem
In-Reply-To: <1611231517.86.0.296188996897.issue42988@roundup.psfhosted.org>
Message-ID: <1611676363.22.0.936567299603.issue42988@roundup.psfhosted.org>


Ken Jin <kenjin4096 at gmail.com> added the comment:

@Serhiy,

While this approach solves the getfile problem, I don't think this will solve the other problem of pydoc leaking secrets stored in python files:

Quoting from Marc-Andre Lemburg's message:
> the tool also makes available all Python modules which can be found on sys.path of the user starting pydoc -p. It shows all doc-strings, functions, the class structure and literal values of any constants found in those modules.
> In a corporate environment this can easily result in data leaks of e.g. unreleased software, personal information, disclosure of NDA protected code, designs, algorithms and other secrets.

Quoting from Victor's messages:
> pydoc shows global constant values in the doc. So yes, if you find a settings.py of a Django project, you can discover secrets.

Ultimately, the problem seems to be that .py files (other than those in the stdlib) may contain sensitive info, which pydoc can read.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42988>
_______________________________________

From report at bugs.python.org  Tue Jan 26 10:58:27 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 26 Jan 2021 15:58:27 +0000
Subject: [issue42383] Pdb does not correclty restart the target if it changes
 the current directory
In-Reply-To: <1605597991.66.0.0396733980212.issue42383@roundup.psfhosted.org>
Message-ID: <1611676707.05.0.889554373285.issue42383@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:


New changeset f8cfe54e5a7082edcec74a34b3d7e6afab051afd by Andrey Bienkowski in branch '3.9':
[3.9] bpo-42383: pdb: do not fail to restart the target if the current directory changed (GH-23412) (#24322)
https://github.com/python/cpython/commit/f8cfe54e5a7082edcec74a34b3d7e6afab051afd


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42383>
_______________________________________

From report at bugs.python.org  Tue Jan 26 10:58:37 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 26 Jan 2021 15:58:37 +0000
Subject: [issue42383] Pdb does not correclty restart the target if it changes
 the current directory
In-Reply-To: <1605597991.66.0.0396733980212.issue42383@roundup.psfhosted.org>
Message-ID: <1611676717.17.0.512853863312.issue42383@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:


New changeset d863deeff27f00ac33e9f169d23ca56d69af3f86 by Andrey Bienkowski in branch '3.8':
 [3.8] bpo-42383: pdb: do not fail to restart the target if the current directory changed (GH-23412) (#24323)
https://github.com/python/cpython/commit/d863deeff27f00ac33e9f169d23ca56d69af3f86


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42383>
_______________________________________

From report at bugs.python.org  Tue Jan 26 10:58:50 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 26 Jan 2021 15:58:50 +0000
Subject: [issue42383] Pdb does not correclty restart the target if it changes
 the current directory
In-Reply-To: <1605597991.66.0.0396733980212.issue42383@roundup.psfhosted.org>
Message-ID: <1611676730.35.0.500766486893.issue42383@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42383>
_______________________________________

From report at bugs.python.org  Tue Jan 26 10:59:07 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 26 Jan 2021 15:59:07 +0000
Subject: [issue42384] Inconsistent sys.path between python and pdb
In-Reply-To: <1605599201.78.0.619329509169.issue42384@roundup.psfhosted.org>
Message-ID: <1611676747.34.0.0140228813525.issue42384@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42384>
_______________________________________

From report at bugs.python.org  Tue Jan 26 11:19:44 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 26 Jan 2021 16:19:44 +0000
Subject: [issue43031] aarch64 RHEL7 LTO + PGO 3.7: "make" hangs when running
 test_asyncio
In-Reply-To: <1611668779.87.0.585376079425.issue43031@roundup.psfhosted.org>
Message-ID: <1611677984.21.0.173487555594.issue43031@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I created https://github.com/python/buildmaster-config/pull/228 to skip PGO builds on Python 3.7, since test_asyncio hangs on PGO builds.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43031>
_______________________________________

From report at bugs.python.org  Tue Jan 26 11:42:52 2021
From: report at bugs.python.org (Ethan Furman)
Date: Tue, 26 Jan 2021 16:42:52 +0000
Subject: [issue38250] enum.Flag should be more set-like
In-Reply-To: <1569150842.66.0.799345616323.issue38250@roundup.psfhosted.org>
Message-ID: <1611679372.14.0.15765580296.issue38250@roundup.psfhosted.org>


Change by Ethan Furman <ethan at stoneleaf.us>:


----------
pull_requests: +23161
stage: resolved -> patch review
pull_request: https://github.com/python/cpython/pull/24342

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38250>
_______________________________________

From report at bugs.python.org  Tue Jan 26 11:46:27 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 26 Jan 2021 16:46:27 +0000
Subject: [issue42997] Improve error message for missing : before suites
In-Reply-To: <1611278405.38.0.0749709348669.issue42997@roundup.psfhosted.org>
Message-ID: <1611679587.65.0.468156323911.issue42997@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> See also issue1634034.

The problem with issue1634034 is that is not anymore possible without manual changes to the grammar with the PEG parser (or new infrastructure). The new parser does not have a defined concept of "i expected this token and now I am going to hard fail because is not there", but instead it will backtrack and try something else. We also did some work on something similar and we deemed it not useful as it was:

bugs.python.org/issue40599

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42997>
_______________________________________

From report at bugs.python.org  Tue Jan 26 11:47:09 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 26 Jan 2021 16:47:09 +0000
Subject: [issue42997] Improve error message for missing : before suites
In-Reply-To: <1611278405.38.0.0749709348669.issue42997@roundup.psfhosted.org>
Message-ID: <1611679629.57.0.690538009013.issue42997@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> It's basically a positive lookahead with a cut, but the extra feature that it raises a SyntaxError, right?

Yeah, but the cut is "absolute" (because of the syntax Error). IIRC the normal cut only affects that rule, no?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42997>
_______________________________________

From report at bugs.python.org  Tue Jan 26 11:47:56 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 26 Jan 2021 16:47:56 +0000
Subject: [issue42948] bytearray.copy is undocumented
In-Reply-To: <1610908912.39.0.795030432727.issue42948@roundup.psfhosted.org>
Message-ID: <1611679676.48.0.783641247093.issue42948@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
resolution:  -> not a bug

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42948>
_______________________________________

From report at bugs.python.org  Tue Jan 26 12:02:49 2021
From: report at bugs.python.org (paul j3)
Date: Tue, 26 Jan 2021 17:02:49 +0000
Subject: [issue42973] argparse: mixing optional and positional arguments...
 not again
In-Reply-To: <1611094894.69.0.476759327253.issue42973@roundup.psfhosted.org>
Message-ID: <1611680569.42.0.147091924809.issue42973@roundup.psfhosted.org>


paul j3 <ajipanca at gmail.com> added the comment:

I haven't had a chance to study your longer posts, but it seems to me that the AddFruitAction example could just as well be implemented with 

    parser.add_argument('--color', nargs='*', action='append')

with post parsing processing to create the 'fruits' dicts from the appended lists.  

The basic logic of argparse is to accept optionals in any order, and positionals in strict positional order.  'nargs' allows us to pair any number of strings with each optional's flag.

While custom Action classes can implement interactions between arguments based on values in the namespace, it is usually easier to do this after parsing.  

But back to your core change, I wonder if adding a new nargs, such as '**' would be better than than the new parameter 'greedy_star=True'.  I prefer not to add parameters that are hard to document.  At this point in the argparse development, changes should be minimally invasive.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42973>
_______________________________________

From report at bugs.python.org  Tue Jan 26 12:58:49 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 26 Jan 2021 17:58:49 +0000
Subject: [issue41841] idlelib/NEWS.txt for 3.10.0 and backports
In-Reply-To: <1600864292.35.0.268589439404.issue41841@roundup.psfhosted.org>
Message-ID: <1611683929.87.0.651754977279.issue41841@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
pull_requests: +23162
pull_request: https://github.com/python/cpython/pull/24343

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41841>
_______________________________________

From report at bugs.python.org  Tue Jan 26 13:07:10 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 26 Jan 2021 18:07:10 +0000
Subject: [issue41841] idlelib/NEWS.txt for 3.10.0 and backports
In-Reply-To: <1600864292.35.0.268589439404.issue41841@roundup.psfhosted.org>
Message-ID: <1611684430.94.0.0708575596032.issue41841@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
pull_requests: +23163
pull_request: https://github.com/python/cpython/pull/24344

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41841>
_______________________________________

From report at bugs.python.org  Tue Jan 26 13:15:16 2021
From: report at bugs.python.org (Irit Katriel)
Date: Tue, 26 Jan 2021 18:15:16 +0000
Subject: [issue43024] improve signature (in help,
 etc) for functions taking sentinel defaults
In-Reply-To: <1611587640.53.0.195201731083.issue43024@roundup.psfhosted.org>
Message-ID: <1611684916.05.0.483417845627.issue43024@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
nosy: +ZackerySpytz, pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43024>
_______________________________________

From report at bugs.python.org  Tue Jan 26 13:18:09 2021
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Tue, 26 Jan 2021 18:18:09 +0000
Subject: [issue42997] Improve error message for missing : before suites
In-Reply-To: <1611278405.38.0.0749709348669.issue42997@roundup.psfhosted.org>
Message-ID: <1611685089.41.0.218002573628.issue42997@roundup.psfhosted.org>


Lysandros Nikolaou <lisandrosnik at gmail.com> added the comment:

> Yeah, but the cut is "absolute" (because of the syntax Error). IIRC the normal cut only affects that rule, no?

Right.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42997>
_______________________________________

From report at bugs.python.org  Tue Jan 26 13:28:40 2021
From: report at bugs.python.org (Austin Lamb)
Date: Tue, 26 Jan 2021 18:28:40 +0000
Subject: [issue42825] Build libraries with "/OPT:REF" linker optimization on
 Windows
In-Reply-To: <1609782160.13.0.0224895080942.issue42825@roundup.psfhosted.org>
Message-ID: <1611685720.33.0.904843941333.issue42825@roundup.psfhosted.org>


Austin Lamb <austin.lamb at microsoft.com> added the comment:

I don't know much about how ctypes exposes stuff - are these exposed as DLL exports?  Or if not, how do they get exposed?

The linker will remove things it can't find a callsite for, but it leaves in exported functions as of course those are by definition externally callable.  If ctypes is called another way, I can help confirm whether anything is accidentally being stripped out.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42825>
_______________________________________

From report at bugs.python.org  Tue Jan 26 13:59:27 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 26 Jan 2021 18:59:27 +0000
Subject: [issue41841] idlelib/NEWS.txt for 3.10.0 and backports
In-Reply-To: <1600864292.35.0.268589439404.issue41841@roundup.psfhosted.org>
Message-ID: <1611687567.55.0.833952401576.issue41841@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset fd668bc62b7f6de95448344b6650e1c3c2a997fa by Terry Jan Reedy in branch '3.9':
[3.9] bpo-41841: Prepare IDLE NEWS for 3.9.2 (#GH-4343)
https://github.com/python/cpython/commit/fd668bc62b7f6de95448344b6650e1c3c2a997fa


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41841>
_______________________________________

From report at bugs.python.org  Tue Jan 26 13:59:50 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 26 Jan 2021 18:59:50 +0000
Subject: [issue41841] idlelib/NEWS.txt for 3.10.0 and backports
In-Reply-To: <1600864292.35.0.268589439404.issue41841@roundup.psfhosted.org>
Message-ID: <1611687590.93.0.745595465404.issue41841@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset a178473dd6a3b527a67ab3f9dc38ef8b1a60881a by Terry Jan Reedy in branch '3.8':
[3.8] bpo-41841: Prepare IDLE NEWS for 3.8.8 (GH-24344)
https://github.com/python/cpython/commit/a178473dd6a3b527a67ab3f9dc38ef8b1a60881a


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41841>
_______________________________________

From report at bugs.python.org  Tue Jan 26 14:56:14 2021
From: report at bugs.python.org (Glenn Linderman)
Date: Tue, 26 Jan 2021 19:56:14 +0000
Subject: [issue42973] argparse: mixing optional and positional arguments...
 not again
In-Reply-To: <1611094894.69.0.476759327253.issue42973@roundup.psfhosted.org>
Message-ID: <1611690974.66.0.286979817742.issue42973@roundup.psfhosted.org>


Glenn Linderman <v+python at g.nevcal.com> added the comment:

This sounds very good to me.  Might also want action='store_capture' for a single positional definition?

capture could be a string, or any iterable of strings (tuple comes to mind)

capture_once have similar value as capture, but I wonder if the naming would be better as capture_reset to indicate the value is reset to default, rather than just captured.


Tadek said:
There could be new predefined action, e.g. 'extend_with_capture' (or just 'extend_capture') which could be used like this:

  parser.add_argument('fruits', nargs='*', action='extend_capture', capture_once=['color'])

Where 'capture' would be one of: a list of parameters to capture (could be a string instead of a list if it's just one parameter) or '*' to capture all optional parameters and 'capture_once' would be similar list of parameters to capture and reset to default.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42973>
_______________________________________

From report at bugs.python.org  Tue Jan 26 14:59:50 2021
From: report at bugs.python.org (Glenn Linderman)
Date: Tue, 26 Jan 2021 19:59:50 +0000
Subject: [issue42973] argparse: mixing optional and positional arguments...
 not again
In-Reply-To: <1611094894.69.0.476759327253.issue42973@roundup.psfhosted.org>
Message-ID: <1611691190.53.0.2672200945.issue42973@roundup.psfhosted.org>


Glenn Linderman <v+python at g.nevcal.com> added the comment:

Paul said:
I haven't had a chance to study your longer posts, but it seems to me that the AddFruitAction example could just as well be implemented with 

    parser.add_argument('--color', nargs='*', action='append')

with post parsing processing to create the 'fruits' dicts from the appended lists.  


That was also my first reaction, Paul, when I read Tadek's proposal. But I quickly realized that particularly with the feature of "capture and reset to default" that the number of instances of a particular optional and the number of positionals do not always match, and there is no way to correlate them later, even if they are all captured and saved.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42973>
_______________________________________

From report at bugs.python.org  Tue Jan 26 15:24:14 2021
From: report at bugs.python.org (Tadek Kijkowski)
Date: Tue, 26 Jan 2021 20:24:14 +0000
Subject: [issue42973] argparse: mixing optional and positional arguments...
 not again
In-Reply-To: <1611094894.69.0.476759327253.issue42973@roundup.psfhosted.org>
Message-ID: <1611692654.78.0.584013702932.issue42973@roundup.psfhosted.org>


Tadek Kijkowski <tkijkowski at gmail.com> added the comment:

Paul,

> The basic logic of argparse is to accept optionals in any order, and positionals in strict positional order.  'nargs' allows us to pair any number of strings with each optional's flag.

I started this issue because that was insufficient for my project.

> I wonder if adding a new nargs, such as '**' would be better than than the new parameter 'greedy_star=True'.

Yeah, I considered that earlier, but I thought that would be too much effort to review all the places where it would have to be treated as equal to '*'. But now I agree with you, I'll try to change that.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42973>
_______________________________________

From report at bugs.python.org  Tue Jan 26 15:53:16 2021
From: report at bugs.python.org (Ethan Furman)
Date: Tue, 26 Jan 2021 20:53:16 +0000
Subject: [issue38250] enum.Flag should be more set-like
In-Reply-To: <1569150842.66.0.799345616323.issue38250@roundup.psfhosted.org>
Message-ID: <1611694396.93.0.234484223056.issue38250@roundup.psfhosted.org>


Ethan Furman <ethan at stoneleaf.us> added the comment:


New changeset 01faf4542a8652adfbd3b3f897ba718e8ce43f5e by Ethan Furman in branch 'master':
bpo-38250: [Enum] only include .rst test if file available (GH-24342)
https://github.com/python/cpython/commit/01faf4542a8652adfbd3b3f897ba718e8ce43f5e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38250>
_______________________________________

From report at bugs.python.org  Tue Jan 26 16:33:09 2021
From: report at bugs.python.org (Anthony Sottile)
Date: Tue, 26 Jan 2021 21:33:09 +0000
Subject: [issue3353] make built-in tokenizer available via Python C API
In-Reply-To: <1216035196.11.0.15913194841.issue3353@psf.upfronthosting.co.za>
Message-ID: <1611696789.55.0.297546684651.issue3353@roundup.psfhosted.org>


Anthony Sottile <asottile at umich.edu> added the comment:

Serhiy Storchaka is this still blocked?  it's been a few years on either this or the linked issue and I'm reaching for this one :)

----------
nosy: +Anthony Sottile

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue3353>
_______________________________________

From report at bugs.python.org  Tue Jan 26 17:15:42 2021
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 26 Jan 2021 22:15:42 +0000
Subject: [issue38250] enum.Flag should be more set-like
In-Reply-To: <1569150842.66.0.799345616323.issue38250@roundup.psfhosted.org>
Message-ID: <1611699342.21.0.445364708429.issue38250@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

PPC64LE Fedora Rawhide Clang Installed 3.x is back to green, thanks for the fix ;-)
https://buildbot.python.org/all/#/builders/312/builds/600

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38250>
_______________________________________

From report at bugs.python.org  Tue Jan 26 18:39:25 2021
From: report at bugs.python.org (Zackery Spytz)
Date: Tue, 26 Jan 2021 23:39:25 +0000
Subject: [issue43033] Incorrect handling of PyObject_SetAttrString() in the
 _zoneinfo module
Message-ID: <1611704365.65.0.160193977721.issue43033@roundup.psfhosted.org>


New submission from Zackery Spytz <zspytz at gmail.com>:

There is a PyObject_SetAttrString() call in zoneinfo_init_subclass() which
is not checked for failure.  This could lead to serious bugs if an
exception occurs in PyObject_SetAttrString().

----------
components: Extension Modules
messages: 385739
nosy: ZackerySpytz
priority: normal
severity: normal
status: open
title: Incorrect handling of PyObject_SetAttrString() in the _zoneinfo module
versions: Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43033>
_______________________________________

From report at bugs.python.org  Tue Jan 26 18:41:32 2021
From: report at bugs.python.org (Zackery Spytz)
Date: Tue, 26 Jan 2021 23:41:32 +0000
Subject: [issue43033] Incorrect handling of PyObject_SetAttrString() in the
 _zoneinfo module
In-Reply-To: <1611704365.65.0.160193977721.issue43033@roundup.psfhosted.org>
Message-ID: <1611704492.54.0.842851687766.issue43033@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
keywords: +patch
pull_requests: +23165
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24345

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43033>
_______________________________________

From report at bugs.python.org  Tue Jan 26 18:48:46 2021
From: report at bugs.python.org (Eryk Sun)
Date: Tue, 26 Jan 2021 23:48:46 +0000
Subject: [issue42606] Support POSIX atomicity guarantee of O_APPEND on Windows
In-Reply-To: <1607483566.95.0.1927829703.issue42606@roundup.psfhosted.org>
Message-ID: <1611704926.39.0.0744476365931.issue42606@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> So the idea is to delete the file for a brief period, but then 
> undelete it. 

Currently NTFS defaults to using classic delete semantics for delete-on-close. However, it supports POSIX delete semantics for delete-on-close, so the default could change in a future release. When delete-on-close uses POSIX semantics, closing the last handle to the kernel File immediately unlinks the file. The upside is that a filesystem that uses POSIX delete semantics for delete-on-close should support SetFileInformationByHandle: FileDispositionInfoEx, which allows directly removing the delete-on-close flag.

That said, I can't stomach having to manually overwrite, truncate, delete and undelete files in order to avoid side effects if _open_osfhandle() fails. IMO, if opening a file has serious side effects, then we need a public API to allocate the fd beforehand. Or the idea needs to be put on hold until Python divorces itself from the C runtime's low I/O layer.

> If the file type is FILE_TYPE_CHAR and the first byte to write 
> was 26 (Ctrl-Z), it's treated as success. I don't think I 
> understand: it *seems* like it's handling something like writing 
> to the *input* of a console, but I'm not sure it's even possible 
> in this manner.

Writing to the console input buffer is possible, but not supported with WriteFile() or WriteConsoleW(). It requires WriteConsoleInputW(), which writes low-level input records.

ReadFile() on a console input handle is special cased to return that 0 bytes were read if the string read from the console starts with Ctrl+Z. But I don't know of a device that special cases WriteFile() like this. The documentation of _write() says "[w]hen writing to a device, _write treats a CTRL+Z character in the buffer as an output terminator". Whatever this meant in the past in OS/2 or DOS, I doubt that it's meaningful nowadays.

> Anything else is a failure with ENOSPC. This is mysterious too.

Possibly someone picked an error code that was good enough. Maybe it was selected for the case of a full pipe that's in non-blocking mode. The named pipe device doesn't fail an NtWriteFile() system call for a non-blocking pipe when there isn't enough space. It simply succeeds with 0 bytes written. For example:

    >>> fdr, fdw = os.pipe()
    >>> hw = msvcrt.get_osfhandle(fdw)
    >>> win32pipe.SetNamedPipeHandleState(hw, 1, None, None)
    >>> os.write(fdw, b'a'*4096)
    4096
    >>> os.write(fdw, b'a')
    Traceback (most recent call last):
      File "<stdin>", line 1, in <module>
    OSError: [Errno 28] No space left on device

A POSIX developer would expect this case to fail with EAGAIN and raise BlockingIOError. But support for non-blocking mode is poorly implemented by pipes in Windows. Developers are encouraged to use asynchronous I/O instead.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42606>
_______________________________________

From report at bugs.python.org  Tue Jan 26 18:56:05 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 26 Jan 2021 23:56:05 +0000
Subject: [issue43008] IDLE ignores sys.excepthook in normal, subprocess mode
In-Reply-To: <1611401446.12.0.0532585832167.issue43008@roundup.psfhosted.org>
Message-ID: <1611705365.19.0.794935162047.issue43008@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset 7a34380ad788886f5ad50d4175ceb2d5715b8cff by Ken in branch 'master':
bpo-43008: Make IDLE respect sys.excepthook (GH-24302)
https://github.com/python/cpython/commit/7a34380ad788886f5ad50d4175ceb2d5715b8cff


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43008>
_______________________________________

From report at bugs.python.org  Tue Jan 26 18:56:34 2021
From: report at bugs.python.org (miss-islington)
Date: Tue, 26 Jan 2021 23:56:34 +0000
Subject: [issue43008] IDLE ignores sys.excepthook in normal, subprocess mode
In-Reply-To: <1611401446.12.0.0532585832167.issue43008@roundup.psfhosted.org>
Message-ID: <1611705394.53.0.952311808237.issue43008@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 3.0 -> 4.0
pull_requests: +23166
stage: test needed -> patch review
pull_request: https://github.com/python/cpython/pull/24346

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43008>
_______________________________________

From report at bugs.python.org  Tue Jan 26 18:56:43 2021
From: report at bugs.python.org (miss-islington)
Date: Tue, 26 Jan 2021 23:56:43 +0000
Subject: [issue43008] IDLE ignores sys.excepthook in normal, subprocess mode
In-Reply-To: <1611401446.12.0.0532585832167.issue43008@roundup.psfhosted.org>
Message-ID: <1611705403.17.0.584576426664.issue43008@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +23167
pull_request: https://github.com/python/cpython/pull/24347

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43008>
_______________________________________

From report at bugs.python.org  Tue Jan 26 19:24:23 2021
From: report at bugs.python.org (miss-islington)
Date: Wed, 27 Jan 2021 00:24:23 +0000
Subject: [issue43008] IDLE ignores sys.excepthook in normal, subprocess mode
In-Reply-To: <1611401446.12.0.0532585832167.issue43008@roundup.psfhosted.org>
Message-ID: <1611707063.71.0.834062201116.issue43008@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 68102fb9987338a70d69a0162917866e5710458d by Miss Islington (bot) in branch '3.9':
bpo-43008: Make IDLE respect sys.excepthook (GH-24302)
https://github.com/python/cpython/commit/68102fb9987338a70d69a0162917866e5710458d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43008>
_______________________________________

From report at bugs.python.org  Tue Jan 26 19:24:39 2021
From: report at bugs.python.org (miss-islington)
Date: Wed, 27 Jan 2021 00:24:39 +0000
Subject: [issue43008] IDLE ignores sys.excepthook in normal, subprocess mode
In-Reply-To: <1611401446.12.0.0532585832167.issue43008@roundup.psfhosted.org>
Message-ID: <1611707079.23.0.292710137702.issue43008@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 6f0346d09f78180886982e070cc92425ada96144 by Miss Islington (bot) in branch '3.8':
bpo-43008: Make IDLE respect sys.excepthook (GH-24302)
https://github.com/python/cpython/commit/6f0346d09f78180886982e070cc92425ada96144


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43008>
_______________________________________

From report at bugs.python.org  Tue Jan 26 19:27:44 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Wed, 27 Jan 2021 00:27:44 +0000
Subject: [issue43008] IDLE ignores sys.excepthook in normal, subprocess mode
In-Reply-To: <1611401446.12.0.0532585832167.issue43008@roundup.psfhosted.org>
Message-ID: <1611707264.64.0.673730047194.issue43008@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Ken, for next time -- there is a separate News category for IDLE.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43008>
_______________________________________

From report at bugs.python.org  Tue Jan 26 19:53:14 2021
From: report at bugs.python.org (Ken Hilton)
Date: Wed, 27 Jan 2021 00:53:14 +0000
Subject: [issue43008] IDLE ignores sys.excepthook in normal, subprocess mode
In-Reply-To: <1611401446.12.0.0532585832167.issue43008@roundup.psfhosted.org>
Message-ID: <1611708794.49.0.0109777792445.issue43008@roundup.psfhosted.org>


Ken Hilton <kenny2minecraft at gmail.com> added the comment:

Oops, gotcha. Thanks for doing the tests. I'm a Python contributor! :D

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43008>
_______________________________________

From report at bugs.python.org  Tue Jan 26 20:15:02 2021
From: report at bugs.python.org (Jesse Silverman)
Date: Wed, 27 Jan 2021 01:15:02 +0000
Subject: [issue43034] Python tutorial misleads users about floor division
 behavior
Message-ID: <1611710102.87.0.478016588876.issue43034@roundup.psfhosted.org>


New submission from Jesse Silverman <jessevsilverman at gmail.com>:

I had never worked thru the Python tutorial, it's kind of awesome.

I noticed multiple independent presenters incorrectly describe the behavior of floor division when the signs of the operands don't match.  Not just sloppy ones, some who are usually pretty careful -- people forget.  I found it odd.

Today I read:
https://docs.python.org/3.9/tutorial/introduction.html#using-python-as-a-calculator
'Division (/) always returns a float. To do floor division and get an integer result (discarding any fractional result) you can use the // operator; to calculate the remainder you can use %:'

I know what they mean (there will never be a non-zero fractional component in the result) however, stating that it "discards any fraction result" explicitly suggests that it will round towards zero for all results.  The name of the operator tells us the true story, as does a test, it rounds towards negative infinity for all results.

Hopefully all the people using Python to treat cancer, fly to Mars and run power plants know what the behavior is.  However, anecdotally, I have seen evidence that generally cautious, fairly-detail oriented programmers seem to forget the details of the behavior, this is one place in the docs from which many people first learn about the floor division operator and this page would lead me to believe it operates differently than it does in reality.

If the words right there don't get changed, or the example of -10/3 doesn't get added, would this be a good excuse for a third footnote?  I would actually wish for both the wording to be changed and to show an example like -10 / 3, tho admittedly I came from an Engineering background so I am always worried someone's going to blow up somewhere...

Deepest regards for everyone who gets to regularly close the complaints about floor division working as designed and documented -- but not quite documented on this page which more people may read than others covering the operator.

----------
assignee: docs at python
components: Documentation
messages: 385746
nosy: docs at python, jessevsilverman
priority: normal
severity: normal
status: open
title: Python tutorial misleads users about floor division behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43034>
_______________________________________

From report at bugs.python.org  Tue Jan 26 20:20:06 2021
From: report at bugs.python.org (Inada Naoki)
Date: Wed, 27 Jan 2021 01:20:06 +0000
Subject: [issue43030] signed/unsigned mismatch in Py_UNICODE_ISSPACE macro
In-Reply-To: <1611664822.48.0.67078426677.issue43030@roundup.psfhosted.org>
Message-ID: <1611710406.13.0.868714582621.issue43030@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

Just replacing "128U" with "128" enough?
Will `ch < 128` emit warning on platforms wchar_t is unsigned?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43030>
_______________________________________

From report at bugs.python.org  Tue Jan 26 21:14:48 2021
From: report at bugs.python.org (Eric V. Smith)
Date: Wed, 27 Jan 2021 02:14:48 +0000
Subject: [issue41459] pickle.load raises SystemError on malformed input
In-Reply-To: <1596401775.19.0.63803368162.issue41459@roundup.psfhosted.org>
Message-ID: <1611713688.77.0.961858056378.issue41459@roundup.psfhosted.org>


Change by Eric V. Smith <eric at trueblade.com>:


----------
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41459>
_______________________________________

From report at bugs.python.org  Tue Jan 26 23:37:47 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Wed, 27 Jan 2021 04:37:47 +0000
Subject: [issue43008] IDLE ignores sys.excepthook in normal, subprocess mode
In-Reply-To: <1611401446.12.0.0532585832167.issue43008@roundup.psfhosted.org>
Message-ID: <1611722267.36.0.0192973567127.issue43008@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

I hope this is not your last contribution.  Another hint: if one uses issue 12643 or #12643, then the tracker makes the link -- and strikes it out if closed.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43008>
_______________________________________

From report at bugs.python.org  Wed Jan 27 01:28:31 2021
From: report at bugs.python.org (Aviral)
Date: Wed, 27 Jan 2021 06:28:31 +0000
Subject: [issue38307] Provide Class' end line in pyclbr module
In-Reply-To: <1569691590.29.0.185701662636.issue38307@roundup.psfhosted.org>
Message-ID: <1611728911.27.0.706473390164.issue38307@roundup.psfhosted.org>


Change by Aviral <hi at aviralsrivastava.com>:


----------
pull_requests: +23168
pull_request: https://github.com/python/cpython/pull/24348

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38307>
_______________________________________

From report at bugs.python.org  Wed Jan 27 03:16:36 2021
From: report at bugs.python.org (miss-islington)
Date: Wed, 27 Jan 2021 08:16:36 +0000
Subject: [issue43033] Incorrect handling of PyObject_SetAttrString() in the
 _zoneinfo module
In-Reply-To: <1611704365.65.0.160193977721.issue43033@roundup.psfhosted.org>
Message-ID: <1611735396.25.0.626181820148.issue43033@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 1.0 -> 2.0
pull_requests: +23169
pull_request: https://github.com/python/cpython/pull/24349

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43033>
_______________________________________

From report at bugs.python.org  Wed Jan 27 03:16:51 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 27 Jan 2021 08:16:51 +0000
Subject: [issue43033] Incorrect handling of PyObject_SetAttrString() in the
 _zoneinfo module
In-Reply-To: <1611704365.65.0.160193977721.issue43033@roundup.psfhosted.org>
Message-ID: <1611735411.8.0.684300292725.issue43033@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 5327f370344a627f1578d8183d197feb286371c6 by Zackery Spytz in branch 'master':
bpo-43033: Fix the handling of PyObject_SetAttrString() in _zoneinfo.c (GH-24345)
https://github.com/python/cpython/commit/5327f370344a627f1578d8183d197feb286371c6


----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43033>
_______________________________________

From report at bugs.python.org  Wed Jan 27 03:30:40 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 27 Jan 2021 08:30:40 +0000
Subject: [issue43030] signed/unsigned mismatch in Py_UNICODE_ISSPACE macro
In-Reply-To: <1611664822.48.0.67078426677.issue43030@roundup.psfhosted.org>
Message-ID: <1611736240.76.0.888840750318.issue43030@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
keywords: +patch
nosy: +serhiy.storchaka
nosy_count: 3.0 -> 4.0
pull_requests: +23170
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24350

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43030>
_______________________________________

From report at bugs.python.org  Wed Jan 27 03:31:55 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 27 Jan 2021 08:31:55 +0000
Subject: [issue43030] signed/unsigned mismatch in Py_UNICODE_ISSPACE macro
In-Reply-To: <1611664822.48.0.67078426677.issue43030@roundup.psfhosted.org>
Message-ID: <1611736315.96.0.564525475509.issue43030@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

No, it is not enough, because we do not want to use ch as index if it is negative.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43030>
_______________________________________

From report at bugs.python.org  Wed Jan 27 04:40:53 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 27 Jan 2021 09:40:53 +0000
Subject: [issue43033] Incorrect handling of PyObject_SetAttrString() in the
 _zoneinfo module
In-Reply-To: <1611704365.65.0.160193977721.issue43033@roundup.psfhosted.org>
Message-ID: <1611740453.3.0.912388108725.issue43033@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset cb77c5e1ddd9328e4706f8fdf893aa6bf697942c by Miss Islington (bot) in branch '3.9':
bpo-43033: Fix the handling of PyObject_SetAttrString() in _zoneinfo.c (GH-24345) (GH-24349)
https://github.com/python/cpython/commit/cb77c5e1ddd9328e4706f8fdf893aa6bf697942c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43033>
_______________________________________

From report at bugs.python.org  Wed Jan 27 04:41:10 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 27 Jan 2021 09:41:10 +0000
Subject: [issue43033] Incorrect handling of PyObject_SetAttrString() in the
 _zoneinfo module
In-Reply-To: <1611704365.65.0.160193977721.issue43033@roundup.psfhosted.org>
Message-ID: <1611740470.73.0.36865474528.issue43033@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43033>
_______________________________________

From report at bugs.python.org  Wed Jan 27 05:16:30 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 27 Jan 2021 10:16:30 +0000
Subject: [issue43031] aarch64 RHEL7 LTO + PGO 3.7: "make" hangs when running
 test_asyncio
In-Reply-To: <1611668779.87.0.585376079425.issue43031@roundup.psfhosted.org>
Message-ID: <1611742590.51.0.368300446101.issue43031@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 6790005a9a30ae3eca69d1957fb072171643a366 by Victor Stinner in branch 'master':
bpo-43031: Set a timeout when running tests in PGO build (GH-24339)
https://github.com/python/cpython/commit/6790005a9a30ae3eca69d1957fb072171643a366


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43031>
_______________________________________

From report at bugs.python.org  Wed Jan 27 05:20:17 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 27 Jan 2021 10:20:17 +0000
Subject: [issue43031] aarch64 RHEL7 LTO + PGO 3.7: "make" hangs when running
 test_asyncio
In-Reply-To: <1611668779.87.0.585376079425.issue43031@roundup.psfhosted.org>
Message-ID: <1611742817.73.0.665842018989.issue43031@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I close the issue.

I added a timeout (20 min) in master when running tests for a PGO build.

> I created https://github.com/python/buildmaster-config/pull/228 to skip PGO builds on Python 3.7, since test_asyncio hangs on PGO builds.

Done. I remove all Python 3.7 PGO buildbot builders.

The test_asyncio issue on Python 3.7 looks like a race condition which is likely already fixed in Python 3.8. Even if it's a bug, we cannot fix asyncio bugs in Python 3.7 anymore.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43031>
_______________________________________

From report at bugs.python.org  Wed Jan 27 05:23:42 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 27 Jan 2021 10:23:42 +0000
Subject: [issue42979] _zoneinfo: zoneinfomodule_exec() doesn't check for
 PyDateTime_IMPORT failure
In-Reply-To: <1611163566.26.0.253539458839.issue42979@roundup.psfhosted.org>
Message-ID: <1611743022.91.0.445756822447.issue42979@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset eeb701adc0fc29ba803fddf133d917ff45639a00 by Hai Shi in branch 'master':
bpo-42979: _zoneinfo exec function checks for PyDateTime_IMPORT failure (GH-24333)
https://github.com/python/cpython/commit/eeb701adc0fc29ba803fddf133d917ff45639a00


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42979>
_______________________________________

From report at bugs.python.org  Wed Jan 27 05:27:23 2021
From: report at bugs.python.org (miss-islington)
Date: Wed, 27 Jan 2021 10:27:23 +0000
Subject: [issue42979] _zoneinfo: zoneinfomodule_exec() doesn't check for
 PyDateTime_IMPORT failure
In-Reply-To: <1611163566.26.0.253539458839.issue42979@roundup.psfhosted.org>
Message-ID: <1611743243.76.0.948635516704.issue42979@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 2.0 -> 3.0
pull_requests: +23171
pull_request: https://github.com/python/cpython/pull/24351

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42979>
_______________________________________

From report at bugs.python.org  Wed Jan 27 05:28:02 2021
From: report at bugs.python.org (=?utf-8?q?Miro_Hron=C4=8Dok?=)
Date: Wed, 27 Jan 2021 10:28:02 +0000
Subject: [issue42307] make install must not copy python.o into
 $prefix/lib/python3.10/config-3.10-x86_64-linux-gnu/
In-Reply-To: <1605005380.13.0.93741295392.issue42307@roundup.psfhosted.org>
Message-ID: <1611743282.79.0.622694771698.issue42307@roundup.psfhosted.org>


Change by Miro Hron?ok <miro at hroncok.cz>:


----------
nosy: +hroncok

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42307>
_______________________________________

From report at bugs.python.org  Wed Jan 27 05:28:15 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 27 Jan 2021 10:28:15 +0000
Subject: [issue42979] _zoneinfo: zoneinfomodule_exec() doesn't check for
 PyDateTime_IMPORT failure
In-Reply-To: <1611163566.26.0.253539458839.issue42979@roundup.psfhosted.org>
Message-ID: <1611743295.8.0.341352119363.issue42979@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Thanks for the fix Hai Shi!

> By the way, the import machinery should raise a SystemError if a module exec function raises an exception *and* reports a success: see _Py_CheckFunctionResult().

It's already the case. Example:

>>> import _zoneinfo
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
SystemError: execution of module _zoneinfo raised unreported exception

With this bug:

diff --git a/Modules/_zoneinfo.c b/Modules/_zoneinfo.c
index d0c462fb86..fc564b9587 100644
--- a/Modules/_zoneinfo.c
+++ b/Modules/_zoneinfo.c
@@ -2683,6 +2683,7 @@ zoneinfomodule_exec(PyObject *m)
         goto error;
     }
 
+    PyErr_SetString(PyExc_Exception, "BUG");
     return 0;
 
 error:

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42979>
_______________________________________

From report at bugs.python.org  Wed Jan 27 05:49:44 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 27 Jan 2021 10:49:44 +0000
Subject: [issue3353] make built-in tokenizer available via Python C API
In-Reply-To: <1216035196.11.0.15913194841.issue3353@psf.upfronthosting.co.za>
Message-ID: <1611744584.07.0.802677264292.issue3353@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

I am -1 exposing the C-API of the tokenizer. For the new parser several modifications of the C tokenizer had to be done and some of them modify existing behaviour slightly. I don't want to corner ourselves in a place where we cannot make improvements because is a backwards incompatible change because the API is exposed.

----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue3353>
_______________________________________

From report at bugs.python.org  Wed Jan 27 06:04:20 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 27 Jan 2021 11:04:20 +0000
Subject: [issue42979] _zoneinfo: zoneinfomodule_exec() doesn't check for
 PyDateTime_IMPORT failure
In-Reply-To: <1611163566.26.0.253539458839.issue42979@roundup.psfhosted.org>
Message-ID: <1611745460.01.0.183594181404.issue42979@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +23172
pull_request: https://github.com/python/cpython/pull/24352

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42979>
_______________________________________

From report at bugs.python.org  Wed Jan 27 06:09:05 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 27 Jan 2021 11:09:05 +0000
Subject: [issue42979] _zoneinfo: zoneinfomodule_exec() doesn't check for
 PyDateTime_IMPORT failure
In-Reply-To: <1611163566.26.0.253539458839.issue42979@roundup.psfhosted.org>
Message-ID: <1611745745.71.0.574839282548.issue42979@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 895591c1f0bdec5ad357fe6a5fd0875990061357 by Miss Islington (bot) in branch '3.9':
bpo-42979: _zoneinfo exec function checks for PyDateTime_IMPORT failure (GH-24333) (GH-24351)
https://github.com/python/cpython/commit/895591c1f0bdec5ad357fe6a5fd0875990061357


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42979>
_______________________________________

From report at bugs.python.org  Wed Jan 27 06:20:36 2021
From: report at bugs.python.org (Karthik Nishanth)
Date: Wed, 27 Jan 2021 11:20:36 +0000
Subject: [issue43035] FileNotFoundError in distutils\file_util.py copy_tree
Message-ID: <1611746436.35.0.546212642615.issue43035@roundup.psfhosted.org>


New submission from Karthik Nishanth <karthik.nishanth at zivid.com>:

I am making a bdist_wheel for a private python binary module.

`python setup.py bdist_wheel` fails on a very specific windows VM repeatedly. This works fine on both a regular windows machine & linux machines.

Attached the complete distutils verbose logs.

Stacktrace for quick search:
---------------------------------------------

     File "C:\Program Files\Python39\lib\site-packages\setuptools\__init__.py", line 165, in setup
       return distutils.core.setup(**attrs)
     File "C:\Program Files\Python39\lib\distutils\core.py", line 148, in setup
       dist.run_commands()
     File "C:\Program Files\Python39\lib\distutils\dist.py", line 966, in run_commands
       self.run_command(cmd)
     File "C:\Program Files\Python39\lib\distutils\dist.py", line 985, in run_command
       cmd_obj.run()
     File "C:\Program Files\Python39\lib\site-packages\wheel\bdist_wheel.py", line 335, in run
       self.run_command('install')
     File "C:\Program Files\Python39\lib\distutils\cmd.py", line 313, in run_command
       self.distribution.run_command(command)
     File "C:\Program Files\Python39\lib\distutils\dist.py", line 985, in run_command
       cmd_obj.run()
     File "C:\Program Files\Python39\lib\site-packages\setuptools\command\install.py", line 61, in run
       return orig.install.run(self)
     File "C:\Program Files\Python39\lib\distutils\command\install.py", line 558, in run
       self.run_command(cmd_name)
     File "C:\Program Files\Python39\lib\distutils\cmd.py", line 313, in run_command
       self.distribution.run_command(command)
     File "C:\Program Files\Python39\lib\distutils\dist.py", line 985, in run_command
       cmd_obj.run()
     File "C:\Program Files\Python39\lib\site-packages\setuptools\command\install_lib.py", line 12, in run
       outfiles = self.install()
     File "C:\Program Files\Python39\lib\distutils\command\install_lib.py", line 111, in install
       outfiles = self.copy_tree(self.build_dir, self.install_dir)
     File "C:\Program Files\Python39\lib\site-packages\setuptools\command\install_lib.py", line 95, in copy_tree
       return orig.install_lib.copy_tree(self, infile, outfile)
     File "C:\Program Files\Python39\lib\distutils\cmd.py", line 354, in copy_tree
       return dir_util.copy_tree(infile, outfile, preserve_mode,
     File "C:\Program Files\Python39\lib\distutils\dir_util.py", line 157, in copy_tree
       copy_tree(src_name, dst_name, preserve_mode,
     File "C:\Program Files\Python39\lib\distutils\dir_util.py", line 161, in copy_tree
       copy_file(src_name, dst_name, preserve_mode,
     File "C:\Program Files\Python39\lib\distutils\file_util.py", line 151, in copy_file
       _copy_file_contents(src, dst)
     File "C:\Program Files\Python39\lib\distutils\file_util.py", line 43, in _copy_file_contents
       raise DistutilsFileError(
   distutils.errors.DistutilsFileError: could not create 'build\bdist.win-amd64\wheel\internal_pkgname-2.3.0_pre_alpha_1_c8273a4c_1_preview.data\purelib\mydeviceapi\mydeviceapi.cp39-win_amd64.pyd': No such file or directory

---------------------------------------------

I may get an [Errno 2] on open(dst, 'wb') if dst has a directory component that does not exist. But distutils logs already say 

> creating dir1
> creating dir1/dir2
> creating dir1/dir2/dir3

so I assume the directories must have been created before calling open().

----------
components: Distutils
files: scratch_4.txt
messages: 385758
nosy: dstufft, eric.araujo, knzivid
priority: normal
severity: normal
status: open
title: FileNotFoundError in distutils\file_util.py copy_tree
type: crash
versions: Python 3.9
Added file: https://bugs.python.org/file49767/scratch_4.txt

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43035>
_______________________________________

From report at bugs.python.org  Wed Jan 27 06:29:33 2021
From: report at bugs.python.org (Christian Heimes)
Date: Wed, 27 Jan 2021 11:29:33 +0000
Subject: [issue43035] FileNotFoundError in distutils\file_util.py copy_tree
In-Reply-To: <1611746436.35.0.546212642615.issue43035@roundup.psfhosted.org>
Message-ID: <1611746973.04.0.433549167631.issue43035@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

distutils is a legacy package. setuptools is the successor of distutils. Could you please try again with setuptools?

----------
nosy: +christian.heimes

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43035>
_______________________________________

From report at bugs.python.org  Wed Jan 27 06:31:14 2021
From: report at bugs.python.org (Karthik Nishanth)
Date: Wed, 27 Jan 2021 11:31:14 +0000
Subject: [issue43035] FileNotFoundError in distutils\file_util.py copy_tree
In-Reply-To: <1611746436.35.0.546212642615.issue43035@roundup.psfhosted.org>
Message-ID: <1611747074.38.0.843454869875.issue43035@roundup.psfhosted.org>


Karthik Nishanth <karthik.nishanth at zivid.com> added the comment:

Sorry, I did use the `setup` function from

`from setuptools import setup` 

I marked the component as Distutils because I noticed setuptools called distutils internally in the stacktrace

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43035>
_______________________________________

From report at bugs.python.org  Wed Jan 27 06:36:06 2021
From: report at bugs.python.org (Christian Heimes)
Date: Wed, 27 Jan 2021 11:36:06 +0000
Subject: [issue43035] FileNotFoundError in distutils\file_util.py copy_tree
In-Reply-To: <1611746436.35.0.546212642615.issue43035@roundup.psfhosted.org>
Message-ID: <1611747366.48.0.14470221966.issue43035@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

It looks like you version number is confusing setuptools and distutils. Setuptools even warns you about the invalid version number:

UserWarning: The version specified ('2.3.0-pre-alpha-1+c8273a4c-1-preview') is an invalid version, this may not work as expected with newer versions of setuptools, pip, and PyPI. Please see PEP 440 for more details.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43035>
_______________________________________

From report at bugs.python.org  Wed Jan 27 06:39:48 2021
From: report at bugs.python.org (Xavier Morel)
Date: Wed, 27 Jan 2021 11:39:48 +0000
Subject: [issue43036] TOS-behaviour documentation is
Message-ID: <1611747588.28.0.967739305084.issue43036@roundup.psfhosted.org>


New submission from Xavier Morel <xavier.morel at masklinn.net>:

I was looking at the disassembly of a fairly straightforward listcomp:

    [e for e in s if e[0]]

  1           0 BUILD_LIST               0
              2 LOAD_FAST                0 (.0)
        >>    4 FOR_ITER                16 (to 22)
              6 STORE_FAST               1 (e)
              8 LOAD_FAST                1 (e)
             10 LOAD_CONST               0 (0)
             12 BINARY_SUBSCR
             14 POP_JUMP_IF_FALSE        4
             16 LOAD_FAST                1 (e)
             18 LIST_APPEND              2
             20 JUMP_ABSOLUTE            4
        >>   22 RETURN_VALUE

6, 8 bothered me because STORE_FAST is documented as

> Stores TOS into the local co_varnames[var_num].

So it seems like it leaves TOS and thus the LOAD is unnecessary, However looking at ceval.c:

        case TARGET(STORE_FAST): {
            PREDICTED(STORE_FAST);
            PyObject *value = POP();
            SETLOCAL(oparg, value);
            FAST_DISPATCH();
        }

so STORE_FAST does pop the TOS and the LOAD_FAST is necessary. This is confusing because there are instructions which literally have POP in their name whose stack behaviour is documented explicitly.

Should all bytecode instructions have their stack behaviour explicitly documented, or only those with an *odd* stack behaviour (e.g. JUMP_IF_FALSE_OR_POP) and the rest maybe covered by a note saying that they will pop their parameters and push back their result or somesuch?

--

Furthermore, maybe optimising `STORE_LOCAL a; LOAD_LOCAL a` to `DUP_TOP; STORE_LOCAL a` would be useful? It obviously would have no effect on bytecode size since wordcode, and `fastlocals[i]` would be in cache and the conditional check likely predicted, but it seems like skipping them entirely would still be more reliable? This idea is somewhat supported by expression assignments already generating the latter:

    >>> @dis.dis
    ... def foo():
    ...     if a := thing():
    ...         do(a)
    ... 
  3           0 LOAD_GLOBAL              0 (thing)
              2 CALL_FUNCTION            0
              4 DUP_TOP
              6 STORE_FAST               0 (a)
              8 POP_JUMP_IF_FALSE       18

  4          10 LOAD_GLOBAL              1 (do)
             12 LOAD_FAST                0 (a)
             14 CALL_FUNCTION            1
             16 POP_TOP
        >>   18 LOAD_CONST               0 (None)
             20 RETURN_VALUE


This optimisation would also trigger for e.g.

    [x[i] for x in xs]

or

    a = foo()
    if a:
        # do thing

making the latter generate bytecode identical to walrus assignments at least for the trivial case: currently the only difference (aside from line numbers) is that the normal assignment generates STORE_FAST;LOAD_FAST while expression assignments generate DUP_TOP;STORE_FAST.

----------
assignee: docs at python
components: Documentation
messages: 385762
nosy: docs at python, xmorel
priority: normal
severity: normal
status: open
title: TOS-behaviour documentation is
type: enhancement
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43036>
_______________________________________

From report at bugs.python.org  Wed Jan 27 06:40:07 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 27 Jan 2021 11:40:07 +0000
Subject: [issue42955] Add sys.stdlib_module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611747607.68.0.658431057264.issue42955@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +23173
pull_request: https://github.com/python/cpython/pull/24353

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Wed Jan 27 06:42:35 2021
From: report at bugs.python.org (Karthik Nishanth)
Date: Wed, 27 Jan 2021 11:42:35 +0000
Subject: [issue43035] FileNotFoundError in distutils\file_util.py copy_tree
In-Reply-To: <1611746436.35.0.546212642615.issue43035@roundup.psfhosted.org>
Message-ID: <1611747755.93.0.870962742468.issue43035@roundup.psfhosted.org>


Karthik Nishanth <karthik.nishanth at zivid.com> added the comment:

I use the same version of python on my local windows machine and in the VM. Since I am not explicitly upgrading setuptools in my scripts, I should expect the same error on my windows machine too, right?

This also works on linux.

The stacktrace also says the correct directories (with an invalid version) are created before `open` fails.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43035>
_______________________________________

From report at bugs.python.org  Wed Jan 27 06:55:43 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 27 Jan 2021 11:55:43 +0000
Subject: [issue42507] test_ttk_guionly test failures on macOS with Tcl/Tk
 8.6.10
In-Reply-To: <1606704400.88.0.0493725264205.issue42507@roundup.psfhosted.org>
Message-ID: <1611748543.84.0.568359559103.issue42507@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

Failure on the Ubuntu job run on my PR 24353:

https://github.com/python/cpython/pull/24353/checks?check_run_id=1776422914

======================================================================
FAIL: test_identify (tkinter.test.test_ttk.test_widgets.ComboboxTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/runner/work/cpython/cpython/Lib/tkinter/test/test_ttk/test_widgets.py", line 335, in test_identify
    self.assertEqual(self.entry.identify(5, 5), "textarea")
AssertionError: '' != 'textarea'
+ textarea

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42507>
_______________________________________

From report at bugs.python.org  Wed Jan 27 07:14:36 2021
From: report at bugs.python.org (Stefan Mosoi)
Date: Wed, 27 Jan 2021 12:14:36 +0000
Subject: [issue43037] Importlib reload by module name (String)
Message-ID: <1611749676.48.0.692377110291.issue43037@roundup.psfhosted.org>


New submission from Stefan Mosoi <st3f4n2006 at gmail.com>:

Weird behaviour (maybe it's my opinion) in reload from importlib

if i do:
import importlib
import sys
import datetime
importlib.reload(datetime.timedelta.__module__)

I get
Typeerror: reload() argument must be a module

but if i do

import importlib
import sys
import datetime
importlib.reload(sys.modules.get(datetime.timedelta.__module__))

it works.

The sys.modules.get i got from reload() code:
def reload(module)
    if not module or not isinstance(module, types.ModuleType):
        raise TypeError("reload() argument must be a module")
    try:
        name = module.__spec__.name
    except AttributeError:
        name = module.__name__

    if sys.modules.get(name) is not module:

It wouldn't be easier to check if string do sys.modules.get ?

And as a bonus a reload_module function that gets a class (or anything with __module__ and reloads that module, no question asked?) 

And i know it's easy to implement, but it would be nicer if was better handled in the lib :)

Notes (if it matters):
Python 3.9.1 x64 Windows
I didn't test on other versions.

----------
components: Library (Lib)
messages: 385765
nosy: st3f4n2006
priority: normal
severity: normal
status: open
title: Importlib reload by module name (String)
type: enhancement
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43037>
_______________________________________

From report at bugs.python.org  Wed Jan 27 07:59:37 2021
From: report at bugs.python.org (hai shi)
Date: Wed, 27 Jan 2021 12:59:37 +0000
Subject: [issue42979] _zoneinfo: zoneinfomodule_exec() doesn't check for
 PyDateTime_IMPORT failure
In-Reply-To: <1611163566.26.0.253539458839.issue42979@roundup.psfhosted.org>
Message-ID: <1611752377.07.0.771910976765.issue42979@roundup.psfhosted.org>


hai shi <shihai1991 at 126.com> added the comment:

> It's already the case. Example

Nice, interesting case.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42979>
_______________________________________

From report at bugs.python.org  Wed Jan 27 08:04:57 2021
From: report at bugs.python.org (Jan Christoph)
Date: Wed, 27 Jan 2021 13:04:57 +0000
Subject: [issue43038] ensurepip: tries to use setup.py/setup.cfg
Message-ID: <1611752697.42.0.4760269276.issue43038@roundup.psfhosted.org>


New submission from Jan Christoph <con-f-use at gmx.net>:

Running

python3 -Im ensurepip --upgrade --default-pip

in a directory that contains a setup.cfg / setup.py combination, caused ensurepip to try and use these files, leading to

distutils.errors.DistutilsOptionError: error in setup.cfg: command 'build' has no such option 'icons'

A full shell session is attached that contains details on the exact files and python version involved involved.

I was under the impression ensurepip simply ensured that a suitable version of pip is installed with my Python distribution in use.

----------
components: Library (Lib)
files: shell-session.txt
messages: 385767
nosy: con-f-use
priority: normal
severity: normal
status: open
title: ensurepip: tries to use setup.py/setup.cfg
type: behavior
versions: Python 3.8, Python 3.9
Added file: https://bugs.python.org/file49768/shell-session.txt

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43038>
_______________________________________

From report at bugs.python.org  Wed Jan 27 08:06:25 2021
From: report at bugs.python.org (Eric Osborne)
Date: Wed, 27 Jan 2021 13:06:25 +0000
Subject: [issue43039] tempfile.TemporaryDirectory() name string is incorrect
Message-ID: <1611752785.31.0.169033052217.issue43039@roundup.psfhosted.org>


New submission from Eric Osborne <eosborne at vapor.io>:

When I create a temporary directory, the name doesn't come back in a way the application expects it.  I ran into this using gitPython and I'm not entirely clear whether it's a tmpfile issue or a gitpython issue, but I think it's tempfile.  

Repro:

In [12]: td = tempfile.TemporaryDirectory()

In [13]: td.name
Out[13]: '/var/folders/kd/bjhw84ss2x734frx98qh1mw40000gn/T/tmpgralfh9m'

In [14]: str(td)
Out[14]: "<TemporaryDirectory '/var/folders/kd/bjhw84ss2x734frx98qh1mw40000gn/T/tmpgralfh9m'>"

The problem with this is that gitPython takes a temporary directory as an argument and effectively does a mkdir(str(td)), which creates a weird directory in /var/tmp:

eosborne at eosborne-salt-master:/tmp$ ls -alhd *Temp*
drwxrwxr-x 3 eosborne eosborne 4.0K Jan 27 12:42 '<TemporaryDirectory '\'''



I believe that str(td) should return just the directory name and that repr(td) can return the extra bit of text with "<TemporaryDirectory ..>" but that's just my two cents.

I have thrown this issue up on the gitPython list too: https://github.com/gitpython-developers/GitPython/issues/1115

----------
components: Library (Lib)
messages: 385768
nosy: eosborne
priority: normal
severity: normal
status: open
title: tempfile.TemporaryDirectory() name string is incorrect
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43039>
_______________________________________

From report at bugs.python.org  Wed Jan 27 08:07:13 2021
From: report at bugs.python.org (Donovan Baarda)
Date: Wed, 27 Jan 2021 13:07:13 +0000
Subject: [issue43040] random.py randrange() is very slow if the range is a
 power of 2.
Message-ID: <1611752833.52.0.275617605532.issue43040@roundup.psfhosted.org>


New submission from Donovan Baarda <abo at minkirri.apana.org.au>:

I encountered a very significant slowdown migrating some code from python2.7 to python3.9 that I tracked down to randrange() being slow. After digging I noticed that _randbelow_with_getrandbits() calls getrandbits() 2x as many times, and asks for one more bit each time, than is actually required if the range requested is a power of 2.

I have a GitHub PR on the way to fix this...

----------
components: Library (Lib)
messages: 385769
nosy: abo
priority: normal
severity: normal
status: open
title: random.py randrange() is very slow if the range is a power of 2.
type: performance
versions: Python 3.10, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43040>
_______________________________________

From report at bugs.python.org  Wed Jan 27 08:14:10 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 27 Jan 2021 13:14:10 +0000
Subject: [issue43040] random.py randrange() is very slow if the range is a
 power of 2.
In-Reply-To: <1611752833.52.0.275617605532.issue43040@roundup.psfhosted.org>
Message-ID: <1611753250.76.0.649884133807.issue43040@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
nosy: +mark.dickinson, rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43040>
_______________________________________

From report at bugs.python.org  Wed Jan 27 08:15:14 2021
From: report at bugs.python.org (Tadek Kijkowski)
Date: Wed, 27 Jan 2021 13:15:14 +0000
Subject: [issue42973] argparse: mixing optional and positional arguments...
 not again
In-Reply-To: <1611094894.69.0.476759327253.issue42973@roundup.psfhosted.org>
Message-ID: <1611753314.8.0.467897739035.issue42973@roundup.psfhosted.org>


Tadek Kijkowski <tkijkowski at gmail.com> added the comment:

I went with Paul's suggestion and added nargs='**' instead of greedy, so at this moment this PR doesn't introduce any changes in any public signatures.

I'm working on 'capture' actions, but I want that to be a separate PR and a separate issue because - first - it may be harder to accept as it is bigger change in both code and documentation and - second - it actually is a separate feature, which could be useful for optional arguments even without nargs='**' implemented.

So, what do you all think about this PR as it now? Docs and tests are updated.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42973>
_______________________________________

From report at bugs.python.org  Wed Jan 27 08:23:49 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 27 Jan 2021 13:23:49 +0000
Subject: [issue43039] tempfile.TemporaryDirectory() name string is incorrect
In-Reply-To: <1611752785.31.0.169033052217.issue43039@roundup.psfhosted.org>
Message-ID: <1611753829.61.0.480120926269.issue43039@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

It is a bug in gitPython.

As for adding a new feature, making TemporaryDirectory.__str__() returning just a name, I am not sure that it is needed, and it has drawbacks. If print() for TemporaryDirectory object will output just a directory name, it can create a false assumption that TemporaryDirectory() returns a string. Also, there are problems with bytes paths. You always can use the name attribute, str(td) is not better than td.name.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43039>
_______________________________________

From report at bugs.python.org  Wed Jan 27 08:34:07 2021
From: report at bugs.python.org (Mark Dickinson)
Date: Wed, 27 Jan 2021 13:34:07 +0000
Subject: [issue43040] random.py randrange() is very slow if the range is a
 power of 2.
In-Reply-To: <1611752833.52.0.275617605532.issue43040@roundup.psfhosted.org>
Message-ID: <1611754447.4.0.288954512066.issue43040@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

See also #37000.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43040>
_______________________________________

From report at bugs.python.org  Wed Jan 27 08:37:53 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 27 Jan 2021 13:37:53 +0000
Subject: [issue43037] Importlib reload by module name (String)
In-Reply-To: <1611749676.48.0.692377110291.issue43037@roundup.psfhosted.org>
Message-ID: <1611754673.75.0.852315161077.issue43037@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

It works as documented. reload() argument must be a module. If you have only module name, sys.modules is a mapping of module names to modules. It is trivial to combine two things in one line.

And why do you want to reload a module by name (without having a reference to module itself)? In general, reload() should be used with caution, it is easy to misuse it.

----------
nosy: +brett.cannon, eric.snow, ncoghlan, serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43037>
_______________________________________

From report at bugs.python.org  Wed Jan 27 08:46:06 2021
From: report at bugs.python.org (Eric V. Smith)
Date: Wed, 27 Jan 2021 13:46:06 +0000
Subject: [issue43039] tempfile.TemporaryDirectory() name string is incorrect
In-Reply-To: <1611752785.31.0.169033052217.issue43039@roundup.psfhosted.org>
Message-ID: <1611755166.44.0.94126923657.issue43039@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

I agree with Serhiy: changing TemporaryDirectory.__str__() definitely has drawbacks.

I assume gitPython is using str() where they might want to use os.fspath(). Maybe tempfile.TemporaryDirectory (and similar) could then support __fspath__.

----------
nosy: +eric.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43039>
_______________________________________

From report at bugs.python.org  Wed Jan 27 09:17:05 2021
From: report at bugs.python.org (Karthik Nishanth)
Date: Wed, 27 Jan 2021 14:17:05 +0000
Subject: [issue43035] FileNotFoundError in distutils\file_util.py copy_tree
In-Reply-To: <1611746436.35.0.546212642615.issue43035@roundup.psfhosted.org>
Message-ID: <1611757025.96.0.936373661279.issue43035@roundup.psfhosted.org>


Karthik Nishanth <karthik.nishanth at zivid.com> added the comment:

I made my version PEP440 (local version) compliant. Now I get an error in a different place and it makes more sense.

[WinError 206] The filename or extension is too long: 'build\\bdist.win-amd64\\wheel\\...\\purelib\\pkg..-2.3.0+b0105812.1.preview-py3.9.egg-info'

Is there a pythonic way of enabling long paths on windows?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43035>
_______________________________________

From report at bugs.python.org  Wed Jan 27 09:26:45 2021
From: report at bugs.python.org (Donovan Baarda)
Date: Wed, 27 Jan 2021 14:26:45 +0000
Subject: [issue43040] random.py randrange() is very slow if the range is a
 power of 2.
In-Reply-To: <1611752833.52.0.275617605532.issue43040@roundup.psfhosted.org>
Message-ID: <1611757605.63.0.842330583574.issue43040@roundup.psfhosted.org>


Change by Donovan Baarda <abo at minkirri.apana.org.au>:


----------
keywords: +patch
pull_requests: +23174
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24354

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43040>
_______________________________________

From report at bugs.python.org  Wed Jan 27 09:33:56 2021
From: report at bugs.python.org (Donovan Baarda)
Date: Wed, 27 Jan 2021 14:33:56 +0000
Subject: [issue43040] random.py randrange() is very slow if the range is a
 power of 2.
In-Reply-To: <1611752833.52.0.275617605532.issue43040@roundup.psfhosted.org>
Message-ID: <1611758036.53.0.793889209957.issue43040@roundup.psfhosted.org>


Donovan Baarda <abo at minkirri.apana.org.au> added the comment:

Thanks @mark.dickinson for the heads up on that issue. Comments in the code hinted that people had tried to tackle this but IMHO they missed the real fix.

I've submitted #24354 on github. It's missing an addition to the NEWS.d because I wasn't sure if something this small required it.

I've signed the CLA and it's just waiting to go through.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43040>
_______________________________________

From report at bugs.python.org  Wed Jan 27 09:35:17 2021
From: report at bugs.python.org (Stefan Mosoi)
Date: Wed, 27 Jan 2021 14:35:17 +0000
Subject: [issue43037] Importlib reload by module name (String)
In-Reply-To: <1611749676.48.0.692377110291.issue43037@roundup.psfhosted.org>
Message-ID: <1611758117.37.0.72483244377.issue43037@roundup.psfhosted.org>


Stefan Mosoi <st3f4n2006 at gmail.com> added the comment:

The motivation behind my request is as follow: 
I have a dynamic set class (i don't "know" it) and calling
__module__ for that class return a string, reload requires Module(and i don't think __module__ will be changed to module). The other functions (import, import_module) recieve a string. 
 
Maybe is trivial to add a one liner, but it's a bit confusing to call another function in another module than importlib.

Also (not from what i found when searching) there is no way to get the module from name without using import_module/import. 

maybe i found the solution, but there might be others that aren't so lucky.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43037>
_______________________________________

From report at bugs.python.org  Wed Jan 27 09:42:22 2021
From: report at bugs.python.org (Daniel Romberg)
Date: Wed, 27 Jan 2021 14:42:22 +0000
Subject: [issue43041] copying WeakValueDictionary is not iteration safe
Message-ID: <1611758542.35.0.93123255334.issue43041@roundup.psfhosted.org>


New submission from Daniel Romberg <daniel at romberg.io>:

The copy operation is not safe to use during iteration. The following test case raises a "RuntimeError: dictionary changed size during iteration":


import weakref

class Class:
  pass

def TEST_weakValue():
  d = weakref.WeakValueDictionary()
  a = Class()
  b = Class()
  d["a"] = a
  d["b"] = b
  e = d.copy()
  
  for key in e:
    a = None
    c = e.copy()

TEST_weakValue()


This is related to https://bugs.python.org/issue35615 where I commented as well, but I couldn't find a way to reopen this issue, which is why I open this one.

We experience a lot fewer crashes in weakref than before https://bugs.python.org/issue35615 had been fixed, however, there are recursive situations in which copy() is invoked while iterating the WeakValueDictionary (e.g., in our case it is a signal/slot implementation where the slots are stored in a WeakValueDictionary). _commit_removals(), which is called at the beginning of the copy operation, might change the dictionary if there are items that are to be removed. If there is an ongoing iteration, the corresponding RuntimeError is raised.

I haven't thought that through entirely, but I wonder whether the copy (and also deepcopy) operation could just blindly copy everything without "committing removals". After the copy, both instances would do their _commit_removals on their own upon access.

----------
components: Library (Lib)
messages: 385779
nosy: djromberg
priority: normal
severity: normal
status: open
title: copying WeakValueDictionary is not iteration safe
type: crash
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43041>
_______________________________________

From report at bugs.python.org  Wed Jan 27 09:59:20 2021
From: report at bugs.python.org (Mark Dickinson)
Date: Wed, 27 Jan 2021 14:59:20 +0000
Subject: [issue43040] random.py randrange() is very slow if the range is a
 power of 2.
In-Reply-To: <1611752833.52.0.275617605532.issue43040@roundup.psfhosted.org>
Message-ID: <1611759560.21.0.589423134319.issue43040@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

@Donovan: Please get Raymond Hettinger's sign-off before merging anything. 

In #37000, the decision not to change things wasn't because we missed a fix, but rather because it was decided that it was better to leave things as they were. I don't think anything's changed since then.

In particular, changes that affect reproducibility shouldn't be taken lightly, and this is such a change.

You mention a "very significant slowdown". Do you have numbers for the pre-PR and post-PR performance?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43040>
_______________________________________

From report at bugs.python.org  Wed Jan 27 09:59:33 2021
From: report at bugs.python.org (Stefan Mosoi)
Date: Wed, 27 Jan 2021 14:59:33 +0000
Subject: [issue43037] Importlib reload by module name (String)
In-Reply-To: <1611749676.48.0.692377110291.issue43037@roundup.psfhosted.org>
Message-ID: <1611759573.03.0.638080833446.issue43037@roundup.psfhosted.org>


Stefan Mosoi <st3f4n2006 at gmail.com> added the comment:

Also 
> without having a reference to module itself

reload() just gets the name of the module

    try:
        name = module.__spec__.name
    except AttributeError:
        name = module.__name__

and then 

if sys.modules.get(name) is not module

So it might be just check if is str just skip the tranformation to string.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43037>
_______________________________________

From report at bugs.python.org  Wed Jan 27 10:01:56 2021
From: report at bugs.python.org (Bis Matrimony)
Date: Wed, 27 Jan 2021 15:01:56 +0000
Subject: [issue42115] Caching infrastructure for the evaluation loop:
 specialised opcodes
In-Reply-To: <1603336898.74.0.366564812208.issue42115@roundup.psfhosted.org>
Message-ID: <1611759716.72.0.783052083989.issue42115@roundup.psfhosted.org>


Bis Matrimony <bismatrimony at gmail.com> added the comment:

I think it has something to do with the ENABLE_VIRTUAL_TERMINAL_PROCESSING flag which came to python.org
release: https://www.bismatrimony.com/
Implemented FR #72768 (Add ENABLE_VIRTUAL_TERMINAL_PROCESSING flag f

----------
nosy: +bismatrimony

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42115>
_______________________________________

From report at bugs.python.org  Wed Jan 27 10:16:17 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 27 Jan 2021 15:16:17 +0000
Subject: [issue42115] Caching infrastructure for the evaluation loop:
 specialised opcodes
In-Reply-To: <1603336898.74.0.366564812208.issue42115@roundup.psfhosted.org>
Message-ID: <1611760577.4.0.0192295582236.issue42115@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
Removed message: https://bugs.python.org/msg385782

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42115>
_______________________________________

From report at bugs.python.org  Wed Jan 27 10:37:29 2021
From: report at bugs.python.org (Torben Paetz)
Date: Wed, 27 Jan 2021 15:37:29 +0000
Subject: [issue43041] copying WeakValueDictionary is not iteration safe
In-Reply-To: <1611758542.35.0.93123255334.issue43041@roundup.psfhosted.org>
Message-ID: <1611761849.23.0.24606197781.issue43041@roundup.psfhosted.org>


Change by Torben Paetz <Torben.Paetz at mevis.fraunhofer.de>:


----------
nosy: +tpaetz

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43041>
_______________________________________

From report at bugs.python.org  Wed Jan 27 10:37:56 2021
From: report at bugs.python.org (Torben Paetz)
Date: Wed, 27 Jan 2021 15:37:56 +0000
Subject: [issue35615] "RuntimeError: Dictionary changed size during iteration"
 when copying a WeakValueDictionary
In-Reply-To: <1546116337.91.0.423915840639.issue35615@roundup.psfhosted.org>
Message-ID: <1611761876.4.0.436030076246.issue35615@roundup.psfhosted.org>


Change by Torben Paetz <Torben.Paetz at mevis.fraunhofer.de>:


----------
nosy: +tpaetz

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35615>
_______________________________________

From report at bugs.python.org  Wed Jan 27 10:40:26 2021
From: report at bugs.python.org (Christian Heimes)
Date: Wed, 27 Jan 2021 15:40:26 +0000
Subject: [issue43041] copying WeakValueDictionary is not iteration safe
In-Reply-To: <1611758542.35.0.93123255334.issue43041@roundup.psfhosted.org>
Message-ID: <1611762026.27.0.575824307627.issue43041@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

Do you see a crash or an exception? We use the term "crash" to refer to a segfault or other fatal crashes of the interpreter.

----------
nosy: +christian.heimes
versions:  -Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43041>
_______________________________________

From report at bugs.python.org  Wed Jan 27 10:42:49 2021
From: report at bugs.python.org (Donovan Baarda)
Date: Wed, 27 Jan 2021 15:42:49 +0000
Subject: [issue43040] random.py randrange() is very slow if the range is a
 power of 2.
In-Reply-To: <1611752833.52.0.275617605532.issue43040@roundup.psfhosted.org>
Message-ID: <1611762169.0.0.14277838671.issue43040@roundup.psfhosted.org>


Donovan Baarda <abo at minkirri.apana.org.au> added the comment:

I first noticed the problem when migrating a program doing lots of randrange(2**32) calls from python2 (using pypy -O) to python3 (using pypy3 -O) on Debian. The time results were;


pypy -O
real ? ?3m58.621s
user ? ?3m58.501s
sys ? ? 0m0.085s

pypy3 -O
real ? ?19m57.337s
user ? ?19m57.011s
sys ? ? 0m0.131s

So 5x slower. The execution times for python2 and python3 were too long for me to wait for (I'm guessing 30x those numbers). I realize pypy and pypy3 are not the same as cpython, but they use the same python random.py module, and after fiddling around with profiling it running under all of pypy, pypy3, python2, and python3 it became apparent that pypy and pypy3 was effectively reducing my program to mostly random() (python2) or getrandombits() (python3) calls from under randrange(), and python3 (and pypy3) was calling it 2x as many times. The general overheads of python2 and python3 made the speed differences harder to notice, as the main bottleneck shifted from getrandombits() to general-python-interpreting, but they were still there. So I could get a decent comparison between python2 and python3 without waiting till my retirement, I changed my program to do a fraction of the total work and timed them again, getting;

$ time pypy -O ./chunker.py chunker
real ? ?0m2.315s
user ? ?0m2.246s
sys ? ? 0m0.074s

$ time pypy3 -O ./chunker.py chunker
real ? ?0m12.922s
user ? ?0m12.850s
sys ? ? 0m0.073s

$ time python2 -O ./chunker.py chunker
real ? ?0m59.631s
user ? ?0m59.620s
sys ? ? 0m0.018s

$ time python3 -O ./chunker.py chunker
real ? ?1m2.588s
user ? ?1m2.536s
sys ? ? 0m0.037s

Some of the speed difference seems to be a bit of python2's random() is a little faster than python3's getrandombits(), and maybe python2 int vs python3 longint speed differences, but the 2x calls seemed to be the main killer.

I also stumbled onto several blogs talking about Python's random number generation being slow, including the following where I first spotted the problem;

https://eli.thegreenplace.net/2018/slow-and-fast-methods-for-generating-random-integers-in-python/

So it seems other people have noticed this is slow too. After reading this blog I switched to just calling getrandbits(32) directly and the timings went to;

$ time pypy -O ./chunker.py chunker
real ? ?0m4.164s
user ? ?0m4.121s
sys ? ? 0m0.049s

$ time pypy3 -O ./chunker.py chunker
real ? ?0m4.786s
user ? ?0m4.714s
sys ? ? 0m0.076s

$ time python2 -O ./chunker.py chunker
real ? ?0m44.869s
user ? ?0m44.826s
sys ? ? 0m0.044s

$ time python3 -O ./chunker.py chunker
real ? ?0m44.018s
user ? ?0m43.998s
sys ? ? 0m0.019s

So changing from randrange(2**32) to getrandbits(32) made pypy 0.55x as fast (random() vs getrandbits() under the hood), pypy3 2.7x faster, python2 1.3x faster and python3 1.4x faster.

Some of that is bypassing the call-layers between getrandbits() and randrange(), and profiling tells me the bit_length() call it skips was also pretty expensive, but the 2x getrandbits() bit was definitely most of it.

It is interesting random() used by python2 is a bit cheaper than getrandbits() too. Perhaps the default should be _randbelow_without_getrandbits()? I guess it has more limitations on range etc.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43040>
_______________________________________

From report at bugs.python.org  Wed Jan 27 10:44:33 2021
From: report at bugs.python.org (Daniel Romberg)
Date: Wed, 27 Jan 2021 15:44:33 +0000
Subject: [issue43041] copying WeakValueDictionary is not iteration safe
In-Reply-To: <1611758542.35.0.93123255334.issue43041@roundup.psfhosted.org>
Message-ID: <1611762273.21.0.941567819698.issue43041@roundup.psfhosted.org>


Daniel Romberg <daniel at romberg.io> added the comment:

Sorry, I meant an exception. I changed the type to "behavior", thanks for the hint.

----------
type: crash -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43041>
_______________________________________

From report at bugs.python.org  Wed Jan 27 11:01:11 2021
From: report at bugs.python.org (Ned Deily)
Date: Wed, 27 Jan 2021 16:01:11 +0000
Subject: [issue43038] ensurepip: tries to use setup.py/setup.cfg
In-Reply-To: <1611752697.42.0.4760269276.issue43038@roundup.psfhosted.org>
Message-ID: <1611763271.44.0.563804596191.issue43038@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Thanks for the report. This behavior has been reported in open issue issue42050. Feel free to add to the discussion there.

----------
nosy: +ned.deily
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> ensurepip fails if cwd contains illformed setup.cf

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43038>
_______________________________________

From report at bugs.python.org  Wed Jan 27 11:39:42 2021
From: report at bugs.python.org (Mark Shannon)
Date: Wed, 27 Jan 2021 16:39:42 +0000
Subject: [issue42979] _zoneinfo: zoneinfomodule_exec() doesn't check for
 PyDateTime_IMPORT failure
In-Reply-To: <1611163566.26.0.253539458839.issue42979@roundup.psfhosted.org>
Message-ID: <1611765582.97.0.735767018615.issue42979@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:


New changeset c9b8e9c421b57acdcaf24fab0c93bc29b3ef7c67 by Victor Stinner in branch 'master':
bpo-42979: Enhance abstract.c assertions checking slot result (GH-24352)
https://github.com/python/cpython/commit/c9b8e9c421b57acdcaf24fab0c93bc29b3ef7c67


----------
nosy: +Mark.Shannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42979>
_______________________________________

From report at bugs.python.org  Wed Jan 27 11:47:49 2021
From: report at bugs.python.org (Anthony Sottile)
Date: Wed, 27 Jan 2021 16:47:49 +0000
Subject: [issue3353] make built-in tokenizer available via Python C API
In-Reply-To: <1216035196.11.0.15913194841.issue3353@psf.upfronthosting.co.za>
Message-ID: <1611766069.79.0.685356721335.issue3353@roundup.psfhosted.org>


Anthony Sottile <asottile at umich.edu> added the comment:

I'm interested in it because the `tokenize` module is painfully slow

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue3353>
_______________________________________

From report at bugs.python.org  Wed Jan 27 11:59:47 2021
From: report at bugs.python.org (Ammar Askar)
Date: Wed, 27 Jan 2021 16:59:47 +0000
Subject: [issue42628] binascii doesn't work on some base64
In-Reply-To: <1607808198.75.0.933631782561.issue42628@roundup.psfhosted.org>
Message-ID: <1611766787.0.0.0117556601513.issue42628@roundup.psfhosted.org>


Ammar Askar <ammar at ammaraskar.com> added the comment:

It seems to me that your commands are just sequenced wrong, in Python you're performing (examples in parens):

* base64 (ue==) -> decode to binary (0xB9)
* binary (0xB9) -> encode to base64 (uQ==)

whereas in your command line commands you're doing:

* base64 (ue==) -> encode to double base64 (dWU9PQo=)
* double base64 (dWU9PQo=) -> decoded to base64 (ue==)


If we do the same thing on the command line as you're doing in Python, we get:

$ echo "base64encodedvalue==" | base64 -d | base64
base64encodedvaluQ==

$ echo "ue==" | base64 -d | base64
uQ==

$ echo "base64encodedvalue==" | openssl enc -d -base64 -A | openssl enc -base64 -A
base64encodedvaluQ==

----------
nosy: +ammar2

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42628>
_______________________________________

From report at bugs.python.org  Wed Jan 27 12:05:53 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 27 Jan 2021 17:05:53 +0000
Subject: [issue3353] make built-in tokenizer available via Python C API
In-Reply-To: <1216035196.11.0.15913194841.issue3353@psf.upfronthosting.co.za>
Message-ID: <1611767153.44.0.200908596269.issue3353@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> I'm interested in it because the `tokenize` module is painfully slow

I assumed, but I don't feel confortable exposing the built-in one.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue3353>
_______________________________________

From report at bugs.python.org  Wed Jan 27 12:10:10 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 27 Jan 2021 17:10:10 +0000
Subject: [issue3353] make built-in tokenizer available via Python C API
In-Reply-To: <1216035196.11.0.15913194841.issue3353@psf.upfronthosting.co.za>
Message-ID: <1611767410.32.0.226411009294.issue3353@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> I assumed, but I don't feel confortable exposing the built-in one.

As an example of the situation, I want to avoid: every time we change anything in the AST because of internal details we have many complains and pressure from tool authors because they need to add branches or because it makes life more difficult for them it and I absolutely want to avoid more of that.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue3353>
_______________________________________

From report at bugs.python.org  Wed Jan 27 12:18:04 2021
From: report at bugs.python.org (Anthony Sottile)
Date: Wed, 27 Jan 2021 17:18:04 +0000
Subject: [issue3353] make built-in tokenizer available via Python C API
In-Reply-To: <1216035196.11.0.15913194841.issue3353@psf.upfronthosting.co.za>
Message-ID: <1611767884.2.0.970913821693.issue3353@roundup.psfhosted.org>


Anthony Sottile <asottile at umich.edu> added the comment:

you already have that right now because the `tokenize` module is exposed. (except that every change to the tokenization requires it to be implemented once in C and once in python)

it's much more frustrating when the two differ as well

I don't think all the internals of the C tokenization need to be exposed, my main goals would be:

- expose enough information to reimplement Lib/tokenize.py
- replace Lib/tokenize.py with the C tokenizer

and the reasons would be:

- eliminate the (potential) drift and complexity between the two
- get a fast tokenizer


Unlike the AST, the tokenization changes much less frequently (last major addition I can remember is the `@` operator


We can hide almost all of the details of the tokenization behind an opaque struct and getter functions

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue3353>
_______________________________________

From report at bugs.python.org  Wed Jan 27 12:36:58 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 27 Jan 2021 17:36:58 +0000
Subject: [issue3353] make built-in tokenizer available via Python C API
In-Reply-To: <1216035196.11.0.15913194841.issue3353@psf.upfronthosting.co.za>
Message-ID: <1611769018.83.0.920776810469.issue3353@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

For reimplementing Lib/tokenize.py we don't need to publicly expose anything in the C-API. We can have a private _tokenize module with uses whatever you need and then you use that _tokenize module in the tokenize.py file to reimplement the exact Python API that the module exposes.

Publicly exposing the headers or APIs opens new boxes of potential problems: ABI stability, changes in the signatures, changes in the structs. Our experience so far with other parts is that almost always is painful to add optimization to internal functions that are partially exposed, so I am still not convinced offering public C-APIs for the builtin tokenizer.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue3353>
_______________________________________

From report at bugs.python.org  Wed Jan 27 12:43:25 2021
From: report at bugs.python.org (Anthony Sottile)
Date: Wed, 27 Jan 2021 17:43:25 +0000
Subject: [issue3353] make built-in tokenizer available via Python C API
In-Reply-To: <1216035196.11.0.15913194841.issue3353@psf.upfronthosting.co.za>
Message-ID: <1611769405.04.0.0740122105725.issue3353@roundup.psfhosted.org>


Anthony Sottile <asottile at umich.edu> added the comment:

private api sounds fine too -- I thought it was necessary to implement the module (as it needs external linkage) but if it isn't then even better

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue3353>
_______________________________________

From report at bugs.python.org  Wed Jan 27 12:47:38 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 27 Jan 2021 17:47:38 +0000
Subject: [issue3353] make built-in tokenizer available via Python C API
In-Reply-To: <1216035196.11.0.15913194841.issue3353@psf.upfronthosting.co.za>
Message-ID: <1611769658.78.0.0361863665553.issue3353@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> private api sounds fine too -- I thought it was necessary to implement the module (as it needs external linkage) but if it isn't then even better

We can make it builtin the same way we do for the _ast module, or we can have a new module under Modules (exposing the symbols in the dynamic table) **but** making them private (and not documented), which explicitly goes against what this issue proposes.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue3353>
_______________________________________

From report at bugs.python.org  Wed Jan 27 13:08:34 2021
From: report at bugs.python.org (Anthony Sottile)
Date: Wed, 27 Jan 2021 18:08:34 +0000
Subject: [issue3353] make built-in tokenizer available via Python C API
In-Reply-To: <1216035196.11.0.15913194841.issue3353@psf.upfronthosting.co.za>
Message-ID: <1611770914.21.0.192052906184.issue3353@roundup.psfhosted.org>


Anthony Sottile <asottile at umich.edu> added the comment:

Either works for me, would you be able to point me to the starting bits as to how `_ast` becomes builtin?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue3353>
_______________________________________

From report at bugs.python.org  Wed Jan 27 13:11:18 2021
From: report at bugs.python.org (Xavier Morel)
Date: Wed, 27 Jan 2021 18:11:18 +0000
Subject: [issue43036] TOS-behaviour documentation is inconsistent
In-Reply-To: <1611747588.28.0.967739305084.issue43036@roundup.psfhosted.org>
Message-ID: <1611771078.63.0.671398329063.issue43036@roundup.psfhosted.org>


Change by Xavier Morel <xavier.morel at masklinn.net>:


----------
title: TOS-behaviour documentation is -> TOS-behaviour documentation is inconsistent

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43036>
_______________________________________

From report at bugs.python.org  Wed Jan 27 13:13:38 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 27 Jan 2021 18:13:38 +0000
Subject: [issue3353] make built-in tokenizer available via Python C API
In-Reply-To: <1216035196.11.0.15913194841.issue3353@psf.upfronthosting.co.za>
Message-ID: <1611771218.31.0.550604151888.issue3353@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> Either works for me, would you be able to point me to the starting bits as to how `_ast` becomes builtin?


https://github.com/python/cpython/blob/master/Python/Python-ast.c#L10075-L10079 

and 

https://github.com/python/cpython/blob/63298930fb531ba2bb4f23bc3b915dbf1e17e9e1/PC/config.c#L84

But before that I have some questions. For example: How do you plan to implement the readline() interface that tokenize.py uses in the c-module without modifying tokenize.c?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue3353>
_______________________________________

From report at bugs.python.org  Wed Jan 27 13:19:20 2021
From: report at bugs.python.org (Anthony Sottile)
Date: Wed, 27 Jan 2021 18:19:20 +0000
Subject: [issue3353] make built-in tokenizer available via Python C API
In-Reply-To: <1216035196.11.0.15913194841.issue3353@psf.upfronthosting.co.za>
Message-ID: <1611771560.11.0.270247444978.issue3353@roundup.psfhosted.org>


Anthony Sottile <asottile at umich.edu> added the comment:

I haven't looked into or thought about that yet, it might not be possible

It might also make sense to build new tokenize.py apis avoiding the `readline()` api -- I always found it painful to work with

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue3353>
_______________________________________

From report at bugs.python.org  Wed Jan 27 13:22:11 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 27 Jan 2021 18:22:11 +0000
Subject: [issue3353] make built-in tokenizer available via Python C API
In-Reply-To: <1216035196.11.0.15913194841.issue3353@psf.upfronthosting.co.za>
Message-ID: <1611771731.67.0.532119614725.issue3353@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> It might also make sense to build new tokenize.py apis avoiding the `readline()` api -- I always found it painful to work with

Then we would need to maintain the old Python APIs + the new ones using the module? What you are proposing seems more than just speeding up tokenize.py re-using the existing c code

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue3353>
_______________________________________

From report at bugs.python.org  Wed Jan 27 13:42:22 2021
From: report at bugs.python.org (Jesse Silverman)
Date: Wed, 27 Jan 2021 18:42:22 +0000
Subject: [issue43042] tutorial ambiguous about creation of local symbol table
 for recursive calls
Message-ID: <1611772942.43.0.309900316345.issue43042@roundup.psfhosted.org>


New submission from Jesse Silverman <jessevsilverman at gmail.com>:

In section 4.6 of the tutorial, we find:

"When a function calls another function, a new local symbol table is created for that call."

Now, perhaps because we were just looking at a function that people will often ask you to write both recursively and non-recursively and then ask which one you would use and why...I was thinking "Wait -- when a function calls itself recursively, obviously they need a new local symbol table or local variables won't work??"

I may be confused, in which case the doc is fine and I personally need to better understand the moral equivalent of activation record / stack frame in Python.

If I am not, given that recursion isn't much more computer science oriented or obscure than Fibonacci sequences, could it not be worth the investment of a few extra words as:

"When a function calls another function, or calls itself recursively, a new local symbol table is created for that call."

----------
assignee: docs at python
components: Documentation
messages: 385800
nosy: docs at python, jessevsilverman
priority: normal
severity: normal
status: open
title: tutorial ambiguous about creation of local symbol table for recursive calls
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43042>
_______________________________________

From report at bugs.python.org  Wed Jan 27 13:49:22 2021
From: report at bugs.python.org (Kuang-che Wu)
Date: Wed, 27 Jan 2021 18:49:22 +0000
Subject: [issue22401] argparse: 'resolve' conflict handler damages the actions
 of the parent parser
In-Reply-To: <1410673598.78.0.274465754789.issue22401@psf.upfronthosting.co.za>
Message-ID: <1611773362.29.0.0366631339302.issue22401@roundup.psfhosted.org>


Change by Kuang-che Wu <kcwu at csie.org>:


----------
nosy: +kcwu

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue22401>
_______________________________________

From report at bugs.python.org  Wed Jan 27 14:00:31 2021
From: report at bugs.python.org (Jerry Heiselman)
Date: Wed, 27 Jan 2021 19:00:31 +0000
Subject: [issue2824] zipfile to handle duplicate files in archive
In-Reply-To: <1210537070.35.0.0613996133193.issue2824@psf.upfronthosting.co.za>
Message-ID: <1611774031.04.0.627966011199.issue2824@roundup.psfhosted.org>


Jerry Heiselman <jerry at heiselman.com> added the comment:

This just bit us too. I don't feel like a warning is enough. In our case, we want to prevent it from happening to begin with so that a developer who isn't expecting this doesn't have to know ahead of time to check for a file.

Once a duplicate is in the zip file, it is maintained in the listing of files, but deleting one of the entries using Windows explorer results in both entries being deleted which can (and has) led to a loss of data. So preventing it from happening in the first place seems more prudent. Of course, allow an override with a parameter to .write() perhaps.

----------
nosy: +jheiselman

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue2824>
_______________________________________

From report at bugs.python.org  Wed Jan 27 14:03:47 2021
From: report at bugs.python.org (Jerry Heiselman)
Date: Wed, 27 Jan 2021 19:03:47 +0000
Subject: [issue2824] zipfile to handle duplicate files in archive
In-Reply-To: <1210537070.35.0.0613996133193.issue2824@psf.upfronthosting.co.za>
Message-ID: <1611774227.78.0.375096455568.issue2824@roundup.psfhosted.org>


Jerry Heiselman <jerry at heiselman.com> added the comment:

Further, some tools like zipgrep, seem to iterate over the toc in the zipfile and end up running the grep part once per entry leading to some duplication of data returned without it being obvious that there wasn't actually duplicate data in the zip archive.

Interestingly, the zipfile module does not expose the duplicate toc entries using 'python -m zipfile -l <file.zip>', so it's hiding the issue itself.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue2824>
_______________________________________

From report at bugs.python.org  Wed Jan 27 14:04:41 2021
From: report at bugs.python.org (Brett Cannon)
Date: Wed, 27 Jan 2021 19:04:41 +0000
Subject: [issue43037] Importlib reload by module name (String)
In-Reply-To: <1611749676.48.0.692377110291.issue43037@roundup.psfhosted.org>
Message-ID: <1611774281.57.0.262755485689.issue43037@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

Thanks for the idea, Stefan, but I'm going to close this as something we don't want to do. `importlib.reload()` purposefully takes a module object as that's what is going to get mutated/changed and it must already exist. The other importlib functions take a string because the module might not even exist yet.

And as Serhiy said, reloading is a bit dangerous and shouldn't be taken lightly. It primarily exists to reload a module when you're working in the REPL and editing a file live, not for anything fancy during execution of production code. So keeping it squarely targeted the REPL case and making it a bit harder for other cases is a good thing in my opinion.

----------
resolution:  -> rejected
stage:  -> resolved
status: open -> closed
versions: +Python 3.10 -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43037>
_______________________________________

From report at bugs.python.org  Wed Jan 27 14:12:58 2021
From: report at bugs.python.org (Glenn Linderman)
Date: Wed, 27 Jan 2021 19:12:58 +0000
Subject: [issue42973] argparse: mixing optional and positional arguments...
 not again
In-Reply-To: <1611094894.69.0.476759327253.issue42973@roundup.psfhosted.org>
Message-ID: <1611774778.7.0.031407527691.issue42973@roundup.psfhosted.org>


Glenn Linderman <v+python at g.nevcal.com> added the comment:

Yes I think this is a useful enabling step toward enhanced functionality, as is.

But I think the learning curve to achieve the enhanced functionality is a bit high for most people, as it requires too much knowledge of argparse internals, so I really look forward to your followon work on 'capture' actions. which will be an enhancement that will not require internals knowledge, and will resolve a day-one deficiency in argparse in a nicely backward-compatible manner.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42973>
_______________________________________

From report at bugs.python.org  Wed Jan 27 14:14:36 2021
From: report at bugs.python.org (Stefan Mosoi)
Date: Wed, 27 Jan 2021 19:14:36 +0000
Subject: [issue43037] Importlib reload by module name (String)
In-Reply-To: <1611749676.48.0.692377110291.issue43037@roundup.psfhosted.org>
Message-ID: <1611774876.76.0.703736354278.issue43037@roundup.psfhosted.org>


Stefan Mosoi <st3f4n2006 at gmail.com> added the comment:

I understand. 
I was using to reload some classes that might have changed/added (updates and stuff) without having to reload the hole project. There might be some other ways (i found this, and didn't keep researching after).
The documentation didn't warned / informed about real live usage or intentions for this to exist(like in REPL).

I will continue using this as i use it now and i fully accept the consequences. 

Thank you for the time and answers.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43037>
_______________________________________

From report at bugs.python.org  Wed Jan 27 14:46:36 2021
From: report at bugs.python.org (Aviral Srivastava)
Date: Wed, 27 Jan 2021 19:46:36 +0000
Subject: [issue38307] Provide Class' end line in pyclbr module
In-Reply-To: <1569691590.29.0.185701662636.issue38307@roundup.psfhosted.org>
Message-ID: <1611776796.19.0.253977937028.issue38307@roundup.psfhosted.org>


Aviral Srivastava <avi.srivastava254084 at gmail.com> added the comment:

I have made the changes and tested, my builds were successful. Please review it? 

CC @brandtbucher, @steven.daprano

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38307>
_______________________________________

From report at bugs.python.org  Wed Jan 27 15:58:53 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 27 Jan 2021 20:58:53 +0000
Subject: [issue3353] make built-in tokenizer available via Python C API
In-Reply-To: <1216035196.11.0.15913194841.issue3353@psf.upfronthosting.co.za>
Message-ID: <1611781133.91.0.455503481075.issue3353@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

I have built a draft of how the changes required to make what you describe, in case you want to finish them:

https://github.com/pablogsal/cpython/tree/tokenizer_mod

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue3353>
_______________________________________

From report at bugs.python.org  Wed Jan 27 16:03:10 2021
From: report at bugs.python.org (paul j3)
Date: Wed, 27 Jan 2021 21:03:10 +0000
Subject: [issue42973] argparse: mixing optional and positional arguments...
 not again
In-Reply-To: <1611094894.69.0.476759327253.issue42973@roundup.psfhosted.org>
Message-ID: <1611781390.32.0.150760088961.issue42973@roundup.psfhosted.org>


paul j3 <ajipanca at gmail.com> added the comment:

So in the big picture, the purpose of this change is to treat the inputs like a kind of state-machine.

In the bigger example, the `**` positional values are processed one by one, using the interspersed optionals to set state parameters.

`args.sources` then ends up as a list of dicts, each of the form:

    {'name': 'input3.txt', 'frobnicate': None, 'massage_level': 5}

where 'name' is the positional value, and 'frobnicate' and 'massage_level' are the latest values (default or user supplied).  The optionals can be specified in any order or repeatedly.

While the proposed change to the core parser is (apparently) minor, it does occur at the center of the action.  That is not the place we want any (new) bugs or backward incompatibility.  And the full implementation requires a new Action subclass that is quite different from existing ones.

Given how different this is from the normal argparse parsing (and the POSIX parsing argparse seeks to emulate), I question the wisdom of adding this, in part or whole, to the stock distribution.  It could certainly be published as a pypi.  That already has a number of  parsers, some built on argparse, others stand alone.

I also wonder whether it would be simpler to do this kind of parsing directly from sys.argv.  Just step through that list, consuming the values and flags in sequence.  

Sorry to sound like a wet blanket, but I've seen too many seemingly innocent patches that caused unforeseen problems down the line.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42973>
_______________________________________

From report at bugs.python.org  Wed Jan 27 16:13:16 2021
From: report at bugs.python.org (paul j3)
Date: Wed, 27 Jan 2021 21:13:16 +0000
Subject: [issue42973] argparse: mixing optional and positional arguments...
 not again
In-Reply-To: <1611094894.69.0.476759327253.issue42973@roundup.psfhosted.org>
Message-ID: <1611781996.44.0.0605969591679.issue42973@roundup.psfhosted.org>


paul j3 <ajipanca at gmail.com> added the comment:

Sometimes patches have unforeseen benefits.  My earlier patch for this issue, parse_intermixed_args, has been useful beyond the OP's case.

https://stackoverflow.com/questions/50916124/allow-positional-command-line-arguments-with-nargs-to-be-seperated-by-a-flag

https://bugs.python.org/issue15112
argparse: nargs='*' positional argument doesn't accept any items if preceded by an option and another positional

With

     usage: test.py [-h] [-a A] b [c]

and 

     test.py B -a A C

has problems because the optional '[c]' positional is used up when 'b' is processed.   Intermixed gets around this by first processing '-a', and then handling 'b [c]' together.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42973>
_______________________________________

From report at bugs.python.org  Wed Jan 27 16:14:20 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 27 Jan 2021 21:14:20 +0000
Subject: [issue3353] make built-in tokenizer available via Python C API
In-Reply-To: <1216035196.11.0.15913194841.issue3353@psf.upfronthosting.co.za>
Message-ID: <1611782060.01.0.467016921921.issue3353@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Problems that you are going to find:

* The c tokenizer throws syntax errors while the tokenizer module does not. For example:

? python -c "1_"
  File "<string>", line 1
    1_
     ^
SyntaxError: invalid decimal literal

? python -m tokenize <<< "1_"
1,0-1,1:            NUMBER         '1'
1,1-1,2:            NAME           '_'
1,2-1,3:            NEWLINE        '\n'
2,0-2,0:            ENDMARKER      ''

* The encoding cannot be immediately specified. You need to thread it in many places.

* The readline() function can now return whatever or be whatever, that needs to be handled (better) in the c tokenizer to not crash.

* str/bytes in the c tokenizer.

* The c tokenizer does not get the full line in some cases or is tricky to get the full line.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue3353>
_______________________________________

From report at bugs.python.org  Wed Jan 27 16:20:10 2021
From: report at bugs.python.org (Steve Dower)
Date: Wed, 27 Jan 2021 21:20:10 +0000
Subject: [issue41282] Deprecate and remove distutils
In-Reply-To: <1594542625.3.0.789939298104.issue41282@roundup.psfhosted.org>
Message-ID: <1611782410.12.0.847709137679.issue41282@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
pull_requests: +23178
pull_request: https://github.com/python/cpython/pull/24355

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41282>
_______________________________________

From report at bugs.python.org  Wed Jan 27 16:24:10 2021
From: report at bugs.python.org (Steve Dower)
Date: Wed, 27 Jan 2021 21:24:10 +0000
Subject: [issue41282] Deprecate and remove distutils
In-Reply-To: <1594542625.3.0.789939298104.issue41282@roundup.psfhosted.org>
Message-ID: <1611782650.33.0.725782947134.issue41282@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

That PR is just to add the import warning and update docs. I want to make sure that's in asap so we don't miss the release.

Is there anywhere else in the docs that needs a note? Distutils has been marked as deprecated for years already, so it's really just emphasising that and adding the 3.12 removal date. I think whatsnew, library and the old doc sections is enough, yeah?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41282>
_______________________________________

From report at bugs.python.org  Wed Jan 27 17:01:00 2021
From: report at bugs.python.org (Jesse Silverman)
Date: Wed, 27 Jan 2021 22:01:00 +0000
Subject: [issue43043] Python tutorial could make rules for default argument
 definition clearer
Message-ID: <1611784860.27.0.764773083907.issue43043@roundup.psfhosted.org>


New submission from Jesse Silverman <jessevsilverman at gmail.com>:

I love the tutorial, but have been pointing out things I only knew from brutal experience, other tutorials, reasoning from other languages I know better, or looking things up.  I only mention them if they seem in scope and at the same level of the material which is presented.

Regarding 4.7.1. Default Argument Values of the excellent Python tutorial:

I guessed that I would see the behavior shown below from my understanding of default arguments in several other languages.  I did not read anything in this tutorial section that would lead me to conclude this, and other things mentioned in this section are neither much more or less subtle, more or less obvious, or more or less important.

PS F:\PythonCode> py VarArgs.py
  File "F:\PythonCode\VarArgs.py", line 1
    def varArgs(quote, footnote='', times):
                                         ^
SyntaxError: non-default argument follows default argument

Most introductions to default argument definition in other languages go out of their way to highlight that the default parameters can be only the last N of them, and that all required ones must come first.
Python is intended to be accessible to people no more clever than the other languages intend, so tho it seems obvious to me that they must only come after all required arguments, I remember when it was not obvious (and fortunately the tutorials I read in the past for other languages belabored the point).

The explanatory text of:
giving one of the optional arguments: ask_ok('OK to overwrite the file?', 2)

as it merely says "one of", rather than "the first of" led me to wonder if Python was somehow more flexible/better at mind-reading than the languages I already know well that require all default args to be trailing, and to only let you default the last one, two, or ... N.  The results of the experiment shown above demonstrate it is similar to the behavior in other languages in this regard.

I deeply appreciate the information about when the default arguments get evaluated, which is highly relevant and is not something I would have picked up on from other languages I've used.

A simple line stating that "any default arguments must follow any required arguments in the definition" and something like "on calls, optional arguments may only be omitted from the end of the parameter list, they can't simply be skipped" would be awesome.

I am not sure whether or not this is made perfectly clear in the next section, which has a lot of other new and interesting ideas flying around in it as well, besides this one.

----------
assignee: docs at python
components: Documentation
messages: 385813
nosy: docs at python, jessevsilverman
priority: normal
severity: normal
status: open
title: Python tutorial could make rules for default argument definition clearer
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43043>
_______________________________________

From report at bugs.python.org  Wed Jan 27 17:34:04 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Wed, 27 Jan 2021 22:34:04 +0000
Subject: [issue38307] Add .end_lineno attribute to pyclbr _Objects
In-Reply-To: <1569691590.29.0.185701662636.issue38307@roundup.psfhosted.org>
Message-ID: <1611786844.85.0.0551658813865.issue38307@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

The answer, Aviral discovered,  is that current ast nodes have end_lineno attributes, so the patch amounts to consistently copying them.

I don't understand Aviral's use case either, but an item on my IDLE wish list is to be able to move class and function definitions within a file by moving the Class and Function entries within the browser tree.  This requieres end lines and having it be an attribute is easier and more accurate than recalculating it.  Merely clicking on an entry could highlight the whole definition.  Other people might think of other uses.

An issue in the patch is inserting parameter 'end_line' after 'line'.  Normally, new parameters have to go at the end, but:

1. Inserting 'end_line' after 'line' makes the code easier to read.

2. The parameter or parameters at the end have default values.  If we added 'end_line=None', we would have to consider what to do when it is omitted.

3. https://docs.python.org/3/library/pyclbr.html#module-pyclbr, which I rewrote in 2017, documents readline and readline_ex as the public call interface.  They return a hierarchical structure that includes Functions and Classes in the dict values.  Their signatures are intentionally omitted and the attributes are only listed after saying "Users are not expected to create instances of these classes."

I posted "What is the pyclbr public API" to pydev asking about this issue.

----------
nosy: +terry.reedy
title: Provide Class' end line in pyclbr module -> Add .end_lineno attribute to pyclbr _Objects
versions: +Python 3.10 -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38307>
_______________________________________

From report at bugs.python.org  Wed Jan 27 17:48:33 2021
From: report at bugs.python.org (Donovan Baarda)
Date: Wed, 27 Jan 2021 22:48:33 +0000
Subject: [issue43040] random.py randrange() is very slow if the range is a
 power of 2.
In-Reply-To: <1611752833.52.0.275617605532.issue43040@roundup.psfhosted.org>
Message-ID: <1611787713.43.0.452184498716.issue43040@roundup.psfhosted.org>


Donovan Baarda <abo at minkirri.apana.org.au> added the comment:

FTR, more articles about the slowness of generating random integers in Python;

https://lemire.me/blog/2016/03/21/ranged-random-number-generation-is-slow-in-python/

https://www.reddit.com/r/Python/comments/jn0bb/randomrandint_vs_randomrandom_why_is_one_15x/

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43040>
_______________________________________

From report at bugs.python.org  Wed Jan 27 17:57:54 2021
From: report at bugs.python.org (Aviral Srivastava)
Date: Wed, 27 Jan 2021 22:57:54 +0000
Subject: [issue38307] Add .end_lineno attribute to pyclbr _Objects
In-Reply-To: <1569691590.29.0.185701662636.issue38307@roundup.psfhosted.org>
Message-ID: <1611788274.22.0.340774166183.issue38307@roundup.psfhosted.org>


Aviral Srivastava <avi.srivastava254084 at gmail.com> added the comment:

Hey Terry, thanks for commenting. I have a few questions to ask you, please pardon my lack of awareness.

>This requieres end lines and having it be an attribute is easier and more accurate than recalculating it.

How do you recalculate the end_lineno?


Since all the objects that _start_, have an _end_ too, would `end_lineno=None` make any sense?


I could not make anything out of your third point where you mention `readline` and `readline_ex`. Can you explain that point?


>I posted "What is the pyclbr public API" to pydev asking about this issue.

Can you share the link of your post?


As for my use case, I need the scope of a class and a function in the new tool that I am developing. My tool is to generate a new type of UML diagrams for a given codebase. Do check it out and leave your critical feedback: https://github.com/kebab-mai-haddi/gruml

I need to know about the scope (start and end) so that I can deduce whether the "used_at" attribute of an object is within a class. This will help me deduce whether a particular class (or a function) uses any imported object. This is to deduce the dependency of a class on other classes and functions.

Currently, I have to edit the pyclbr and make it custom, then, had to Dockerize the whole thing. So, want to contribute to `cpython` so that this feature is present at the source itself.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38307>
_______________________________________

From report at bugs.python.org  Wed Jan 27 18:03:30 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 27 Jan 2021 23:03:30 +0000
Subject: [issue42955] Add sys.stdlib_module_names: list of stdlib module names
 (Python and extension modules)
In-Reply-To: <1610964514.06.0.696047252341.issue42955@roundup.psfhosted.org>
Message-ID: <1611788610.69.0.465460913329.issue42955@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 64fc105b2d2faaeadd1026d2417b83915af6622f by Victor Stinner in branch 'master':
bpo-42955: Remove sub-packages from sys.stdlib_module_names (GH-24353)
https://github.com/python/cpython/commit/64fc105b2d2faaeadd1026d2417b83915af6622f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42955>
_______________________________________

From report at bugs.python.org  Wed Jan 27 18:14:19 2021
From: report at bugs.python.org (Gregory P. Smith)
Date: Wed, 27 Jan 2021 23:14:19 +0000
Subject: [issue36379] nb_inplace_pow is always called with an invalid argument
In-Reply-To: <1553083293.5.0.811205671176.issue36379@roundup.psfhosted.org>
Message-ID: <1611789259.16.0.585247944657.issue36379@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

I'm pretty sure this is fixed for 3.8+.

whether or not it should be considered a bugfix and backported to 3.7.x is probably too late at this point in release lifecycles anyways.

thanks for raising this and the fixing PR!

----------
nosy: +gregory.p.smith
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36379>
_______________________________________

From report at bugs.python.org  Wed Jan 27 18:19:18 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Wed, 27 Jan 2021 23:19:18 +0000
Subject: [issue38307] Add .end_lineno attribute to pyclbr _Objects
In-Reply-To: <1569691590.29.0.185701662636.issue38307@roundup.psfhosted.org>
Message-ID: <1611789558.43.0.185146370215.issue38307@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

If IDLE were to recalculate the end from start, it would have to more or less parse forward to find the end of the statement.  This is why I considered it a speculative wish.

> would `end_lineno=None` make any sense?  
Only as a kludge if a default were required because of the signature position.

Point 3: The existing doc implies but does not exactly state that the _Object signature are private, so that we could break any possibly existing (but possibly not, and discouraged) use.  I think back-compatibility is discussed in the devguide.

Posts do not have a link until distributed, and then you can find it on mail.python.org.  The title is sufficient to do that.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38307>
_______________________________________

From report at bugs.python.org  Wed Jan 27 18:24:41 2021
From: report at bugs.python.org (Donovan Baarda)
Date: Wed, 27 Jan 2021 23:24:41 +0000
Subject: [issue43040] random.py randrange() is very slow if the range is a
 power of 2.
In-Reply-To: <1611752833.52.0.275617605532.issue43040@roundup.psfhosted.org>
Message-ID: <1611789881.65.0.885618959547.issue43040@roundup.psfhosted.org>


Donovan Baarda <abo at minkirri.apana.org.au> added the comment:

I had a look at the C implementation of getrandbits() and spotted this;

https://github.com/python/cpython/blob/64fc105b2d2faaeadd1026d2417b83915af6622f/Modules/_randommodule.c#L487

In my case I was also being hit by randrange(2**32) calling getrandbits(33) just pushing it past using the optimized fast-path for ranges needing <=32 bits. So not only was it calling getrandbits() 2x as many times as necessary, under the hood it was generating 64 random bits each time using a slow path.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43040>
_______________________________________

From report at bugs.python.org  Wed Jan 27 18:26:36 2021
From: report at bugs.python.org (=?utf-8?b?0JHQvtGA0LjRgSDQktC10YDRhdC+0LLRgdC60LjQuQ==?=)
Date: Wed, 27 Jan 2021 23:26:36 +0000
Subject: [issue43044] Python 2.7 documentation links to 404 pages when the
 library was moved or renamed
Message-ID: <1611789996.46.0.13568536358.issue43044@roundup.psfhosted.org>


New submission from ????? ?????????? <boris.verk at gmail.com>:

1. go to https://docs.python.org/2/library/stringio.html (note the "/2/")
2. click on "You should upgrade and read the Python documentation for the current stable release." at the top

I expect to be sent to the Python 3 documentation for StringIO (or at least the index.html page of the Python 3 documentaion) but because StringIO was moved from its own library into `io`, the Python 2 docs are linking to a 404 error page, because they just rewrite "/2/" to "/3/" in the URL.

See attached PR for a list of all these broken pages and where they could redirect to.

----------
assignee: docs at python
components: Documentation
messages: 385821
nosy: boris, docs at python
priority: normal
pull_requests: 23179
severity: normal
status: open
title: Python 2.7 documentation links to 404 pages when the library was moved or renamed
type: enhancement
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43044>
_______________________________________

From report at bugs.python.org  Wed Jan 27 18:30:33 2021
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 27 Jan 2021 23:30:33 +0000
Subject: [issue43044] Python 2.7 documentation links to 404 pages when the
 library was moved or renamed
In-Reply-To: <1611789996.46.0.13568536358.issue43044@roundup.psfhosted.org>
Message-ID: <1611790233.67.0.972407946542.issue43044@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The Python 2.7 branch has been removed: https://github.com/python/cpython/pull/24195#issuecomment-768474389

I close the issue. Please use the Python 3 documentation.

----------
nosy: +vstinner
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43044>
_______________________________________

From report at bugs.python.org  Wed Jan 27 18:43:06 2021
From: report at bugs.python.org (Lennart Borgman)
Date: Wed, 27 Jan 2021 23:43:06 +0000
Subject: [issue43045] Instructions for installing pip on Ubuntu/WSL2 is
 incomplete
Message-ID: <1611790986.57.0.0815546947787.issue43045@roundup.psfhosted.org>


New submission from Lennart Borgman <lennart.borgman at gmail.com>:

Please see here for details:

https://stackoverflow.com/questions/65928875/no-module-named-pip-python-3-9/65929009#65929009

----------
messages: 385823
nosy: lennart.borgman
priority: normal
severity: normal
status: open
title: Instructions for installing pip on Ubuntu/WSL2 is incomplete
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43045>
_______________________________________

From report at bugs.python.org  Wed Jan 27 18:52:12 2021
From: report at bugs.python.org (Tadek Kijkowski)
Date: Wed, 27 Jan 2021 23:52:12 +0000
Subject: [issue43046] argparse: capturing actions
Message-ID: <1611791532.72.0.119102600348.issue43046@roundup.psfhosted.org>


New submission from Tadek Kijkowski <tkijkowski at gmail.com>:

This is spinoff from issue42973.

The purpose of this issue is to provide set of additional action classes for argparse, that could capture mutual relationship between command line arguments for more advanced parsers, where order of command line arguments is meaningful. It is hoped that this will work together with enhancement introduced in issue42973, providing also ability to capture relationship between options and positional parameters.

There will be four new action classes: 'extend_capture', 'append_capture', 'store_capture' and 'capture'.

Here are excerpts from documentation being prepared for the new action classes and an example of use:

* 'extend_capture' - Captures preceding argument values listed in the
  'capture' and 'capture_reset' keyword arguments and creates a dictionary object
  from those values, then adds actual command-line value to the dictionary using
  the 'key' keyword argument, finally the created dictionary is appended to the
  'dest' list. After capturing, all arguments listed in 'capture_reset' are reset
  to their default values. If there are more than one command-line values, a new
  dictionary object is created, and appended to the list for each value, with
  'capture_reset' arguments reset to their default values after first value is
  added.
  Example usage:

    >>> parser = argparse.ArgumentParser()
    >>> parser.add_argument("--load-addr", type=lambda s: int(s, 16))
    >>> parser.add_argument("--exec-addr", type=lambda s: int(s, 16))
    >>> parser.add_argument("--replace", action="store_true")
    >>> parser.add_argument("--file", nargs="*", action="extend_capture",
    ...     capture="*", capture_reset=["load_addr", "exec_addr"])
    >>> parser.parse_args("--replace --load-addr 1900 --exec-addr 8023 "
    ...     "--file CALC !BOOT".split())
    Namespace(load_addr=None, exec_addr=None, replace=True, file=[
        {'replace': True, 'exec_addr': 32803, 'load_addr': 6400, 'file': 'CALC'},
        {'replace': True, 'exec_addr': None, 'load_addr': None, 'file': '!BOOT'}])

capture

The list of attributes to capture. This can be either a single attribute name,
a list (or other iterable type) of names or special value '*'. Name of
attribute associated with each argument is determined by the dest keyword
passed to add_argument method when the argument was
created. If capture_ is '*', all attributes are captured, except for this
argument's own value.

This keyword argument is valid only for 'extend_capture',
'append_capture', 'store_capture' and 'capture' actions.


capture_reset

The list of attributes to capture and reset to default value. As with capture,
this can be '*' to capture and reset all attributes except for this
argument's own value.

This keyword argument is valid only for 'extend_capture',
'append_capture', 'store_capture' and 'capture' actions.


key

The key to use for adding this argument's own command-line value to dictionary
of captured values. If this keyword argument is not specified, the dest is
used.

This keyword argument is valid only for 'extend_capture',
'append_capture' and 'store_capture' actions.

----------
components: Library (Lib)
messages: 385824
nosy: monkeyman79
priority: normal
severity: normal
status: open
title: argparse: capturing actions
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43046>
_______________________________________

From report at bugs.python.org  Wed Jan 27 18:53:56 2021
From: report at bugs.python.org (Tadek Kijkowski)
Date: Wed, 27 Jan 2021 23:53:56 +0000
Subject: [issue43046] argparse: capturing actions
In-Reply-To: <1611791532.72.0.119102600348.issue43046@roundup.psfhosted.org>
Message-ID: <1611791636.03.0.690009117906.issue43046@roundup.psfhosted.org>


Change by Tadek Kijkowski <tkijkowski at gmail.com>:


----------
nosy: +paul.j3, r.david.murray, rhettinger, v+python

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43046>
_______________________________________

From report at bugs.python.org  Wed Jan 27 19:07:45 2021
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 28 Jan 2021 00:07:45 +0000
Subject: [issue42979] _zoneinfo: zoneinfomodule_exec() doesn't check for
 PyDateTime_IMPORT failure
In-Reply-To: <1611163566.26.0.253539458839.issue42979@roundup.psfhosted.org>
Message-ID: <1611792465.13.0.144343067942.issue42979@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +23180
pull_request: https://github.com/python/cpython/pull/24356

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42979>
_______________________________________

From report at bugs.python.org  Wed Jan 27 19:19:16 2021
From: report at bugs.python.org (Tadek Kijkowski)
Date: Thu, 28 Jan 2021 00:19:16 +0000
Subject: [issue43046] argparse: capturing actions
In-Reply-To: <1611791532.72.0.119102600348.issue43046@roundup.psfhosted.org>
Message-ID: <1611793156.86.0.575262227186.issue43046@roundup.psfhosted.org>


Change by Tadek Kijkowski <tkijkowski at gmail.com>:


----------
keywords: +patch
pull_requests: +23181
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24357

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43046>
_______________________________________

From report at bugs.python.org  Wed Jan 27 19:19:29 2021
From: report at bugs.python.org (Ian Wienand)
Date: Thu, 28 Jan 2021 00:19:29 +0000
Subject: [issue43047] logging.config formatters documentation is out of sync
 with code
Message-ID: <1611793169.86.0.0215519819351.issue43047@roundup.psfhosted.org>


New submission from Ian Wienand <ian at wienand.org>:

The dict based configuration does not mention the "class" option, and neither the ini-file or dict sections mention the style tag.

----------
components: Library (Lib)
messages: 385825
nosy: iwienand
priority: normal
severity: normal
status: open
title: logging.config formatters documentation is out of sync with code
type: enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43047>
_______________________________________

From report at bugs.python.org  Wed Jan 27 19:21:50 2021
From: report at bugs.python.org (Ian Wienand)
Date: Thu, 28 Jan 2021 00:21:50 +0000
Subject: [issue43047] logging.config formatters documentation is out of sync
 with code
In-Reply-To: <1611793169.86.0.0215519819351.issue43047@roundup.psfhosted.org>
Message-ID: <1611793310.15.0.168056217055.issue43047@roundup.psfhosted.org>


Change by Ian Wienand <ian at wienand.org>:


----------
keywords: +patch
pull_requests: +23182
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24358

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43047>
_______________________________________

From report at bugs.python.org  Wed Jan 27 19:34:17 2021
From: report at bugs.python.org (Glenn Linderman)
Date: Thu, 28 Jan 2021 00:34:17 +0000
Subject: [issue43046] argparse: capturing actions
In-Reply-To: <1611791532.72.0.119102600348.issue43046@roundup.psfhosted.org>
Message-ID: <1611794057.67.0.540311522307.issue43046@roundup.psfhosted.org>


Glenn Linderman <v+python at g.nevcal.com> added the comment:

I'm a little confused by the mention of the "key" keyword argument. I suspect that is an internal concept to argparse, possibly passed that way to internal methods, but on the add_argument interface, it doesn't exist... instead there is "name or flags" positional arguments, from which, together with the "dest" argument, the "key" keyword argument is derived.  This is described under the explanation for the "dest" parameter.

But in the user documentation, the use of "key" is a surprise (to me, maybe I missed something).

Perhaps using "dest" rather than "key" in this documentation would be better? Or perhaps there is a precedent in the argparse documentation for what to call it?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43046>
_______________________________________

From report at bugs.python.org  Wed Jan 27 19:36:02 2021
From: report at bugs.python.org (Glenn Linderman)
Date: Thu, 28 Jan 2021 00:36:02 +0000
Subject: [issue42973] argparse: mixing optional and positional arguments...
 not again
In-Reply-To: <1611094894.69.0.476759327253.issue42973@roundup.psfhosted.org>
Message-ID: <1611794162.91.0.155540408211.issue42973@roundup.psfhosted.org>


Glenn Linderman <v+python at g.nevcal.com> added the comment:

paul j3 said:

Given how different this is from the normal argparse parsing (and the POSIX parsing argparse seeks to emulate), I question the wisdom of adding this, in part or whole, to the stock distribution.  It could certainly be published as a pypi.  That already has a number of  parsers, some built on argparse, others stand alone.


I say:

This has been a deficiency of argparse from day one. Tadek's solution seems to enable addressing the deficiency in a backward-compatible manner. Do you, paul, find any test failures? Or any incompatibilities that may not be in the test cases? If not, then it certainly does seem like a wet-blanket comment.


paul j3 forther said:

I also wonder whether it would be simpler to do this kind of parsing directly from sys.argv.  Just step through that list, consuming the values and flags in sequence.  


I say:

The whole point of argparse, and of deprecation of the prior optparse was to make more functionality available in a more powerful API. Increasing the power of the API seems to be consistent with the purpose of argparse. It took me some time and use cases to discover the limitations of argparse, and although parse_intermixed_args solved the use cases I had, I was well aware that it didn't solve cases of every existing Unix utility.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42973>
_______________________________________

From report at bugs.python.org  Wed Jan 27 20:45:37 2021
From: report at bugs.python.org (Vladimir Feinberg)
Date: Thu, 28 Jan 2021 01:45:37 +0000
Subject: [issue43048] Printing RecursionError results in RecursionError
Message-ID: <1611798337.38.0.626995188313.issue43048@roundup.psfhosted.org>


New submission from Vladimir Feinberg <vlad at sisudata.com>:

Python's standard logger provides an exception() method, which is to be called from except blocks to log out exception traces by pulling from sys.exc_info().

Per https://github.com/python/cpython/blob/3.9/Lib/logging/__init__.py#L617 , logger.exception('my message') eventually boils down to something like traceback.print_exception(ei[0], ei[1], ei[2], None, some_buffer) where ei is the sys.exc_info().

However, the traceback code generates that printout by constructing a TracebackException recursively for every `except` context.

In turn, if a RecursionError was generated from an exception thrown across many except blocks, the TracebackException construction itself will have a RecursionError. This is particularly bad in cases where you'd want to capture this failure information, such as when you're printing the exception, since you'll never find out about the originating error.

Certain (well-used) libraries rely on try/except for control flow, and occasionally do recurse in their except blocks, so such exceptions are not hypothetical.

A solution to this might be to avoid constructing a TracebackException, and instead unwind traceback context using a while loop.

----------
components: Library (Lib)
files: exc.py
messages: 385828
nosy: vlad2
priority: normal
severity: normal
status: open
title: Printing RecursionError results in RecursionError
versions: Python 3.6, Python 3.7, Python 3.9
Added file: https://bugs.python.org/file49769/exc.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43048>
_______________________________________

From report at bugs.python.org  Wed Jan 27 21:09:23 2021
From: report at bugs.python.org (Tadek Kijkowski)
Date: Thu, 28 Jan 2021 02:09:23 +0000
Subject: [issue42973] argparse: mixing optional and positional arguments...
 not again
In-Reply-To: <1611094894.69.0.476759327253.issue42973@roundup.psfhosted.org>
Message-ID: <1611799763.73.0.428342795169.issue42973@roundup.psfhosted.org>


Tadek Kijkowski <tkijkowski at gmail.com> added the comment:

> So in the big picture, the purpose of this change is to treat the inputs like a kind of state-machine.

Not necessarily that. Simple parsers should be easy to write, complicated parsers should be _possible_ to write. Users should be able to do whatever they wish by providing custom actions. Like writing Conway's Life in Excel or building Turing Machine using bricks and conveyors. Problem with positional parameter is a blocker. Fact that you can: 1. mix positional parameters with options in general, 2. have unlimited number of positional parameters, but 3. can't have 1 and 2 at the same time, makes great number of things impossible. For me that looks like a bug, not a feature.

Capture actions are second priority for me, because if this PR goes through, user will be able to write his own actions.

> While the proposed change to the core parser is (apparently) minor, it does occur at the center of the action. That is not the place we want any (new) bugs or backward incompatibility.

The core change is apparently minor, and also actually minor. It boils out to this:

@@ -2010,17 +2020,23 @@ def consume_positionals(start_index):
             match_partial = self._match_arguments_partial
             selected_pattern = arg_strings_pattern[start_index:]
             arg_counts = match_partial(positionals, selected_pattern)
+            action_index = 0

             # slice off the appropriate arg strings for each Positional
             # and add the Positional and its args to the list
-            for action, arg_count in zip(positionals, arg_counts):
+            for arg_count in arg_counts:
+                action = positionals[action_index]
                 args = arg_strings[start_index: start_index + arg_count]
                 start_index += arg_count
                 take_action(action, args)
+                # if positional action nargs is '**',
+                # never remove it from actions list
+                if action.nargs != AS_MANY_AS_POSSIBLE:
+                    action_index += 1

             # slice off the Positionals that we just parsed and return the
             # index at which the Positionals' string args stopped
-            positionals[:] = positionals[len(arg_counts):]
+            positionals[:] = positionals[action_index:]
             return start_index

It's not hard to determine that if all action.nargs != AS_MANY_AS_POSSIBLE, old and new code do exactly the same.
Besides that's what tests and code review is for. As for backward compatibility, nargs='**' was illegal until now,
and for all parameters with nargs!='**' the code behaves exactly as before.

> And the full implementation requires a new Action subclass that is quite different from existing ones.

No, that's an extra. That's why it's separate issue and separate PR. This issue is about giving users ability to write their own actions.

> Given how different this is from the normal argparse parsing (and the POSIX parsing argparse seeks to emulate), I question the wisdom of adding this, in part or whole, to the stock distribution.  It could certainly be published as a pypi.  That already has a number of  parsers, some built on argparse, others stand alone.
>
> I also wonder whether it would be simpler to do this kind of parsing directly from sys.argv.  Just step through that list, consuming the values and flags in sequence.

In other words, "if argparse doesn't meet your requirements, you can write your own parser". I don't think that's the way to go.

Both GNU getopt and GNU argp_parse allow mixing options with positional arguments without reordering. For getopt it's: options argument string begins with a hyphen, for argp_parse it's ARGP_IN_ORDER flag. I don't see why argparse wouldn't allow that. Original POSIX getopt didn't even have longopts.

> Sorry to sound like a wet blanket, but I've seen too many seemingly innocent patches that caused unforeseen problems down the line.

Yeah, that can be said about any project at any time - changes can introduce bugs, so let's just keep it as it is. I appreciate your ideas, but your criticism does sound unsubstantiated: "POSIX getopts didn't have it", "it can be done on pypi", "enhancements introduce bugs".

I think this change should be applied, because it is small change in code which removes significant obstacle in writing advanced option parsers.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42973>
_______________________________________

From report at bugs.python.org  Wed Jan 27 21:10:04 2021
From: report at bugs.python.org (Peter Donis)
Date: Thu, 28 Jan 2021 02:10:04 +0000
Subject: [issue43049] Use io.IncrementalNewlineDecoder for doctest newline
 conversion
Message-ID: <1611799804.84.0.215071854075.issue43049@roundup.psfhosted.org>


New submission from Peter Donis <peterdonis at alum.mit.edu>:

This is a follow-up to issue 1812:

https://bugs.python.org/issue1812

It was suggested in the discussion on that issue that the newline conversion in doctest that was corrected in that issue could be done using already defined resources in the io module instead of by a custom function. This issue is to provide an issue number for my pull request on github to do that: the io module provides the IncrementalNewlineDecoder object that does exactly what is needed.

----------
components: Tests
messages: 385830
nosy: pdonis
priority: normal
severity: normal
status: open
title: Use io.IncrementalNewlineDecoder for doctest newline conversion
type: enhancement
versions: Python 3.10, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43049>
_______________________________________

From report at bugs.python.org  Wed Jan 27 21:13:46 2021
From: report at bugs.python.org (Peter Donis)
Date: Thu, 28 Jan 2021 02:13:46 +0000
Subject: [issue1812] doctest _load_testfile function -- newline handling seems
 incorrect
In-Reply-To: <1200117455.4.0.563963262174.issue1812@psf.upfronthosting.co.za>
Message-ID: <1611800026.96.0.300240881816.issue1812@roundup.psfhosted.org>


Change by Peter Donis <peterdonis at alum.mit.edu>:


----------
pull_requests: +23184
pull_request: https://github.com/python/cpython/pull/24359

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1812>
_______________________________________

From report at bugs.python.org  Wed Jan 27 21:13:46 2021
From: report at bugs.python.org (Peter Donis)
Date: Thu, 28 Jan 2021 02:13:46 +0000
Subject: [issue43049] Use io.IncrementalNewlineDecoder for doctest newline
 conversion
In-Reply-To: <1611799804.84.0.215071854075.issue43049@roundup.psfhosted.org>
Message-ID: <1611800026.66.0.845408062564.issue43049@roundup.psfhosted.org>


Change by Peter Donis <peterdonis at alum.mit.edu>:


----------
keywords: +patch
pull_requests: +23183
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24359

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43049>
_______________________________________

From report at bugs.python.org  Wed Jan 27 21:24:03 2021
From: report at bugs.python.org (fengjiang)
Date: Thu, 28 Jan 2021 02:24:03 +0000
Subject: [issue43050] threading timer memory leak
Message-ID: <1611800643.13.0.196440440542.issue43050@roundup.psfhosted.org>


New submission from fengjiang <fengjiang8 at huawei.com>:

Hi,we are transfering code from python2.7 to 3.7 and find that using threading.timer will cause memory leak. It works fine in python2.7 but not 3.7. To repreduce the problem, you can simply run the code below.

While True:
    timer = threading.Timer(5, None)
    timer.start()
    timer.cancel()

you will find the memory of progress increases rapidly

----------
components: Library (Lib)
messages: 385831
nosy: fengjiang
priority: normal
severity: normal
status: open
title: threading timer memory leak
type: performance
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43050>
_______________________________________

From report at bugs.python.org  Wed Jan 27 21:41:12 2021
From: report at bugs.python.org (Tadek Kijkowski)
Date: Thu, 28 Jan 2021 02:41:12 +0000
Subject: [issue43046] argparse: capturing actions
In-Reply-To: <1611791532.72.0.119102600348.issue43046@roundup.psfhosted.org>
Message-ID: <1611801672.57.0.142511288261.issue43046@roundup.psfhosted.org>


Tadek Kijkowski <tkijkowski at gmail.com> added the comment:

> I'm a little confused by the mention of the "key" keyword argument. I suspect that is an internal concept to argparse, possibly passed that way to internal methods, but on the add_argument interface, it doesn't exist... instead there is "name or flags" positional arguments, from which, together with the "dest" argument, the "key" keyword argument is derived.  This is described under the explanation for the "dest" parameter.

Hmm... that may be confusing. The "key" keyword argument is not internal concept, is new parameter that can be passed to add_argument, specifically for 'capture' actions. The "key" name may be unfortunate, maybe it could be "dest_key" or "dict_key"? It can't be "dest", because it is goes to add_argument together with "dest". In most cases it is not needed and "dest" is used as dictionary key, but user may want to override that.
Like in this example:

    >>> parser = argparse.ArgumentParser()
    >>> parser.add_argument("--user", default=None)
    >>> parser.add_argument("--server", default="localhost")
    >>> parser.add_argument("src1", action="store_capture", key="file", capture_reset=["user", "server"])
    >>> parser.add_argument("src2", action="store_capture", key="file", capture_reset=["user", "server"])
    >>> parser.add_argument("dst", action="store_capture", key="file", capture_reset=["user", "server"])
    >>> parser.parse_args("first --user guest --server no_such second --server not_found third".split())
    Namespace(user=None, server='localhost',
        src1={'user': None, 'server': 'localhost', 'file': 'first'},
        src2={'user': 'guest', 'server': 'no_such', 'file': 'second'},
        dst={'user': None, 'server': 'not_found', 'file': 'third'})

The 'dest' is 'src1', 'src2' and 'dst' respectively, but we want to have unified layout of the dictionaries,
so 'key' is 'file' in all three cases.

Oh, and I forgot to update add_argument signature in rst earlier.

ArgumentParser.add_argument(name or flags..., [action], [nargs], \
                           [const], [default], [type], [choices], [required], \
                           [help], [metavar], [dest], [capture], \
                           [capture_reset], [key])
...
...
   * dest - The name of the attribute to be added to the object returned by
     parse_args.

-> these are new:

   * capture - A name or a list of names of attributes to capture by one of
     capture actions.

   * capture_reset - A name or a list of name of attributes to capture and
     reset to default value by one of capture actions.

   * key - The key to use putting command-line argument to dictionary object
     created by capture actions.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43046>
_______________________________________

From report at bugs.python.org  Wed Jan 27 21:47:23 2021
From: report at bugs.python.org (Zachary Ware)
Date: Thu, 28 Jan 2021 02:47:23 +0000
Subject: [issue43049] Use io.IncrementalNewlineDecoder for doctest newline
 conversion
In-Reply-To: <1611799804.84.0.215071854075.issue43049@roundup.psfhosted.org>
Message-ID: <1611802043.28.0.0211434469557.issue43049@roundup.psfhosted.org>


Change by Zachary Ware <zachary.ware at gmail.com>:


----------
nosy: +eric.araujo, zach.ware

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43049>
_______________________________________

From report at bugs.python.org  Wed Jan 27 21:56:08 2021
From: report at bugs.python.org (Martin Panter)
Date: Thu, 28 Jan 2021 02:56:08 +0000
Subject: [issue43050] threading timer memory leak
In-Reply-To: <1611800643.13.0.196440440542.issue43050@roundup.psfhosted.org>
Message-ID: <1611802568.03.0.785351472756.issue43050@roundup.psfhosted.org>


Martin Panter <vadmium+py at gmail.com> added the comment:

Perhaps this is caused by Issue 37788. Python 3.7.4 introduced a leak for any thread that doesn't get its "join" method called. Timer is a subclass of Thread, so to confirm, see if calling "timer.join()" after "cancel" will make the leak go away.

----------
nosy: +martin.panter
resolution:  -> duplicate
superseder:  -> fix for bpo-36402 (threading._shutdown() race condition) causes reference leak
type: performance -> resource usage

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43050>
_______________________________________

From report at bugs.python.org  Wed Jan 27 22:11:48 2021
From: report at bugs.python.org (fengjiang)
Date: Thu, 28 Jan 2021 03:11:48 +0000
Subject: [issue43050] threading timer memory leak
In-Reply-To: <1611800643.13.0.196440440542.issue43050@roundup.psfhosted.org>
Message-ID: <1611803508.17.0.249784625927.issue43050@roundup.psfhosted.org>


fengjiang <fengjiang8 at huawei.com> added the comment:

yes, I find similar issues,the use the patch(https://github.com/python/cpython/pull/15228/files) to fix the bug

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43050>
_______________________________________

From report at bugs.python.org  Wed Jan 27 22:16:24 2021
From: report at bugs.python.org (Martin Panter)
Date: Thu, 28 Jan 2021 03:16:24 +0000
Subject: [issue37788] fix for bpo-36402 (threading._shutdown() race condition)
 causes reference leak
In-Reply-To: <1565194972.64.0.065323919799.issue37788@roundup.psfhosted.org>
Message-ID: <1611803784.5.0.282867879873.issue37788@roundup.psfhosted.org>


Change by Martin Panter <vadmium+py at gmail.com>:


----------
keywords: +3.7regression

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37788>
_______________________________________

From report at bugs.python.org  Thu Jan 28 00:10:26 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Thu, 28 Jan 2021 05:10:26 +0000
Subject: [issue43046] argparse: capturing actions
In-Reply-To: <1611791532.72.0.119102600348.issue43046@roundup.psfhosted.org>
Message-ID: <1611810626.64.0.502149865276.issue43046@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

> capture mutual relationship between command line arguments for more
> advanced parsers, where order of command line arguments is meaningful

I don't think this is a pattern we should encourage.  It doesn't seem to arise often and it makes the API much more complex for end users.

Also, I'm concerned that adding more action classes will make argparse harder to learn for the average user.  Already, the module suffers from sprawl and has unexpected interactions between the components.  The docs and tutorial are voluminous and hard to digest in a single sitting.

ISTM the scope of argparse was never intended to capture all possible patterns for command line argument parsing.  Instead, it aimed at to address the common cases.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43046>
_______________________________________

From report at bugs.python.org  Thu Jan 28 00:18:25 2021
From: report at bugs.python.org (Glenn Linderman)
Date: Thu, 28 Jan 2021 05:18:25 +0000
Subject: [issue43046] argparse: capturing actions
In-Reply-To: <1611791532.72.0.119102600348.issue43046@roundup.psfhosted.org>
Message-ID: <1611811105.57.0.598904641042.issue43046@roundup.psfhosted.org>


Glenn Linderman <v+python at g.nevcal.com> added the comment:

So the missing signature is why I didn't understand, probably. At least, it seems reasonable to blame that :)  You didn't include [version] in the signature, but that isn't your fault: it isn't in the original and should be (see action "version").

So key is optional and defaults to dest... I saw that, but was already confused.  This latest example clears up why you might want to overrride dest for use in different arguments... very similar to why dest is allowed to be specified instead of its default value.

And dest could be used, it is sufficient, but allowing specification of key to override it is more flexible, and could save user code in some circumstances, with little cost to the implementation.

Sounds good to me now.

I was also surprised by introduction of a "capture" action by itself, and look forward to documentation for it, as things progress. I can guess about store_capture and append_capture from the definition of extend_capture.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43046>
_______________________________________

From report at bugs.python.org  Thu Jan 28 00:24:46 2021
From: report at bugs.python.org (Glenn Linderman)
Date: Thu, 28 Jan 2021 05:24:46 +0000
Subject: [issue43046] argparse: capturing actions
In-Reply-To: <1611791532.72.0.119102600348.issue43046@roundup.psfhosted.org>
Message-ID: <1611811486.94.0.488206642223.issue43046@roundup.psfhosted.org>


Glenn Linderman <v+python at g.nevcal.com> added the comment:

Raymond said:
ISTM the scope of argparse was never intended to capture all possible patterns for command line argument parsing.  Instead, it aimed at to address the common cases.

I say:
Sounds like another wet blanket argpment. Refer to the section "Why aren't getopt and optparse enough?" in the argparse PEP 389.  It is clearn that argparse was intended to implement more complex cases than could be easily implemented with the prior getopt and optparse. The concepts of variable numbers of arguments for an option, and of subcommonds, introduced initially in argparse, are far more complex than the enhancements proposed here.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43046>
_______________________________________

From report at bugs.python.org  Thu Jan 28 00:26:33 2021
From: report at bugs.python.org (Charley Riley)
Date: Thu, 28 Jan 2021 05:26:33 +0000
Subject: [issue43051] Pip Permissions Error overwriting pip directory
Message-ID: <1611811593.92.0.540989910161.issue43051@roundup.psfhosted.org>


New submission from Charley Riley <mcriley821 at gmail.com>:

After installing Python 3.9.1 on Windows 10 system-wide to "C:\Program Files\Python39", I tried to pip install the package 'dirsearch'.

pip refused with the error: "Defaulting to user installation because normal site-packages is not writeable", and proceeded to write to Local AppData (unwanted, so I deleted from AppData).

I changed the permissions of the site-packages folder to allow python access (allowed Users and Application Packages full control). 

Then I retried installing 'dirsearch', which now completed successfully. However, I was warned that my pip version was out of date. So I did:
>>> py -m pip install --upgrade pip
I ensured py --version = 3.9.1

This failed with "ERROR: Could not install packages due to an EnvironmentError: [WinError 5] Access is denied: 'c:\\program files\\python39\\scripts\\pip.exe'

I then allowed same permissions as site-packages to the scripts folder. 

Retried 
>>> py -m pip install --upgrade pip
and I get an error:
"C:\Program Files\Python39\python.exe: No module named pip"

I navigate to site-packages, where pip directories have been renamed as:
~ip
~ip-21.0.dist-info

----------
components: Installation, Windows
messages: 385838
nosy: mcriley821, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: Pip Permissions Error overwriting pip directory
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43051>
_______________________________________

From report at bugs.python.org  Thu Jan 28 00:57:52 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Thu, 28 Jan 2021 05:57:52 +0000
Subject: [issue43040] random.py randrange() is very slow if the range is a
 power of 2.
In-Reply-To: <1611752833.52.0.275617605532.issue43040@roundup.psfhosted.org>
Message-ID: <1611813472.68.0.92052906589.issue43040@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Donovan, if the speed of the power of two case is important to you, I recommend using getrandbits() instead.  It is ten times faster.

  $ python3.9 -m timeit -r 11 -s 'from random import randrange, getrandbits' 'randrange(2**32)'
  1000000 loops, best of 11: 362 nsec per loop

  $ python3.9 -m timeit -r 11 -s 'from random import randrange, getrandbits' 'getrandbits(32)'
  10000000 loops, best of 11: 32 nsec per loop

The two referenced articles aren't pertinent to this issue, the power of two case for randrange(). Both articles boil down to finding that a single task, arity zero, C coded method is significantly faster than a pure python method with error checking, a complex signature, support for arbitrarily large integers, and extra effort to assure an equal distribution.  It is unsurprising random() is faster than randrange().  Code that does less work is faster than code that does more work.

Mark is correct that the current code wasn't an accident and that we intensionally chose to keep reproducibility.

I appreciate your suggestion, but it essentially same one that was rejected in bpo-37000.  As Mark pointed out, nothing has changed since then (though some other changes have been added to 3.10 that improved the speed of rangerange() without affecting reproducibility).

Note, even if the PR had been accepted, you would still be much better off with getrandbits().

----------
resolution:  -> duplicate
stage: patch review -> resolved
status: open -> closed
superseder:  -> _randbelow_with_getrandbits function inefficient with powers of two

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43040>
_______________________________________

From report at bugs.python.org  Thu Jan 28 01:07:28 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Thu, 28 Jan 2021 06:07:28 +0000
Subject: [issue43040] random.py randrange() is very slow if the range is a
 power of 2.
In-Reply-To: <1611752833.52.0.275617605532.issue43040@roundup.psfhosted.org>
Message-ID: <1611814048.74.0.291841075165.issue43040@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
assignee:  -> rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43040>
_______________________________________

From report at bugs.python.org  Thu Jan 28 01:16:05 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Thu, 28 Jan 2021 06:16:05 +0000
Subject: [issue43034] Python tutorial misleads users about floor division
 behavior
In-Reply-To: <1611710102.87.0.478016588876.issue43034@roundup.psfhosted.org>
Message-ID: <1611814565.11.0.309503653736.issue43034@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

The first section of the tutorial isn't the right place to go into these details.  The point of the section is to have a basic introduction to the interactive prompt.  It is intensionally gentle and lightweight.

It isn't the purpose of the tutorial to document complete semantics and corner cases.  We leave that for the language reference or for coverage of specific types in the library reference.  See footnote (1) in the operator table at https://docs.python.org/3/library/stdtypes.html#numeric-types-int-float-complex .

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43034>
_______________________________________

From report at bugs.python.org  Thu Jan 28 01:19:11 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Thu, 28 Jan 2021 06:19:11 +0000
Subject: [issue36086] Split IDLE into separate feature in Windows installer
In-Reply-To: <1550883782.51.0.779365974532.issue36086@roundup.psfhosted.org>
Message-ID: <1611814751.03.0.000308657931769.issue36086@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

I concur with the other commenters that this isn't worth it.  Installing Tcl/Tk without IDLE saves almost nothing.

Thank you for the suggestion, but I'm going to mark it as rejected.

----------
nosy: +rhettinger
resolution:  -> rejected
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36086>
_______________________________________

From report at bugs.python.org  Thu Jan 28 01:32:05 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Thu, 28 Jan 2021 06:32:05 +0000
Subject: [issue43046] argparse: capturing actions
In-Reply-To: <1611791532.72.0.119102600348.issue43046@roundup.psfhosted.org>
Message-ID: <1611815525.6.0.370292353054.issue43046@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

> Sounds like another wet blanket argpment

Please watch your tone.  It borders on being abusive.

It is entirely appropriate to set limits on the scope of what a module is trying to achieve.  It is appropriate to consider module learnability.  It is appropriate to limit sprawl and feature creep.  It is appropriate to consider whether the pattern being encouraged and supported by the PR is intellectually manageable by end users.

It is correct that argparse set out to handle more complex cases than optparse.  But even then, it was aiming to cases that commonly arose it the wild (subparsers are not uncommon).  It never aspired to be all things to all users.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43046>
_______________________________________

From report at bugs.python.org  Thu Jan 28 01:36:29 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Thu, 28 Jan 2021 06:36:29 +0000
Subject: [issue43025] Use normal 'i' character to denote imaginary part of
 complex numbers
In-Reply-To: <1611600350.32.0.540433161176.issue43025@roundup.psfhosted.org>
Message-ID: <1611815789.5.0.0252731307395.issue43025@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Unfortunately, this ship sailed a long time ago.  Changing it now would create more problems that it solves.

> I doubt that that will be enough to silence the repeated requests:
> people are still going to complain that the value that was entered
> as `1i` is being displayed as `1j`. I don't see a sane path 
> towards changing that.

Exactly this.

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43025>
_______________________________________

From report at bugs.python.org  Thu Jan 28 01:39:56 2021
From: report at bugs.python.org (Isuru Fernando)
Date: Thu, 28 Jan 2021 06:39:56 +0000
Subject: [issue43052] _dyld_shared_cache_contains_path needs
 SYSTEM_VERSION_COMPAT=0
Message-ID: <1611815996.85.0.805200252907.issue43052@roundup.psfhosted.org>


New submission from Isuru Fernando <isuruf at gmail.com>:

In macOS Big Sur, if the executable was compiled with MACOSX_DEPLOYMENT_TARGET=10.15
or below, then SYSTEM_VERSION_COMPAT=1 is the default which means that Big Sur
reports itself as 10.16 which in turn means that __builtin_available(macOS 11.0)
will not be triggered.

This can be observed by using the python 3.9.1 universal2 installer and using it on
x86_64 Big Sur or with Rossetta 2 on arm64 Big Sur. (Not an issue with native arm64
as that part is compiled with MACOSX_DEPLOYMENT_TARGET=11.0)

Original issue is that the following returned None.
SYSTEM_VERSION_COMPAT=1 arch -x86_64 /usr/local/bin/python3 -c "from ctypes.util import find_library; print(find_library('AppKit'))"

----------
messages: 385845
nosy: isuruf, ned.deily, ronaldoussoren
priority: normal
pull_requests: 23185
severity: normal
status: open
title: _dyld_shared_cache_contains_path needs SYSTEM_VERSION_COMPAT=0

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43052>
_______________________________________

From report at bugs.python.org  Thu Jan 28 01:41:37 2021
From: report at bugs.python.org (Donovan Baarda)
Date: Thu, 28 Jan 2021 06:41:37 +0000
Subject: [issue43040] random.py randrange() is very slow if the range is a
 power of 2.
In-Reply-To: <1611752833.52.0.275617605532.issue43040@roundup.psfhosted.org>
Message-ID: <1611816097.56.0.198466288688.issue43040@roundup.psfhosted.org>


Donovan Baarda <abo at minkirri.apana.org.au> added the comment:

Some points to note;

I first noticed this as an apparently 5x performance regression for randrange() between pypy and pypy3. This seemed pretty significant, but admittedly the difference is largely masked by other python overheads when comparing python2 and python3.

When I mentioned random() is faster, I meant that python2's implementation of randrange() that uses random() under the hood was noticeably faster than python3's randrange() that uses getrandbits() under the hood.

I know getrandbits() is significantly faster than randrange(), but randrange() doesn't have to be that bad.

However, I agree that changing repeatability is potentially a big issue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43040>
_______________________________________

From report at bugs.python.org  Thu Jan 28 01:52:44 2021
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 28 Jan 2021 06:52:44 +0000
Subject: [issue43048] Printing RecursionError results in RecursionError
In-Reply-To: <1611798337.38.0.626995188313.issue43048@roundup.psfhosted.org>
Message-ID: <1611816764.73.0.0885194728434.issue43048@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

This looks like a duplicate of issue 42848 which was fixed in 3.10.

----------
nosy: +iritkatriel

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43048>
_______________________________________

From report at bugs.python.org  Thu Jan 28 03:03:26 2021
From: report at bugs.python.org (Juraj Sukop)
Date: Thu, 28 Jan 2021 08:03:26 +0000
Subject: [issue43053] Speed up math.isqrt, again
Message-ID: <1611821006.77.0.580238316666.issue43053@roundup.psfhosted.org>


New submission from Juraj Sukop <juraj.sukop at gmail.com>:

This is a follow up to https://bugs.python.org/issue36887 and https://bugs.python.org/issue36957 .

The new `isqrt` is remarkably simple but it does not split the number at hand optimally. Ideally one would want to have 2n/n division everywhere but since the last iteration takes as much effort as all of the iterations before it this is what the attached code focuses on.

At least in my testing the `isqrt_2` code below improved the performance by 50% (3s down to 2s, for example) and, if used, perhaps the original `isqrt` could do without the final correction `a - (a*a > n)`.

----------
components: Extension Modules
files: isqrt_2.py
messages: 385848
nosy: juraj.sukop
priority: normal
severity: normal
status: open
title: Speed up math.isqrt, again
type: performance
versions: Python 3.8
Added file: https://bugs.python.org/file49770/isqrt_2.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43053>
_______________________________________

From report at bugs.python.org  Thu Jan 28 03:06:06 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 28 Jan 2021 08:06:06 +0000
Subject: [issue43053] Speed up math.isqrt, again
In-Reply-To: <1611821006.77.0.580238316666.issue43053@roundup.psfhosted.org>
Message-ID: <1611821166.27.0.465315090934.issue43053@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
nosy: +mark.dickinson, rhettinger, serhiy.storchaka, stutzbach

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43053>
_______________________________________

From report at bugs.python.org  Thu Jan 28 03:41:53 2021
From: report at bugs.python.org (Mark Dickinson)
Date: Thu, 28 Jan 2021 08:41:53 +0000
Subject: [issue43053] Speed up math.isqrt, again
In-Reply-To: <1611821006.77.0.580238316666.issue43053@roundup.psfhosted.org>
Message-ID: <1611823313.88.0.604242311805.issue43053@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

Thanks; I'll take a look at this at the weekend. Do you have a sketch of a proof of correctness available?

----------
assignee:  -> mark.dickinson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43053>
_______________________________________

From report at bugs.python.org  Thu Jan 28 06:03:11 2021
From: report at bugs.python.org (Isaac Young)
Date: Thu, 28 Jan 2021 11:03:11 +0000
Subject: [issue42830] tempfile mkstemp() leaks file descriptors if os.close()
 is not called
In-Reply-To: <1609846127.44.0.860192251042.issue42830@roundup.psfhosted.org>
Message-ID: <1611831791.27.0.308373189642.issue42830@roundup.psfhosted.org>


Isaac Young <isyoung at pm.me> added the comment:

Perhaps the documentation should be more explicit, but I wouldn't say this is an issue. Both mkstemp and mkdtemp are low level functions which are intended to have this kind of flexibility.

The os.unlink, and the equivalent os.remove, are POSIX defined functions which always deletes the name from the filesystem but the file will remain in memory so long as there are file descriptors referencing it. So using os.close(file_descriptor) is actually how you are expected to use this API.

Is there any reason you don't want to use [Named]TemporaryFile? They are  high level interfaces which handle the cleanup.

----------
nosy: +StillSubjectToChange

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42830>
_______________________________________

From report at bugs.python.org  Thu Jan 28 06:12:05 2021
From: report at bugs.python.org (Mark Shannon)
Date: Thu, 28 Jan 2021 11:12:05 +0000
Subject: [issue43054] What does the existence of a struct in a header file
 imply about the C-API
Message-ID: <1611832325.97.0.674198865532.issue43054@roundup.psfhosted.org>


New submission from Mark Shannon <mark at hotpy.org>:

Given the lack of explicit documentation on this subject, and differing opinions among core developers, I though it would be good to discuss how the existence of a struct in a header file constrains the C-API.

Original PR provoking this discussion: https://github.com/python/cpython/pull/24298

Suppose a header file, e.g. funcobject.h, contains a struct, e.g. PyFunctionObject, to what extent is that struct part of the API?


If a struct is present in a header file, there are three options for what means in terms of the API (that make sense to me).

1. That the struct is not part of the API and may be freely changed or deleted.
2. That the struct is produced, or initialized, by an API function, which implies that existing fields will continue to exist, but they can be reorder or added to.
3. That the struct is consumed by an API function, which implies that the struct must keep its exact shape, only adding fields if flags are present in the pre-existing fields to indicate the use of the extension.

PyTypeObject is an example of (3).

We should be able to infer which of the above cases applies, if not explicitly documented, for any struct.

Using PyFunctionObject in funcobject.h as an example:

There is no API function or macro that directly produces or consumes the struct, which would imply case 1. But, the struct is documented as the struct for Python functions, and `PyFunction_Check()` exists, which strongly implies that the following code is OK:

if (PyFunction_Check(obj)) {  
    PyFunctionObject *func = (PyFunctionObject *)obj;
    ...

which therefore implies that (2) applies.
(3) does not apply as there is no API that takes a PyFunctionObject struct as a parameter.

Similar logic can be applied to other parts of the API.


Rather than go through this tortuous analysis for all headers, it might be better to document which structs are part of the API.

----------
messages: 385851
nosy: Mark.Shannon, gvanrossum, petr.viktorin, vstinner
priority: normal
severity: normal
status: open
title: What does the existence of a struct in a header file imply about the C-API

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43054>
_______________________________________

From report at bugs.python.org  Thu Jan 28 06:40:04 2021
From: report at bugs.python.org (Mark Dickinson)
Date: Thu, 28 Jan 2021 11:40:04 +0000
Subject: [issue43025] Use normal 'i' character to denote imaginary part of
 complex numbers
In-Reply-To: <1611600350.32.0.540433161176.issue43025@roundup.psfhosted.org>
Message-ID: <1611834004.32.0.129682661381.issue43025@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

@Eric: Are you okay with closing this issue, or do you think we should leave it open as a reminder to write that PEP?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43025>
_______________________________________

From report at bugs.python.org  Thu Jan 28 06:58:35 2021
From: report at bugs.python.org (Aman Anifer)
Date: Thu, 28 Jan 2021 11:58:35 +0000
Subject: [issue43055] Inconsistent behaviour when using walrus operator with
 'and'/'or'
Message-ID: <1611835115.72.0.951775533132.issue43055@roundup.psfhosted.org>


New submission from Aman Anifer <fgoo.edu at hash.fyi>:

Using the walrus operator (:=) alongside 'and'/'or' shows inconsistent behaviour which changes with the order of given conditions. 

For example:
if(False and (x := 0)<1):
    print("Yes")
else:
    print(x)

Gives the error that 'NameError: name 'x' is not defined'
Whereas if the walrus operator is used first, like:
if((x := 0)>1 and False):
    print("Yes")
else:
    print(x)

Prints the value 0 without any error. This behaviour is the same when using 'or'. For example:

if(True or (y:=0)<1):
    print(y)
else:
    print("No")

Gives the same error but this:
if((y:=0)<1 or True):
    print(y)
else:
    print("No")

Prints the value 0.
I am guessing that this is because 'and' doesn't check the second operand if the first operand is False, also 'if' doesn't check the second operand if the first operand is True. I don't know if this is an intended behaviour.

Thanks

----------
components: Interpreter Core
messages: 385853
nosy: FuturisticGoo
priority: normal
severity: normal
status: open
title: Inconsistent behaviour when using walrus operator with 'and'/'or'
type: behavior
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43055>
_______________________________________

From report at bugs.python.org  Thu Jan 28 07:38:51 2021
From: report at bugs.python.org (Petr Viktorin)
Date: Thu, 28 Jan 2021 12:38:51 +0000
Subject: [issue43054] What does the existence of a struct in a header file
 imply about the C-API
In-Reply-To: <1611832325.97.0.674198865532.issue43054@roundup.psfhosted.org>
Message-ID: <1611837531.13.0.3479239458.issue43054@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

When we're talking just about API, not the stable ABI (which contains only a few structs), reordering and additions should be fair game.


> Rather than go through this tortuous analysis for all headers, it might be better to document which structs are part of the API.

Yup. I'm trying to do this for stable ABI/limited API, and it's unfortunately taking quite a long time.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43054>
_______________________________________

From report at bugs.python.org  Thu Jan 28 07:54:15 2021
From: report at bugs.python.org (Irit Katriel)
Date: Thu, 28 Jan 2021 12:54:15 +0000
Subject: [issue43048] Printing RecursionError results in RecursionError
In-Reply-To: <1611798337.38.0.626995188313.issue43048@roundup.psfhosted.org>
Message-ID: <1611838455.07.0.61165253169.issue43048@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
resolution:  -> duplicate
status: open -> pending
superseder:  -> asyncio produces an unexpected traceback with recursive __getattribute__

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43048>
_______________________________________

From report at bugs.python.org  Thu Jan 28 07:55:28 2021
From: report at bugs.python.org (Dustin Rodrigues)
Date: Thu, 28 Jan 2021 12:55:28 +0000
Subject: [issue42819] readline 8.1 bracketed paste
In-Reply-To: <1609707155.89.0.22999518491.issue42819@roundup.psfhosted.org>
Message-ID: <1611838528.66.0.712459525958.issue42819@roundup.psfhosted.org>


Dustin Rodrigues <dust.rod at gmail.com> added the comment:

Bumping this issue because it's a bug affecting all users who build or use a Python built with the current version of readline, to include all macOS HomeBrew and Arch Linux users who use the python from the respective package managers.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42819>
_______________________________________

From report at bugs.python.org  Thu Jan 28 08:13:29 2021
From: report at bugs.python.org (Juraj Sukop)
Date: Thu, 28 Jan 2021 13:13:29 +0000
Subject: [issue43053] Speed up math.isqrt, again
In-Reply-To: <1611821006.77.0.580238316666.issue43053@roundup.psfhosted.org>
Message-ID: <1611839609.29.0.648550434677.issue43053@roundup.psfhosted.org>


Juraj Sukop <juraj.sukop at gmail.com> added the comment:

What the proof goes, you did most of the work already. Consider the following:

    l = (n.bit_length() - 1)//4
    a = isqrt(n >> 2*l)
    a = ((a << l) + n//(a << l))//2
    return a - (a*a > n)

This computes the square root of the (possibly longer) upper half, applies one Heron's step and a single correction. I think it is functionally equal to what you wrote. Those zeros don't contribute to the quotient so we could instead write:

    a = ((a << l) + (n >> l)//a)//2

The problem is that the 3n/n division in the step `(a + n//a)//2` basically recomputes the upper half we already know and so we want to avoid it: instead of 3n/n giving 2n quotient, we want 2n/n giving 1n quotient. If the upper half is correct, the lower half to be taken care of is `n - a**2`:

    a = (a << l) + ((n - (a << l)**2) >> l)//a//2

And there is no need to square the zeros either:

    a = (a << l) + ((n - (a**2 << 2*l) >> l)//a//2

So I *think* it should be correct, the only thing I'm not sure about is whether the final correction in the original `isqrt` is needed. Perhaps the automated proof of yours could give an answer?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43053>
_______________________________________

From report at bugs.python.org  Thu Jan 28 08:22:23 2021
From: report at bugs.python.org (Eric V. Smith)
Date: Thu, 28 Jan 2021 13:22:23 +0000
Subject: [issue43025] Use normal 'i' character to denote imaginary part of
 complex numbers
In-Reply-To: <1611600350.32.0.540433161176.issue43025@roundup.psfhosted.org>
Message-ID: <1611840143.98.0.394655492268.issue43025@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

Thanks, Mark. I'll just close it now. I've made a reminder about the PEP, but not sure when/if I'll get to it.

----------
resolution:  -> rejected
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43025>
_______________________________________

From report at bugs.python.org  Thu Jan 28 08:30:40 2021
From: report at bugs.python.org (Eric V. Smith)
Date: Thu, 28 Jan 2021 13:30:40 +0000
Subject: [issue43055] Inconsistent behaviour when using walrus operator with
 'and'/'or'
In-Reply-To: <1611835115.72.0.951775533132.issue43055@roundup.psfhosted.org>
Message-ID: <1611840640.52.0.0416616543487.issue43055@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

I think this is pretty clearly the intended semantics. In your first example, what do you propose "print(x)" would produce? Consider:

if False and (x:=input()) != '':
  pass
else:
  print(x)

We cannot change the semantics to now call input(), or any function with side effects, just to do the assignment to x.

----------
nosy: +eric.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43055>
_______________________________________

From report at bugs.python.org  Thu Jan 28 08:35:19 2021
From: report at bugs.python.org (jeanotlapin)
Date: Thu, 28 Jan 2021 13:35:19 +0000
Subject: [issue36207] robotsparser deny all with some rules
In-Reply-To: <1551865321.24.0.407834320039.issue36207@roundup.psfhosted.org>
Message-ID: <1611840919.95.0.913883747111.issue36207@roundup.psfhosted.org>


jeanotlapin <contact at monagencedecommunication.com> added the comment:

Il semblerait que le script continue d'afficher des erreurs et rencontre des bugs. Preuve en est puisque j'ai test? sur ce site d'auto hypnose https://www.lautohypnose.com/ en vain...

----------
nosy: +jeanotlapin

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36207>
_______________________________________

From report at bugs.python.org  Thu Jan 28 08:36:04 2021
From: report at bugs.python.org (Eric V. Smith)
Date: Thu, 28 Jan 2021 13:36:04 +0000
Subject: [issue43055] Inconsistent behaviour when using walrus operator with
 'and'/'or'
In-Reply-To: <1611835115.72.0.951775533132.issue43055@roundup.psfhosted.org>
Message-ID: <1611840964.32.0.766934746575.issue43055@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

I'm going to close this. The short circuit evaluation of and/or expressions is already documented, and this behavior follows directly from that.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43055>
_______________________________________

From report at bugs.python.org  Thu Jan 28 08:57:22 2021
From: report at bugs.python.org (Mark Dickinson)
Date: Thu, 28 Jan 2021 13:57:22 +0000
Subject: [issue43053] Speed up math.isqrt, again
In-Reply-To: <1611821006.77.0.580238316666.issue43053@roundup.psfhosted.org>
Message-ID: <1611842241.99.0.0151171693685.issue43053@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

> the only thing I'm not sure about is whether the final correction in the original `isqrt` is needed

Well, *some* part of the algorithm has to make use of the low-order bits of n. Otherwise we won't be able to distinguish n = 4a**2 + 4a + 1 (whose isqrt is 2a + 1) from 4a**2 + 4a (whose isqrt is 2a).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43053>
_______________________________________

From report at bugs.python.org  Thu Jan 28 09:10:04 2021
From: report at bugs.python.org (Mark Dickinson)
Date: Thu, 28 Jan 2021 14:10:04 +0000
Subject: [issue43053] Speed up math.isqrt, again
In-Reply-To: <1611821006.77.0.580238316666.issue43053@roundup.psfhosted.org>
Message-ID: <1611843004.76.0.377098387356.issue43053@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

> As it currently stands, `a - (a*a > n)` is computed both in `isqrt` and `isqrt_2`. So I was thinking that maybe the former might be dropped.

Ah, sorry; I misunderstood. Yes, I think so. I'll respond more fully later. (Sorry - real life getting in the way right now.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43053>
_______________________________________

From report at bugs.python.org  Thu Jan 28 09:08:34 2021
From: report at bugs.python.org (Juraj Sukop)
Date: Thu, 28 Jan 2021 14:08:34 +0000
Subject: [issue43053] Speed up math.isqrt, again
In-Reply-To: <1611821006.77.0.580238316666.issue43053@roundup.psfhosted.org>
Message-ID: <1611842914.98.0.00807296303966.issue43053@roundup.psfhosted.org>


Juraj Sukop <juraj.sukop at gmail.com> added the comment:

The rounding down of `l` might compute more than half of the bits so that the final Heron' step in `isqrt_2` might correct the uncertain low bit if `a - (a*a > n)` is missing from `isqrt`.

As it currently stands, `a - (a*a > n)` is computed both in `isqrt` and `isqrt_2`. So I was thinking that maybe the former might be dropped.

Are you saying that both correction are need?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43053>
_______________________________________

From report at bugs.python.org  Thu Jan 28 09:12:14 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 28 Jan 2021 14:12:14 +0000
Subject: [issue24790] Idle: improve stack viewer
In-Reply-To: <1438734562.89.0.932245136919.issue24790@psf.upfronthosting.co.za>
Message-ID: <1611843134.69.0.31972124954.issue24790@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

9. As of now, values are not named, whereas I believe they are in debugger.  IE given def f(a,b,c): 1/0; f(1,2,3), viewer prints unlaabelled 1, 2, 3 on separate lines.

Also, the representation of a value may not fit on a line.  I believe a current debugger patch addresses this issue.  Clearly, there should be one function for displaying locals and globals.  And in debugger, one should be able to display them for previous frames.

----------
versions: +Python 3.10 -Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24790>
_______________________________________

From report at bugs.python.org  Thu Jan 28 09:38:12 2021
From: report at bugs.python.org (Ned Deily)
Date: Thu, 28 Jan 2021 14:38:12 +0000
Subject: [issue42819] readline 8.1 bracketed paste
In-Reply-To: <1609707155.89.0.22999518491.issue42819@roundup.psfhosted.org>
Message-ID: <1611844692.38.0.481968906969.issue42819@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
nosy: +twouters

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42819>
_______________________________________

From report at bugs.python.org  Thu Jan 28 09:45:46 2021
From: report at bugs.python.org (Ned Deily)
Date: Thu, 28 Jan 2021 14:45:46 +0000
Subject: [issue42967] [security] urllib.parse.parse_qsl(): Web cache poisoning
 - `; ` as a query args separator
In-Reply-To: <1611068809.96.0.58823274544.issue42967@roundup.psfhosted.org>
Message-ID: <1611845146.52.0.422102700948.issue42967@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Resolution of this issue is blocking 3.7.x and 3.6.x security releases and threatens to block upcoming maintenance releases.

----------
nosy: +lukasz.langa, ned.deily
priority: normal -> release blocker

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Thu Jan 28 09:46:42 2021
From: report at bugs.python.org (Ned Deily)
Date: Thu, 28 Jan 2021 14:46:42 +0000
Subject: [issue42988] [security] Information disclosure via pydoc -p:
 /getfile?key=path allows to read arbitrary file on the filesystem
In-Reply-To: <1611231517.86.0.296188996897.issue42988@roundup.psfhosted.org>
Message-ID: <1611845202.77.0.54164082862.issue42988@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Resolution of this issue is blocking 3.7.x and 3.6.x security releases and threatens to block upcoming maintenance releases.

----------
nosy: +lukasz.langa, ned.deily
priority: normal -> release blocker
title: Information disclosure via pydoc -p: /getfile?key=path allows to read arbitrary file on the filesystem -> [security] Information disclosure via pydoc -p: /getfile?key=path allows to read arbitrary file on the filesystem

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42988>
_______________________________________

From report at bugs.python.org  Thu Jan 28 09:54:10 2021
From: report at bugs.python.org (Ned Deily)
Date: Thu, 28 Jan 2021 14:54:10 +0000
Subject: [issue29076] Mac installer shell updater script silently fails if
 default shell is fish
In-Reply-To: <1482778000.76.0.584407589583.issue29076@psf.upfronthosting.co.za>
Message-ID: <1611845650.81.0.731388154364.issue29076@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset e9c6c26aff08e4c7bc6f1e8015cdd8edcc92dbef by Miss Islington (bot) in branch '3.9':
bpo-29076: Add fish support to macOS installer (GH-23302) (GH-23937)
https://github.com/python/cpython/commit/e9c6c26aff08e4c7bc6f1e8015cdd8edcc92dbef


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29076>
_______________________________________

From report at bugs.python.org  Thu Jan 28 09:55:05 2021
From: report at bugs.python.org (Ned Deily)
Date: Thu, 28 Jan 2021 14:55:05 +0000
Subject: [issue29076] Mac installer shell updater script silently fails if
 default shell is fish
In-Reply-To: <1482778000.76.0.584407589583.issue29076@psf.upfronthosting.co.za>
Message-ID: <1611845705.02.0.432208307492.issue29076@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset 81b23a9b148b60f8f541e4b06e1d88c58644e3b8 by Miss Islington (bot) in branch '3.8':
bpo-29076: Add fish support to macOS installer (GH-23302) (GH-23938)
https://github.com/python/cpython/commit/81b23a9b148b60f8f541e4b06e1d88c58644e3b8


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29076>
_______________________________________

From report at bugs.python.org  Thu Jan 28 09:56:00 2021
From: report at bugs.python.org (Ned Deily)
Date: Thu, 28 Jan 2021 14:56:00 +0000
Subject: [issue29076] Mac installer shell updater script silently fails if
 default shell is fish
In-Reply-To: <1482778000.76.0.584407589583.issue29076@psf.upfronthosting.co.za>
Message-ID: <1611845760.72.0.197187351649.issue29076@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Thanks for the PR!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29076>
_______________________________________

From report at bugs.python.org  Thu Jan 28 10:56:59 2021
From: report at bugs.python.org (Jesse Silverman)
Date: Thu, 28 Jan 2021 15:56:59 +0000
Subject: [issue43056] Use of dicts in sections 4.2 and 4.7 of Python tutorial
 a bit confusing
Message-ID: <1611849419.6.0.947675106627.issue43056@roundup.psfhosted.org>


New submission from Jesse Silverman <jessevsilverman at gmail.com>:

The Python tutorial was not my first introduction to Python, but I see things in sections 4.2 and 4.7 that likely would have confused me a lot if it was.

In 4.2 near the end, we have great advice about how to avoid problems with modifying a collection while iterating thru it.

Unfortunately, it both makes use of a dict despite not having introduced it before at all within the tutorial (I wasn't shocked because it was NOT my first introduction to Python) and in fact, the .items() method which is beautifully explained in section 5.6, which hasn't been read yet.

I got thru it a bit shakily, and in a reference, rather than an introductory tutorial, it is quite literally impossible to present everything in a strict sequence, but I would definitely have been thrown for a loop if it was actually my first introduction to Python.

All was good again until I got to section 4.7.2, where I was again glad I had previously consumed tutorial materials concerning dict.  There is a forward reference to:
https://docs.python.org/3.9/library/stdtypes.html#typesmapping

Which every Python programmer should undoubtedly be familiar with eventually, but "why not?" to the more novice-friendly:
https://docs.python.org/3.9/tutorial/datastructures.html#dictionaries

The forward reference from this section to tuples in section 5 of the tutorial suggests that this might have been appropriate as well.

The dict, the tuple and parameter passing are all very basic topics indeed, but I would have found 4.7 very rough going if I had no prior exposure to dict and tuple.

This isn't a complaint demanding a refund for the cost of the tutorial, so much as an indication of where I think true novices attempting to follow the tutorial in sequence would likely be thrown for a loop.  I understand there is a healthy ecosystem of free and paid introductory tutorial material for Python, as evidenced by the fact that I was only working thru the tutorial just now, having been referred to it as a pre-req for other material I will be moving on to soon.

----------
assignee: docs at python
components: Documentation
messages: 385870
nosy: docs at python, jessevsilverman
priority: normal
severity: normal
status: open
title: Use of dicts in sections 4.2 and 4.7 of Python tutorial a bit confusing
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43056>
_______________________________________

From report at bugs.python.org  Thu Jan 28 12:26:53 2021
From: report at bugs.python.org (killv5)
Date: Thu, 28 Jan 2021 17:26:53 +0000
Subject: [issue43057] Timezone 'Etc/GMT-5' functions as Timezone 'Etc/GMT+5'
Message-ID: <1611854813.81.0.604991551457.issue43057@roundup.psfhosted.org>


New submission from killv5 <killianvetter at gmail.com>:

When I run the code attached I get the results below. This is not the expected behavior because I was expecting the GMT-5 timezone instead of GMT+5. When I tried to use GMT-5 I had the result of GMT+5. Luckily the timezone names still work ('EST','CST', etc.)

2021-01-28 19:10:47+05:00
+05

----------
components: Library (Lib)
files: timezone_example.py
messages: 385871
nosy: killv5
priority: normal
severity: normal
status: open
title: Timezone 'Etc/GMT-5' functions as Timezone 'Etc/GMT+5'
type: behavior
versions: Python 3.8
Added file: https://bugs.python.org/file49771/timezone_example.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43057>
_______________________________________

From report at bugs.python.org  Thu Jan 28 12:30:05 2021
From: report at bugs.python.org (Mark Dickinson)
Date: Thu, 28 Jan 2021 17:30:05 +0000
Subject: [issue43053] Speed up math.isqrt, again
In-Reply-To: <1611821006.77.0.580238316666.issue43053@roundup.psfhosted.org>
Message-ID: <1611855005.16.0.337778891207.issue43053@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

Some comments, now that I've had a chance to look properly at the suggestion.

For reference, here's the "near square root" function that forms the basis of Python's isqrt algorithm. For clarity, I've written it recursively, but it's equivalent to the iterative version described in mathmodule.c. (Definition: for a positive integer n, a "near square root" of n is an integer a such that |a - ?n| < 1; or in other words the near square roots of n are the floor and the ceiling of ?n.)

    def nsqrt(n):
        """Compute a near square root for a positive integer n."""
        if n < 4:
            return 1
        else:
            e = (n.bit_length() - 3) // 4
            a = nsqrt(n >> 2*e + 2)
            return (a << e) + (n >> e + 2) // a

Juraj's suggestion, applied to each step of the recursion rather than just the outer step, amounts to computing the expression in the last line in a different way. (What follows isn't *identical* to what Juraj is suggesting in all the details, but it's essentially equivalent and has the same key performance implications.) Here's the proposed new version, identical to the previous one except for the last line:

    def nsqrt(n):
        """Compute a near square root for a positive integer n."""
        if n < 4:
            return 1
        else:
            e = (n.bit_length() - 3) // 4
            a = nsqrt(n >> 2*e + 2)
            return (a << e + 1) + ((n >> e + 2) - (a * a << e)) // a

With regards to proof, it's straightforward to see that this is equivalent: we have

        (a << e) + (n >> e + 2) // a
     == (a << e) + (a << e) + (n >> e + 2) // a - (a << e)
     == (a << e + 1) + (n >> e + 2) // a - (a << e)
     == (a << e + 1) + ((n >> e + 2) - (a * a << e)) // a

It's interesting to note that with this version we *do* rely on Python's floor division semantics for negative numbers, since the quantity ((n >> e + 2) - (a * a << e)) could be negative; that last equality is not valid with C-style sign-of-result-is-sign-of-dividend division. The first version works entirely with nonnegative integers. (And the version proposed by Juraj also works entirely with nonnegative integers, as a result of the extra correction step.)

And now the key point is that the dividend (n >> e + 2) - (a * a << e) in the second version is significantly smaller (roughly two-thirds the bit count) than the original divisor n >> e + 2. That should make the division roughly twice as fast (in the limit as n gets large), and since the division is the main bottleneck in the algorithm for large n, it should speed up the algorithm overall, again in the limit for large n, despite the fact that we have a greater number of arithmetic operations per iteration. And with Python's current subquadratic multiplication but quadratic division, the advantage becomes more significant as n gets large.

The second version is a little more complicated than the first, but the complication probably amounts to no more than 10-20 extra lines of C code. Still, there's a maintenance cost in adding that complication to be considered.

But here's the thing: I don't actually care about the performance for *huge* n - people who care about that sort of thing would be better off using gmpy2. I'm much more interested in the performance implications for *smaller* n: that is, integers of length 64-256 bits, say. (For n smaller than 2**64 the difference is irrelevant, since we have a pure C fast path there.) If the second version performs better across the board it may be worth the extra complexity. If it doesn't, then what's the cutoff? That is, where does the second version start outperforming the first? I'm not really so interested in having a hybrid algorithm that switches from one solution to the other at some threshold - that's a step too far complexity-wise.

So I propose that the next step be to code up the second variant in mathmodule.c and do some performance testing.

Juraj: are you interested in working on a PR?

----------
nosy: +tim.peters

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43053>
_______________________________________

From report at bugs.python.org  Thu Jan 28 12:57:58 2021
From: report at bugs.python.org (Mark Dickinson)
Date: Thu, 28 Jan 2021 17:57:58 +0000
Subject: [issue43053] Speed up math.isqrt, again
In-Reply-To: <1611821006.77.0.580238316666.issue43053@roundup.psfhosted.org>
Message-ID: <1611856678.67.0.851462264428.issue43053@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

Translation of the proposal to the iterative version described here: https://github.com/python/cpython/blob/64fc105b2d2faaeadd1026d2417b83915af6622f/Modules/mathmodule.c#L1591-L1611

The main loop:

        c = (n.bit_length() - 1) // 2
        a = 1
        d = 0
        for s in reversed(range(c.bit_length())):
            # Loop invariant: (a-1)**2 < (n >> 2*(c - d)) < (a+1)**2
            e = d
            d = c >> s
            a = (a << d - e - 1) + (n >> 2*c - e - d + 1) // a

becomes (again identical except for the last line):

        c = (n.bit_length() - 1) // 2
        a = 1
        d = 0
        for s in reversed(range(c.bit_length())):
            # Loop invariant: (a-1)**2 < (n >> 2*(c - d)) < (a+1)**2
            e = d
            d = c >> s
            a = (a << d - e) + ((n >> 2*c - e - d + 1) - (a*a << d - e - 1)) // a

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43053>
_______________________________________

From report at bugs.python.org  Thu Jan 28 13:32:25 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Thu, 28 Jan 2021 18:32:25 +0000
Subject: [issue43040] random.py randrange() is very slow if the range is a
 power of 2.
In-Reply-To: <1611752833.52.0.275617605532.issue43040@roundup.psfhosted.org>
Message-ID: <1611858745.32.0.584565328411.issue43040@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

> python2's implementation of randrange() that uses random() 
> under the hood was noticeably faster than python3's 
> randrange() that uses getrandbits() under the hood.

Yes, that was a conscious decision. See https://bugs.python.org/issue9025 . We traded performance in order to gain correctness.  As noted in the docs:

"Changed in version 3.2: randrange() is more sophisticated about producing equally distributed values. Formerly it used a style like int(random()*n) which could produce slightly uneven distributions."

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43040>
_______________________________________

From report at bugs.python.org  Thu Jan 28 13:32:56 2021
From: report at bugs.python.org (Dennis Sweeney)
Date: Thu, 28 Jan 2021 18:32:56 +0000
Subject: [issue43057] Timezone 'Etc/GMT-5' functions as Timezone 'Etc/GMT+5'
In-Reply-To: <1611854813.81.0.604991551457.issue43057@roundup.psfhosted.org>
Message-ID: <1611858776.07.0.48461563992.issue43057@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

I reproduced something similar in 3.9 with standard library modules:

>>> from datetime import datetime
>>> from zoneinfo import ZoneInfo
>>> zone = ZoneInfo(key='Etc/GMT-3')
>>> zone.tzname(datetime(2021, 1, 28))
'+03'

----------
nosy: +Dennis Sweeney

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43057>
_______________________________________

From report at bugs.python.org  Thu Jan 28 13:54:14 2021
From: report at bugs.python.org (Hristo Venev)
Date: Thu, 28 Jan 2021 18:54:14 +0000
Subject: [issue24275] lookdict_* give up too soon
In-Reply-To: <1432444109.96.0.971324850141.issue24275@psf.upfronthosting.co.za>
Message-ID: <1611860054.66.0.406984864854.issue24275@roundup.psfhosted.org>


Hristo Venev <hristo at venev.name> added the comment:

I've attached a patch. I will soon provide benchmark results.

----------
keywords: +patch
nosy: +h.venev
Added file: https://bugs.python.org/file49772/0001-Don-t-downgrade-unicode-only-dicts-to-mixed-on-non-u.patch

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24275>
_______________________________________

From report at bugs.python.org  Thu Jan 28 13:58:11 2021
From: report at bugs.python.org (Hristo Venev)
Date: Thu, 28 Jan 2021 18:58:11 +0000
Subject: [issue24275] lookdict_* give up too soon
In-Reply-To: <1432444109.96.0.971324850141.issue24275@psf.upfronthosting.co.za>
Message-ID: <1611860291.59.0.705515572652.issue24275@roundup.psfhosted.org>


Hristo Venev <hristo at venev.name> added the comment:

Benchmark program attached.

0. Creates a dict with str keys
1. str lookups
2. str subclass lookups on the same dict
3. str lookups on the same dict

Results before patch:
0.9493069459404069 +- 0.004707371313935551
1.47313450980997 +- 0.01350596115630158
1.3181799192904144 +- 0.006550182814933545

Results after patch:
0.9498907704499289 +- 0.003721378313122522
1.4936510094799451 +- 0.057905386684185135
0.9494844124498195 +- 0.0029465760297623235

----------
Added file: https://bugs.python.org/file49773/bench.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24275>
_______________________________________

From report at bugs.python.org  Thu Jan 28 14:21:09 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 28 Jan 2021 19:21:09 +0000
Subject: [issue42380] Build windows binaries with MS VS2019 16.8+ / MSVC 19.28+
In-Reply-To: <1605562580.81.0.356035250253.issue42380@roundup.psfhosted.org>
Message-ID: <1611861669.53.0.785879466366.issue42380@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Judging from the link you posted to version numbering
https://en.wikipedia.org/wiki/Microsoft_Visual_C%2B%2B#Internal_version_numbering
the first line should have 'MSVC 14.28' the middle column title should be  'MS Visual Studio'.

Mark Shannon today posted "Why aren't we allowing the use of C11?" on pydev.
https://mail.python.org/archives/list/python-dev at python.org/thread/PLXETSQE7PRFXBXN2QY6VNPKUTM6I7OD/

----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42380>
_______________________________________

From report at bugs.python.org  Thu Jan 28 15:00:03 2021
From: report at bugs.python.org (Mark Dickinson)
Date: Thu, 28 Jan 2021 20:00:03 +0000
Subject: [issue43057] Timezone 'Etc/GMT-5' functions as Timezone 'Etc/GMT+5'
In-Reply-To: <1611854813.81.0.604991551457.issue43057@roundup.psfhosted.org>
Message-ID: <1611864003.87.0.473296982748.issue43057@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

This isn't a Python bug - it's a quirk of the way that the "Etc/***" timezones are defined. See for example https://en.wikipedia.org/wiki/Tz_database#Area:

> In order to conform with the POSIX style, those zone names beginning with "Etc/GMT" have their sign reversed from the standard ISO 8601 convention. In the "Etc" area, zones west of GMT have a positive sign and those east have a negative sign in their name (e.g "Etc/GMT-14" is 14 hours ahead of GMT).

----------
nosy: +mark.dickinson
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43057>
_______________________________________

From report at bugs.python.org  Thu Jan 28 15:17:02 2021
From: report at bugs.python.org (Brett Cohen)
Date: Thu, 28 Jan 2021 20:17:02 +0000
Subject: [issue43058] setting a logging Handler name
Message-ID: <1611865022.25.0.122108787235.issue43058@roundup.psfhosted.org>


New submission from Brett Cohen <bcohen at livedata.com>:

When using the logging module to add a new handler, the documentation doesn't mention the ability to set the name of the handler. It turns out that it's actually a supported feature by using:

    handler_instance.set_name("YOUR_NAME_HERE")

I'd suggest updating the documentation to indicate the ability to set the name of the handler. It'd be very nice if the name was settable in the constructor of the Handler class. This could be done by including an optional `name` argument that defaults to None:

    class Handler(Filterer):
        def __init__(self, level=NOTSET, name=None):
            Filterer.__init__(self)
            self._name = name
            ...
            ...

I noticed the problem when trying to call logging.config.dictConfig with a config which specified a handler (it crashes: `ValueError: No handler found with name 'my_handler'`).

I initially thought to manually alter the _handlers directly since the docs didn't indicate how to set the name. After digging into the source code I found the undocumented `set_name` function.

----------
assignee: docs at python
components: Documentation, Library (Lib)
messages: 385880
nosy: bcohen, docs at python, vinay.sajip
priority: normal
severity: normal
status: open
title: setting a logging Handler name
type: enhancement
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43058>
_______________________________________

From report at bugs.python.org  Thu Jan 28 15:25:48 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Thu, 28 Jan 2021 20:25:48 +0000
Subject: [issue43009] Port curses capi pointer array to a struct
In-Reply-To: <1611405221.76.0.555112594998.issue43009@roundup.psfhosted.org>
Message-ID: <1611865548.35.0.785922079178.issue43009@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

The _decimal API is also just an array of pointers. Should we change that to a struct as well?

----------
nosy: +erlendaasland

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43009>
_______________________________________

From report at bugs.python.org  Thu Jan 28 15:32:47 2021
From: report at bugs.python.org (Glenn Linderman)
Date: Thu, 28 Jan 2021 20:32:47 +0000
Subject: [issue43046] argparse: capturing actions
In-Reply-To: <1611791532.72.0.119102600348.issue43046@roundup.psfhosted.org>
Message-ID: <1611865967.35.0.432011677389.issue43046@roundup.psfhosted.org>


Glenn Linderman <v+python at g.nevcal.com> added the comment:

Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

>> Sounds like another wet blanket argpment

> Please watch your tone.  It borders on being abusive.

I considered that as a canonical description of the type of negativity presented by your comment. It was not intended to be abusive, just a descriptive summary.


> It is entirely appropriate to set limits on the scope of what a module is trying to achieve.  It is appropriate to consider module learnability.  It is appropriate to limit sprawl and feature creep.  It is appropriate to consider whether the pattern being encouraged and supported by the PR is intellectually manageable by end users.


I agree that all those considerations are worthwhile, but I see this as a small extension that adds significant power. No one is forced to use the new features, or the old features, or argparse at all. There are already features in argparse that I simply ignore, because I have no need for them. It doesn't make using the feature I do use more difficult. I just look for what I need, and use those features.


> It is correct that argparse set out to handle more complex cases than optparse.  But even then, it was aiming to cases that commonly arose it the wild (subparsers are not uncommon).  It never aspired to be all things to all users.

And unfortunately, in so doing, it failed to support some cases that optparse could handle, although for the cases that argparse could handle, the user code to use it was far simpler.  This was improved somewhat by the addition of parse_intermixed_args.

Since argparse is provided in stdlib, it seems very reasonable to me to enhance it to support command line parsing paradigms used effectively since 1979, at least (ref: tar).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43046>
_______________________________________

From report at bugs.python.org  Thu Jan 28 15:45:54 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Thu, 28 Jan 2021 20:45:54 +0000
Subject: [issue42972] [C API] Heap types (PyType_FromSpec) must fully
 implement the GC protocol
In-Reply-To: <1611093266.11.0.721387186389.issue42972@roundup.psfhosted.org>
Message-ID: <1611866754.81.0.883132727343.issue42972@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

Should we proceed with fixing GC for all heap types before continuing work with bpo-40077?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42972>
_______________________________________

From report at bugs.python.org  Thu Jan 28 16:07:11 2021
From: report at bugs.python.org (user1347091)
Date: Thu, 28 Jan 2021 21:07:11 +0000
Subject: [issue43059] sqlite3: Externally developed?
Message-ID: <1611868031.72.0.138640197563.issue43059@roundup.psfhosted.org>


New submission from user1347091 <accounts at lrose.de>:

In the documentation of the sqlite3 module it says:

See also:
    https://github.com/ghaering/pysqlite
    The pysqlite web page ? sqlite3 is developed externally under the name ?pysqlite?.

However, the README.md of the linked repository says:

    This project is not actively maintained any more: You are better off using the "sqlite3" module in the Python standard library, which originated from the pysqlite codebase.

Which information is correct? They seem contraticting to me. It looks like this is old information from times where sqlite3 wasn't integrated in the Python standard library yet - or am I missing something?

----------
assignee: docs at python
components: Documentation
messages: 385884
nosy: docs at python, user1347091
priority: normal
severity: normal
status: open
title: sqlite3: Externally developed?
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43059>
_______________________________________

From report at bugs.python.org  Thu Jan 28 16:08:49 2021
From: report at bugs.python.org (user1347091)
Date: Thu, 28 Jan 2021 21:08:49 +0000
Subject: [issue43059] sqlite3: Externally developed?
In-Reply-To: <1611868031.72.0.138640197563.issue43059@roundup.psfhosted.org>
Message-ID: <1611868129.45.0.063428194766.issue43059@roundup.psfhosted.org>


user1347091 <accounts at lrose.de> added the comment:

The documentation page in question is the following:

https://docs.python.org/3.10/library/sqlite3.html
(Sorry, I forgot to add this information to my original post)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43059>
_______________________________________

From report at bugs.python.org  Thu Jan 28 16:14:55 2021
From: report at bugs.python.org (Zachary Ware)
Date: Thu, 28 Jan 2021 21:14:55 +0000
Subject: [issue43059] sqlite3: Externally developed?
In-Reply-To: <1611868031.72.0.138640197563.issue43059@roundup.psfhosted.org>
Message-ID: <1611868495.64.0.378408075594.issue43059@roundup.psfhosted.org>


Zachary Ware <zachary.ware at gmail.com> added the comment:

Looks like that link could be safely removed from our docs.  Would you like to submit a pull request doing so?

----------
nosy: +berker.peksag, erlendaasland, zach.ware

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43059>
_______________________________________

From report at bugs.python.org  Thu Jan 28 16:36:04 2021
From: report at bugs.python.org (Roundup Robot)
Date: Thu, 28 Jan 2021 21:36:04 +0000
Subject: [issue43059] sqlite3: Externally developed?
In-Reply-To: <1611868031.72.0.138640197563.issue43059@roundup.psfhosted.org>
Message-ID: <1611869764.45.0.833189802168.issue43059@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
keywords: +patch
nosy: +python-dev
nosy_count: 5.0 -> 6.0
pull_requests: +23186
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24364

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43059>
_______________________________________

From report at bugs.python.org  Thu Jan 28 16:45:53 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Thu, 28 Jan 2021 21:45:53 +0000
Subject: [issue43059] sqlite3: Externally developed?
In-Reply-To: <1611868031.72.0.138640197563.issue43059@roundup.psfhosted.org>
Message-ID: <1611870353.7.0.62262135435.issue43059@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

Perhaps we should remove the (pysqlite) version attributes while we're there? Ref. https://mail.python.org/archives/list/python-dev at python.org/message/NS6YVA3QCAXELK7KROOLULKXOF3KFFJA/

>>> import sqlite3
>>> sqlite3.version
'2.6.0'
>>> sqlite3.version_info
(2, 6, 0)


Berker?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43059>
_______________________________________

From report at bugs.python.org  Thu Jan 28 16:54:51 2021
From: report at bugs.python.org (user1347091)
Date: Thu, 28 Jan 2021 21:54:51 +0000
Subject: [issue43059] sqlite3: Externally developed?
In-Reply-To: <1611868031.72.0.138640197563.issue43059@roundup.psfhosted.org>
Message-ID: <1611870891.39.0.512791776448.issue43059@roundup.psfhosted.org>


user1347091 <accounts at lrose.de> added the comment:

At least in Python 3.9.1, these commands still exist:
    Python 3.9.1 (default, Dec 13 2020, 11:55:53) 
    [GCC 10.2.0] on linux
    Type "help", "copyright", "credits" or "license" for more information.
    >>> import sqlite3
    >>> sqlite3.version
    '2.6.0'
    >>> sqlite3.version_info
    (2, 6, 0) 
So if they are obsolete as well, they should be removed from cpython as well, and not only from the documentation.

I have created a pull request for the obsolete link, and I'd be happy to take care of this as well if we decide to do so.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43059>
_______________________________________

From report at bugs.python.org  Thu Jan 28 18:13:54 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 28 Jan 2021 23:13:54 +0000
Subject: [issue23544] IDLE hangs when selecting Stack View with debug active
In-Reply-To: <1425072335.83.0.576854566256.issue23544@psf.upfronthosting.co.za>
Message-ID: <1611875634.48.0.478032296261.issue23544@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset 23a567c11ca36eedde0e119443c85cc16075deaf by Zackery Spytz in branch 'master':
bpo-23544: Disable IDLE Stack Viewer when running user code (GH-17163)
https://github.com/python/cpython/commit/23a567c11ca36eedde0e119443c85cc16075deaf


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23544>
_______________________________________

From report at bugs.python.org  Thu Jan 28 18:14:02 2021
From: report at bugs.python.org (miss-islington)
Date: Thu, 28 Jan 2021 23:14:02 +0000
Subject: [issue23544] IDLE hangs when selecting Stack View with debug active
In-Reply-To: <1425072335.83.0.576854566256.issue23544@psf.upfronthosting.co.za>
Message-ID: <1611875642.02.0.940054325773.issue23544@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 4.0 -> 5.0
pull_requests: +23188
pull_request: https://github.com/python/cpython/pull/24365

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23544>
_______________________________________

From report at bugs.python.org  Thu Jan 28 18:14:10 2021
From: report at bugs.python.org (miss-islington)
Date: Thu, 28 Jan 2021 23:14:10 +0000
Subject: [issue23544] IDLE hangs when selecting Stack View with debug active
In-Reply-To: <1425072335.83.0.576854566256.issue23544@psf.upfronthosting.co.za>
Message-ID: <1611875650.19.0.166767756943.issue23544@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +23189
pull_request: https://github.com/python/cpython/pull/24366

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23544>
_______________________________________

From report at bugs.python.org  Thu Jan 28 18:38:54 2021
From: report at bugs.python.org (miss-islington)
Date: Thu, 28 Jan 2021 23:38:54 +0000
Subject: [issue23544] IDLE hangs when selecting Stack View with debug active
In-Reply-To: <1425072335.83.0.576854566256.issue23544@psf.upfronthosting.co.za>
Message-ID: <1611877134.89.0.056834753876.issue23544@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 6d87dec5818667168cc7e4ad972dde8aeec6d900 by Miss Islington (bot) in branch '3.9':
bpo-23544: Disable IDLE Stack Viewer when running user code (GH-17163)
https://github.com/python/cpython/commit/6d87dec5818667168cc7e4ad972dde8aeec6d900


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23544>
_______________________________________

From report at bugs.python.org  Thu Jan 28 19:55:10 2021
From: report at bugs.python.org (Steve Dower)
Date: Fri, 29 Jan 2021 00:55:10 +0000
Subject: [issue43051] Pip Permissions Error overwriting pip directory
In-Reply-To: <1611811593.92.0.540989910161.issue43051@roundup.psfhosted.org>
Message-ID: <1611881710.39.0.380571007717.issue43051@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

This is better reported at https://github.com/pypa/pip, as it will be fixed out of their repository and then updated into here.

Seems like the failed install did not roll back properly. Those directories are the backup of the uninstallation so that if it fails, they can be restored. It's not obvious why that didn't work here.

----------
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43051>
_______________________________________

From report at bugs.python.org  Thu Jan 28 20:48:12 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 29 Jan 2021 01:48:12 +0000
Subject: [issue23544] IDLE hangs when selecting Stack View with debug active
In-Reply-To: <1425072335.83.0.576854566256.issue23544@psf.upfronthosting.co.za>
Message-ID: <1611884892.05.0.546652063744.issue23544@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset 901a9834420e516c07d6cad356d2be481db6d8d1 by Miss Islington (bot) in branch '3.8':
bpo-23544: Disable IDLE Stack Viewer when running user code (GH-17163) (#24366)
https://github.com/python/cpython/commit/901a9834420e516c07d6cad356d2be481db6d8d1


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23544>
_______________________________________

From report at bugs.python.org  Thu Jan 28 20:49:46 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 29 Jan 2021 01:49:46 +0000
Subject: [issue23544] IDLE hangs when selecting Stack View with debug active
In-Reply-To: <1425072335.83.0.576854566256.issue23544@psf.upfronthosting.co.za>
Message-ID: <1611884986.61.0.493196174385.issue23544@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Tal, I agree with you.

The debugger is an execution controller with an optional current-frame viewer updated whenever execution is paused.  It displays both name and value.  I believe a current PR addresses the issue of value representations being indefinitely long and possibly overflowing the space allotted.

The stack viewer can view any frame on the stack, but only after an exception.  At least currently, on Windows, it omits value names. And there are other issues (#24790).  The debugger viewer and stack viewer should be combined with the best features of each (new issues).

In the meanwhile, I finished PR and merged.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23544>
_______________________________________

From report at bugs.python.org  Thu Jan 28 20:50:04 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 29 Jan 2021 01:50:04 +0000
Subject: [issue23544] IDLE hangs when selecting Stack View with debug active
In-Reply-To: <1425072335.83.0.576854566256.issue23544@psf.upfronthosting.co.za>
Message-ID: <1611885004.81.0.0169368673161.issue23544@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23544>
_______________________________________

From report at bugs.python.org  Thu Jan 28 23:49:24 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 29 Jan 2021 04:49:24 +0000
Subject: [issue43029] unittest: Add assertUniqeIn
In-Reply-To: <1611653456.39.0.201138075595.issue43029@roundup.psfhosted.org>
Message-ID: <1611895764.39.0.238632731921.issue43029@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

-0 on this one because the algorithm is quadratic, the name is opaque, and because the common case can already be clearly expressed with sets.

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43029>
_______________________________________

From report at bugs.python.org  Fri Jan 29 01:58:24 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 29 Jan 2021 06:58:24 +0000
Subject: [issue43029] unittest: Add assertUniqeIn
In-Reply-To: <1611653456.39.0.201138075595.issue43029@roundup.psfhosted.org>
Message-ID: <1611903504.36.0.481777587338.issue43029@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

It looks pretty niche. I do not remember a single case in which such method would help.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43029>
_______________________________________

From report at bugs.python.org  Fri Jan 29 02:01:43 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 29 Jan 2021 07:01:43 +0000
Subject: [issue43059] sqlite3: Externally developed?
In-Reply-To: <1611868031.72.0.138640197563.issue43059@roundup.psfhosted.org>
Message-ID: <1611903703.32.0.151439884836.issue43059@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Before removing public documented attribute it should be deprecated.

Don't haste with this, I have a large patch for removing obsolete version attributes in process.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43059>
_______________________________________

From report at bugs.python.org  Fri Jan 29 02:29:01 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Fri, 29 Jan 2021 07:29:01 +0000
Subject: [issue43059] sqlite3: Externally developed?
In-Reply-To: <1611868031.72.0.138640197563.issue43059@roundup.psfhosted.org>
Message-ID: <1611905341.06.0.168984778257.issue43059@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

> Before removing public documented attribute it should be deprecated.

Of course.

> [?], I have a large patch for removing obsolete version attributes in process.

Great!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43059>
_______________________________________

From report at bugs.python.org  Fri Jan 29 02:54:41 2021
From: report at bugs.python.org (=?utf-8?b?TWllY3p5c8WCYXcgVG9yY2hhxYJh?=)
Date: Fri, 29 Jan 2021 07:54:41 +0000
Subject: [issue42830] tempfile mkstemp() leaks file descriptors if os.close()
 is not called
In-Reply-To: <1609846127.44.0.860192251042.issue42830@roundup.psfhosted.org>
Message-ID: <1611906881.89.0.47395673274.issue42830@roundup.psfhosted.org>


Mieczys?aw Torcha?a <mieczyslaw.torchala at gmail.com> added the comment:

Yes, having it written explicitly in docs (that remove means not only a file removal with unlink/remove and warn about lacking file descriptors), or/and providing a remove function in tempfile which will both unlink and close, would be valuable.

The use case is that when the process crashes during some scientific computations, I still want to keep the file to investigate. Of course, one can argue that try/except could copy the file somewhere else, but having it still in /tmp (and pointing to this file in the log) is pretty useful.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42830>
_______________________________________

From report at bugs.python.org  Fri Jan 29 04:33:58 2021
From: report at bugs.python.org (hai shi)
Date: Fri, 29 Jan 2021 09:33:58 +0000
Subject: [issue43009] Port curses capi pointer array to a struct
In-Reply-To: <1611405221.76.0.555112594998.issue43009@roundup.psfhosted.org>
Message-ID: <1611912838.05.0.612556209101.issue43009@roundup.psfhosted.org>


hai shi <shihai1991 at 126.com> added the comment:

> The _decimal API is also just an array of pointers. Should we change that to a struct as well?

+1. IMHO, structure is more directly than pointer array. And there haven't exposing this pointer array to users(no backward compatibility).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43009>
_______________________________________

From report at bugs.python.org  Fri Jan 29 04:43:52 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Fri, 29 Jan 2021 09:43:52 +0000
Subject: [issue43009] Port curses capi pointer array to a struct
In-Reply-To: <1611405221.76.0.555112594998.issue43009@roundup.psfhosted.org>
Message-ID: <1611913432.69.0.172597313613.issue43009@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

> +1. IMHO, structure is more directly than pointer array. And there haven't exposing this pointer array to users(no backward compatibility).

Good. I'll open a separate issue and give it a try. Thanks!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43009>
_______________________________________

From report at bugs.python.org  Fri Jan 29 04:46:53 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Fri, 29 Jan 2021 09:46:53 +0000
Subject: [issue43060] Convert _decimal C API from pointer array to struct
Message-ID: <1611913613.83.0.451385849535.issue43060@roundup.psfhosted.org>


New submission from Erlend Egeberg Aasland <erlend.aasland at innova.no>:

Ref. discussions on bpo-43009 and bpo-41798.

----------
components: Library (Lib)
messages: 385901
nosy: erlendaasland, shihai1991, vstinner
priority: normal
severity: normal
status: open
title: Convert _decimal C API from pointer array to struct
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43060>
_______________________________________

From report at bugs.python.org  Fri Jan 29 04:47:12 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Fri, 29 Jan 2021 09:47:12 +0000
Subject: [issue43060] Convert _decimal C API from pointer array to struct
In-Reply-To: <1611913613.83.0.451385849535.issue43060@roundup.psfhosted.org>
Message-ID: <1611913632.09.0.4972619729.issue43060@roundup.psfhosted.org>


Change by Erlend Egeberg Aasland <erlend.aasland at innova.no>:


----------
type:  -> enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43060>
_______________________________________

From report at bugs.python.org  Fri Jan 29 04:47:28 2021
From: report at bugs.python.org (hai shi)
Date: Fri, 29 Jan 2021 09:47:28 +0000
Subject: [issue43009] Port curses capi pointer array to a struct
In-Reply-To: <1611405221.76.0.555112594998.issue43009@roundup.psfhosted.org>
Message-ID: <1611913648.59.0.233978151457.issue43009@roundup.psfhosted.org>


hai shi <shihai1991 at 126.com> added the comment:

> The _decimal API is also just an array of pointers. Should we change that to a struct as well?

Hi, victor. Do you have suggestion about it :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43009>
_______________________________________

From report at bugs.python.org  Fri Jan 29 04:52:57 2021
From: report at bugs.python.org (Erlend Egeberg Aasland)
Date: Fri, 29 Jan 2021 09:52:57 +0000
Subject: [issue43009] Port curses capi pointer array to a struct
In-Reply-To: <1611405221.76.0.555112594998.issue43009@roundup.psfhosted.org>
Message-ID: <1611913977.38.0.275422473098.issue43009@roundup.psfhosted.org>


Erlend Egeberg Aasland <erlend.aasland at innova.no> added the comment:

FYI: I've opened bpo-43060 for the decimal module.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43009>
_______________________________________

From report at bugs.python.org  Fri Jan 29 05:15:06 2021
From: report at bugs.python.org (h-vetinari)
Date: Fri, 29 Jan 2021 10:15:06 +0000
Subject: [issue42380] Build windows binaries with MS VS2019 16.8+ / MSVC 19.28+
In-Reply-To: <1605562580.81.0.356035250253.issue42380@roundup.psfhosted.org>
Message-ID: <1611915306.16.0.438817075184.issue42380@roundup.psfhosted.org>


h-vetinari <h.vetinari at gmx.com> added the comment:

Hey Terry

I had asked about this on discuss (https://discuss.python.org/t/toolchain-upgrade-on-windows/6377/2), and Steve provided some very valuable input.

In particular, building with the newer VS (that supports C11) should stay ABI-compatible with everything that has been built on Visual Studio 2015, 2017 and 2019:
> This is different from all previous Visual C++ versions, as they each had their own distinct runtime files, not shared with other versions.

(from https://docs.microsoft.com/en-gb/cpp/windows/universal-crt-deployment?view=msvc-160&viewFallbackFrom=vs-2019), due to the way the (now-)universal runtime is designed.

Thanks

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42380>
_______________________________________

From report at bugs.python.org  Fri Jan 29 05:28:41 2021
From: report at bugs.python.org (Denis Roussel)
Date: Fri, 29 Jan 2021 10:28:41 +0000
Subject: [issue43029] unittest: Add assertUniqeIn
In-Reply-To: <1611653456.39.0.201138075595.issue43029@roundup.psfhosted.org>
Message-ID: <1611916121.16.0.961520916171.issue43029@roundup.psfhosted.org>


Denis Roussel <roussel2nis at gmail.com> added the comment:

Indeed, can do 
assertNotEquals(len(the_list), len(set(the_list))

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43029>
_______________________________________

From report at bugs.python.org  Fri Jan 29 06:59:02 2021
From: report at bugs.python.org (robbiecares)
Date: Fri, 29 Jan 2021 11:59:02 +0000
Subject: [issue39010] ProactorEventLoop raises unhandled ConnectionResetError
In-Reply-To: <1575924458.67.0.403977169674.issue39010@roundup.psfhosted.org>
Message-ID: <1611921542.89.0.676866415725.issue39010@roundup.psfhosted.org>


Change by robbiecares <robbiecares at gmail.com>:


----------
nosy: +robbiecares

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39010>
_______________________________________

From report at bugs.python.org  Fri Jan 29 07:08:34 2021
From: report at bugs.python.org (Emir)
Date: Fri, 29 Jan 2021 12:08:34 +0000
Subject: =?utf-8?q?=5Bissue43020=5D_str=2Elower_method_with_=22=C4=B0=22_character?=
In-Reply-To: <1611570175.95.0.637862597213.issue43020@roundup.psfhosted.org>
Message-ID: <CAB-L771N5JUc7WqgBM-B_UzPctuOBeiDBvYcG646TYO+jJQcMw@mail.gmail.com>


Emir <emiryegnidemir7 at gmail.com> added the comment:

Thanks for the answer. I will keep that in mind when posting another
"issue" instead of naming them as "bug".

Steven D'Aprano <report at bugs.python.org>, 25 Oca 2021 Pzt, 13:22 tarihinde
?unu yazd?:

>
> Steven D'Aprano <steve+python at pearwood.info> added the comment:
>
> This is not a bug, but an issue with the way the Unicode standard defines
> the lowercase of dotted I.
>
> See #34723
>
> Fortunately, Unicode will (hopefully!) fix this in revision 14.0, which is
> scheduled to be included in Python 3.10.
>
> Until then, perhaps the simplest way to solve this is that if you are
> processing Turkish text, change your call to .lower() to .replace('?',
> 'I').lower()
>
> ----------
> nosy: +steven.daprano
> resolution:  -> not a bug
> stage:  -> resolved
> status: open -> closed
>
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue43020>
> _______________________________________
>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43020>
_______________________________________

From report at bugs.python.org  Fri Jan 29 08:02:01 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 29 Jan 2021 13:02:01 +0000
Subject: [issue43060] Convert _decimal C API from pointer array to struct
In-Reply-To: <1611913613.83.0.451385849535.issue43060@roundup.psfhosted.org>
Message-ID: <1611925321.64.0.302112471393.issue43060@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
nosy: +facundobatista, mark.dickinson, rhettinger, skrah

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43060>
_______________________________________

From report at bugs.python.org  Fri Jan 29 08:15:31 2021
From: report at bugs.python.org (James Russell)
Date: Fri, 29 Jan 2021 13:15:31 +0000
Subject: [issue25166] Windows AllUsers installation places uninstaller in user
 profile
In-Reply-To: <1442575090.58.0.314641407957.issue25166@psf.upfronthosting.co.za>
Message-ID: <1611926131.36.0.575701307511.issue25166@roundup.psfhosted.org>


James Russell <james.russell at pxpfinancial.com> added the comment:

I have been reviewing the Install process as we need to start installing / patching Python and I have seen the same issue as mentioned below however the difference for me is I am running the install on a Silent command line.  

I cannot seem to override "AllUsers" Property using the command line as WiX logs the following: "Ignoring attempt to set non-overridable variable: 'AllUsers'."  If this parameter was made overridable I believe this would then allow the Bootstrapper to be listed under all users Uninstall area rather than the current user (or in my case it gets written to HKEY_USERS\.Default\... (which is really unhelpful) as the installer is being run under the system context).

----------
nosy: +beefy80
versions: +Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue25166>
_______________________________________

From report at bugs.python.org  Fri Jan 29 08:25:07 2021
From: report at bugs.python.org (Mark Shannon)
Date: Fri, 29 Jan 2021 13:25:07 +0000
Subject: [issue42990] Improve the C code for calling Python code:
 _PyEval_EvalCode()
In-Reply-To: <1611245152.12.0.0348161555926.issue42990@roundup.psfhosted.org>
Message-ID: <1611926707.34.0.742729428783.issue42990@roundup.psfhosted.org>


Mark Shannon <mark at hotpy.org> added the comment:


New changeset d6c33fbd346765c6a8654dccacb2338006bf2b47 by Mark Shannon in branch 'master':
bpo-42990: Introduce 'frame constructor' struct to simplify API for PyEval_CodeEval and friends (GH-24298)
https://github.com/python/cpython/commit/d6c33fbd346765c6a8654dccacb2338006bf2b47


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42990>
_______________________________________

From report at bugs.python.org  Fri Jan 29 08:29:51 2021
From: report at bugs.python.org (Tadek Kijkowski)
Date: Fri, 29 Jan 2021 13:29:51 +0000
Subject: [issue14191] argparse doesn't allow optionals within positionals
In-Reply-To: <1330843053.88.0.983162018395.issue14191@psf.upfronthosting.co.za>
Message-ID: <1611926991.11.0.247674580686.issue14191@roundup.psfhosted.org>


Change by Tadek Kijkowski <tkijkowski at gmail.com>:


----------
pull_requests: +23191
pull_request: https://github.com/python/cpython/pull/24367

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue14191>
_______________________________________

From report at bugs.python.org  Fri Jan 29 08:29:51 2021
From: report at bugs.python.org (Tadek Kijkowski)
Date: Fri, 29 Jan 2021 13:29:51 +0000
Subject: [issue42973] argparse: mixing optional and positional arguments...
 not again
In-Reply-To: <1611094894.69.0.476759327253.issue42973@roundup.psfhosted.org>
Message-ID: <1611926991.03.0.754814018735.issue42973@roundup.psfhosted.org>


Change by Tadek Kijkowski <tkijkowski at gmail.com>:


----------
pull_requests: +23190
pull_request: https://github.com/python/cpython/pull/24367

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42973>
_______________________________________

From report at bugs.python.org  Fri Jan 29 09:07:35 2021
From: report at bugs.python.org (Riccardo La Marca)
Date: Fri, 29 Jan 2021 14:07:35 +0000
Subject: [issue43061] subprocess: feature request: Get only the stdout of the
 last shell command
Message-ID: <1611929255.77.0.806477721139.issue43061@roundup.psfhosted.org>


New submission from Riccardo La Marca <riccardolamarca1 at gmail.com>:

This is a link with some examples of the required functionality:
https://stackoverflow.com/questions/65952314

----------
messages: 385909
nosy: Riccardo La Marca
priority: normal
severity: normal
status: open
title: subprocess: feature request: Get only the stdout of the last shell command
type: enhancement
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43061>
_______________________________________

From report at bugs.python.org  Fri Jan 29 09:11:58 2021
From: report at bugs.python.org (Riccardo La Marca)
Date: Fri, 29 Jan 2021 14:11:58 +0000
Subject: [issue43061] subprocess: feature request: Get only the stdout of the
 last shell command
In-Reply-To: <1611929255.77.0.806477721139.issue43061@roundup.psfhosted.org>
Message-ID: <1611929518.43.0.143416360706.issue43061@roundup.psfhosted.org>


Change by Riccardo La Marca <riccardolamarca1 at gmail.com>:


----------
nosy: +monkeyman79, paul.j3, r.david.murray, v+python

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43061>
_______________________________________

From report at bugs.python.org  Fri Jan 29 09:15:09 2021
From: report at bugs.python.org (Riccardo La Marca)
Date: Fri, 29 Jan 2021 14:15:09 +0000
Subject: [issue43061] subprocess: feature request: Get only the stdout of the
 last shell command
In-Reply-To: <1611929255.77.0.806477721139.issue43061@roundup.psfhosted.org>
Message-ID: <1611929709.07.0.41708845874.issue43061@roundup.psfhosted.org>


Change by Riccardo La Marca <riccardolamarca1 at gmail.com>:


----------
nosy: +altendky, paul.moore, serhiy.storchaka, steve.dower, tim.golden, vstinner, zach.ware

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43061>
_______________________________________

From report at bugs.python.org  Fri Jan 29 09:27:31 2021
From: report at bugs.python.org (Mark Shannon)
Date: Fri, 29 Jan 2021 14:27:31 +0000
Subject: [issue42990] Improve the C code for calling Python code:
 _PyEval_EvalCode()
In-Reply-To: <1611245152.12.0.0348161555926.issue42990@roundup.psfhosted.org>
Message-ID: <1611930451.67.0.234787285958.issue42990@roundup.psfhosted.org>


Change by Mark Shannon <mark at hotpy.org>:


----------
pull_requests: +23192
pull_request: https://github.com/python/cpython/pull/24368

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42990>
_______________________________________

From report at bugs.python.org  Fri Jan 29 09:30:52 2021
From: report at bugs.python.org (Kyle Altendorf)
Date: Fri, 29 Jan 2021 14:30:52 +0000
Subject: [issue43061] subprocess: feature request: Get only the stdout of the
 last shell command
In-Reply-To: <1611929255.77.0.806477721139.issue43061@roundup.psfhosted.org>
Message-ID: <1611930652.85.0.715279832393.issue43061@roundup.psfhosted.org>


Kyle Altendorf <sda at fstab.net> added the comment:

I'm not sure why I got added...  but as mentioned in the SO response, this isn't how stuff works.  Python isn't monitoring what subprocesses are created in the tree below the one Python itself creates nor does it have any way to know which line of which subprocess is creating any given output.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43061>
_______________________________________

From report at bugs.python.org  Fri Jan 29 09:33:04 2021
From: report at bugs.python.org (Christian Heimes)
Date: Fri, 29 Jan 2021 14:33:04 +0000
Subject: [issue43061] subprocess: feature request: Get only the stdout of the
 last shell command
In-Reply-To: <1611929255.77.0.806477721139.issue43061@roundup.psfhosted.org>
Message-ID: <1611930784.79.0.576159399799.issue43061@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

Please provide all information for your feature request in this ticket. We like to keep and archive all steps of the decision process in the same place. We also don't do stackoverflow-driven development.

----------
nosy: +christian.heimes

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43061>
_______________________________________

From report at bugs.python.org  Fri Jan 29 09:33:34 2021
From: report at bugs.python.org (Christian Heimes)
Date: Fri, 29 Jan 2021 14:33:34 +0000
Subject: [issue43061] subprocess: feature request: Get only the stdout of the
 last shell command
In-Reply-To: <1611929255.77.0.806477721139.issue43061@roundup.psfhosted.org>
Message-ID: <1611930814.92.0.141064145466.issue43061@roundup.psfhosted.org>


Change by Christian Heimes <lists at cheimes.de>:


----------
components: +Library (Lib)
versions: +Python 3.10 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43061>
_______________________________________

From report at bugs.python.org  Fri Jan 29 09:38:17 2021
From: report at bugs.python.org (R. David Murray)
Date: Fri, 29 Jan 2021 14:38:17 +0000
Subject: [issue43061] subprocess: feature request: Get only the stdout of the
 last shell command
In-Reply-To: <1611929255.77.0.806477721139.issue43061@roundup.psfhosted.org>
Message-ID: <1611931097.35.0.771069232746.issue43061@roundup.psfhosted.org>


R. David Murray <rdmurray at bitdance.com> added the comment:

This has nothing to do with python other than the fact that you are using it to capture stdout.  You have to figure out how to get the output you want to be what shows up on stdout, python has no knowledge of what commands you put in your shell script, and it *cannot* have any knowledge of that.  I think you need to learn more about basic shell scripting and unix pipelines and how stdout works.

Also note that making people nosy on an issue is not a good idea if you are not part of the triage team.  You should leave that for the bug triage people to do, as they know who's attention on the issue will be most useful.  In the future when you open an issue please simply wait a while for a response.

----------
resolution:  -> rejected
stage:  -> resolved
status: open -> closed
versions:  -Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43061>
_______________________________________

From report at bugs.python.org  Fri Jan 29 09:50:25 2021
From: report at bugs.python.org (HuangFuSL)
Date: Fri, 29 Jan 2021 14:50:25 +0000
Subject: [issue43062] Non-integer values in collections.Counter
Message-ID: <1611931825.03.0.205807042614.issue43062@roundup.psfhosted.org>


New submission from HuangFuSL <huangfusl at outlook.com>:

When I am creating a counter object provided by `collections.Counter` using a mapping object like a dictionary, it seems that Python will not check the validity of the values in the mapping object.

I've checked the following Python script could be successfully executed using Python 3.9.0 on Windows.

```python
>>> from collections import Counter
>>> a = Counter({'0': '0'})
>>> a.elements()
<itertools.chain object at 0x00000252DDB5A4F0>
```

`a.elements()` returns a iterator, iterating through it will normally get the records counted by the `Counter`, but with a `str` object inside, iterating through it will make a `TypeError` raised.

```python
>>> for i in a.elements():
...     pass
...
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
TypeError: 'str' object cannot be interpreted as an integer
```

Meanwhile, if the counter contains values that cannot be compared such as `False` and `''`, `most_common()` method will fail.

```python
>>> b = Counter({'0': False, '1': ''})
>>> b.most_common()
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "C:\Python39\lib\collections\__init__.py", line 610, in most_common
    return sorted(self.items(), key=_itemgetter(1), reverse=True)
TypeError: '<' not supported between instances of 'bool' and 'str'
```

The `sys.version` variable of my Python interpreter is as follows:

```
>>> import sys
>>> sys.version
'3.9.0 (tags/v3.9.0:9cf6752, Oct  5 2020, 15:34:40) [MSC v.1927 64 bit (AMD64)]'
>>>
```

I'm not sure whether the result is intentionally designed, but I think such execution results may lead to confusion.

----------
components: Extension Modules
messages: 385913
nosy: HuangFuSL
priority: normal
severity: normal
status: open
title: Non-integer values in collections.Counter
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43062>
_______________________________________

From report at bugs.python.org  Fri Jan 29 09:55:23 2021
From: report at bugs.python.org (HuangFuSL)
Date: Fri, 29 Jan 2021 14:55:23 +0000
Subject: [issue43062] Non-integer values in collections.Counter
In-Reply-To: <1611931825.03.0.205807042614.issue43062@roundup.psfhosted.org>
Message-ID: <1611932123.84.0.134854058404.issue43062@roundup.psfhosted.org>


Change by HuangFuSL <huangfusl at outlook.com>:


----------
components: +Library (Lib) -Extension Modules

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43062>
_______________________________________

From report at bugs.python.org  Fri Jan 29 10:09:54 2021
From: report at bugs.python.org (Cosimo Lupo)
Date: Fri, 29 Jan 2021 15:09:54 +0000
Subject: [issue36470] dataclasses.replace raises an exception if InitVar with
 default argument is not provided.
In-Reply-To: <1553860338.68.0.823118501948.issue36470@roundup.psfhosted.org>
Message-ID: <1611932994.78.0.170819094915.issue36470@roundup.psfhosted.org>


Cosimo Lupo <cosimo at anthrotype.com> added the comment:

any updates on this? Would be great if any of the two candidate PRs was merged. It's basically impossible to use replace() with default InitVars..
Thank you in advace

----------
nosy: +anthrotype

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36470>
_______________________________________

From report at bugs.python.org  Fri Jan 29 10:24:20 2021
From: report at bugs.python.org (Pandu E POLUAN)
Date: Fri, 29 Jan 2021 15:24:20 +0000
Subject: [issue39232] asyncio crashes when tearing down the proactor event loop
In-Reply-To: <1578335360.75.0.333919607495.issue39232@roundup.psfhosted.org>
Message-ID: <1611933860.27.0.224347020578.issue39232@roundup.psfhosted.org>


Change by Pandu E POLUAN <pepoluan at gmail.com>:


----------
nosy: +pepoluan

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue39232>
_______________________________________

From report at bugs.python.org  Fri Jan 29 10:53:36 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 29 Jan 2021 15:53:36 +0000
Subject: [issue42979] _zoneinfo: zoneinfomodule_exec() doesn't check for
 PyDateTime_IMPORT failure
In-Reply-To: <1611163566.26.0.253539458839.issue42979@roundup.psfhosted.org>
Message-ID: <1611935616.89.0.457529097083.issue42979@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset a6192635f1e62af2bb8a435487ebb51800edd671 by Victor Stinner in branch 'master':
bpo-42979: Use _Py_CheckSlotResult() to check slots result (GH-24356)
https://github.com/python/cpython/commit/a6192635f1e62af2bb8a435487ebb51800edd671


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42979>
_______________________________________

From report at bugs.python.org  Fri Jan 29 10:59:27 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 29 Jan 2021 15:59:27 +0000
Subject: [issue43061] subprocess: feature request: Get only the stdout of the
 last shell command
In-Reply-To: <1611929255.77.0.806477721139.issue43061@roundup.psfhosted.org>
Message-ID: <1611935967.5.0.169000515036.issue43061@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43061>
_______________________________________

From report at bugs.python.org  Fri Jan 29 11:12:19 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 29 Jan 2021 16:12:19 +0000
Subject: [issue30744] Local variable assignment is broken when combined with
 threads + tracing + closures
In-Reply-To: <1498277129.07.0.940069687434.issue30744@psf.upfronthosting.co.za>
Message-ID: <1611936739.89.0.522768570733.issue30744@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
versions: +Python 3.10 -Python 2.7, Python 3.5, Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30744>
_______________________________________

From report at bugs.python.org  Fri Jan 29 11:17:20 2021
From: report at bugs.python.org (Mark Dickinson)
Date: Fri, 29 Jan 2021 16:17:20 +0000
Subject: [issue43062] Non-integer values in collections.Counter
In-Reply-To: <1611931825.03.0.205807042614.issue43062@roundup.psfhosted.org>
Message-ID: <1611937040.1.0.97787261195.issue43062@roundup.psfhosted.org>


Change by Mark Dickinson <dickinsm at gmail.com>:


----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43062>
_______________________________________

From report at bugs.python.org  Fri Jan 29 11:19:03 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Fri, 29 Jan 2021 16:19:03 +0000
Subject: [issue42974] tokenize reports incorrect end col offset and line
 string when input ends without explicit newline
In-Reply-To: <1611424219.58.0.374242716352.issue42974@roundup.psfhosted.org>
Message-ID: <CAP7+vJKE7Hk9M-pSqDqScnu7aAGcW4i1NTnHpgp8BN28c7Y6Vg@mail.gmail.com>


Guido van Rossum <guido at python.org> added the comment:

Do you still need my opinion? I can't say that I have one ATM.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42974>
_______________________________________

From report at bugs.python.org  Fri Jan 29 11:28:50 2021
From: report at bugs.python.org (h-vetinari)
Date: Fri, 29 Jan 2021 16:28:50 +0000
Subject: [issue42380] Build windows binaries with MS VS2019 16.8+ / MSVC 19.28+
In-Reply-To: <1605562580.81.0.356035250253.issue42380@roundup.psfhosted.org>
Message-ID: <1611937730.3.0.843494205491.issue42380@roundup.psfhosted.org>


h-vetinari <h.vetinari at gmx.com> added the comment:

PS.
> Judging from the link you posted to version numbering
https://en.wikipedia.org/wiki/Microsoft_Visual_C%2B%2B#Internal_version_numbering the first line should have 'MSVC 14.28' the middle column title should be 'MS Visual Studio'.

The wiki page was refactored quite extensively it seems, this is what I had been referring to: https://en.wikipedia.org/w/index.php?title=Microsoft_Visual_C%2B%2B&oldid=997067123. But I'll happily admit that I don't understand the reasons behind (the differences between) the various version numbers: MSVC++, _MSC_VER, etc.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42380>
_______________________________________

From report at bugs.python.org  Fri Jan 29 11:31:47 2021
From: report at bugs.python.org (h-vetinari)
Date: Fri, 29 Jan 2021 16:31:47 +0000
Subject: [issue42380] Build windows binaries with MS VS2019 16.8+ / MSVC 19.28+
In-Reply-To: <1605562580.81.0.356035250253.issue42380@roundup.psfhosted.org>
Message-ID: <1611937907.72.0.522366976276.issue42380@roundup.psfhosted.org>


h-vetinari <h.vetinari at gmx.com> added the comment:

PPS. Also, the compiler implementation reference uses 19.x for MSVC: https://en.cppreference.com/w/cpp/compiler_support, which was the link I was trying to make, now that I'm looking at it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42380>
_______________________________________

From report at bugs.python.org  Fri Jan 29 11:56:11 2021
From: report at bugs.python.org (Florian Bruhin)
Date: Fri, 29 Jan 2021 16:56:11 +0000
Subject: [issue43063] zipfile.Path / importlib.resources raises KeyError if a
 file wasn't found
Message-ID: <1611939371.43.0.787270932991.issue43063@roundup.psfhosted.org>


New submission from Florian Bruhin <python.org at the-compiler.org>:

When a package is installed as an egg, importlib.resources.files returns a zipfile.Path rather than a pathlib.Path (maybe it returns other things too, seeing that it's documented to return a importlib.abc.Traversable - I didn't check).

However, those two have a rather odd inconsistency when it comes to reading files which don't actually exist. In that case, zipfile.Path raises KeyError rather than FileNotFoundError. After a "zip tmp/test.zip somefile":

    >>> import zipfile
    >>> p = zipfile.Path('tmp/test.zip')
    >>> (p / 'helloworld').read_text()
    Traceback (most recent call last):
      File "<stdin>", line 1, in <module>
      File "/usr/lib/python3.9/zipfile.py", line 2318, in read_text
        with self.open('r', *args, **kwargs) as strm:
      File "/usr/lib/python3.9/zipfile.py", line 2306, in open
        stream = self.root.open(self.at, zip_mode, pwd=pwd)
      File "/usr/lib/python3.9/zipfile.py", line 1502, in open
        zinfo = self.getinfo(name)
      File "/usr/lib/python3.9/zipfile.py", line 1429, in getinfo
        raise KeyError(
    KeyError: "There is no item named 'helloworld' in the archive"

Note that the "zipp" backport (used by the "importlib_resources" backport) does raise FileNotFoundError instead:

    >>> import zipp
    >>> p2 = zipp.Path('tmp/test.zip')
    >>> (p2 / 'helloworld').read_text()
    Traceback (most recent call last):
      File "<stdin>", line 1, in <module>
      File "/usr/lib/python3.9/site-packages/zipp.py", line 267, in read_text
        with self.open('r', *args, **kwargs) as strm:
      File "/usr/lib/python3.9/site-packages/zipp.py", line 250, in open
        raise FileNotFoundError(self)
    FileNotFoundError: tmp/test.zip/helloworld

And of course, so does pathlib.Path:

    >>> import pathlib
    >>> p3 = pathlib.Path('tmp')
    >>> (p3 / 'helloworld').read_text()
    Traceback (most recent call last):
      File "<stdin>", line 1, in <module>
      File "/usr/lib/python3.9/pathlib.py", line 1255, in read_text
        with self.open(mode='r', encoding=encoding, errors=errors) as f:
      File "/usr/lib/python3.9/pathlib.py", line 1241, in open
        return io.open(self, mode, buffering, encoding, errors, newline,
      File "/usr/lib/python3.9/pathlib.py", line 1109, in _opener
        return self._accessor.open(self, flags, mode)
    FileNotFoundError: [Errno 2] No such file or directory: 'tmp/helloworld'

When using `importlib.resources.files`, this can be very surprising - especially because during testing, the package might not be installed as an egg, so this never turns up until users complain about it (which is what happened in my case - no bad feelings though!).

This seems to have been fixed by jaraco in ebbe8033b1c61854c4b623aaf9c3e170d179f875, by introducing an explicit:

    if not self.exists() and zip_mode == 'r':
        raise FileNotFoundError(self)

in open(), as part of what seems like an unrelated change (bpo-40564 / GH-22371).

While this is arguably a backwards-compatible change between 3.9 and 3.10, it might be a good idea to either adjust Python 3.9 to have the same behavior (perhaps with a new exception which inherits from both KeyError and FileNotFoundError?). At the very least, I feel like this should be documented prominently in the importlib.resources.files, importlib.abc.Traversable and zipfile.Path documentation for 3.9.

As an aside, the error message when using `.iterdir()` is similarly confusing, though that's at least consistent between the stdlib and the zipp backport:

    >>> (p / 'helloworld').iterdir()
    Traceback (most recent call last):
      File "<stdin>", line 1, in <module>
      File "/usr/lib/python3.9/zipfile.py", line 2342, in iterdir
        raise ValueError("Can't listdir a file")
    ValueError: Can't listdir a file

    >>> (p2 / 'helloworld').iterdir()
    Traceback (most recent call last):
      File "<stdin>", line 1, in <module>
      File "/usr/lib/python3.9/site-packages/zipp.py", line 291, in iterdir
        raise ValueError("Can't listdir a file")
    ValueError: Can't listdir a file

    >>> list((p3 / 'helloworld').iterdir())
    Traceback (most recent call last):
      File "<stdin>", line 1, in <module>
      File "/usr/lib/python3.9/pathlib.py", line 1149, in iterdir
        for name in self._accessor.listdir(self):
    FileNotFoundError: [Errno 2] No such file or directory: 'tmp/helloworld'

----------
components: Library (Lib)
messages: 385919
nosy: The Compiler, alanmcintyre, brett.cannon, jaraco, serhiy.storchaka, twouters
priority: normal
severity: normal
status: open
title: zipfile.Path / importlib.resources raises KeyError if a file wasn't found
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43063>
_______________________________________

From report at bugs.python.org  Fri Jan 29 12:07:03 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 29 Jan 2021 17:07:03 +0000
Subject: [issue38631] Replace Py_FatalError() with regular Python exceptions
In-Reply-To: <1572352735.51.0.915792481752.issue38631@roundup.psfhosted.org>
Message-ID: <1611940023.49.0.145586050293.issue38631@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +23193
pull_request: https://github.com/python/cpython/pull/24369

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38631>
_______________________________________

From report at bugs.python.org  Fri Jan 29 12:16:42 2021
From: report at bugs.python.org (Florian Bruhin)
Date: Fri, 29 Jan 2021 17:16:42 +0000
Subject: [issue43063] zipfile.Path / importlib.resources raises KeyError if a
 file wasn't found
In-Reply-To: <1611939371.43.0.787270932991.issue43063@roundup.psfhosted.org>
Message-ID: <1611940602.36.0.678373794968.issue43063@roundup.psfhosted.org>


Florian Bruhin <python.org at the-compiler.org> added the comment:

Whoops, I was mistaken about Python 3.8 not being affected. I thought it wouldn't be because importlib.resources.files was added in 3.9, but zipfile.Path was added in 3.8.

With that in mind, I guess changing the behavior of 3.9 would be rather confusing, though I wonder what others think.

(Also, "arguably a backwards-compatible change" in my previous message should say *incompatible* - sorry about that!)

----------
versions: +Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43063>
_______________________________________

From report at bugs.python.org  Fri Jan 29 12:19:56 2021
From: report at bugs.python.org (Kent Watsen)
Date: Fri, 29 Jan 2021 17:19:56 +0000
Subject: [issue42628] binascii doesn't work on some base64
In-Reply-To: <1607808198.75.0.933631782561.issue42628@roundup.psfhosted.org>
Message-ID: <1611940796.12.0.641881234123.issue42628@roundup.psfhosted.org>


Kent Watsen <kent+python at watsen.net> added the comment:

I see.  There are two issues:

1) my `base64` and `openssl` CLI commands were flipped, as you point out, giving a false positive - oops ;)

2) more importantly, the base64 value "ue==" is invalid (there is no binary input that could possibly generate it) and none of the implementations issued a warning or error, which is reasonable IMO.

Thank you for your help.  Please close this issue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42628>
_______________________________________

From report at bugs.python.org  Fri Jan 29 12:31:14 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Fri, 29 Jan 2021 17:31:14 +0000
Subject: [issue42115] Caching infrastructure for the evaluation loop:
 specialised opcodes
In-Reply-To: <1603336898.74.0.366564812208.issue42115@roundup.psfhosted.org>
Message-ID: <1611941474.91.0.431820946601.issue42115@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

I had a simpler idea for an inline cache for LOAD_METHOD than GH-23503. The essential part goes like this (sorry for the hybrid C/Python):

if <optimized etc.>:
    if type == lm->type and type->tp_version_tag == lm->tp_version_tag:
        meth = lm->meth
        SET_TOP(meth)
        PUSH(obj)
        DISPATCH()

name = GETITEM(names, oparg)
meth_found = _PyObject_GetMethod(obj, name, &meth)
<error check>

if meth_found:
    SET_TOP(meth)
    PUSH(obj)
    if <optimizing etc.>:
        lm = ...
        lm->type = type
        lm->meth = meth

<etc.>

What am I missing? Why is the hash of the name needed?


Oh, it's probably because there could still be an overriding value in obj.__dict__. But certainly we could check for type == lm->type before the other checks (HasFeature and tp_version_tag).

But what if we only did this for classes without an instance dict? That could work for things like list.append and str.find.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42115>
_______________________________________

From report at bugs.python.org  Fri Jan 29 12:32:38 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 29 Jan 2021 17:32:38 +0000
Subject: [issue43008] IDLE ignores sys.excepthook in normal, subprocess mode
In-Reply-To: <1611401446.12.0.0532585832167.issue43008@roundup.psfhosted.org>
Message-ID: <1611941558.65.0.235428196324.issue43008@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
pull_requests: +23194
pull_request: https://github.com/python/cpython/pull/24370

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43008>
_______________________________________

From report at bugs.python.org  Fri Jan 29 12:38:55 2021
From: report at bugs.python.org (Alexander Stepanov)
Date: Fri, 29 Jan 2021 17:38:55 +0000
Subject: [issue38905] venv python reports wrong sys.executable in a subprocess
 on Windows
In-Reply-To: <1574583460.3.0.94905817038.issue38905@roundup.psfhosted.org>
Message-ID: <1611941935.57.0.578823685529.issue38905@roundup.psfhosted.org>


Alexander Stepanov <student_vmk at mail.ru> added the comment:

Another victim of this change in `venv` behavior is Ray, which hangs forever because the workers fail to register as parent does not recognize their PIDs.
https://github.com/ray-project/ray/issues/13794

----------
nosy: +nirvana-msu

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38905>
_______________________________________

From report at bugs.python.org  Fri Jan 29 13:02:34 2021
From: report at bugs.python.org (miss-islington)
Date: Fri, 29 Jan 2021 18:02:34 +0000
Subject: [issue43008] IDLE ignores sys.excepthook in normal, subprocess mode
In-Reply-To: <1611401446.12.0.0532585832167.issue43008@roundup.psfhosted.org>
Message-ID: <1611943354.14.0.420150691164.issue43008@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +23196
pull_request: https://github.com/python/cpython/pull/24375

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43008>
_______________________________________

From report at bugs.python.org  Fri Jan 29 13:02:25 2021
From: report at bugs.python.org (miss-islington)
Date: Fri, 29 Jan 2021 18:02:25 +0000
Subject: [issue43008] IDLE ignores sys.excepthook in normal, subprocess mode
In-Reply-To: <1611401446.12.0.0532585832167.issue43008@roundup.psfhosted.org>
Message-ID: <1611943345.45.0.491875895513.issue43008@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +23195
pull_request: https://github.com/python/cpython/pull/24374

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43008>
_______________________________________

From report at bugs.python.org  Fri Jan 29 13:02:34 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 29 Jan 2021 18:02:34 +0000
Subject: [issue43008] IDLE ignores sys.excepthook in normal, subprocess mode
In-Reply-To: <1611401446.12.0.0532585832167.issue43008@roundup.psfhosted.org>
Message-ID: <1611943354.5.0.779800538922.issue43008@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset 11d75ec807f05eff1148c049e38b808d11c23b8a by Terry Jan Reedy in branch 'master':
bpo-43008: Add 'Patch by Ken Hilton' (GH-24370)
https://github.com/python/cpython/commit/11d75ec807f05eff1148c049e38b808d11c23b8a


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43008>
_______________________________________

From report at bugs.python.org  Fri Jan 29 13:08:08 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 29 Jan 2021 18:08:08 +0000
Subject: [issue42628] binascii doesn't work on some base64
In-Reply-To: <1607808198.75.0.933631782561.issue42628@roundup.psfhosted.org>
Message-ID: <1611943688.86.0.978931985764.issue42628@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42628>
_______________________________________

From report at bugs.python.org  Fri Jan 29 13:22:56 2021
From: report at bugs.python.org (miss-islington)
Date: Fri, 29 Jan 2021 18:22:56 +0000
Subject: [issue43008] IDLE ignores sys.excepthook in normal, subprocess mode
In-Reply-To: <1611401446.12.0.0532585832167.issue43008@roundup.psfhosted.org>
Message-ID: <1611944576.0.0.168590345711.issue43008@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset cf883827496d0fbe2c5fe39e4778cd7525f6f7bc by Miss Islington (bot) in branch '3.8':
bpo-43008: Add 'Patch by Ken Hilton' (GH-24370)
https://github.com/python/cpython/commit/cf883827496d0fbe2c5fe39e4778cd7525f6f7bc


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43008>
_______________________________________

From report at bugs.python.org  Fri Jan 29 13:51:57 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 29 Jan 2021 18:51:57 +0000
Subject: [issue43008] IDLE ignores sys.excepthook in normal, subprocess mode
In-Reply-To: <1611401446.12.0.0532585832167.issue43008@roundup.psfhosted.org>
Message-ID: <1611946317.16.0.650754760937.issue43008@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset bf782b2636880dd634281f905ae43b8555450ee2 by Miss Islington (bot) in branch '3.9':
bpo-43008: Add 'Patch by Ken Hilton' (GH-24370) (#24374)
https://github.com/python/cpython/commit/bf782b2636880dd634281f905ae43b8555450ee2


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43008>
_______________________________________

From report at bugs.python.org  Fri Jan 29 14:13:19 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 29 Jan 2021 19:13:19 +0000
Subject: [issue43062] Non-integer values in collections.Counter
In-Reply-To: <1611931825.03.0.205807042614.issue43062@roundup.psfhosted.org>
Message-ID: <1611947599.82.0.896978720222.issue43062@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Thanks for the report, but there isn't anything that can be done about this.  The core design concept for Counter was to be a regular dictionary augmented by a few capabilities that made it suitable for counting.  It isn't closed-off in any way.  On the plus side, that makes it versatile and make it fit well the other parts of the Python ecosystem that work with dictionaries.  On the minus, there is nothing to keep out data that doesn't make sense in the context of counting.

FWIW, there is a multiset package on PyPi that offers a closed-off implementation that has an internal dictionary that can only be accessed by methods that prevent negative counts or non-integer values.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43062>
_______________________________________

From report at bugs.python.org  Fri Jan 29 14:15:14 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 29 Jan 2021 19:15:14 +0000
Subject: [issue43060] Convert _decimal C API from pointer array to struct
In-Reply-To: <1611913613.83.0.451385849535.issue43060@roundup.psfhosted.org>
Message-ID: <1611947714.1.0.212804838211.issue43060@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
nosy:  -rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43060>
_______________________________________

From report at bugs.python.org  Fri Jan 29 14:47:25 2021
From: report at bugs.python.org (Tadek Kijkowski)
Date: Fri, 29 Jan 2021 19:47:25 +0000
Subject: [issue42966] argparse: customizable help formatter
In-Reply-To: <1611066420.6.0.700026495964.issue42966@roundup.psfhosted.org>
Message-ID: <1611949645.34.0.53441631439.issue42966@roundup.psfhosted.org>


Change by Tadek Kijkowski <tkijkowski at gmail.com>:


----------
keywords: +patch
pull_requests: +23197
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24377

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42966>
_______________________________________

From report at bugs.python.org  Fri Jan 29 14:51:37 2021
From: report at bugs.python.org (Selim Belhaouane)
Date: Fri, 29 Jan 2021 19:51:37 +0000
Subject: [issue43064] Impossible to override signal handler set with
 add_signal_handler in forked process
Message-ID: <1611949897.69.0.881699073289.issue43064@roundup.psfhosted.org>


New submission from Selim Belhaouane <selim.belhaouane at gmail.com>:

Cannot clear signal handler set with loop.add_signal_handler in forked process with signal.signal

# Context

I'm running an async web server with uvicorn[1] and have background processes (using multiprocessing) doing CPU-bound work. uvicorn install signal handlers with loop.add*signal_handler, if available[2]. It also implements the common "attempt graceful shutdown on the first signal, and forcefully shutdown on the second (or more) signal" pattern. The problem I noticed was: when \_forking* at least one process, the server never gracefully shuts down, **even if I install new signal handlers in the subprocesses**.

# Problem

Signal handlers installed with loop.add*signal_handler cannot be cleared in forked processes with `signal.signal` (see Experiment 1), \_unless* using `signal.SIG_DFL` or `signal.SIG_IGN` in the forked processes (see Experiment 3).

For the record:

- When installing signal handlers in the parent process with signal.signal, this is not a problem (see Experiment 2).
- When using multiprocessing with the "spawn" method, this is not a problem. Unsurprising, since signal handlers are not inherited from the parent process when using "spawn" (see Experiment 4).
- When install signal handlers in the child proceess with loop.add_signal_handler, this is not a problem (see Experiment 5).

# Experiments

You'll find a minimal `exp.py` file in the attached archive. There's a few tweakable parameters at the top. I just run this with `python3.X exp.py`, wait a second or two, and hit Ctrl+C.
`results.txt` shows the results of a few experiments with different set of parameters.
Note that the point at which I hit Ctrl+C is indicated by the ? (heart) symbol, due to some terminal weirdness, although this is quite useful in this case!
The subsections below detail what happens when Ctrl+C is hit.
You guys probably know this already, but Ctrl+C basically sends SIGINT to all processes in the process tree.

## Experiment 1

- Installs a signal handler in the parent process with loop.add_signal_handler
- Starts 3 subprocesses with "fork"
- The subprocesses install a new signal handler with signal.signal

Outcome: both the parent handler and child handlers get called (3 calls to handle_sig_worker, 4 calls to handle_sig_main)

**Expected**: I would expect a single call to handle_sig_main, and 3 calls to handle_sig_worker, as in Experiment 2 (which uses signal.signal instead of loop.add_signal_handler) or Experiment 4 (which uses "spawn" instead of "fork") or Experiment 5 ()

## Experiment 2

As Experiment 1, but signal handlers are installed in the parent process with signal.signal

Outcome: the parent handler gets called once, and the child handlers get called 3 times

## Experiment 3

Same as Experiment 1, but this time using `signal.SIG_DFL` as the callback in the child processes.

Outcome: the child processes immediately terminate, thanks to SIG_DFL, and the parent handler gets called only once!

## Experiment 4

Same as Experiment 1, but this time using "spawn" as the multiprocessing start method.

Outcome: same as Experiment 2: parent handlers gets called once, child handlers get called 3 times

## Experiment 5

Same as Experiment 1, but this time installing signal handlers in the child processes with loop.add_signal_handler.

Outcome: Same as Experiment 2.

# Environment

I was able to replicate the issue with python 3.7, 3.8, 3.9 and 3.10 (didn't even try 3.6) on Ubuntu 20.04. I obtained python via `apt`.

[1]: https://www.uvicorn.org/
[2]: https://github.com/encode/uvicorn/blob/61a6cabb4580e1c923df396eac264803f599412c/uvicorn/server.py#L281

----------
components: asyncio
files: python-async-signal-bug.zip
messages: 385928
nosy: asvetlov, selimb, yselivanov
priority: normal
severity: normal
status: open
title: Impossible to override signal handler set with add_signal_handler in forked process
type: behavior
versions: Python 3.10, Python 3.7, Python 3.8, Python 3.9
Added file: https://bugs.python.org/file49774/python-async-signal-bug.zip

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43064>
_______________________________________

From report at bugs.python.org  Fri Jan 29 14:53:37 2021
From: report at bugs.python.org (jack1142)
Date: Fri, 29 Jan 2021 19:53:37 +0000
Subject: [issue43006] Changed behaviour of inspect.signature() in Python 3.10
In-Reply-To: <1611383063.08.0.672499153283.issue43006@roundup.psfhosted.org>
Message-ID: <1611950017.72.0.631865133111.issue43006@roundup.psfhosted.org>


Change by jack1142 <kuba.kuczys at gmail.com>:


----------
nosy: +jack1142

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43006>
_______________________________________

From report at bugs.python.org  Fri Jan 29 14:59:44 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 29 Jan 2021 19:59:44 +0000
Subject: [issue43029] unittest: Add assertUniqeIn
In-Reply-To: <1611653456.39.0.201138075595.issue43029@roundup.psfhosted.org>
Message-ID: <1611950384.6.0.737136859886.issue43029@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

I think you meant assertEqual(len(alist), len(set(alist))).  I agree with others.

----------
nosy: +terry.reedy
resolution:  -> rejected
stage: patch review -> resolved
status: open -> closed
type:  -> enhancement
versions: +Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43029>
_______________________________________

From report at bugs.python.org  Fri Jan 29 15:01:24 2021
From: report at bugs.python.org (Denis Roussel)
Date: Fri, 29 Jan 2021 20:01:24 +0000
Subject: [issue43029] unittest: Add assertUniqeIn
In-Reply-To: <1611653456.39.0.201138075595.issue43029@roundup.psfhosted.org>
Message-ID: <1611950484.34.0.766169476336.issue43029@roundup.psfhosted.org>


Denis Roussel <roussel2nis at gmail.com> added the comment:

Of course. Wanted a shortcut. Can close it if you want.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43029>
_______________________________________

From report at bugs.python.org  Fri Jan 29 15:03:19 2021
From: report at bugs.python.org (doublex)
Date: Fri, 29 Jan 2021 20:03:19 +0000
Subject: [issue43065] 'concurrent.futures' stucks in 3.9.1
Message-ID: <1611950599.0.0.548007285224.issue43065@roundup.psfhosted.org>


New submission from doublex <doppelbauer at gmx.net>:

Works with python 3.8
Fails with 3.9.1 (tested on CentOS 7 and Ubuntu 2004)
Yes, sometimes is does not stuck...

Command-line: 
python3.9 stuck.py

----------
components: Interpreter Core
files: stuck.py
messages: 385931
nosy: doublex
priority: normal
severity: normal
status: open
title: 'concurrent.futures' stucks in 3.9.1
type: resource usage
versions: Python 3.9
Added file: https://bugs.python.org/file49775/stuck.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43065>
_______________________________________

From report at bugs.python.org  Fri Jan 29 15:12:45 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 29 Jan 2021 20:12:45 +0000
Subject: [issue43034] Python tutorial misleads users about floor division
 behavior
In-Reply-To: <1611710102.87.0.478016588876.issue43034@roundup.psfhosted.org>
Message-ID: <1611951165.3.0.795290616702.issue43034@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

-17/3 = -5.666666666666667 = -6.0 + .333333333333333.  It is the latter fraction that gets discarded.

However, this is a frequent source of confusion.  How about adding 

>>> -17 // 3
-6
>>> -17 % 3
1
>>> -6 * 3 + 1
-17

to illustrate what we mean, without footnote or additional text.

----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43034>
_______________________________________

From report at bugs.python.org  Fri Jan 29 15:19:25 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 29 Jan 2021 20:19:25 +0000
Subject: [issue43039] tempfile.TemporaryDirectory() name string is incorrect
In-Reply-To: <1611752785.31.0.169033052217.issue43039@roundup.psfhosted.org>
Message-ID: <1611951565.84.0.804306920883.issue43039@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Making str(td) == td.name does not seem useful.  I think this should be closed as 'Not a bug', because it isn't.  If changed to an enhancement request, reject as insufficiently warranted against the likely breakage.

----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43039>
_______________________________________

From report at bugs.python.org  Fri Jan 29 15:27:01 2021
From: report at bugs.python.org (Selim Belhaouane)
Date: Fri, 29 Jan 2021 20:27:01 +0000
Subject: [issue43064] Cannot clear signal handler set with
 loop.add_signal_handler in forked process with signal.signal
In-Reply-To: <1611949897.69.0.881699073289.issue43064@roundup.psfhosted.org>
Message-ID: <1611952021.16.0.17789794229.issue43064@roundup.psfhosted.org>


Change by Selim Belhaouane <selim.belhaouane at gmail.com>:


----------
title: Impossible to override signal handler set with add_signal_handler in forked process -> Cannot clear signal handler set with loop.add_signal_handler in forked process with signal.signal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43064>
_______________________________________

From report at bugs.python.org  Fri Jan 29 15:28:48 2021
From: report at bugs.python.org (Garrison Taylor)
Date: Fri, 29 Jan 2021 20:28:48 +0000
Subject: [issue43066] Zipfile with leading slashes
Message-ID: <1611952128.43.0.663068649879.issue43066@roundup.psfhosted.org>


New submission from Garrison Taylor <garrison.taylor at gridunity.com>:

Currently the zipfile library allows you to create invalid zip files. The following code is an example:

from zipfile import ZipFile
import tempfile
temporary_file = tempfile.NamedTemporaryFile()
my_zip = ZipFile(temporary_file.name, 'w')
my_zip.writestr('/some_folder/some_file.txt', 'Some content')
my_zip.close()

The generated zipfile contains "/some_folder/some_file.txt". However, according to the specification for zip files, this is invalid. See below, from the .ZIP File Format Specification version 6.3.9:

       4.4.17.1 The name of the file, with optional relative path.
       The path stored MUST NOT contain a drive or
       device letter, or a leading slash.  All slashes
       MUST be forward slashes '/' as opposed to
       backwards slashes '\' for compatibility with Amiga
       and UNIX file systems etc.  If input came from standard
       input, there is no file name field.  

This is significant because the default Windows Explorer zip file extractor cannot handle zip files that contain a leading slash, producing an error that "The compressed (zipped) folder is invalid."

----------
components: Library (Lib)
messages: 385934
nosy: garrison.taylor
priority: normal
severity: normal
status: open
title: Zipfile with leading slashes
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43066>
_______________________________________

From report at bugs.python.org  Fri Jan 29 15:37:23 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 29 Jan 2021 20:37:23 +0000
Subject: [issue43042] Delete or merge redundant tutorial sentence.
In-Reply-To: <1611772942.43.0.309900316345.issue43042@roundup.psfhosted.org>
Message-ID: <1611952643.14.0.149909534007.issue43042@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

The sentence you quoted ends a paragraph that begins with a sentences saying the same thing even more clearly.  "The execution of a function introduces a new symbol table used for the local variables of the function."  I think the ending sentence could be deleted as redundant.  Or it could be merged into the initial sentence with "When a function is called, the execution of that function ... ."  What do you think?

The me, the confusion of 'other function' is that it leaves open the possibility of 'same function' having a different result, as in languages with tail recursion conversion.  But this is not true of python, which cares nothing about the caller.

----------
nosy: +terry.reedy
stage:  -> needs patch
title: tutorial ambiguous about creation of local symbol table for recursive calls -> Delete or merge redundant tutorial sentence.
versions: +Python 3.10 -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43042>
_______________________________________

From report at bugs.python.org  Fri Jan 29 15:46:49 2021
From: report at bugs.python.org (Eric V. Smith)
Date: Fri, 29 Jan 2021 20:46:49 +0000
Subject: [issue43039] tempfile.TemporaryDirectory() name string is incorrect
In-Reply-To: <1611752785.31.0.169033052217.issue43039@roundup.psfhosted.org>
Message-ID: <1611953209.63.0.344243654615.issue43039@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

I've been thinking about this some more, and I agree with Terry. Changing str() seems dangerous, and __fspath__ wouldn't be backwardly compatible. If you want the name, use .name. So I'm going to close this.

----------
resolution:  -> rejected
stage:  -> resolved
status: open -> closed
type:  -> enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43039>
_______________________________________

From report at bugs.python.org  Fri Jan 29 15:56:28 2021
From: report at bugs.python.org (Sam Kagan)
Date: Fri, 29 Jan 2021 20:56:28 +0000
Subject: [issue31212] datetime: min date (0001-01-01 00:00:00) can't be
 converted to local timestamp
In-Reply-To: <1502817992.35.0.826006067807.issue31212@psf.upfronthosting.co.za>
Message-ID: <1611953788.05.0.860541061345.issue31212@roundup.psfhosted.org>


Sam Kagan <skagan at nrao.edu> added the comment:

I encountered this issue in Python 3.8. I consider it to be a bug because it's an instance of a class-defined constant (datetime.min) not working with a method of that class (timestamp) when all other values that the class could take work with the method AND the constant works with all of the class' other methods. And it has practical implications: As belopolsky said above, "a reasonable design can use datetime.min/max as placeholders for unknown times far in the past/future compensating for the lack [of] datetime ?inf."

Since datetime.min lies so close to the edges of datetime's value-space, perhaps it should be made offset-aware and placed in UTC so that it stops breaking timestamp() when the user is in the wrong timezone. Alternatively, there could be a note in the documentation for datetime.timestamp() about this edge case. Assuming similarly bizarre behavior happens at datetime.max for one or more datetime methods (and for consistency's sake), it should probably be put in UTC as well.

----------
nosy: +skagan_NRAO
versions: +Python 3.8 -Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31212>
_______________________________________

From report at bugs.python.org  Fri Jan 29 15:56:53 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 29 Jan 2021 20:56:53 +0000
Subject: [issue43048] Printing RecursionError results in RecursionError
In-Reply-To: <1611798337.38.0.626995188313.issue43048@roundup.psfhosted.org>
Message-ID: <1611953813.77.0.542434670108.issue43048@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

With 3.9, exc.py produces for me

Traceback (most recent call last):
  File "F:\Python\a\tem3.py", line 3, in f
    raise ValueError('hello')
ValueError: hello

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "F:\Python\a\tem3.py", line 3, in f
    raise ValueError('hello')
ValueError: hello
...
During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "F:\Python\a\tem3.py", line 11, in <module>
    f()
  File "F:\Python\a\tem3.py", line 5, in f
    f()
  File "F:\Python\a\tem3.py", line 5, in f
    f()
  File "F:\Python\a\tem3.py", line 5, in f
    f()
  [Previous line repeated 992 more times]
  File "F:\Python\a\tem3.py", line 3, in f
    raise ValueError('hello')
RecursionError: maximum recursion depth exceeded while calling a Python object

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Programs\Python310\lib\runpy.py", line 197, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "C:\Programs\Python310\lib\runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "F:\Python\a\tem3.py", line 14, in <module>
    print_exception(exc_info[0], exc_info[1], exc_info[2], None)
  File "C:\Programs\Python310\lib\traceback.py", line 113, in print_exception
    for line in TracebackException(
  File "C:\Programs\Python310\lib\traceback.py", line 503, in __init__
    context = TracebackException(
  File "C:\Programs\Python310\lib\traceback.py", line 503, in __init__
    context = TracebackException(
  File "C:\Programs\Python310\lib\traceback.py", line 503, in __init__
    context = TracebackException(
  [Previous line repeated 494 more times]
RecursionError: maximum recursion depth exceeded

This ends the same way as in #42848.


The patch in #42848 will appear in 3.10.0a5 in March.  Guido and Irit decided not to backport at the patch is as much a refactoring as a fix.

On a fresh repository build, exc.py ends with 

Traceback (most recent call last):
  File "f:\python\a\tem3.py", line 3, in f
    raise ValueError('hello')
ValueError: hello

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "f:\python\a\tem3.py", line 11, in <module>
    f()
  File "f:\python\a\tem3.py", line 5, in f
    f()
  File "f:\python\a\tem3.py", line 5, in f
    f()
  File "f:\python\a\tem3.py", line 5, in f
    f()
  [Previous line repeated 995 more times]
  File "f:\python\a\tem3.py", line 3, in f
    raise ValueError('hello')
RecursionError: maximum recursion depth exceeded while calling a Python object
got to the finish line!

I believe this is the expected improvement.

----------
nosy: +terry.reedy
stage:  -> resolved
status: pending -> closed
type:  -> behavior
versions: +Python 3.10 -Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43048>
_______________________________________

From report at bugs.python.org  Fri Jan 29 15:59:48 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 29 Jan 2021 20:59:48 +0000
Subject: [issue42982] Update suggested number of iterations for pbkdf2_hmac()
In-Reply-To: <1611173199.26.0.961948207202.issue42982@roundup.psfhosted.org>
Message-ID: <1611953988.54.0.743324116722.issue42982@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

FWIW, OnePass uses 100,000.  https://support.1password.com/pbkdf2/

Also, I don't think an additional time factor of 2.5x would make substantial difference in security, but it may make a noticeable difference in user authentication time.

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42982>
_______________________________________

From report at bugs.python.org  Fri Jan 29 16:00:52 2021
From: report at bugs.python.org (=?utf-8?b?0JHQvtGA0LjRgSDQktC10YDRhdC+0LLRgdC60LjQuQ==?=)
Date: Fri, 29 Jan 2021 21:00:52 +0000
Subject: [issue43067] inspect.signature(bytes.hex) raises ValueError "builtin
 has invalid signature"
Message-ID: <1611954052.56.0.164683452654.issue43067@roundup.psfhosted.org>


New submission from ????? ?????????? <boris.verk at gmail.com>:

On Python 3.9

>>> import inspect
>>> inspect.signature(bytes.hex)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/lib/python3.9/inspect.py", line 3118, in signature
    return Signature.from_callable(obj, follow_wrapped=follow_wrapped)
  File "/usr/lib/python3.9/inspect.py", line 2867, in from_callable
    return _signature_from_callable(obj, sigcls=cls,
  File "/usr/lib/python3.9/inspect.py", line 2322, in _signature_from_callable
    return _signature_from_builtin(sigcls, obj,
  File "/usr/lib/python3.9/inspect.py", line 2135, in _signature_from_builtin
    return _signature_fromstr(cls, func, s, skip_bound_arg)
  File "/usr/lib/python3.9/inspect.py", line 2005, in _signature_fromstr
    raise ValueError("{!r} builtin has invalid signature".format(obj))
ValueError: <method 'hex' of 'bytes' objects> builtin has invalid signature


This is also true for memoryview.hex and bytearray.hex . This happens because

>>> bytes.hex.__text_signature__
'($self, /, sep=<unrepresentable>, bytes_per_sep=1)'

when it would make more sense for it to return

'($self, /, sep='', bytes_per_sep=1)'

or at least sep=None

----------
components: Library (Lib)
messages: 385940
nosy: boris
priority: normal
severity: normal
status: open
title: inspect.signature(bytes.hex) raises ValueError "builtin has invalid signature"
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43067>
_______________________________________

From report at bugs.python.org  Fri Jan 29 16:21:34 2021
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 29 Jan 2021 21:21:34 +0000
Subject: [issue43056] Use of dicts in 4.2 and 4.7 of Python tutorial a bit
 confusing
In-Reply-To: <1611849419.6.0.947675106627.issue43056@roundup.psfhosted.org>
Message-ID: <1611955294.46.0.18025508737.issue43056@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

For 4.2, the point is the '.copy()' versus the 'active_users' copy.  I think a real beginner would, or should, ignore any other details not immediately familiar.  

4.7.2 Keyword arguments.  It is simply a fact that including the full discussion here requires the forward references.  I think splitting the discussion and moving this part somewhere later would be worse.  Some will not be able to "follow the tutorial in sequence".  It is not a novel.

I think you should close this.  It makes observations but does not have any concrete suggestions for improvements, and unlike your other posts, I don't see that it might lead to any.

----------
nosy: +terry.reedy
title: Use of dicts in sections 4.2 and 4.7 of Python tutorial a bit confusing -> Use of dicts in 4.2 and 4.7 of Python tutorial a bit confusing

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43056>
_______________________________________

From report at bugs.python.org  Fri Jan 29 16:27:53 2021
From: report at bugs.python.org (Tadek Kijkowski)
Date: Fri, 29 Jan 2021 21:27:53 +0000
Subject: [issue42966] argparse: customizable help formatter
In-Reply-To: <1611066420.6.0.700026495964.issue42966@roundup.psfhosted.org>
Message-ID: <1611955673.85.0.545410878096.issue42966@roundup.psfhosted.org>


Tadek Kijkowski <tkijkowski at gmail.com> added the comment:

This is just repackaging old ideas into nice box. Instead of creating lambdas or generator function for each particular case, there is one easy to use, universal class. It will be finally written in official documentation how to change indentation.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42966>
_______________________________________

From report at bugs.python.org  Fri Jan 29 16:38:42 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 29 Jan 2021 21:38:42 +0000
Subject: [issue42596] aarch64 Fedora Rawhide LTO + PGO 3.8 fails to build
 Python: /usr/bin/ld: error adding symbols: bad value
In-Reply-To: <1607419324.76.0.598132356337.issue42596@roundup.psfhosted.org>
Message-ID: <1611956322.27.0.167936282942.issue42596@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

The worker is back to green: https://buildbot.python.org/all/#/builders/528/builds/299

----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42596>
_______________________________________

From report at bugs.python.org  Fri Jan 29 16:40:15 2021
From: report at bugs.python.org (Illia Volochii)
Date: Fri, 29 Jan 2021 21:40:15 +0000
Subject: [issue42982] Update suggested number of iterations for pbkdf2_hmac()
In-Reply-To: <1611173199.26.0.961948207202.issue42982@roundup.psfhosted.org>
Message-ID: <1611956415.85.0.149821780057.issue42982@roundup.psfhosted.org>


Illia Volochii <illia.volochii at gmail.com> added the comment:

> FWIW, OnePass uses 100,000.  https://support.1password.com/pbkdf2/

There is a history section on that page. And current 100,000 is ten times more than 1Password used in 2013 when the suggestion was added to the documentation.

> Also, I don't think an additional time factor of 2.5x would make substantial difference in security, but it may make a noticeable difference in user authentication time.

2.5x difference can be substantial if x is hours, days, or years :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42982>
_______________________________________

From report at bugs.python.org  Fri Jan 29 16:42:19 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 29 Jan 2021 21:42:19 +0000
Subject: [issue42323] [AIX] test_math: test_nextafter(float('nan'),
 1.0) does not return a NaN on AIX
In-Reply-To: <1605094498.01.0.809514320528.issue42323@roundup.psfhosted.org>
Message-ID: <1611956539.24.0.522539970994.issue42323@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
pull_requests: +23198
pull_request: https://github.com/python/cpython/pull/24381

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42323>
_______________________________________

From report at bugs.python.org  Fri Jan 29 16:49:00 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 29 Jan 2021 21:49:00 +0000
Subject: [issue43068] test_subprocess: test_specific_shell() fails on AMD64
 FreeBSD Shared 3.x
Message-ID: <1611956940.56.0.594651223595.issue43068@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at python.org>:

https://buildbot.python.org/all/#/builders/483/builds/758

FAIL: test_specific_shell (test.test_subprocess.POSIXProcessTestCase)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-564d/build/Lib/test/test_subprocess.py", line 2286, in test_specific_shell
    self.assertEqual(p.stdout.read().strip(), bytes(sh, 'ascii'))
AssertionError: b'' != b'/usr/local/bin/bash'

AMD64 FreeBSD Shared 3.9 is also affected:
https://buildbot.python.org/all/#/builders/151/builds/283

And AMD64 FreeBSD Shared 3.8:
https://buildbot.python.org/all/#/builders/555/builds/197

----------
components: Tests
messages: 385945
nosy: vstinner
priority: normal
severity: normal
status: open
title: test_subprocess: test_specific_shell() fails on AMD64 FreeBSD Shared 3.x
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43068>
_______________________________________

From report at bugs.python.org  Fri Jan 29 16:49:01 2021
From: report at bugs.python.org (Steve Dower)
Date: Fri, 29 Jan 2021 21:49:01 +0000
Subject: [issue41282] Deprecate and remove distutils
In-Reply-To: <1594542625.3.0.789939298104.issue41282@roundup.psfhosted.org>
Message-ID: <1611956941.74.0.889263905387.issue41282@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset 62949f697fdefbf0c8bbba7a8354b9376afa35ba by Steve Dower in branch 'master':
bpo-41282: Add deprecation warning and docs for distutils (PEP 632) (GH-24355)
https://github.com/python/cpython/commit/62949f697fdefbf0c8bbba7a8354b9376afa35ba


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41282>
_______________________________________

From report at bugs.python.org  Fri Jan 29 16:49:19 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 29 Jan 2021 21:49:19 +0000
Subject: [issue43068] test_subprocess: test_specific_shell() fails on AMD64
 FreeBSD Shared 3.x
In-Reply-To: <1611956940.56.0.594651223595.issue43068@roundup.psfhosted.org>
Message-ID: <1611956959.21.0.151961144337.issue43068@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at python.org>:


----------
nosy: +koobs

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43068>
_______________________________________

From report at bugs.python.org  Fri Jan 29 16:50:18 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 29 Jan 2021 21:50:18 +0000
Subject: [issue41013] test_os.test_memfd_create() fails on AMD64 FreeBSD
 Shared 3.x
In-Reply-To: <1592434332.74.0.304039490213.issue41013@roundup.psfhosted.org>
Message-ID: <1611957018.92.0.767702287603.issue41013@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

test_os pass again on FreeBSD Shared 3.x, I close the issue.

----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41013>
_______________________________________

From report at bugs.python.org  Fri Jan 29 16:53:41 2021
From: report at bugs.python.org (Jesse Silverman)
Date: Fri, 29 Jan 2021 21:53:41 +0000
Subject: [issue43042] Delete or merge redundant tutorial sentence.
In-Reply-To: <1611772942.43.0.309900316345.issue43042@roundup.psfhosted.org>
Message-ID: <1611957221.71.0.924733331461.issue43042@roundup.psfhosted.org>


Jesse Silverman <jessevsilverman at gmail.com> added the comment:

Yes, your takeaway was what precisely what I was getting at.  I sounded unsure because I was unsure.  In reality, it doesn't matter whether a different function is being called or one is calling itself, the current wording suggests that it might.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43042>
_______________________________________

From report at bugs.python.org  Fri Jan 29 16:54:32 2021
From: report at bugs.python.org (Vladimir Feinberg)
Date: Fri, 29 Jan 2021 21:54:32 +0000
Subject: [issue43048] Printing RecursionError results in RecursionError
In-Reply-To: <1611798337.38.0.626995188313.issue43048@roundup.psfhosted.org>
Message-ID: <1611957272.99.0.361059377159.issue43048@roundup.psfhosted.org>


Vladimir Feinberg <vlad at sisudata.com> added the comment:

I agree with both the duplicate classification and am glad the fix works in 3.10. Thanks all for the responses.

Given the issue can be triggered with a fairly benign setup (pandas triggers such an error, and logger.exception is idiomatic), I do think backport should be worth consideration, but maybe I'm overindexing on the frequency of such exceptions in the wild.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43048>
_______________________________________

From report at bugs.python.org  Fri Jan 29 17:00:28 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 29 Jan 2021 22:00:28 +0000
Subject: [issue40521] [subinterpreters] Make free lists and unicode caches
 per-interpreter
In-Reply-To: <1588693682.5.0.219755904926.issue40521@roundup.psfhosted.org>
Message-ID: <1611957628.28.0.842898997738.issue40521@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> I reopen the issue. This change caused a regression in attached interned_bug.py.

Fixed by:

commit c8a87addb1fa35dec79ed8f227eba3694fc36234
Author: Mohamed Koubaa <koubaa.m at gmail.com>
Date:   Mon Jan 4 08:34:26 2021 -0600

    bpo-1635741: Port pyexpat to multi-phase init (PEP 489) (GH-22222)

----------
resolution:  -> fixed
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40521>
_______________________________________

From report at bugs.python.org  Fri Jan 29 17:01:44 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 29 Jan 2021 22:01:44 +0000
Subject: [issue40070] GCC crashed on AMD64 RHEL7 LTO + PGO 3.7 (compiler bug)
In-Reply-To: <1585180062.41.0.685376297211.issue40070@roundup.psfhosted.org>
Message-ID: <1611957704.73.0.398917345605.issue40070@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

I didn't see the compiler bug recently, and Python 3.7 no longer accept bug fixes anymore.

----------
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40070>
_______________________________________

From report at bugs.python.org  Fri Jan 29 17:02:41 2021
From: report at bugs.python.org (Jesse Silverman)
Date: Fri, 29 Jan 2021 22:02:41 +0000
Subject: [issue43034] Python tutorial misleads users about floor division
 behavior
In-Reply-To: <1611710102.87.0.478016588876.issue43034@roundup.psfhosted.org>
Message-ID: <1611957761.46.0.468081131022.issue43034@roundup.psfhosted.org>


Jesse Silverman <jessevsilverman at gmail.com> added the comment:

I understand and agree with both comments.
I will confirm that a substantial number of people think -17 // 3 yields -5.0, so when I saw this I wondered if it reinforced that common misconception.

I was curious enough to not just confirm in the actual docs not only that -17 // 3 == -6.0 but learned why it does so.

I would be happy to see any of Terry's three suggestions added, with the first one adding the most bang for the buck (if someone is surprised to see -6.0 there, they can go look up why).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43034>
_______________________________________

From report at bugs.python.org  Fri Jan 29 17:04:53 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 29 Jan 2021 22:04:53 +0000
Subject: [issue42323] [AIX] test_math: test_nextafter(float('nan'),
 1.0) does not return a NaN on AIX
In-Reply-To: <1605094498.01.0.809514320528.issue42323@roundup.psfhosted.org>
Message-ID: <1611957893.78.0.309259389675.issue42323@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset 0837f99d3367ecf200033bbddfa05d061ae9f483 by Victor Stinner in branch 'master':
bpo-42323: Fix math.nextafter() on AIX (GH-24381)
https://github.com/python/cpython/commit/0837f99d3367ecf200033bbddfa05d061ae9f483


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42323>
_______________________________________

From report at bugs.python.org  Fri Jan 29 17:11:49 2021
From: report at bugs.python.org (Jesse Silverman)
Date: Fri, 29 Jan 2021 22:11:49 +0000
Subject: [issue43056] Use of dicts in 4.2 and 4.7 of Python tutorial a bit
 confusing
In-Reply-To: <1611849419.6.0.947675106627.issue43056@roundup.psfhosted.org>
Message-ID: <1611958309.56.0.354672929063.issue43056@roundup.psfhosted.org>


Jesse Silverman <jessevsilverman at gmail.com> added the comment:

Agreed with the exception that I'd like to review whether the forward reference to dict in the tutorial might be better suited to people working thru the tutorial than the current forward reference to the real docs.

I got to take a look at Eric Matthes' excellent "Python Crash Course".  He avoids this by treating function definitions only after introducing both tuples and dicts, rather than together with simple control flow within a function.  That would clearly be a re-org that is way out of scope of a bug report.

So, if someone compares the potential forward reference to the dict section of the tutorial rather than the current forward reference to the language reference in light of where the tutorial audience is expected to be at when reading this section, I am good with closing it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43056>
_______________________________________

From report at bugs.python.org  Fri Jan 29 17:32:21 2021
From: report at bugs.python.org (Ciprian Dorin Craciun)
Date: Fri, 29 Jan 2021 22:32:21 +0000
Subject: [issue43069] Python fails to read a script whose path is `/dev/fd/X`
Message-ID: <1611959541.65.0.0210578215871.issue43069@roundup.psfhosted.org>


New submission from Ciprian Dorin Craciun <ciprian.craciun at gmail.com>:

Sometimes (especially from wrapper scripts) one would like to call Python with a script that should be read from a file-descriptor, like `python3 /dev/fd/9`;  most likely the backing is a file in `TMPDIR` (perhaps unlinked, like `bash`'s "here documents").

However on OSX (I've tried it on `10.15.7` and `10.13.6`), for some reason if that script is too "large" (more than a couple of characters) it just bails out, even if that file-descriptor is in fact backed by a file.

For example:
~~~~
echo 'print("1234567890")' >/tmp/x.py && python3 /dev/fd/9 9</tmp/x.py
# correctly prints 1234567890

echo 'print("12345678901234567890")' >/tmp/x.py && python3 /dev/fd/9 9</tmp/x.py
# prints nothing, no error, no exit code, etc.

# alternative variant 1, with `bash` "here-documents"
python3 /dev/fd/9 9<<<'print("12345678901234567890")'
# still prints nothing.

# alternative variant 2, that uses `/dev/stdin` instead of `/dev/fd/N`
python3 /dev/stdin <<<'print("12345678901234567890")'
# still prints nothing.

# alternative variant 3, that uses `open` and `exec`
python3 -c 'exec(open("/dev/fd/9").read())' 9<<<'print("12345678901234567890")'
# correctly prints 12345678901234567890
~~~~

The file `/tmp/x.py` is just a simple script that prints that token.

I've tried both Python 3.9.1, 3.8.2 and even 2.7.18 and 2.7.16, all with the same results.  (This makes me think it's actually an OSX issue?)

On Linux this works flawlesly.  Furthermore if one uses something else like `cat`, `bash` or anything else it works.  Thus it is something related with Python on OSX.

Also as seen from the examples, this is not a "shell issue" or something similar;  it just seems to hit a corner case when the script path is `/dev/fd/...` or `/dev/stdin`

----------
components: Interpreter Core, macOS
messages: 385955
nosy: ciprian.craciun, ned.deily, ronaldoussoren
priority: normal
severity: normal
status: open
title: Python fails to read a script whose path is `/dev/fd/X`
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43069>
_______________________________________

From report at bugs.python.org  Fri Jan 29 17:32:55 2021
From: report at bugs.python.org (Jason R. Coombs)
Date: Fri, 29 Jan 2021 22:32:55 +0000
Subject: [issue43063] zipfile.Path / importlib.resources raises KeyError if a
 file wasn't found
In-Reply-To: <1611939371.43.0.787270932991.issue43063@roundup.psfhosted.org>
Message-ID: <1611959575.8.0.762336766001.issue43063@roundup.psfhosted.org>


Jason R. Coombs <jaraco at jaraco.com> added the comment:

The change to error handling for zipp.Path was added in https://github.com/jaraco/zipp/issues/46 and released as [3.1.0](https://zipp.readthedocs.io/en/latest/history.html#v3-1-0). Probably that change was incorporated into CPython shortly thereafter with bpo-40564, as you observed.

I agree with you, backporting these as bugfixes doesn't feel appropriate. It is a change in behavior. On the other hand, it's a change within the documented scope of the API (that is, it was never stipulated what the behavior would be). My slight preference is to leave the CPython version alone and to recommend the use of the backports to get Python 3.10 compatibility.

It really comes down to the judgment of the release manager. ?ukasz, how do you feel about changing the exception that's raised when a directory or file doesn't exist from a KeyError to a more-appropriate OSError for future compatibility?

----------
nosy: +lukasz.langa

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43063>
_______________________________________

From report at bugs.python.org  Fri Jan 29 18:35:54 2021
From: report at bugs.python.org (Trey Hunner)
Date: Fri, 29 Jan 2021 23:35:54 +0000
Subject: [issue43070] Control keys stop working after pressing Ctrl-C Escape
 Enter
Message-ID: <1611963354.38.0.774052304558.issue43070@roundup.psfhosted.org>


New submission from Trey Hunner <trey at truthful.technology>:

On Ubuntu Linux 18.04 when I run Python from within a terminal, control keys such as Ctrl-L, Ctrl-A, Ctrl-E, and Ctrl-K work as expected.

However, if I type Ctrl-C Escape Enter (^C followed by Esc followed by Return), control keys stop working as expected. Ctrl-C still causes KeyboardInterrupt to be printed, but pressing Ctrl-L causes "^L" to be shown and Ctrl-A shows "^A".

This happens in Gnome Terminal as well as XTerm both on Ubuntu Linux 18.04. It happens in zsh, bash, tcsh, and sh.

I've reproduced this issue in Python 2.7, 3.6, 3.7, 3.8, 3.9, and 3.10. Some of these Python versions I installed via pyenv, some came from the deadsnakes PPA, and some were preinstalled with Ubuntu.

----------
messages: 385957
nosy: trey
priority: normal
severity: normal
status: open
title: Control keys stop working after pressing Ctrl-C Escape Enter
type: behavior
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43070>
_______________________________________

From report at bugs.python.org  Fri Jan 29 18:57:29 2021
From: report at bugs.python.org (Trey Hunner)
Date: Fri, 29 Jan 2021 23:57:29 +0000
Subject: [issue43070] Control keys stop working after pressing Ctrl-C Escape
 Enter
In-Reply-To: <1611963354.38.0.774052304558.issue43070@roundup.psfhosted.org>
Message-ID: <1611964649.38.0.191975296615.issue43070@roundup.psfhosted.org>


Trey Hunner <trey at truthful.technology> added the comment:

I got some help investigating via a Twitter thread on this topic: https://twitter.com/treyhunner/status/1355280273399664642

Here's more context: that combination of keys seems to put readline into vi mode, though it only does so in Python and not inside my system shell.

If I type start to type a line of code (say "2+2") and hit Escape and then type vi commands like 0 or $, the cursor will navigate to the beginning/end of the line as expected in vi mode.

Ctrl-Alt-L clears the screen and typing "Ctrl-A e" enters back into Emacs readline mode.

I can understand how "Ctrl-A v" would cause the Python REPL to enter vi mode, but I don't understand why "Ctrl-C Escape Enter" would cause that.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43070>
_______________________________________

From report at bugs.python.org  Fri Jan 29 18:59:05 2021
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 29 Jan 2021 23:59:05 +0000
Subject: [issue42604] EXT_SUFFIX too short on FreeBSD and AIX
In-Reply-To: <1607464402.35.0.336960410788.issue42604@roundup.psfhosted.org>
Message-ID: <1611964745.93.0.560794532175.issue42604@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> It seems like Python no long builds on PPC64 AIX 3.x buildbot:
> https://buildbot.python.org/all/#/builders/438/builds/753

Sorry, it was unrelated to this issue. I fixed it with:

New changeset 0837f99d3367ecf200033bbddfa05d061ae9f483 by Victor Stinner in branch 'master':
bpo-42323: Fix math.nextafter() on AIX (GH-24381)

> This is bpo-42979: "_zoneinfo: zoneinfomodule_exec() doesn't check for PyDateTime_IMPORT failure".

_zoneinfo has also been fixed.

----------
resolution:  -> fixed
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42604>
_______________________________________

From report at bugs.python.org  Fri Jan 29 19:00:53 2021
From: report at bugs.python.org (Steven D'Aprano)
Date: Sat, 30 Jan 2021 00:00:53 +0000
Subject: [issue43070] Control keys stop working after pressing Ctrl-C Escape
 Enter
In-Reply-To: <1611963354.38.0.774052304558.issue43070@roundup.psfhosted.org>
Message-ID: <1611964853.75.0.159793744519.issue43070@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

Ctrl-C is a red-herring here. Esc-Enter alone is sufficient to switch control processing.

Tested in Python 2.7 and 3.9 using xfce4-terminal in Fedora:

1. Ctrl-L clears the terminal window;
2. Type Esc-Enter;
3. Ctrl-L now inserts an actual ^L (chr(12) linefeed) instead of being captured by the terminal and clearing the screen.

I am 80% sure this is a *terminal feature* not a Python bug, to allow you to insert control characters into the command line, but I can't reproduce it in bash or find a way to revert back to normal processing.

----------
nosy: +steven.daprano

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43070>
_______________________________________

From report at bugs.python.org  Fri Jan 29 19:00:29 2021
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 30 Jan 2021 00:00:29 +0000
Subject: [issue42323] [AIX] test_math: test_nextafter(float('nan'),
 1.0) does not return a NaN on AIX
In-Reply-To: <1605094498.01.0.809514320528.issue42323@roundup.psfhosted.org>
Message-ID: <1611964829.19.0.616977818873.issue42323@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:

> test_nextafter fails on PPC64 AIX 3.x (build 749).

It pass again in build 788, so I close the issue:
https://buildbot.python.org/all/#/builders/438/builds/788

It would be great if the AIX libm could be fixed, but I wanted to fix the AIX buildbots, to be abl to detect other Python regressions.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42323>
_______________________________________

From report at bugs.python.org  Fri Jan 29 19:46:47 2021
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 30 Jan 2021 00:46:47 +0000
Subject: [issue38631] Replace Py_FatalError() with regular Python exceptions
In-Reply-To: <1572352735.51.0.915792481752.issue38631@roundup.psfhosted.org>
Message-ID: <1611967607.11.0.0417207321675.issue38631@roundup.psfhosted.org>


STINNER Victor <vstinner at python.org> added the comment:


New changeset ba7a99ddb52a45c8dec1f7e9f1648add0ace82ab by Victor Stinner in branch 'master':
bpo-38631: Replace compiler fatal errors with exceptions (GH-24369)
https://github.com/python/cpython/commit/ba7a99ddb52a45c8dec1f7e9f1648add0ace82ab


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue38631>
_______________________________________

From report at bugs.python.org  Fri Jan 29 20:08:18 2021
From: report at bugs.python.org (Tadek Kijkowski)
Date: Sat, 30 Jan 2021 01:08:18 +0000
Subject: [issue43070] Control keys stop working after pressing Ctrl-C Escape
 Enter
In-Reply-To: <1611963354.38.0.774052304558.issue43070@roundup.psfhosted.org>
Message-ID: <1611968898.47.0.589827510231.issue43070@roundup.psfhosted.org>


Tadek Kijkowski <tkijkowski at gmail.com> added the comment:

This is readline library feature. ESC-enter swithes it to vi mode. Press ESC-e to switch is back to emacs mode. See man readline.

----------
nosy: +monkeyman79

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43070>
_______________________________________

From report at bugs.python.org  Fri Jan 29 20:43:33 2021
From: report at bugs.python.org (Trey Hunner)
Date: Sat, 30 Jan 2021 01:43:33 +0000
Subject: [issue43070] Control keys stop working after pressing Ctrl-C Escape
 Enter
In-Reply-To: <1611963354.38.0.774052304558.issue43070@roundup.psfhosted.org>
Message-ID: <1611971013.47.0.358069486942.issue43070@roundup.psfhosted.org>


Trey Hunner <trey at truthful.technology> added the comment:

Thank you Steve and Tadek for confirming that this is a readline feature and for pointing me to the readline manual. The note about an ~/.inputrc file lead me to discover (happily) that I could override this behavior by creating a ~/.inputrc file with the following line in it:

"\e\C-M": abort     Stop Esc Enter from entering vi mode in Python REPL


I'm closing this as "not a bug".

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43070>
_______________________________________

From report at bugs.python.org  Fri Jan 29 21:02:32 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 30 Jan 2021 02:02:32 +0000
Subject: [issue42927] Inline cache for slots
In-Reply-To: <1610599509.18.0.893371992468.issue42927@roundup.psfhosted.org>
Message-ID: <1611972152.38.0.249282905048.issue42927@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:


New changeset 5c5a938573ce665f00e362c7766912d9b3f3b44e by Guido van Rossum in branch 'master':
bpo-42927: Inline cache for attributes defined with '__slots__' (#24216)
https://github.com/python/cpython/commit/5c5a938573ce665f00e362c7766912d9b3f3b44e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42927>
_______________________________________

From report at bugs.python.org  Fri Jan 29 21:03:05 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 30 Jan 2021 02:03:05 +0000
Subject: [issue42927] Inline cache for slots
In-Reply-To: <1610599509.18.0.893371992468.issue42927@roundup.psfhosted.org>
Message-ID: <1611972185.45.0.843388457262.issue42927@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
resolution:  -> fixed
stage: patch review -> commit review
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42927>
_______________________________________

From report at bugs.python.org  Fri Jan 29 21:08:32 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 30 Jan 2021 02:08:32 +0000
Subject: [issue42927] Inline cache for slots
In-Reply-To: <1610599509.18.0.893371992468.issue42927@roundup.psfhosted.org>
Message-ID: <1611972512.69.0.51823294499.issue42927@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
pull_requests: +23199
pull_request: https://github.com/python/cpython/pull/24383

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42927>
_______________________________________

From report at bugs.python.org  Fri Jan 29 21:13:28 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 30 Jan 2021 02:13:28 +0000
Subject: [issue42115] Caching infrastructure for the evaluation loop:
 specialised opcodes
In-Reply-To: <1603336898.74.0.366564812208.issue42115@roundup.psfhosted.org>
Message-ID: <1611972808.15.0.725226396625.issue42115@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> What am I missing? Why is the hash of the name needed?

To speed up the call to get the method from the dictionary using _PyDict_GetItem_KnownHash. The reason I was not caching the method is that as you mention there could still be an overriding value in the dictionary.

> But what if we only did this for classes without an instance dict? 

This is an interesting idea. For PR23503 seems that the machinery was too costly that it was killing the advantages, but maybe we could simplify this for classes without dictionaries so we can still gain overall.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42115>
_______________________________________

From report at bugs.python.org  Fri Jan 29 21:42:00 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 30 Jan 2021 02:42:00 +0000
Subject: [issue42115] Caching infrastructure for the evaluation loop:
 specialised opcodes
In-Reply-To: <1603336898.74.0.366564812208.issue42115@roundup.psfhosted.org>
Message-ID: <1611974520.56.0.385517573349.issue42115@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

I am attaching to this issue a patch with PR 23503 restricted to only classes without dict. I can measure a speedup but is super small (5%) in a function that keeps calling a method for a builtin:

def foo(obj):
    for _ in range(10000):
        res = obj.index(42)
    return res

----------
Added file: https://bugs.python.org/file49776/patch

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42115>
_______________________________________

From report at bugs.python.org  Fri Jan 29 22:26:09 2021
From: report at bugs.python.org (Greg)
Date: Sat, 30 Jan 2021 03:26:09 +0000
Subject: [issue43071] IDLE: Windows 7 - Trackpad two-finger vertical scrolling
 is not recognized
Message-ID: <1611977169.85.0.900313540733.issue43071@roundup.psfhosted.org>


New submission from Greg <gregsaywhaat at gmail.com>:

Up/down scrolling is not possible with a two-finger swipe on a trackpad. I'm using Lenovo's notably bad UltraNav drivers on Windows 7. Horizontal scrolling works just fine. PgUp and PgDn both behave as normal, as does ctrl + arrow keys.

I'm having this issue with IDLE for 3.8.7, and 3.7.9, but not 2.7.3 (which just happens to be the last version I had installed).

----------
assignee: terry.reedy
components: IDLE
messages: 385968
nosy: Kritzy, terry.reedy
priority: normal
severity: normal
status: open
title: IDLE: Windows 7 - Trackpad two-finger vertical scrolling is not recognized
type: behavior
versions: Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43071>
_______________________________________

From report at bugs.python.org  Fri Jan 29 23:03:55 2021
From: report at bugs.python.org (akshat goyal)
Date: Sat, 30 Jan 2021 04:03:55 +0000
Subject: [issue43072] Memory Leak when using Thread
Message-ID: <1611979435.69.0.821660649621.issue43072@roundup.psfhosted.org>


New submission from akshat goyal <goyalakshat14 at gmail.com>:

when using Thread and allocating memory resource usage is not down as opposed to when using Process or directly calling function as can be seen in the attached script.

To replicate:
start the script with the three functions one by one and see the memory usage of the script.
Thread has the highest of all three.

----------
components: Library (Lib)
files: simple.py
messages: 385969
nosy: goyalakshat14
priority: normal
severity: normal
status: open
title: Memory Leak when using Thread
type: resource usage
versions: Python 3.6, Python 3.8
Added file: https://bugs.python.org/file49777/simple.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43072>
_______________________________________

From report at bugs.python.org  Fri Jan 29 23:38:58 2021
From: report at bugs.python.org (Eric Poulsen)
Date: Sat, 30 Jan 2021 04:38:58 +0000
Subject: [issue43073] Adding a ctypes.Union to a ctypes.BigEndianStructure
 results in an error
Message-ID: <1611981538.61.0.504435630016.issue43073@roundup.psfhosted.org>


New submission from Eric Poulsen <eric at zyxod.com>:

Placing a ctypes.Union inside of a ctypes.BigEndianStructure results in "TypeError: This type does not support other endian".  I believe this is a similar problem to issue #4376 (https://bugs.python.org/issue4376)

Minimum repro test case:

import ctypes as ct

class U(ct.Union):
    _pack_=True
    _fields_=[
        ('a', ct.c_int),
        ('b', ct.c_int),
    ]

class S(ct.BigEndianStructure):
    _pack_=True
    _fields_=[
        ('x', ct.c_int),
        ('y', U),
    ]

I believe the fix is similar to that issue, though I admit I don't know enough about this code to be sure.

diff --git a/Lib/ctypes/_endian.py b/Lib/ctypes/_endian.py
index 37444bd6a7..525c5e58c9 100644
--- a/Lib/ctypes/_endian.py
+++ b/Lib/ctypes/_endian.py
@@ -18,6 +18,9 @@ def _other_endian(typ):
     # if typ is structure
     if issubclass(typ, Structure):
         return typ
+    # if typ is union:
+    if issubclass(typ, Union):
+        return typ
     raise TypeError("This type does not support other endian: %s" % typ)
 
 class _swapped_meta(type(Structure)):

----------
components: ctypes
messages: 385970
nosy: MrSurly
priority: normal
severity: normal
status: open
title: Adding a ctypes.Union to a ctypes.BigEndianStructure results in an error
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43073>
_______________________________________

From report at bugs.python.org  Sat Jan 30 00:00:32 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 30 Jan 2021 05:00:32 +0000
Subject: [issue40455] GCC 10 compiler warnings
In-Reply-To: <1588279868.77.0.13865368461.issue40455@roundup.psfhosted.org>
Message-ID: <1611982832.4.0.620288187122.issue40455@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
nosy: +pablogsal
nosy_count: 5.0 -> 6.0
pull_requests: +23200
pull_request: https://github.com/python/cpython/pull/24384

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40455>
_______________________________________

From report at bugs.python.org  Sat Jan 30 00:39:42 2021
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 30 Jan 2021 05:39:42 +0000
Subject: [issue42115] Caching infrastructure for the evaluation loop:
 specialised opcodes
In-Reply-To: <1603336898.74.0.366564812208.issue42115@roundup.psfhosted.org>
Message-ID: <1611985182.87.0.602171338185.issue42115@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Thanks!

The loop overhead is presumably dramatic in that example. I think I measured a somewhat bigger speedup using timeit, which IIRC subtracts the cost of an empty loop. But you're right that 5% on a micro-benchmark is not very exciting.

I wonder if there are cases where the speedup is larger, e.g. in a class with __slots__ where the method is defined in a base class (also with __slots__). In that case LOAD_METHOD would require two dict lookups, both of which we'd avoid here.

This could be relevant if we had a hidden class mechanism (I'm playing with that but it's too soon to show anything). Let's keep your patch around for that.



Has anyone looked at storing the cache literally inline? If we had a way to rewrite bytecode that allowed us to move code (requiring us to fix up jumps) the cache data could be stored inline in the bytecode array (I guess that's why they call it "inline cache" :-). So e.g. LOAD_METHOD could have a layout like this:

LOAD_METHOD opcode
oparg
(padding)
optimized
type
tp_version_tag
meth

This would avoid the pointer chasing needed to find the opcache struct, and increase memory locality. Obviously the bytecode would have to be copied to mutable memory.

We could even make it so that "LOAD_METHOD with opcache entry" is a new opcode, so there would be less overhead for unoptimized code (and for optimized code :-).

We'd have to do something funky for concurrent invocations of the same function (due to threading or recursion), but that can be dealt with; e.g., the frame could hold a pointer to the bytecode array in use.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42115>
_______________________________________

From report at bugs.python.org  Sat Jan 30 02:11:23 2021
From: report at bugs.python.org (Kyle Stanley)
Date: Sat, 30 Jan 2021 07:11:23 +0000
Subject: [issue42647] Unable to use concurrent.futures in atexit hook
In-Reply-To: <1608040750.56.0.960217977665.issue42647@roundup.psfhosted.org>
Message-ID: <1611990683.41.0.472107870696.issue42647@roundup.psfhosted.org>


Kyle Stanley <aeros167 at gmail.com> added the comment:

Thanks for bringing attention to this, Julien. 

While the regression is definitely unfortunate, I'm uncertain about whether the behavior is *correct* to allow in the first place. Specifically, allowing the registration of an atexit hook which uses a ThreadPoolExecutor within it means that the finalization of the executor will be done *after* thread finalization occurs, leaving dangling threads which will have to be abruptly killed upon interpreter exit instead of being safely joined. From my perspective at least, this doesn't seem like something to be encouraged.

Is there a real-world situation where it's specifically necessary or even beneficial to utilize ThreadPoolExecutor at this point after thread finalization rather than earlier in the program? Not that it doesn't exist, but to me it intuitively seems very odd to utilize an executor within an atexit hook, which are intended to just be resource finalization/cleanup functions called at interpreter shutdown. Assuming there is a genuine use case I'm not seeing, it may be worth weighing against the decision to convert the executors to not use daemon threads, as I presently don't think there's a way to (safely) allow that behavior without reverting back to using daemon threads.

That said, I'll admit that I'm more than a bit biased as the author of the commit which introduced the regression, so I'll CC Antoine Pitrou (active expert for threading and concurrent.futures) to help make the final decision.

----------
nosy: +pitrou

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42647>
_______________________________________

From report at bugs.python.org  Sat Jan 30 02:58:09 2021
From: report at bugs.python.org (=?utf-8?b?5Y+M6I2J6YW46YWv?=)
Date: Sat, 30 Jan 2021 07:58:09 +0000
Subject: [issue43074] Unable to use system proxy with HTTPS connection on
 Windows
Message-ID: <1611993489.22.0.338889763746.issue43074@roundup.psfhosted.org>


New submission from ???? <admin at 0x.mk>:

On Windows you can only set a "host:port" http proxy as system proxy.
```
PS > Get-ItemProperty -Path 'HKCU:\Software\Microsoft\Windows\CurrentVersion\Internet Settings' | findstr ProxyServer
ProxyServer              : 127.0.0.1:7890
```

But in Python, it assumes that this proxy supports both http and https on the same port:

```
>>> import urllib
>>> urllib.request.getproxies()
{'http': 'http://127.0.0.1:7890', 'https': 'https://127.0.0.1:7890', 'ftp': 'ftp://127.0.0.1:7890'}
```

On Python 3.8.x it works but on 3.9.x it keeps failing to handshake on https traffic.

3.8.x:

```
> .\python38.exe
Python 3.8.3 (tags/v3.8.3:6f8c832, May 13 2020, 22:37:02) [MSC v.1924 64 bit (AMD64)] on win32
Type "help", "copyright", "credits" or "license" for more information.
>>> import urllib, requests
>>> urllib.request.getproxies()
{'http': 'http://127.0.0.1:7890', 'https': 'https://127.0.0.1:7890', 'ftp': 'ftp://127.0.0.1:7890'}
>>> requests.get("http://www.google.com")
<Response [200]>
>>> requests.get("https://www.google.com")
<Response [200]>
```

```
> python3
Python 3.9.1 (tags/v3.9.1:1e5d33e, Dec  7 2020, 17:08:21) [MSC v.1927 64 bit (AMD64)] on win32
Type "help", "copyright", "credits" or "license" for more information.
>>> import urllib, requests
>>> urllib.request.getproxies()
{'http': 'http://127.0.0.1:7890', 'https': 'https://127.0.0.1:7890', 'ftp': 'ftp://127.0.0.1:7890'}
>>> requests.get("http://www.google.com")
<Response [200]>
>>> requests.get("https://www.google.com")
Traceback (most recent call last):
  File "C:\Python39\lib\site-packages\urllib3\connectionpool.py", line 696, in urlopen
    self._prepare_proxy(conn)
  File "C:\Python39\lib\site-packages\urllib3\connectionpool.py", line 964, in _prepare_proxy
    conn.connect()
  File "C:\Python39\lib\site-packages\urllib3\connection.py", line 359, in connect
    conn = self._connect_tls_proxy(hostname, conn)
  File "C:\Python39\lib\site-packages\urllib3\connection.py", line 496, in _connect_tls_proxy
    return ssl_wrap_socket(
  File "C:\Python39\lib\site-packages\urllib3\util\ssl_.py", line 432, in ssl_wrap_socket
    ssl_sock = _ssl_wrap_socket_impl(sock, context, tls_in_tls)
  File "C:\Python39\lib\site-packages\urllib3\util\ssl_.py", line 474, in _ssl_wrap_socket_impl
    return ssl_context.wrap_socket(sock)
  File "C:\Python39\lib\ssl.py", line 500, in wrap_socket
    return self.sslsocket_class._create(
  File "C:\Python39\lib\ssl.py", line 1040, in _create
    self.do_handshake()
  File "C:\Python39\lib\ssl.py", line 1309, in do_handshake
    self._sslobj.do_handshake()
ssl.SSLEOFError: EOF occurred in violation of protocol (_ssl.c:1123)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Python39\lib\site-packages\requests\adapters.py", line 439, in send
    resp = conn.urlopen(
  File "C:\Python39\lib\site-packages\urllib3\connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "C:\Python39\lib\site-packages\urllib3\util\retry.py", line 573, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='www.google.com', port=443): Max retries exceeded with url: / (Caused by SSLError(SSLEOFError(8, 'EOF occurred in violation of protocol (_ssl.c:1123)')))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "C:\Python39\lib\site-packages\requests\api.py", line 76, in get
    return request('get', url, params=params, **kwargs)
  File "C:\Python39\lib\site-packages\requests\api.py", line 61, in request
    return session.request(method=method, url=url, **kwargs)
  File "C:\Python39\lib\site-packages\requests\sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "C:\Python39\lib\site-packages\requests\sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "C:\Python39\lib\site-packages\requests\adapters.py", line 514, in send
    raise SSLError(e, request=request)
requests.exceptions.SSLError: HTTPSConnectionPool(host='www.google.com', port=443): Max retries exceeded with url: / (Caused by SSLError(SSLEOFError(8, 'EOF occurred in violation of protocol (_ssl.c:1123)')))
```

----------
components: Windows
messages: 385973
nosy: admin3, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: Unable to use system proxy with HTTPS connection on Windows
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43074>
_______________________________________

From report at bugs.python.org  Sat Jan 30 03:04:05 2021
From: report at bugs.python.org (Christian Heimes)
Date: Sat, 30 Jan 2021 08:04:05 +0000
Subject: [issue34321] mmap.mmap() should not necessarily clone the file
 descriptor
In-Reply-To: <1533216123.68.0.56676864532.issue34321@psf.upfronthosting.co.za>
Message-ID: <1611993845.65.0.598480132875.issue34321@roundup.psfhosted.org>


Change by Christian Heimes <lists at cheimes.de>:


----------
nosy: +christian.heimes
versions: +Python 3.10 -Python 2.7, Python 3.4, Python 3.5, Python 3.6, Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34321>
_______________________________________

From report at bugs.python.org  Sat Jan 30 03:11:46 2021
From: report at bugs.python.org (yeting li)
Date: Sat, 30 Jan 2021 08:11:46 +0000
Subject: [issue43075] ReDoS in request
Message-ID: <1611994306.46.0.333529770265.issue43075@roundup.psfhosted.org>


New submission from yeting li <liyt at ios.ac.cn>:

Hi,

I find this regex '(?:^|,)[ \t]*([^ \t]+)[ \t]+' may be stucked by input.

The vulnerable regex is located in https://github.com/python/cpython/blob/5c5a938573ce665f00e362c7766912d9b3f3b44e/Lib/urllib/request.py#L946

The ReDOS vulnerability of the regex is mainly due to the sub-pattern ',([^ \t]+)' and can be exploited with the following string
attack_str = "," * 10000

You can execute redos_python.py to reproduce the ReDos vulnerability.


I am willing to suggest that you replace '(?:^|,)[ \t]*([^ \t]+)[ \t]+' with '(?:^|,)[ \t]*([^ \t,]+)[ \t]+'

Looking forward for your response?!

Best,
Yeting Li

----------
components: Library (Lib)
files: redos_python.py
messages: 385974
nosy: yetingli
priority: normal
severity: normal
status: open
title: ReDoS in request
versions: Python 3.6, Python 3.7, Python 3.8, Python 3.9
Added file: https://bugs.python.org/file49778/redos_python.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43075>
_______________________________________

From report at bugs.python.org  Sat Jan 30 03:13:38 2021
From: report at bugs.python.org (Aleksandr Sigalov)
Date: Sat, 30 Jan 2021 08:13:38 +0000
Subject: [issue43076] str.split() indexing issue
Message-ID: <1611994418.49.0.767343252792.issue43076@roundup.psfhosted.org>


New submission from Aleksandr Sigalov <tegridycode at gmail.com>:

The following code ran in Google Colab...

=====================================

import sys

print (sys.version)

string = 'WORD=BIRD\nBIRD\nBIRD'

print(string.split())

print('========')

print(string.split('=')[0][0:3])
print(string.split('=')[1][0:3])

=================================

produces this...

=================================

3.6.9 (default, Oct  8 2020, 12:12:24) 
[GCC 8.4.0]
['WORD=BIRD', 'BIRD', 'BIRD']
========
WOR
BIR

=================================

Shouldn't index [0:3] give 4 chars? I looked in the docs and I could not find anything explaining this behavior.

=================================

Thanks.

----------
components: Build
messages: 385975
nosy: tegridycode
priority: normal
severity: normal
status: open
title: str.split() indexing issue
type: behavior
versions: Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43076>
_______________________________________

From report at bugs.python.org  Sat Jan 30 03:29:30 2021
From: report at bugs.python.org (Steven D'Aprano)
Date: Sat, 30 Jan 2021 08:29:30 +0000
Subject: [issue43076] str.split() indexing issue
In-Reply-To: <1611994418.49.0.767343252792.issue43076@roundup.psfhosted.org>
Message-ID: <1611995370.05.0.699533674993.issue43076@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

Hi Aleksandr,

In future, when posting what you think might be a bug, please try to cut the code down to the bare minimum needed. In this case, it doesn't matter at all that the strings you are processing come from splitting a larger string. split() has done its job, correctly, giving you a list of  substrings

    ['WORD', 'BIRD\nBIRD\nBIRD']

You then extract each item, and only then take the slice from it. So you can simplify the problem:

    string = 'WORD'
    print(string[0:3])

You ask:

"Shouldn't index [0:3] give 4 chars?"

No. It gives *three* characters. The end index is not included in the slice. Slice indexes occur *between* the characters:

    |W|O|R|D|
    0.1.2.3.4

so a slice from 0 to 3 includes only three characters, not four.

----------
nosy: +steven.daprano
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43076>
_______________________________________

From report at bugs.python.org  Sat Jan 30 03:32:15 2021
From: report at bugs.python.org (Steven D'Aprano)
Date: Sat, 30 Jan 2021 08:32:15 +0000
Subject: [issue43076] str.split() indexing issue
In-Reply-To: <1611994418.49.0.767343252792.issue43076@roundup.psfhosted.org>
Message-ID: <1611995535.29.0.361885085429.issue43076@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

Slicing is described here:

https://docs.python.org/3/tutorial/introduction.html

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43076>
_______________________________________

From report at bugs.python.org  Sat Jan 30 04:21:50 2021
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sat, 30 Jan 2021 09:21:50 +0000
Subject: [issue43075] ReDoS in request
In-Reply-To: <1611994306.46.0.333529770265.issue43075@roundup.psfhosted.org>
Message-ID: <1611998510.59.0.742881884435.issue43075@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +orsenthil, serhiy.storchaka
type:  -> security

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43075>
_______________________________________

From report at bugs.python.org  Sat Jan 30 05:09:55 2021
From: report at bugs.python.org (Ronald Oussoren)
Date: Sat, 30 Jan 2021 10:09:55 +0000
Subject: [issue43069] Python fails to read a script whose path is `/dev/fd/X`
In-Reply-To: <1611959541.65.0.0210578215871.issue43069@roundup.psfhosted.org>
Message-ID: <1612001395.86.0.0388615948664.issue43069@roundup.psfhosted.org>


Ronald Oussoren <ronaldoussoren at mac.com> added the comment:

I can reproduce the issue on macOS 11.1. 

As you write:
- running /dev/fd/X as a script fails silently if it refers to an smallish file
- reading /dev/fd/X referring to the same smallish files works fine (the ``open('/dev/fd/9').read()`` scenario. 

If I read the code in Modules/main.c correctly the main difference between the two scenario's is that the first scenario using the C stdio library to read the file (in pymain_run_file_obj), and the latter uses the normal Python io stack.

Reading /dev/fd/9 works fine when using either stdio or open/read in C code. 

I have not yet tried to untangle the layers of C code from pymain_run_file_obj to actually reading the script, there might be something there that sheds light on what's going on here.

I'm not yet willing to claim this is an OS bug as I've failed to reproduce this outside of Python.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43069>
_______________________________________

From report at bugs.python.org  Sat Jan 30 05:37:43 2021
From: report at bugs.python.org (miss-islington)
Date: Sat, 30 Jan 2021 10:37:43 +0000
Subject: [issue43047] logging.config formatters documentation is out of sync
 with code
In-Reply-To: <1611793169.86.0.0215519819351.issue43047@roundup.psfhosted.org>
Message-ID: <1612003063.32.0.125660796862.issue43047@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 62437a2fa9ebd2352dc1e15ae310895eef6ff981 by Ian Wienand in branch 'master':
bpo-43047: logging.config formatters documentation update (GH-24358)
https://github.com/python/cpython/commit/62437a2fa9ebd2352dc1e15ae310895eef6ff981


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43047>
_______________________________________

From report at bugs.python.org  Sat Jan 30 06:31:05 2021
From: report at bugs.python.org (Jan Christoph)
Date: Sat, 30 Jan 2021 11:31:05 +0000
Subject: [issue42050] ensurepip fails if cwd contains illformed setup.cf
In-Reply-To: <1602836843.13.0.778924482006.issue42050@roundup.psfhosted.org>
Message-ID: <1612006265.02.0.813576175675.issue42050@roundup.psfhosted.org>


Jan Christoph <con-f-use at gmx.net> added the comment:

Just wanted to say, I ran into this while using direnv. See the issue I opened before knowing of this one: https://bugs.python.org/issue43038

----------
nosy: +con-f-use
Added file: https://bugs.python.org/file49779/shell-session.txt

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42050>
_______________________________________

From report at bugs.python.org  Sat Jan 30 06:48:30 2021
From: report at bugs.python.org (Hergen Lange)
Date: Sat, 30 Jan 2021 11:48:30 +0000
Subject: [issue42896] Solaris 11.4 crle output not handled correctly
In-Reply-To: <1610391317.65.0.0245738213738.issue42896@roundup.psfhosted.org>
Message-ID: <1612007310.9.0.520887053543.issue42896@roundup.psfhosted.org>


Hergen Lange <hergen.lange at me.com> added the comment:

For python 3.8.7 should be:

--- util.py.broken      2021-01-30 12:15:35.047669249 +0100
+++ util.py     2021-01-30 12:28:04.425931587 +0100
@@ -251,6 +251,9 @@
                     line = line.strip()
                     if line.startswith(b'Default Library Path (ELF):'):
                         paths = os.fsdecode(line).split()[4]
+                    elif line.startswith(b'Default Library Path:'):
+                        ## allow for Solaris 11.4 output
+                        paths = os.fsdecode(line).split()[3]
 
             if not paths:
                 return None

----------
nosy: +hergen

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42896>
_______________________________________

From report at bugs.python.org  Sat Jan 30 07:21:41 2021
From: report at bugs.python.org (Alexey Izbyshev)
Date: Sat, 30 Jan 2021 12:21:41 +0000
Subject: [issue43069] Python fails to read a script whose path is `/dev/fd/X`
In-Reply-To: <1611959541.65.0.0210578215871.issue43069@roundup.psfhosted.org>
Message-ID: <1612009301.39.0.676842575334.issue43069@roundup.psfhosted.org>


Alexey Izbyshev <izbyshev at ispras.ru> added the comment:

I would suggest to start digging from the following piece of code in `maybe_pyc_file()` (Python/pythonrun.c):

     int ispyc = 0;
     if (ftell(fp) == 0) {
         if (fread(buf, 1, 2, fp) == 2 &&
             ((unsigned int)buf[1]<<8 | buf[0]) == halfmagic)
             ispyc = 1;
         rewind(fp);
     }

----------
nosy: +izbyshev

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43069>
_______________________________________

From report at bugs.python.org  Sat Jan 30 08:54:58 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Sat, 30 Jan 2021 13:54:58 +0000
Subject: [issue40455] GCC 10 compiler warnings
In-Reply-To: <1588279868.77.0.13865368461.issue40455@roundup.psfhosted.org>
Message-ID: <1612014898.6.0.962237095323.issue40455@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:


New changeset 86e322f1412be6c5a6c8fa8e73af68b99c42bb18 by Pablo Galindo in branch 'master':
bpo-40455: Fix gcc10+ warning about writing into a section of offset 0 (GH-24384)
https://github.com/python/cpython/commit/86e322f1412be6c5a6c8fa8e73af68b99c42bb18


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40455>
_______________________________________

From report at bugs.python.org  Sat Jan 30 08:55:23 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Sat, 30 Jan 2021 13:55:23 +0000
Subject: [issue40455] GCC 10 compiler warnings
In-Reply-To: <1588279868.77.0.13865368461.issue40455@roundup.psfhosted.org>
Message-ID: <1612014923.4.0.19304760441.issue40455@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na at python.org>:


----------
versions: +Python 3.10 -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40455>
_______________________________________

From report at bugs.python.org  Sat Jan 30 08:56:31 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Sat, 30 Jan 2021 13:56:31 +0000
Subject: [issue40455] GCC 10 compiler warnings
In-Reply-To: <1588279868.77.0.13865368461.issue40455@roundup.psfhosted.org>
Message-ID: <1612014991.92.0.543554292131.issue40455@roundup.psfhosted.org>


Dong-hee Na <donghee.na at python.org> added the comment:

Thank you Pablo!!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue40455>
_______________________________________

From report at bugs.python.org  Sat Jan 30 09:28:34 2021
From: report at bugs.python.org (Chih-Hsuan Yen)
Date: Sat, 30 Jan 2021 14:28:34 +0000
Subject: [issue41282] Deprecate and remove distutils
In-Reply-To: <1594542625.3.0.789939298104.issue41282@roundup.psfhosted.org>
Message-ID: <1612016914.23.0.0612604748085.issue41282@roundup.psfhosted.org>


Change by Chih-Hsuan Yen <yan12125 at gmail.com>:


----------
nosy:  -yan12125

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41282>
_______________________________________

From report at bugs.python.org  Sat Jan 30 10:13:03 2021
From: report at bugs.python.org (Juraj Sukop)
Date: Sat, 30 Jan 2021 15:13:03 +0000
Subject: [issue43053] Speed up math.isqrt, again
In-Reply-To: <1611821006.77.0.580238316666.issue43053@roundup.psfhosted.org>
Message-ID: <1612019583.0.0.136424744258.issue43053@roundup.psfhosted.org>


Juraj Sukop <juraj.sukop at gmail.com> added the comment:

Mark, thank you very much for the thorough reply!

I believe it is not for me to say whether the complication is worth it or not. What really huge numbers goes, if I'm not mistaken, the original `isqrt` is already "fast" and only constant speed-up is possible.

I was also trying to speed up the last correction, i.e. that full-width multiplication, but didn't get too far (only M(n) -> M(n/2)). Continuing from `isqrt_2`:

    a = (a << l) + ((n - (a**2 << 2*l)) >> l)//a//2
    return a - (a*a > n)
    
    a = (a << l) + ((n - (a**2 << 2*l)) >> (l + 1))//a
    return a - (a**2 > n)
    
    x = a
    a = (x << l) + ((n - (x**2 << 2*l)) >> (l + 1))//x
    return a - (((x << l) + ((n - (x**2 << 2*l)) >> (l + 1))//x)**2 > n)
    
    x = a
    x2 = x**2
    a = (x << l) + ((n - (x2 << 2*l)) >> (l + 1))//x
    return a - (((x << l) + ((n - (x2 << 2*l)) >> (l + 1))//x)**2 > n)
    
    x = a
    x2 = x**2
    t = (n - (x2 << 2*l)) >> (l + 1)
    u = t//x
    a = (x << l) + u
    b = ((x << l) + u)**2
    return a - (b > n)
    
    x = a
    x2 = x**2
    t = (n - (x2 << 2*l)) >> (l + 1)
    u = t//x
    a = (x << l) + u
    b = ((x << l)**2 + 2*(x << l)*u + u**2)
    return a - (b > n)
    
    x = a
    x2 = x**2
    t = (n - (x2 << 2*l)) >> (l + 1)
    u, v = divmod(t, x)
    a = (x << l) + u
    b = ((x2 << 2*l) + ((t - v) << (l + 1)) + u**2)
    return a - (b > n)

But then I got stuck on that `u**2`. The above should be a bit faster but probably is not worth the complication. On the other hand, if it was worth the complication, each iteration would use only single half width multiplication as `x2` of one interaction is `b` of previous iteration.

Another idea maybe worth trying (only in C) is to use such an `l` during the iterations that it would make the numbers land on the word boundaries. In other words, computing few more bits here and there may not hurt the performance much but it would replace the shifts by pointer arithmetic. Here the only change is `//64*64`:

    def isqrt_3(n):
        l = (n.bit_length() - 1)//4//64*64
        a = isqrt(n >> 2*l)
        a = (a << l) + ((n - (a**2 << 2*l)) >> l)//a//2
        return a - (a*a > n)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43053>
_______________________________________

From report at bugs.python.org  Sat Jan 30 10:18:41 2021
From: report at bugs.python.org (Paul Moore)
Date: Sat, 30 Jan 2021 15:18:41 +0000
Subject: [issue43077] Update bundled pip to 21.0.1 and setuptools to 52.0.0
Message-ID: <1612019921.62.0.653210880281.issue43077@roundup.psfhosted.org>


New submission from Paul Moore <p.f.moore at gmail.com>:

I've just released pip 21.0.1, so this updates the bundled copy (as well as updating setuptools).

I assume this should be backported to 3.8 and 3.9.

----------
components: Library (Lib)
messages: 385986
nosy: paul.moore
priority: normal
pull_requests: 23201
severity: normal
status: open
title: Update bundled pip to 21.0.1 and setuptools to 52.0.0
type: behavior
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43077>
_______________________________________

From report at bugs.python.org  Sat Jan 30 10:23:45 2021
From: report at bugs.python.org (Paul Moore)
Date: Sat, 30 Jan 2021 15:23:45 +0000
Subject: [issue43077] Update bundled pip to 21.0.1 and setuptools to 52.0.0
In-Reply-To: <1612019921.62.0.653210880281.issue43077@roundup.psfhosted.org>
Message-ID: <1612020225.06.0.00133026522358.issue43077@roundup.psfhosted.org>


Change by Paul Moore <p.f.moore at gmail.com>:


----------
assignee:  -> paul.moore
nosy: +Marcus.Smith, dstufft, ncoghlan, pradyunsg
stage:  -> patch review

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43077>
_______________________________________

From report at bugs.python.org  Sat Jan 30 10:26:24 2021
From: report at bugs.python.org (Dong-hee Na)
Date: Sat, 30 Jan 2021 15:26:24 +0000
Subject: [issue42939] Linux's chattr i.e. ioctl(FS_IOC_SETFLAGS) is not
 supported in os.chflags()
In-Reply-To: <1610807134.64.0.859060580807.issue42939@roundup.psfhosted.org>
Message-ID: <1612020384.84.0.319287629939.issue42939@roundup.psfhosted.org>


Change by Dong-hee Na <donghee.na at python.org>:


----------
nosy: +corona10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42939>
_______________________________________

From report at bugs.python.org  Sat Jan 30 11:32:06 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 30 Jan 2021 16:32:06 +0000
Subject: [issue43075] ReDoS in request
In-Reply-To: <1611994306.46.0.333529770265.issue43075@roundup.psfhosted.org>
Message-ID: <1612024326.64.0.0986572248493.issue43075@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

I agree. There is no catastrophic backtracking here (it was fixed in issue39503), but the complexity of matching the regular expression is linear. Searching the pattern in a sequence of commas has quadratic complexity, because every step has linear complexity and we advance only one character at every attempt.

The proposed solution looks correct to me and fixes the issue. Yeting Li, do you mind to create a pull request for it? I can do it myself, but since you have found the problem and the solution, it would be better if the commit be attributed to you.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43075>
_______________________________________

From report at bugs.python.org  Sat Jan 30 11:32:26 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 30 Jan 2021 16:32:26 +0000
Subject: [issue43075] ReDoS in request
In-Reply-To: <1611994306.46.0.333529770265.issue43075@roundup.psfhosted.org>
Message-ID: <1612024346.79.0.31913701594.issue43075@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
stage:  -> needs patch
versions: +Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43075>
_______________________________________

From report at bugs.python.org  Sat Jan 30 11:43:05 2021
From: report at bugs.python.org (Paul Moore)
Date: Sat, 30 Jan 2021 16:43:05 +0000
Subject: [issue43077] Update bundled pip to 21.0.1 and setuptools to 52.0.0
In-Reply-To: <1612019921.62.0.653210880281.issue43077@roundup.psfhosted.org>
Message-ID: <1612024985.3.0.387208322949.issue43077@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:


New changeset 4d11ecbb5ed78e6259ee27289c7638aad795f473 by Paul Moore in branch 'master':
bpo-43077: Update bundled pip to 21.0.1 and setuptools to 52.0.0 (GH-24386)
https://github.com/python/cpython/commit/4d11ecbb5ed78e6259ee27289c7638aad795f473


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43077>
_______________________________________

From report at bugs.python.org  Sat Jan 30 11:50:43 2021
From: report at bugs.python.org (Paul Moore)
Date: Sat, 30 Jan 2021 16:50:43 +0000
Subject: [issue43077] Update bundled pip to 21.0.1 and setuptools to 52.0.0
In-Reply-To: <1612019921.62.0.653210880281.issue43077@roundup.psfhosted.org>
Message-ID: <1612025443.6.0.0532659396736.issue43077@roundup.psfhosted.org>


Change by Paul Moore <p.f.moore at gmail.com>:


----------
keywords: +patch
pull_requests: +23202
pull_request: https://github.com/python/cpython/pull/24387

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43077>
_______________________________________

From report at bugs.python.org  Sat Jan 30 11:50:47 2021
From: report at bugs.python.org (Hergen Lange)
Date: Sat, 30 Jan 2021 16:50:47 +0000
Subject: [issue42896] Solaris 11.4 crle output not handled correctly
In-Reply-To: <1610391317.65.0.0245738213738.issue42896@roundup.psfhosted.org>
Message-ID: <1612025447.63.0.946548218995.issue42896@roundup.psfhosted.org>


Hergen Lange <hergen.lange at me.com> added the comment:

Fix for python 3.8.7
Also added support for LD_CONFIG and LD_LIBRARY_PATH environment variables.

Patch File: py387_ctypes_util.patch

TEST successfull:
 
/opt/python/lib/python3.8/ctypes$ python3 util.py
libm.so.2
libc.so.1
libbz2.so.1
libx264.so.157
<CDLL 'libm.so', handle 7fffbf6f3d28 at 0x7fffbf513310>
<CDLL 'libcrypt.so', handle 7fffbf696750 at 0x7fffbf513310>
libcrypt.so.1

----------
versions:  -Python 3.10, Python 3.7, Python 3.9
Added file: https://bugs.python.org/file49780/py387_ctypes_util.patch

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42896>
_______________________________________

From report at bugs.python.org  Sat Jan 30 11:53:36 2021
From: report at bugs.python.org (Paul Moore)
Date: Sat, 30 Jan 2021 16:53:36 +0000
Subject: [issue43077] Update bundled pip to 21.0.1 and setuptools to 52.0.0
In-Reply-To: <1612019921.62.0.653210880281.issue43077@roundup.psfhosted.org>
Message-ID: <1612025616.03.0.496140446285.issue43077@roundup.psfhosted.org>


Change by Paul Moore <p.f.moore at gmail.com>:


----------
pull_requests: +23203
pull_request: https://github.com/python/cpython/pull/24388

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43077>
_______________________________________

From report at bugs.python.org  Sat Jan 30 12:36:12 2021
From: report at bugs.python.org (Rohan Prasad)
Date: Sat, 30 Jan 2021 17:36:12 +0000
Subject: [issue43078] Equality Errors when Unpickling and Pickling a
 Dictionary with a nan
Message-ID: <1612028172.34.0.735632313742.issue43078@roundup.psfhosted.org>


New submission from Rohan Prasad <rohandev.1200 at gmail.com>:

Hi,

I'm having a weird issue with floats in dictionaries and equality comparison (see attached screenshot for an example). When I create two dictionaries with a nan value they pass an equivalence test. However, if I pickle and unpickle one of the dictionaries they become no longer equivalent. I would expect that the behavior would be the same irrespective of whether they are pickled/unpickled. Is there something else I should be doing here or is there a way to easily resolve this (short of writing custom ways to compare equality)?

----------
files: numpy-nan-dict-error.png
messages: 385990
nosy: rp4fx12
priority: normal
severity: normal
status: open
title: Equality Errors when Unpickling and Pickling a Dictionary with a nan
type: behavior
versions: Python 3.7, Python 3.8
Added file: https://bugs.python.org/file49781/numpy-nan-dict-error.png

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43078>
_______________________________________

From report at bugs.python.org  Sat Jan 30 12:59:08 2021
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 30 Jan 2021 17:59:08 +0000
Subject: [issue43048] Printing RecursionError results in RecursionError
In-Reply-To: <1611798337.38.0.626995188313.issue43048@roundup.psfhosted.org>
Message-ID: <1612029548.2.0.887332839992.issue43048@roundup.psfhosted.org>


Irit Katriel <iritkatriel at yahoo.com> added the comment:

Maybe it is worth doing something less invasive in 3.9, such as catching the recursion error and truncating the output?

----------
status: closed -> open
versions:  -Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43048>
_______________________________________

From report at bugs.python.org  Sat Jan 30 13:00:11 2021
From: report at bugs.python.org (Irit Katriel)
Date: Sat, 30 Jan 2021 18:00:11 +0000
Subject: [issue43048] Printing RecursionError results in RecursionError
In-Reply-To: <1611798337.38.0.626995188313.issue43048@roundup.psfhosted.org>
Message-ID: <1612029611.12.0.2195373069.issue43048@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
keywords: +easy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43048>
_______________________________________

From report at bugs.python.org  Sat Jan 30 13:30:14 2021
From: report at bugs.python.org (Christian Heimes)
Date: Sat, 30 Jan 2021 18:30:14 +0000
Subject: [issue42982] Update suggested number of iterations for pbkdf2_hmac()
In-Reply-To: <1611173199.26.0.961948207202.issue42982@roundup.psfhosted.org>
Message-ID: <1612031414.81.0.173875825931.issue42982@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

PBKDF2-HMAC is a serialized algorithm. It cannot be parallized. That means the runtime depends on single core-performance. The single core-performance of desktop and server CPUs hasn't improved much in the last decade. Modern CPUs have more cores, larger caches, and better IPC. Intel Nehalem architecture from 2009 had up to 3.33 GHz. Fast 2020 Comet Lake CPUs have up to 3.7 GHz base frequence and about 5GHz turbo.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42982>
_______________________________________

From report at bugs.python.org  Sat Jan 30 13:59:10 2021
From: report at bugs.python.org (Senthil Kumaran)
Date: Sat, 30 Jan 2021 18:59:10 +0000
Subject: [issue43075] ReDoS in request
In-Reply-To: <1611994306.46.0.333529770265.issue43075@roundup.psfhosted.org>
Message-ID: <1612033150.25.0.61509215198.issue43075@roundup.psfhosted.org>


Senthil Kumaran <senthil at uthcode.com> added the comment:

+1. The suggested fix looks good to me.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43075>
_______________________________________

From report at bugs.python.org  Sat Jan 30 15:41:43 2021
From: report at bugs.python.org (Jim Jewett)
Date: Sat, 30 Jan 2021 20:41:43 +0000
Subject: [issue24275] lookdict_* give up too soon
In-Reply-To: <1432444109.96.0.971324850141.issue24275@psf.upfronthosting.co.za>
Message-ID: <1612039303.28.0.198654541595.issue24275@roundup.psfhosted.org>


Jim Jewett <jimjjewett at gmail.com> added the comment:

This was originally "can be reopened if a patch is submitted" and Hristo Venev has now done so. Therefore, I am reopening.

----------
resolution: rejected -> remind
stage:  -> patch review
status: closed -> open
versions: +Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24275>
_______________________________________

From report at bugs.python.org  Sat Jan 30 15:50:43 2021
From: report at bugs.python.org (Eryk Sun)
Date: Sat, 30 Jan 2021 20:50:43 +0000
Subject: [issue42939] Linux's chattr i.e. ioctl(FS_IOC_SETFLAGS) is not
 supported in os.chflags()
In-Reply-To: <1610807134.64.0.859060580807.issue42939@roundup.psfhosted.org>
Message-ID: <1612039843.43.0.317892897263.issue42939@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

bpo-39533 is a related issue that seeks to support the Linux statx() system call. A statx record includes an stx_attributes field, which supports the following file attributes that can be set with chattr:

    [a]ppend    : STATX_ATTR_APPEND
    [c]ompressed: STATX_ATTR_COMPRESSED
    no [d]ump   : STATX_ATTR_NODUMP
    [i]mmutable : STATX_ATTR_IMMUTABLE
    da[x]       : STATX_ATTR_DAX (5.8)

and the following read-only file attributes that can be listed with lsattr:

    [E]ncrypted : STATX_ATTR_ENCRYPTED
    [V]erity    : STATX_ATTR_VERITY (5.5)

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42939>
_______________________________________

From report at bugs.python.org  Sat Jan 30 15:59:25 2021
From: report at bugs.python.org (Jim Jewett)
Date: Sat, 30 Jan 2021 20:59:25 +0000
Subject: [issue24275] lookdict_* give up too soon
In-Reply-To: <1432444109.96.0.971324850141.issue24275@psf.upfronthosting.co.za>
Message-ID: <1612040365.74.0.927859111752.issue24275@roundup.psfhosted.org>


Jim Jewett <jimjjewett at gmail.com> added the comment:

Based on Hristo's timing, it appears to be a clear win.  

A near-wash for truly string-only dicts that shouldn't be effected; a near-wash for looking up non-(exact-)strings, and a nearly 40% speedup for the target case of looking up but not inserting a non-string or string subclass, then looking up strings thereafter. 

Additional comments:

Barring objections, I will promote from patch review to commit review when I've had a chance to look more closely.  I don't have commit privs, but I think some of the others following this issue do.

The test looks pretty good enough -- good enough that I wonder if I'm missing something on the parts that seem odd.  It would be great if you either cleaned them up or commented to explain why:

Why is the first key vx1, which seems, if anything, like a variable? 
 Why not k1 or string_key?

Why is the first key built up as vx='x'; vx += '1' instead of just k1="x1"?

Using a str subclass in the test is a great idea, and you've created a truly minimal one.  It would probably be good to *also* test with a non-string, like 3 or 42.0.  I can't imagine this affecting things (unless you missed an eager lookdict demotion somewhere), but it would be good to have that path documented against regression.

This seems like a test that could probably be rolled into a bigger testfile for the actual commit.  I don't have the name of such an appropriate file at hand right now, but will try to find it on a deeper review.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24275>
_______________________________________

From report at bugs.python.org  Sat Jan 30 16:28:47 2021
From: report at bugs.python.org (Hristo Venev)
Date: Sat, 30 Jan 2021 21:28:47 +0000
Subject: [issue24275] lookdict_* give up too soon
In-Reply-To: <1432444109.96.0.971324850141.issue24275@psf.upfronthosting.co.za>
Message-ID: <1612042127.53.0.603229330005.issue24275@roundup.psfhosted.org>


Hristo Venev <hristo at venev.name> added the comment:

> Why is the first key built up as vx='x'; vx += '1' instead of just k1="x1"?

I wanted to construct a key that is equal to, but not the same object as, `'x1'`. Consider this example:

    assert 'x1' is 'x1'
    spam = 'x1'
    assert spam is 'x1'
    eggs = 'x'
    eggs += '1'
    assert eggs == 'x1'
    assert eggs is not 'x1'
    assert sys.intern(eggs) is 'x1'

When doing a dict lookup and the lookup key is the same object as a stored entry, `__eq__` is not called. Lookups are then significantly faster, maybe 20%.

Consider this example:

    class EqTest:
        def __eq__(self, other):
            raise RuntimeError
        def __hash__(self):
            return id(self)
    
    adict = {}
    k1 = EqTest()
    k2 = EqTest()
    
    adict[k1] = 42
    adict[k2] = 43
    print(adict[k1], adict[k2])

Here `k1` is considered the same as `k1` and `k2` is considered the same as `k2`. However, `k1` and `k2` are considered distinct and never compared because they have different hashes.

However, if we were to set `EqTest.__hash__ = lambda self: 42`, we'd get a RuntimeError when we try to set `adict[k2]` because it would get compared for equality with `k1`.

Even if `__eq__` works, we can get some interesting behaviors. For example, when using multiple instances of `float('nan')` as keys.

> Using a str subclass in the test is a great idea, and you've created a truly minimal one.  It would probably be good to *also* test with a non-string, like 3 or 42.0.  I can't imagine this affecting things (unless you missed an eager lookdict demotion somewhere), but it would be good to have that path documented against regression.

I also tested a custom class that compares equal to strings. Other than being much slower, there weren't any significant differences. I also did some checks with int key lookups, which obviously fail with KeyError. They did not make the performance worse for the subsequent str lookups.

I will try to make a proper test tomorrow.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24275>
_______________________________________

From report at bugs.python.org  Sat Jan 30 16:52:40 2021
From: report at bugs.python.org (Dennis Sweeney)
Date: Sat, 30 Jan 2021 21:52:40 +0000
Subject: [issue43078] Equality Errors when Unpickling and Pickling a
 Dictionary with a nan
In-Reply-To: <1612028172.34.0.735632313742.issue43078@roundup.psfhosted.org>
Message-ID: <1612043560.01.0.905220074594.issue43078@roundup.psfhosted.org>


Dennis Sweeney <sweeney.dennis650 at gmail.com> added the comment:

I think this is the expected behavior.

It is expected by IEEE 754 that nan != nan, so that behavior exists:

>>> nan = float('nan')
>>> nan2 = float('nan')
>>> assert nan != nan2
>>> assert nan != nan

However, for "practicality beats purity" (speed) reasons, we compare containers by first checking if the entries are identical (aliases of the same object), before falling back to the actual comparisons. So identical entries make for equal containers, even if the entries don't compare equal.

>>> assert nan is nan       # quick check for identity succeeds,
>>> assert [nan] == [nan]   # therefore these compare equal

>>> assert nan is not nan2  # quick check for identity fails,
>>> assert nan != nan2      # fall back to actual comparison, which fails
>>> assert [nan] != [nan2]  # therefore these do not compare equal

When you serialize and deserialize the container with pickle, you make new entries that are no longer aliases.

>From https://docs.python.org/3.9/reference/expressions.html#comparisons:
"The built-in containers typically assume identical objects are equal to themselves."

----------
nosy: +Dennis Sweeney

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43078>
_______________________________________

From report at bugs.python.org  Sat Jan 30 17:17:20 2021
From: report at bugs.python.org (Al)
Date: Sat, 30 Jan 2021 22:17:20 +0000
Subject: [issue43079] wrong IP address range given for ipv4_mapped
Message-ID: <1612045040.37.0.190941589781.issue43079@roundup.psfhosted.org>


New submission from Al <awpythonbugs at sunnyside.com>:

https://docs.python.org/3.9/library/ipaddress.html

This documentation for the 'ipaddress' IPv4/IPv6 Manipulation Library incorrectly states the address range for 'ipv4_mapped' as ::FFFF/96 (which means 0:0:0:0:0:0:0:FFFF/96).  This is just flat out wrong.  There are some websites out there, e.g. APNIC, that also have this error.

The correct address range can be expressed by any of the following methods:
1) 0:0:0:0:0:FFFF:0:0/96
2) ::FFFF:0:0/96
3) 0:0:0:0:0:FFFF::/96

----------
assignee: docs at python
components: Documentation
messages: 385999
nosy: alwhaley, docs at python
priority: normal
severity: normal
status: open
title: wrong IP address range given for ipv4_mapped
type: behavior
versions: Python 3.10, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43079>
_______________________________________

From report at bugs.python.org  Sat Jan 30 17:24:18 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 30 Jan 2021 22:24:18 +0000
Subject: [issue24275] lookdict_* give up too soon
In-Reply-To: <1432444109.96.0.971324850141.issue24275@psf.upfronthosting.co.za>
Message-ID: <1612045458.03.0.617779123398.issue24275@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Please test also creating a large dict with string-only or non-string keys. Since you add a code in insertdict() it can potentially affects performance.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24275>
_______________________________________

From report at bugs.python.org  Sat Jan 30 17:40:53 2021
From: report at bugs.python.org (Rohan Prasad)
Date: Sat, 30 Jan 2021 22:40:53 +0000
Subject: [issue43078] Equality Errors when Unpickling and Pickling a
 Dictionary with a nan
In-Reply-To: <1612028172.34.0.735632313742.issue43078@roundup.psfhosted.org>
Message-ID: <1612046453.33.0.78826160771.issue43078@roundup.psfhosted.org>


Rohan Prasad <rohandev.1200 at gmail.com> added the comment:

I see this makes a ton of sense, thanks! I'll close this issue.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43078>
_______________________________________

From report at bugs.python.org  Sat Jan 30 19:14:38 2021
From: report at bugs.python.org (Lewis Gaul)
Date: Sun, 31 Jan 2021 00:14:38 +0000
Subject: [issue43080] pprint for dataclass instances
Message-ID: <1612052078.12.0.741479641556.issue43080@roundup.psfhosted.org>


New submission from Lewis Gaul <lewis.gaul at gmail.com>:

Currently the pprint module does not have support for dataclasses. I have implemented support for this and will link the PR once I have the issue number!

See also issue37376 for SimpleNamespace support.

----------
components: Library (Lib)
messages: 386002
nosy: LewisGaul, eric.snow, rhettinger, serhiy.storchaka
priority: normal
severity: normal
status: open
title: pprint for dataclass instances
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43080>
_______________________________________

From report at bugs.python.org  Sat Jan 30 19:19:40 2021
From: report at bugs.python.org (Lewis Gaul)
Date: Sun, 31 Jan 2021 00:19:40 +0000
Subject: [issue43080] pprint for dataclass instances
In-Reply-To: <1612052078.12.0.741479641556.issue43080@roundup.psfhosted.org>
Message-ID: <1612052380.3.0.227520845638.issue43080@roundup.psfhosted.org>


Change by Lewis Gaul <lewis.gaul at gmail.com>:


----------
keywords: +patch
pull_requests: +23204
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24389

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43080>
_______________________________________

From report at bugs.python.org  Sat Jan 30 20:17:47 2021
From: report at bugs.python.org (Irit Katriel)
Date: Sun, 31 Jan 2021 01:17:47 +0000
Subject: [issue43042] Delete or merge redundant tutorial sentence.
In-Reply-To: <1611772942.43.0.309900316345.issue43042@roundup.psfhosted.org>
Message-ID: <1612055867.36.0.743061939155.issue43042@roundup.psfhosted.org>


Change by Irit Katriel <iritkatriel at yahoo.com>:


----------
keywords: +easy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43042>
_______________________________________

From report at bugs.python.org  Sat Jan 30 20:21:25 2021
From: report at bugs.python.org (Senthil Kumaran)
Date: Sun, 31 Jan 2021 01:21:25 +0000
Subject: [issue42967] [security] urllib.parse.parse_qsl(): Web cache poisoning
 - `; ` as a query args separator
In-Reply-To: <1611068809.96.0.58823274544.issue42967@roundup.psfhosted.org>
Message-ID: <1612056085.66.0.364527500827.issue42967@roundup.psfhosted.org>


Senthil Kumaran <senthil at uthcode.com> added the comment:

Ned, and others watching.

In future versions of Python, we can use only "&" based separator. But I am not certain what should be proposed for the older releases of Python.   

Adam's Patch is a good one to specify explicitly specify the separator, but it changes the expectations in our test cases and is not backwards compatible. 

Victor / Marc-Andre: Need your recommendation here.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Sat Jan 30 20:21:35 2021
From: report at bugs.python.org (Senthil Kumaran)
Date: Sun, 31 Jan 2021 01:21:35 +0000
Subject: [issue42967] [security] urllib.parse.parse_qsl(): Web cache poisoning
 - `; ` as a query args separator
In-Reply-To: <1611068809.96.0.58823274544.issue42967@roundup.psfhosted.org>
Message-ID: <1612056095.29.0.0128069448395.issue42967@roundup.psfhosted.org>


Change by Senthil Kumaran <senthil at uthcode.com>:


----------
assignee:  -> orsenthil

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42967>
_______________________________________

From report at bugs.python.org  Sun Jan 31 00:12:49 2021
From: report at bugs.python.org (yeting li)
Date: Sun, 31 Jan 2021 05:12:49 +0000
Subject: [issue43075] ReDoS in request
In-Reply-To: <1611994306.46.0.333529770265.issue43075@roundup.psfhosted.org>
Message-ID: <1612069969.79.0.142277067333.issue43075@roundup.psfhosted.org>


Change by yeting li <liyt at ios.ac.cn>:


----------
keywords: +patch
pull_requests: +23205
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/24391

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43075>
_______________________________________

From report at bugs.python.org  Sun Jan 31 00:19:10 2021
From: report at bugs.python.org (Berker Peksag)
Date: Sun, 31 Jan 2021 05:19:10 +0000
Subject: [issue43059] sqlite3: Externally developed?
In-Reply-To: <1611868031.72.0.138640197563.issue43059@roundup.psfhosted.org>
Message-ID: <1612070350.46.0.908259818456.issue43059@roundup.psfhosted.org>


Berker Peksag <berker.peksag at gmail.com> added the comment:


New changeset e60344364245a23a7a1b25d5ebce6833652a656c by L in branch 'master':
bpo-43059: Remove reference to legacy external sqlite3 repository (GH-24364)
https://github.com/python/cpython/commit/e60344364245a23a7a1b25d5ebce6833652a656c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43059>
_______________________________________

From report at bugs.python.org  Sun Jan 31 00:19:33 2021
From: report at bugs.python.org (miss-islington)
Date: Sun, 31 Jan 2021 05:19:33 +0000
Subject: [issue43059] sqlite3: Externally developed?
In-Reply-To: <1611868031.72.0.138640197563.issue43059@roundup.psfhosted.org>
Message-ID: <1612070373.11.0.0844445997085.issue43059@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 7.0 -> 8.0
pull_requests: +23206
pull_request: https://github.com/python/cpython/pull/24392

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43059>
_______________________________________

From report at bugs.python.org  Sun Jan 31 00:19:40 2021
From: report at bugs.python.org (miss-islington)
Date: Sun, 31 Jan 2021 05:19:40 +0000
Subject: [issue43059] sqlite3: Externally developed?
In-Reply-To: <1611868031.72.0.138640197563.issue43059@roundup.psfhosted.org>
Message-ID: <1612070380.73.0.678675973088.issue43059@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +23207
pull_request: https://github.com/python/cpython/pull/24393

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43059>
_______________________________________

From report at bugs.python.org  Sun Jan 31 00:21:31 2021
From: report at bugs.python.org (Berker Peksag)
Date: Sun, 31 Jan 2021 05:21:31 +0000
Subject: [issue43059] sqlite3: Externally developed?
In-Reply-To: <1611868031.72.0.138640197563.issue43059@roundup.psfhosted.org>
Message-ID: <1612070491.69.0.343373088887.issue43059@roundup.psfhosted.org>


Berker Peksag <berker.peksag at gmail.com> added the comment:


New changeset 926ca51be4b9b80c41a647bbc2fb9c40ff108ff0 by Miss Islington (bot) in branch '3.9':
bpo-43059: Remove reference to legacy external sqlite3 repository (GH-24364)
https://github.com/python/cpython/commit/926ca51be4b9b80c41a647bbc2fb9c40ff108ff0


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43059>
_______________________________________

From report at bugs.python.org  Sun Jan 31 00:21:57 2021
From: report at bugs.python.org (Berker Peksag)
Date: Sun, 31 Jan 2021 05:21:57 +0000
Subject: [issue43059] sqlite3: Externally developed?
In-Reply-To: <1611868031.72.0.138640197563.issue43059@roundup.psfhosted.org>
Message-ID: <1612070517.56.0.52948061231.issue43059@roundup.psfhosted.org>


Berker Peksag <berker.peksag at gmail.com> added the comment:


New changeset de76ce540ed013a31d4c80bca2587a2dd7c23652 by Miss Islington (bot) in branch '3.8':
bpo-43059: Remove reference to legacy external sqlite3 repository (GH-24364)
https://github.com/python/cpython/commit/de76ce540ed013a31d4c80bca2587a2dd7c23652


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43059>
_______________________________________

From report at bugs.python.org  Sun Jan 31 00:26:27 2021
From: report at bugs.python.org (Berker Peksag)
Date: Sun, 31 Jan 2021 05:26:27 +0000
Subject: [issue43059] sqlite3: Externally developed?
In-Reply-To: <1611868031.72.0.138640197563.issue43059@roundup.psfhosted.org>
Message-ID: <1612070787.64.0.90289173801.issue43059@roundup.psfhosted.org>


Berker Peksag <berker.peksag at gmail.com> added the comment:

Yes, version attributes should be deprecated and properly documented in Doc/whatsnew/3.10.rst before removal. I remember we broke Mailman when we removed a dunder attribute from the mail package.

Thank you for the PR!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43059>
_______________________________________

From report at bugs.python.org  Sun Jan 31 00:26:56 2021
From: report at bugs.python.org (Xinmeng Xia)
Date: Sun, 31 Jan 2021 05:26:56 +0000
Subject: [issue43081] Recursive call crash module multiprocessing
Message-ID: <1612070816.14.0.20481029059.issue43081@roundup.psfhosted.org>


New submission from Xinmeng Xia <xiaxm at smail.nju.edu.cn>:

The following code recursively calls function test_forkserver(). However, the output is not expected RecursionError(recursively calling) or OSError(too many open files). An unexpected EOFError ( inside module multiprocessing, not this code itself) is reported. According to the error message, Python interpreter seems to behavior abnormal on line 1, "import multiprocessing". I try other cases in my machine, multiprocessing module can work well. Only this case will crash module multiprocessing.

test.py
======================================
import multiprocessing
import os

def do(i):
      print(test_forkserver(), os.getpid())

def test_forkserver():
      mp = multiprocessing.get_context('forkserver')
      mp.Pool(2).map(do(mp), range(3))
if __name__ == '__main__':
      test_forkserver()
======================================

Attached output:
------------------------------------------------------------------
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/usr/local/python3.10/lib/python3.10/multiprocessing/forkserver.py", line 258, in main
    fds = reduction.recvfds(s, MAXFDS_TO_SEND + 1)
  File "/usr/local/python3.10/lib/python3.10/multiprocessing/reduction.py", line 159, in recvfds
    raise EOFError
EOFError
...
------------------------------------------------------------------

System Info:
>>uname -a
Linux xxm 5.4.0-65-generic #73-Ubuntu SMP Mon Jan 18 17:25:17 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

>>python -V
Python 3.10.0a4

----------
components: Library (Lib)
messages: 386008
nosy: xxm
priority: normal
severity: normal
status: open
title: Recursive call crash module multiprocessing
type: crash
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43081>
_______________________________________

From report at bugs.python.org  Sun Jan 31 00:44:12 2021
From: report at bugs.python.org (yeting li)
Date: Sun, 31 Jan 2021 05:44:12 +0000
Subject: [issue43075] ReDoS in request
In-Reply-To: <1611994306.46.0.333529770265.issue43075@roundup.psfhosted.org>
Message-ID: <1612071852.1.0.260834976607.issue43075@roundup.psfhosted.org>


yeting li <liyt at ios.ac.cn> added the comment:

Thank you for your quick reply!

I agree. Catastrophic backtracking is typically regarded as a regex with exponential worst-case matching time. Besides regexes with exponential worst-case time complexity, ReDoS also includes ones with  other super-linear (e.g., quadratic) worst-case time complexity.


Thanks again for your reply, I'm trying to create a pull request for it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43075>
_______________________________________

From report at bugs.python.org  Sun Jan 31 02:39:13 2021
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sun, 31 Jan 2021 07:39:13 +0000
Subject: [issue43059] sqlite3: Externally developed?
In-Reply-To: <1611868031.72.0.138640197563.issue43059@roundup.psfhosted.org>
Message-ID: <1612078753.48.0.173551883502.issue43059@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

mock also broke similar package on removing __version__. See also https://bugs.python.org/issue31826

----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43059>
_______________________________________

From report at bugs.python.org  Sun Jan 31 02:57:00 2021
From: report at bugs.python.org (diegoe)
Date: Sun, 31 Jan 2021 07:57:00 +0000
Subject: [issue43082] descriptor howto: typo in "Definition and introduction"
Message-ID: <1612079819.98.0.888102810331.issue43082@roundup.psfhosted.org>


New submission from diegoe <diegoe at gnome.org>:

In
  https://docs.python.org/3.10/howto/descriptor.html#definition-and-introduction

The paragraph reads:
"""
Definition and introduction

In general, a descriptor is an attribute value that has one of the methods in the descriptor protocol. Those methods are __get__(), __set__(), and __delete__(). If any of those methods are defined for an the attribute, it is said to be a descriptor.
"""

I believe it should be either "an attribute" or "the attribute" in the last sentence. Probably missed it because both options would read fine.

----------
assignee: docs at python
components: Documentation
messages: 386011
nosy: diegoe, docs at python
priority: normal
severity: normal
status: open
title: descriptor howto: typo in "Definition and introduction"
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43082>
_______________________________________

From report at bugs.python.org  Sun Jan 31 03:07:54 2021
From: report at bugs.python.org (diegoe)
Date: Sun, 31 Jan 2021 08:07:54 +0000
Subject: [issue43082] descriptor howto: typo in "Definition and introduction"
In-Reply-To: <1612079819.98.0.888102810331.issue43082@roundup.psfhosted.org>
Message-ID: <1612080474.0.0.478772813801.issue43082@roundup.psfhosted.org>


Change by diegoe <diegoe at gnome.org>:


----------
keywords: +patch
pull_requests: +23208
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24394

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43082>
_______________________________________

From report at bugs.python.org  Sun Jan 31 04:47:37 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 31 Jan 2021 09:47:37 +0000
Subject: [issue43082] descriptor howto: typo in "Definition and introduction"
In-Reply-To: <1612079819.98.0.888102810331.issue43082@roundup.psfhosted.org>
Message-ID: <1612086457.39.0.861612451598.issue43082@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
assignee: docs at python -> rhettinger
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43082>
_______________________________________

From report at bugs.python.org  Sun Jan 31 04:53:47 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 31 Jan 2021 09:53:47 +0000
Subject: [issue43080] pprint for dataclass instances
In-Reply-To: <1612052078.12.0.741479641556.issue43080@roundup.psfhosted.org>
Message-ID: <1612086827.75.0.519474468262.issue43080@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Since a dataclass can do anything a regular class can do, it is probably too general to have a special case for pprint.

----------
assignee:  -> eric.smith
nosy: +eric.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43080>
_______________________________________

From report at bugs.python.org  Sun Jan 31 06:01:53 2021
From: report at bugs.python.org (Christian Heimes)
Date: Sun, 31 Jan 2021 11:01:53 +0000
Subject: [issue34321] mmap.mmap() should not necessarily clone the file
 descriptor
In-Reply-To: <1533216123.68.0.56676864532.issue34321@psf.upfronthosting.co.za>
Message-ID: <1612090913.78.0.730809903005.issue34321@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

This issue came up in another discussion. I have given it some thought. mmap.mmap() dups the FD because its close() and __exit__() methods close(2) the fd. The size() and resize() methods use the fd to determine the size of the underlying file or to resize the file.

The easiest way to solve the issue while avoind footguns, is an option to not track the fd at all, e.g. "trackfd" with default "True". mmap(..., trackfd=False) would neither dup the fd nor store the fd in its internal struct. In untracked fd case, size() and resize() would no longer work. That's totally fine for mappings without PROT_WRITE.

It's safe to close the fd after mmap call, see https://man7.org/linux/man-pages/man2/mmap.2.html

> After the mmap() call has returned, the file descriptor, fd, can
> be closed immediately without invalidating the mapping.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34321>
_______________________________________

From report at bugs.python.org  Sun Jan 31 07:52:46 2021
From: report at bugs.python.org (Lewis Gaul)
Date: Sun, 31 Jan 2021 12:52:46 +0000
Subject: [issue43080] pprint for dataclass instances
In-Reply-To: <1612052078.12.0.741479641556.issue43080@roundup.psfhosted.org>
Message-ID: <1612097566.96.0.141121093848.issue43080@roundup.psfhosted.org>


Lewis Gaul <lewis.gaul at gmail.com> added the comment:

> a dataclass can do anything a regular class can do

Agreed, but isn't that also true of any subclasses of currently supported types? In particular 'UserDict', 'UserList' and 'UserString', which all have explicit support in pprint and are intended for "easier subclassing" according to the docs.

I'm also not sure why it would be a reason for not giving it pprint handling (in the case where there's no user-defined __repr__). Is there any harm in doing so? 

I'd consider dataclasses one of the primary choices for storing data in modern Python (e.g. for converting to/from JSON/YAML), and may well be used for storing nested data, which can be very hard to read without some mechanism for pretty-printing.

Indeed, the dataclasses.asdict() function recurses into dataclass fields. This gives the option of pprint(dataclasses.asdict(my_dataclass)), but at the cost of losing the class names and any custom reprs.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43080>
_______________________________________

From report at bugs.python.org  Sun Jan 31 08:47:29 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 31 Jan 2021 13:47:29 +0000
Subject: [issue43083] Minor errors related to error handling in _sqlite3 module
Message-ID: <1612100849.9.0.66215198535.issue43083@roundup.psfhosted.org>


New submission from Serhiy Storchaka <storchaka+cpython at gmail.com>:

There are few minor errors in the _sqlite3:

* In two places the result of PyList_Append() is not checked.
* The lastrowid field of pysqlite_Cursor can contain a reference to destroyed object when GIL is released for calling sqlite3_last_insert_rowid().
* Exception after PyDict_DelItem() in pysqlite_connection_create_collation_impl() is not cleared before calling _pysqlite_seterror() (and there is always an exception set if callable is None). Unlikely it can cause problems, but it is better to be explicit.

----------
components: Extension Modules
messages: 386015
nosy: berker.peksag, ghaering, serhiy.storchaka
priority: normal
severity: normal
status: open
title: Minor errors related to error handling in _sqlite3 module
versions: Python 3.10, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43083>
_______________________________________

From report at bugs.python.org  Sun Jan 31 08:49:08 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 31 Jan 2021 13:49:08 +0000
Subject: [issue43083] Minor errors related to error handling in _sqlite3 module
In-Reply-To: <1612100849.9.0.66215198535.issue43083@roundup.psfhosted.org>
Message-ID: <1612100948.12.0.32763518257.issue43083@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
keywords: +patch
pull_requests: +23209
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24395

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43083>
_______________________________________

From report at bugs.python.org  Sun Jan 31 08:55:22 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 31 Jan 2021 13:55:22 +0000
Subject: [issue43030] signed/unsigned mismatch in Py_UNICODE_ISSPACE macro
In-Reply-To: <1611664822.48.0.67078426677.issue43030@roundup.psfhosted.org>
Message-ID: <1612101322.31.0.35053625378.issue43030@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 42b1806af90b86ec393ca7da14e99ce95ec6c53b by Serhiy Storchaka in branch 'master':
bpo-43030: Fixed a compiler warning in Py_UNICODE_ISSPACE with signed wchar_t (GH-24350)
https://github.com/python/cpython/commit/42b1806af90b86ec393ca7da14e99ce95ec6c53b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43030>
_______________________________________

From report at bugs.python.org  Sun Jan 31 08:55:30 2021
From: report at bugs.python.org (miss-islington)
Date: Sun, 31 Jan 2021 13:55:30 +0000
Subject: [issue43030] signed/unsigned mismatch in Py_UNICODE_ISSPACE macro
In-Reply-To: <1611664822.48.0.67078426677.issue43030@roundup.psfhosted.org>
Message-ID: <1612101330.74.0.662637350004.issue43030@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 4.0 -> 5.0
pull_requests: +23210
pull_request: https://github.com/python/cpython/pull/24396

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43030>
_______________________________________

From report at bugs.python.org  Sun Jan 31 08:55:43 2021
From: report at bugs.python.org (miss-islington)
Date: Sun, 31 Jan 2021 13:55:43 +0000
Subject: [issue43030] signed/unsigned mismatch in Py_UNICODE_ISSPACE macro
In-Reply-To: <1611664822.48.0.67078426677.issue43030@roundup.psfhosted.org>
Message-ID: <1612101343.14.0.0507707578105.issue43030@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +23211
pull_request: https://github.com/python/cpython/pull/24397

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43030>
_______________________________________

From report at bugs.python.org  Sun Jan 31 09:09:31 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 31 Jan 2021 14:09:31 +0000
Subject: [issue43080] pprint for dataclass instances
In-Reply-To: <1612052078.12.0.741479641556.issue43080@roundup.psfhosted.org>
Message-ID: <1612102171.98.0.0790445604866.issue43080@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

For all other classes we check that there is no user defined __repr__. But it is difficult to check this for dataclass or namedtuple because there is no base class for dataclasses or namedtuples which provides standard __repr__ implementation. All __repr__ for dataclasses and namedtuples are generated.

See issue7434.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43080>
_______________________________________

From report at bugs.python.org  Sun Jan 31 09:17:02 2021
From: report at bugs.python.org (Eric V. Smith)
Date: Sun, 31 Jan 2021 14:17:02 +0000
Subject: [issue43080] pprint for dataclass instances
In-Reply-To: <1612052078.12.0.741479641556.issue43080@roundup.psfhosted.org>
Message-ID: <1612102622.19.0.376323987142.issue43080@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

Adding an attribute on the __repr__ (and other methods?) signifying that they were generated would let us distinguish them.

Say, checking getattr(__repr__, '__is_generated__', False), or similar.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43080>
_______________________________________

From report at bugs.python.org  Sun Jan 31 09:20:19 2021
From: report at bugs.python.org (miss-islington)
Date: Sun, 31 Jan 2021 14:20:19 +0000
Subject: [issue43030] signed/unsigned mismatch in Py_UNICODE_ISSPACE macro
In-Reply-To: <1611664822.48.0.67078426677.issue43030@roundup.psfhosted.org>
Message-ID: <1612102819.0.0.588211758524.issue43030@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 995a6c015024f050b99ba8f9837dfc6b82d83f7d by Miss Islington (bot) in branch '3.9':
bpo-43030: Fixed a compiler warning in Py_UNICODE_ISSPACE with signed wchar_t (GH-24350)
https://github.com/python/cpython/commit/995a6c015024f050b99ba8f9837dfc6b82d83f7d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43030>
_______________________________________

From report at bugs.python.org  Sun Jan 31 09:34:58 2021
From: report at bugs.python.org (Lewis Gaul)
Date: Sun, 31 Jan 2021 14:34:58 +0000
Subject: [issue43080] pprint for dataclass instances
In-Reply-To: <1612052078.12.0.741479641556.issue43080@roundup.psfhosted.org>
Message-ID: <1612103698.66.0.739159270774.issue43080@roundup.psfhosted.org>


Lewis Gaul <lewis.gaul at gmail.com> added the comment:

@Serhiy - Yes, I noted that problem in the PR. Thanks for pointing me to that issue, I agree it would be good to make pprint properly extensible (my current solution is to maintain a fork of the pprint module with dataclass support added).

Eric's suggestion would work, I wasn't sure if it would be considered an 'ok' thing to do, but if so then could be an easy enough way to support dataclasses (and namedtuples potentially)?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43080>
_______________________________________

From report at bugs.python.org  Sun Jan 31 09:44:59 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 31 Jan 2021 14:44:59 +0000
Subject: [issue43084] curses.window.enclose() should return bool
Message-ID: <1612104299.75.0.0836135566859.issue43084@roundup.psfhosted.org>


New submission from Serhiy Storchaka <storchaka+cpython at gmail.com>:

curses.window.enclose() is the only curses wrapper which returns 0/1 while the original function is declared returning bool. https://linux.die.net/man/3/wenclose

----------
components: Extension Modules
messages: 386021
nosy: serhiy.storchaka
priority: normal
severity: normal
status: open
title: curses.window.enclose() should return bool
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43084>
_______________________________________

From report at bugs.python.org  Sun Jan 31 09:46:25 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 31 Jan 2021 14:46:25 +0000
Subject: [issue43030] signed/unsigned mismatch in Py_UNICODE_ISSPACE macro
In-Reply-To: <1611664822.48.0.67078426677.issue43030@roundup.psfhosted.org>
Message-ID: <1612104385.87.0.285606040068.issue43030@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 229ef39bcc14ee7838968dfda51d045304e5cf39 by Miss Islington (bot) in branch '3.8':
bpo-43030: Fixed a compiler warning in Py_UNICODE_ISSPACE with signed wchar_t (GH-24350) (GH-24397)
https://github.com/python/cpython/commit/229ef39bcc14ee7838968dfda51d045304e5cf39


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43030>
_______________________________________

From report at bugs.python.org  Sun Jan 31 09:46:58 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 31 Jan 2021 14:46:58 +0000
Subject: [issue43030] signed/unsigned mismatch in Py_UNICODE_ISSPACE macro
In-Reply-To: <1611664822.48.0.67078426677.issue43030@roundup.psfhosted.org>
Message-ID: <1612104418.14.0.188233845141.issue43030@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
components: +C API -Extension Modules
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.10, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43030>
_______________________________________

From report at bugs.python.org  Sun Jan 31 10:07:20 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 31 Jan 2021 15:07:20 +0000
Subject: [issue43080] pprint for dataclass instances
In-Reply-To: <1612052078.12.0.741479641556.issue43080@roundup.psfhosted.org>
Message-ID: <1612105640.33.0.111172787562.issue43080@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Good idea Eric, it should work.

But it can make the code of pprint potentially less flexible. Currently it uses a mapping which maps __repr__ to corresponding pprint implementation. Only exception is for dicts, for historical reasons. It potentially can allow to make pprint more general and support arbitrary types by registering some handlers. Since there is no standard implementation of __repr__ for namedtuples and dataclasses we cannot use them as keys, and need to hardcode checks for namedtuple and dataclass (and any other generated classes).

It is a minor objection. Perhaps practicality should beat purity in this case.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43080>
_______________________________________

From report at bugs.python.org  Sun Jan 31 10:22:30 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 31 Jan 2021 15:22:30 +0000
Subject: [issue43016] Improve tests for curses
In-Reply-To: <1611504145.81.0.962541791137.issue43016@roundup.psfhosted.org>
Message-ID: <1612106550.61.0.770198268156.issue43016@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset d64fd4bb5bb4fd2e3277f39d3ad99b5a8d193e1b by Serhiy Storchaka in branch 'master':
bpo-43016: Rewrite tests for curses (GH-24312)
https://github.com/python/cpython/commit/d64fd4bb5bb4fd2e3277f39d3ad99b5a8d193e1b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43016>
_______________________________________

From report at bugs.python.org  Sun Jan 31 10:33:46 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 31 Jan 2021 15:33:46 +0000
Subject: [issue43084] curses.window.enclose() should return bool
In-Reply-To: <1612104299.75.0.0836135566859.issue43084@roundup.psfhosted.org>
Message-ID: <1612107226.71.0.0675356871454.issue43084@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
keywords: +patch
pull_requests: +23212
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24398

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43084>
_______________________________________

From report at bugs.python.org  Sun Jan 31 10:40:43 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 31 Jan 2021 15:40:43 +0000
Subject: [issue43016] Improve tests for curses
In-Reply-To: <1611504145.81.0.962541791137.issue43016@roundup.psfhosted.org>
Message-ID: <1612107643.26.0.269670114691.issue43016@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +23213
pull_request: https://github.com/python/cpython/pull/24399

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43016>
_______________________________________

From report at bugs.python.org  Sun Jan 31 10:42:50 2021
From: report at bugs.python.org (miss-islington)
Date: Sun, 31 Jan 2021 15:42:50 +0000
Subject: [issue43083] Minor errors related to error handling in _sqlite3 module
In-Reply-To: <1612100849.9.0.66215198535.issue43083@roundup.psfhosted.org>
Message-ID: <1612107770.06.0.457553050846.issue43083@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 3.0 -> 4.0
pull_requests: +23214
pull_request: https://github.com/python/cpython/pull/24400

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43083>
_______________________________________

From report at bugs.python.org  Sun Jan 31 10:42:49 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 31 Jan 2021 15:42:49 +0000
Subject: [issue43083] Minor errors related to error handling in _sqlite3 module
In-Reply-To: <1612100849.9.0.66215198535.issue43083@roundup.psfhosted.org>
Message-ID: <1612107769.92.0.969140106979.issue43083@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 9073180db521dc83e6216ff0da1479d00167f643 by Serhiy Storchaka in branch 'master':
bpo-43083: Fix error handling in _sqlite3 (GH-24395)
https://github.com/python/cpython/commit/9073180db521dc83e6216ff0da1479d00167f643


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43083>
_______________________________________

From report at bugs.python.org  Sun Jan 31 11:06:39 2021
From: report at bugs.python.org (miss-islington)
Date: Sun, 31 Jan 2021 16:06:39 +0000
Subject: [issue43083] Minor errors related to error handling in _sqlite3 module
In-Reply-To: <1612100849.9.0.66215198535.issue43083@roundup.psfhosted.org>
Message-ID: <1612109199.97.0.252058659747.issue43083@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 8a833a6f94d8c2baa6aa38abd9fc699881a5b0e1 by Miss Islington (bot) in branch '3.9':
bpo-43083: Fix error handling in _sqlite3 (GH-24395)
https://github.com/python/cpython/commit/8a833a6f94d8c2baa6aa38abd9fc699881a5b0e1


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43083>
_______________________________________

From report at bugs.python.org  Sun Jan 31 11:10:35 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 31 Jan 2021 16:10:35 +0000
Subject: [issue43083] Minor errors related to error handling in _sqlite3 module
In-Reply-To: <1612100849.9.0.66215198535.issue43083@roundup.psfhosted.org>
Message-ID: <1612109435.41.0.601354244403.issue43083@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43083>
_______________________________________

From report at bugs.python.org  Sun Jan 31 11:11:20 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 31 Jan 2021 16:11:20 +0000
Subject: [issue43016] Improve tests for curses
In-Reply-To: <1611504145.81.0.962541791137.issue43016@roundup.psfhosted.org>
Message-ID: <1612109480.83.0.0716204222428.issue43016@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset e9d4960d15c5282904cf26e469ce7cee39f634f7 by Serhiy Storchaka in branch '3.9':
[3.9] bpo-43016: Rewrite tests for curses (GH-24312). (GH-24399)
https://github.com/python/cpython/commit/e9d4960d15c5282904cf26e469ce7cee39f634f7


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43016>
_______________________________________

From report at bugs.python.org  Sun Jan 31 11:14:39 2021
From: report at bugs.python.org (Siyavash)
Date: Sun, 31 Jan 2021 16:14:39 +0000
Subject: [issue43085] Loosening | and |= operator type checking restriction
Message-ID: <1612109679.82.0.693593534177.issue43085@roundup.psfhosted.org>


New submission from Siyavash <Varzeghani.Siyavash at gmail.com>:

| and |= operators work only if the operands are of 'dict' type. This means that they can't be used with some of the user defined mapping objects.

The case that especially caught my attention was 'SignalDict' type in decimal standard library. While 'SignalDict' has got an update method like 'dict', it can not be updated with |= operator. The following code results in a TypeError:

decimal.getcontext().traps |= {decimal.DivisionByZero:False}

----------
components: Regular Expressions
messages: 386028
nosy: Siy_V, brandtbucher, ezio.melotti, mrabarnett, steven.daprano
priority: normal
severity: normal
status: open
title: Loosening | and |= operator type checking restriction
type: enhancement
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43085>
_______________________________________

From report at bugs.python.org  Sun Jan 31 11:15:39 2021
From: report at bugs.python.org (Siyavash)
Date: Sun, 31 Jan 2021 16:15:39 +0000
Subject: [issue43085] Loosening | and |= operator type checking restriction
In-Reply-To: <1612109679.82.0.693593534177.issue43085@roundup.psfhosted.org>
Message-ID: <1612109739.83.0.754358515372.issue43085@roundup.psfhosted.org>


Change by Siyavash <Varzeghani.Siyavash at gmail.com>:


----------
nosy:  -Siy_V, ezio.melotti

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43085>
_______________________________________

From report at bugs.python.org  Sun Jan 31 11:17:20 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 31 Jan 2021 16:17:20 +0000
Subject: [issue43016] Improve tests for curses
In-Reply-To: <1611504145.81.0.962541791137.issue43016@roundup.psfhosted.org>
Message-ID: <1612109840.78.0.637799786873.issue43016@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +23215
pull_request: https://github.com/python/cpython/pull/24401

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43016>
_______________________________________

From report at bugs.python.org  Sun Jan 31 12:44:20 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 31 Jan 2021 17:44:20 +0000
Subject: [issue43016] Improve tests for curses
In-Reply-To: <1611504145.81.0.962541791137.issue43016@roundup.psfhosted.org>
Message-ID: <1612115060.66.0.273402547112.issue43016@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 7ca947e93bff2b9d78312dc8ed8e0a2b7d25d3f3 by Serhiy Storchaka in branch '3.8':
[3.8] bpo-43016: Rewrite tests for curses (GH-24312). (GH-24399) (GH-24401)
https://github.com/python/cpython/commit/7ca947e93bff2b9d78312dc8ed8e0a2b7d25d3f3


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43016>
_______________________________________

From report at bugs.python.org  Sun Jan 31 12:44:37 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 31 Jan 2021 17:44:37 +0000
Subject: [issue43016] Improve tests for curses
In-Reply-To: <1611504145.81.0.962541791137.issue43016@roundup.psfhosted.org>
Message-ID: <1612115077.62.0.747033422821.issue43016@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43016>
_______________________________________

From report at bugs.python.org  Sun Jan 31 12:47:25 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 31 Jan 2021 17:47:25 +0000
Subject: [issue12669] test_curses skipped on buildbots
In-Reply-To: <1312149135.76.0.0319517534091.issue12669@psf.upfronthosting.co.za>
Message-ID: <1612115245.96.0.0517782934634.issue12669@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> out of date
stage: needs patch -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue12669>
_______________________________________

From report at bugs.python.org  Sun Jan 31 12:48:19 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 31 Jan 2021 17:48:19 +0000
Subject: [issue43085] Loosening | and |= operator type checking restriction
In-Reply-To: <1612109679.82.0.693593534177.issue43085@roundup.psfhosted.org>
Message-ID: <1612115299.44.0.90274067365.issue43085@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

The operators | and |= always call __or__() and __ior__().  Support for these methods is optional.  Some mapping classes support both methods, some only support __or__, and some support neither one.

Adding support is done is done on a case by case basis.  SignalDict could be updated if needed.

To make it easier for user defined classes, two new collections.ABCs could be added, MappingWithOr and MutableMappingWithIor.  That is similar to what we had done in Python 2.7 with UserDict and IterableUserDict.

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43085>
_______________________________________

From report at bugs.python.org  Sun Jan 31 12:55:23 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 31 Jan 2021 17:55:23 +0000
Subject: [issue41604] [curses.panel] Failed panel.set_userptr will decrement
 refcount of original userptr
In-Reply-To: <1597968971.01.0.83582874982.issue41604@roundup.psfhosted.org>
Message-ID: <1612115723.71.0.0618713530525.issue41604@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 3243e8a4b4b4cf321f9b28335d565742a34b1976 by Anonymous Maarten in branch 'master':
bpo-41604: Don't decrement the reference count of the previous user_ptr when set_panel_usertpr fails (GH-21933)
https://github.com/python/cpython/commit/3243e8a4b4b4cf321f9b28335d565742a34b1976


----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41604>
_______________________________________

From report at bugs.python.org  Sun Jan 31 13:11:53 2021
From: report at bugs.python.org (Idan Moral)
Date: Sun, 31 Jan 2021 18:11:53 +0000
Subject: [issue43086] Excess data in not handled properly in
 binascii.a2b_base64()
Message-ID: <1612116712.99.0.535653486799.issue43086@roundup.psfhosted.org>


New submission from Idan Moral <idan22moral at gmail.com>:

Currently, when providing binascii.a2b_base64() base-64 input with excess data after the padding ('='/'=='), the excess data is ignored.

Example:

import binascii
binascii.a2b_base64(b'aGVsbG8=')       # b'hello' (valid)
binascii.a2b_base64(b'aGVsbG8==')      # b'hello' (ignoring data)
binascii.a2b_base64(b'aGVsbG8=python') # b'hello' (ignoring data)


Note: MANY libraries (such as the all-time favorite `base64`) use this function as their decoder.


Why is it problematic:
* User input can contain additional data after base64 data, which can lead to unintended behavior in products.
* Well-crafted user input can be used to bypass conditions in code (example in the referenced tweet).
* Can be used to target vulnerable libraries and bypass authentication mechanism such as JWT (potentially).


The logic behind my fix PR on GitHub:
* Before deciding to finish the function (after knowing the fact that we passed the data padding),
  we should check if there's no more data after the padding.
* If excess data exists, we should raise an error, free the allocated writer, and return null.
* Else, everything's fine, and we can proceed to the function's end as previously.


Though not publicly disclosed, this behavior can lead to security issues in heavily-used projects.
Preventing this behavior sounds more beneficial than harmful, since there's no known good usage for this behavior.

>From what I read, the python implementation in not so close (when speaking about this case of course) to the base64 RFC.
(link: https://tools.ietf.org/html/rfc4648#section-3.3)


Thanks to Ori Damari (twitter: https://twitter.com/0xrepnz) for bringing this behavior up,
and thanks to Ryan Mast (twitter: https://twitter.com/rmast), and many of the other great guys for discussing the problem in the comments.

Link to the tweet: https://twitter.com/0xrepnz/status/1355295649915404291

--------------------------

Idan Moral
Twitter: https://twitter.com/idan_moral
GitHub: https://github.com/idan22moral

----------
components: Library (Lib)
messages: 386032
nosy: idan22moral
priority: normal
severity: normal
status: open
title: Excess data in not handled properly in binascii.a2b_base64()
type: security
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43086>
_______________________________________

From report at bugs.python.org  Sun Jan 31 13:15:07 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 31 Jan 2021 18:15:07 +0000
Subject: [issue43080] pprint for dataclass instances
In-Reply-To: <1612052078.12.0.741479641556.issue43080@roundup.psfhosted.org>
Message-ID: <1612116907.43.0.500626987843.issue43080@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

At some point, we need a modern redesign alternative to pprint.  It could have its own __pprint__ method to communicate how it wants to be pretty printed.

Until then, I think the existing pprint module should only grow custom support for classes that have a mostly consistent structure and usage pattern.  SimpleNamespace, for example, made sense for a custom pprint handler because it is so dict like and is almost never customized.

IMO, dataclasses are a bridge too far.  Having pprint() guess what a dataclass intends is not far from try to guess what an arbitrary class intends.  This is skating on thin ice.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43080>
_______________________________________

From report at bugs.python.org  Sun Jan 31 13:18:49 2021
From: report at bugs.python.org (Roundup Robot)
Date: Sun, 31 Jan 2021 18:18:49 +0000
Subject: [issue43086] Excess data in not handled properly in
 binascii.a2b_base64()
In-Reply-To: <1612116712.99.0.535653486799.issue43086@roundup.psfhosted.org>
Message-ID: <1612117129.08.0.0541173930447.issue43086@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
keywords: +patch
nosy: +python-dev
nosy_count: 1.0 -> 2.0
pull_requests: +23216
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24402

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43086>
_______________________________________

From report at bugs.python.org  Sun Jan 31 13:27:10 2021
From: report at bugs.python.org (Eric V. Smith)
Date: Sun, 31 Jan 2021 18:27:10 +0000
Subject: [issue43080] pprint for dataclass instances
In-Reply-To: <1612052078.12.0.741479641556.issue43080@roundup.psfhosted.org>
Message-ID: <1612117630.5.0.405211576036.issue43080@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

I agree that we need a better pprint. I think it would be easier to create something new rather than try and morph the existing pprint, but maybe I lack enough imagination. I'd prefer to use functools.singledispatch instead of a __pprint__ method, but it doesn't really make a lot of difference. PEP 443 (singledispatch) does use pprint as a motivating example.

I tend to agree with Raymond that we don't want to guess what a dataclass class intends as its usage. After all, we deliberately made it easy to add a custom __repr__ (one not generated by dataclasses.dataclass).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43080>
_______________________________________

From report at bugs.python.org  Sun Jan 31 13:29:23 2021
From: report at bugs.python.org (Eric V. Smith)
Date: Sun, 31 Jan 2021 18:29:23 +0000
Subject: [issue43086] Excess data in not handled properly in
 binascii.a2b_base64()
In-Reply-To: <1612116712.99.0.535653486799.issue43086@roundup.psfhosted.org>
Message-ID: <1612117763.19.0.643407464938.issue43086@roundup.psfhosted.org>


Change by Eric V. Smith <eric at trueblade.com>:


----------
nosy: +eric.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43086>
_______________________________________

From report at bugs.python.org  Sun Jan 31 13:54:56 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 31 Jan 2021 18:54:56 +0000
Subject: [issue41604] [curses.panel] Failed panel.set_userptr will decrement
 refcount of original userptr
In-Reply-To: <1597968971.01.0.83582874982.issue41604@roundup.psfhosted.org>
Message-ID: <1612119296.41.0.350373724326.issue41604@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +23218
pull_request: https://github.com/python/cpython/pull/24403

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41604>
_______________________________________

From report at bugs.python.org  Sun Jan 31 14:01:15 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 31 Jan 2021 19:01:15 +0000
Subject: [issue27067] Improve curses tests
In-Reply-To: <1463731355.86.0.176847535381.issue27067@psf.upfronthosting.co.za>
Message-ID: <1612119675.82.0.430091589413.issue27067@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Continued in issue42789 and issue43016.

----------
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27067>
_______________________________________

From report at bugs.python.org  Sun Jan 31 14:03:49 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 31 Jan 2021 19:03:49 +0000
Subject: [issue43016] Improve tests for curses
In-Reply-To: <1611504145.81.0.962541791137.issue43016@roundup.psfhosted.org>
Message-ID: <1612119829.91.0.486784332674.issue43016@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Failures on buildbots:
https://buildbot.python.org/all/#/builders/506/builds/765

======================================================================
ERROR: test_output_character (test.test_curses.TestCurses)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/srv/buildbot/buildarea/3.x.bolen-ubuntu/build/Lib/test/test_curses.py", line 249, in test_output_character
    stdscr.addch('\u20ac')
OverflowError: byte doesn't fit in chtype
======================================================================
FAIL: test_background (test.test_curses.TestCurses)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/srv/buildbot/buildarea/3.x.bolen-ubuntu/build/Lib/test/test_curses.py", line 474, in test_background
    self.assertEqual(win.getbkgd(), 0)
AssertionError: 32 != 0
----------------------------------------------------------------------

----------
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43016>
_______________________________________

From report at bugs.python.org  Sun Jan 31 14:07:19 2021
From: report at bugs.python.org (Mark Tolonen)
Date: Sun, 31 Jan 2021 19:07:19 +0000
Subject: [issue43087] ctypes documentation error
Message-ID: <1612120039.68.0.861661788705.issue43087@roundup.psfhosted.org>


New submission from Mark Tolonen <metolone at hotmail.com>:

At the following documentation link:

https://docs.python.org/3/library/ctypes.html#incomplete-types

The last example should have byte strings:

>>> c1 = cell()
>>> c1.name = b"foo"
>>> c2 = cell()
>>> c2.name = b"bar"

----------
messages: 386037
nosy: metolone
priority: normal
severity: normal
status: open
title: ctypes documentation error

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43087>
_______________________________________

From report at bugs.python.org  Sun Jan 31 14:08:31 2021
From: report at bugs.python.org (Mark Tolonen)
Date: Sun, 31 Jan 2021 19:08:31 +0000
Subject: [issue43087] ctypes documentation error
In-Reply-To: <1612120039.68.0.861661788705.issue43087@roundup.psfhosted.org>
Message-ID: <1612120111.61.0.290723522334.issue43087@roundup.psfhosted.org>


Change by Mark Tolonen <metolone at hotmail.com>:


----------
assignee:  -> docs at python
components: +Documentation, ctypes
nosy: +docs at python
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43087>
_______________________________________

From report at bugs.python.org  Sun Jan 31 14:29:34 2021
From: report at bugs.python.org (Zackery Spytz)
Date: Sun, 31 Jan 2021 19:29:34 +0000
Subject: [issue43087] ctypes documentation error
In-Reply-To: <1612120039.68.0.861661788705.issue43087@roundup.psfhosted.org>
Message-ID: <1612121374.63.0.811654746143.issue43087@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
keywords: +patch
nosy: +ZackerySpytz
nosy_count: 2.0 -> 3.0
pull_requests: +23219
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/24404

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43087>
_______________________________________

From report at bugs.python.org  Sun Jan 31 14:34:48 2021
From: report at bugs.python.org (Zackery Spytz)
Date: Sun, 31 Jan 2021 19:34:48 +0000
Subject: [issue43087] ctypes documentation error
In-Reply-To: <1612120039.68.0.861661788705.issue43087@roundup.psfhosted.org>
Message-ID: <1612121688.15.0.137258286174.issue43087@roundup.psfhosted.org>


Zackery Spytz <zspytz at gmail.com> added the comment:

Thank you for the report.

----------
versions: +Python 3.10, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43087>
_______________________________________

From report at bugs.python.org  Sun Jan 31 14:43:38 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 31 Jan 2021 19:43:38 +0000
Subject: [issue43016] Improve tests for curses
In-Reply-To: <1611504145.81.0.962541791137.issue43016@roundup.psfhosted.org>
Message-ID: <1612122218.63.0.0118572195922.issue43016@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +23220
stage: resolved -> patch review
pull_request: https://github.com/python/cpython/pull/24405

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43016>
_______________________________________

From report at bugs.python.org  Sun Jan 31 14:44:34 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 31 Jan 2021 19:44:34 +0000
Subject: [issue41604] [curses.panel] Failed panel.set_userptr will decrement
 refcount of original userptr
In-Reply-To: <1597968971.01.0.83582874982.issue41604@roundup.psfhosted.org>
Message-ID: <1612122274.78.0.888637992338.issue41604@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 3c8d6934436e20163be802f5239c5b4e4925eeec by Serhiy Storchaka in branch '3.9':
[3.9] bpo-41604: Don't decrement the reference count of the previous user_ptr when set_panel_usertpr fails (GH-21933). (GH-24403)
https://github.com/python/cpython/commit/3c8d6934436e20163be802f5239c5b4e4925eeec


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41604>
_______________________________________

From report at bugs.python.org  Sun Jan 31 14:44:51 2021
From: report at bugs.python.org (miss-islington)
Date: Sun, 31 Jan 2021 19:44:51 +0000
Subject: [issue41604] [curses.panel] Failed panel.set_userptr will decrement
 refcount of original userptr
In-Reply-To: <1597968971.01.0.83582874982.issue41604@roundup.psfhosted.org>
Message-ID: <1612122291.16.0.513965480153.issue41604@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 2.0 -> 3.0
pull_requests: +23221
pull_request: https://github.com/python/cpython/pull/24406

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41604>
_______________________________________

From report at bugs.python.org  Sun Jan 31 15:34:41 2021
From: report at bugs.python.org (Hristo Venev)
Date: Sun, 31 Jan 2021 20:34:41 +0000
Subject: [issue24275] lookdict_* give up too soon
In-Reply-To: <1432444109.96.0.971324850141.issue24275@psf.upfronthosting.co.za>
Message-ID: <1612125281.19.0.313363065076.issue24275@roundup.psfhosted.org>


Hristo Venev <hristo at venev.name> added the comment:

I've attached a patch that should also contain a test.

I also ran some benchmarks on dict creation/inserts. I couldn't notice any difference in performance.

----------
Added file: https://bugs.python.org/file49782/0001-Don-t-downgrade-unicode-only-dicts-to-mixed-on-non-u.patch

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24275>
_______________________________________

From report at bugs.python.org  Sun Jan 31 15:51:49 2021
From: report at bugs.python.org (miss-islington)
Date: Sun, 31 Jan 2021 20:51:49 +0000
Subject: [issue41604] [curses.panel] Failed panel.set_userptr will decrement
 refcount of original userptr
In-Reply-To: <1597968971.01.0.83582874982.issue41604@roundup.psfhosted.org>
Message-ID: <1612126309.46.0.345229068393.issue41604@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 931263baab62b1c3fa7647e45ec6ee6ef4409e7c by Miss Islington (bot) in branch '3.8':
[3.9] bpo-41604: Don't decrement the reference count of the previous user_ptr when set_panel_usertpr fails (GH-21933). (GH-24403)
https://github.com/python/cpython/commit/931263baab62b1c3fa7647e45ec6ee6ef4409e7c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41604>
_______________________________________

From report at bugs.python.org  Sun Jan 31 15:52:12 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 31 Jan 2021 20:52:12 +0000
Subject: [issue41604] [curses.panel] Failed panel.set_userptr will decrement
 refcount of original userptr
In-Reply-To: <1597968971.01.0.83582874982.issue41604@roundup.psfhosted.org>
Message-ID: <1612126332.97.0.00479523347544.issue41604@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions:  -Python 3.5, Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue41604>
_______________________________________

From report at bugs.python.org  Sun Jan 31 16:22:19 2021
From: report at bugs.python.org (miss-islington)
Date: Sun, 31 Jan 2021 21:22:19 +0000
Subject: [issue43016] Improve tests for curses
In-Reply-To: <1611504145.81.0.962541791137.issue43016@roundup.psfhosted.org>
Message-ID: <1612128139.03.0.510952127573.issue43016@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +23223
pull_request: https://github.com/python/cpython/pull/24408

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43016>
_______________________________________

From report at bugs.python.org  Sun Jan 31 16:22:11 2021
From: report at bugs.python.org (miss-islington)
Date: Sun, 31 Jan 2021 21:22:11 +0000
Subject: [issue43016] Improve tests for curses
In-Reply-To: <1611504145.81.0.962541791137.issue43016@roundup.psfhosted.org>
Message-ID: <1612128131.76.0.675394682242.issue43016@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
nosy: +miss-islington
nosy_count: 2.0 -> 3.0
pull_requests: +23222
pull_request: https://github.com/python/cpython/pull/24407

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43016>
_______________________________________

From report at bugs.python.org  Sun Jan 31 16:22:21 2021
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 31 Jan 2021 21:22:21 +0000
Subject: [issue43016] Improve tests for curses
In-Reply-To: <1611504145.81.0.962541791137.issue43016@roundup.psfhosted.org>
Message-ID: <1612128141.87.0.31177970919.issue43016@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset a1e9a1e120a11c563e166c15721169184c802f8b by Serhiy Storchaka in branch 'master':
bpo-43016: Fix test_curses on platform without cursesw (GH-24405)
https://github.com/python/cpython/commit/a1e9a1e120a11c563e166c15721169184c802f8b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43016>
_______________________________________

From report at bugs.python.org  Sun Jan 31 17:33:45 2021
From: report at bugs.python.org (Charles Karney)
Date: Sun, 31 Jan 2021 22:33:45 +0000
Subject: [issue43088] Regression in math.hypot
Message-ID: <1612132425.22.0.477732752771.issue43088@roundup.psfhosted.org>


New submission from Charles Karney <charles at karney.com>:

It would be nice if math.hypot had the property

If
  0 < y1 < y2
then
  math.hypot(x, y1) <= math.hypot(x, y2)

This is not the case in python3 with

  x  = 0.6102683302836215
  y1 = 0.7906090004346522
  y2 = y1 + 1e-16

python2's implementation of math.hypot is OK with these inputs.

----------
components: Library (Lib)
files: hypot_bug.py
messages: 386043
nosy: cffk
priority: normal
severity: normal
status: open
title: Regression in math.hypot
type: behavior
versions: Python 3.9
Added file: https://bugs.python.org/file49783/hypot_bug.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43088>
_______________________________________

From report at bugs.python.org  Sun Jan 31 17:48:29 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 31 Jan 2021 22:48:29 +0000
Subject: [issue42986] pegen parser: Crash on SyntaxError with f-string on
 Windows
In-Reply-To: <1611183086.81.0.804124765933.issue42986@roundup.psfhosted.org>
Message-ID: <1612133309.17.0.903204504419.issue42986@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset 40901518167c66abc1ebc5b71c5b86d733cfa154 by Pablo Galindo in branch 'master':
bpo-42986: Fix parser crash when reporting syntax errors in f-string with newlines (GH-24279)
https://github.com/python/cpython/commit/40901518167c66abc1ebc5b71c5b86d733cfa154


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42986>
_______________________________________

From report at bugs.python.org  Sun Jan 31 17:52:59 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 31 Jan 2021 22:52:59 +0000
Subject: [issue43017] Improve error message in the parser when using
 un-parenthesised tuples in comprehensions
In-Reply-To: <1611511246.56.0.166169475648.issue43017@roundup.psfhosted.org>
Message-ID: <1612133579.87.0.20183083673.issue43017@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset 835f14ff8eec10b3d96f821a1eb46a986e00c690 by Pablo Galindo in branch 'master':
bpo-43017: Improve error message for unparenthesised tuples in comprehensions (GH24314)
https://github.com/python/cpython/commit/835f14ff8eec10b3d96f821a1eb46a986e00c690


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43017>
_______________________________________

From report at bugs.python.org  Sun Jan 31 17:53:06 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 31 Jan 2021 22:53:06 +0000
Subject: [issue43017] Improve error message in the parser when using
 un-parenthesised tuples in comprehensions
In-Reply-To: <1611511246.56.0.166169475648.issue43017@roundup.psfhosted.org>
Message-ID: <1612133586.08.0.330998212023.issue43017@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43017>
_______________________________________

From report at bugs.python.org  Sun Jan 31 17:55:58 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 31 Jan 2021 22:55:58 +0000
Subject: [issue42927] Inline cache for slots
In-Reply-To: <1610599509.18.0.893371992468.issue42927@roundup.psfhosted.org>
Message-ID: <1612133758.11.0.33572648719.issue42927@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset a776da90b8f2a1342f4f9bfd23a62cea9a0497c6 by Pablo Galindo in branch 'master':
bpo-42927: Update the What's new entry for LOAD_ATTR optimizations (GH-24383)
https://github.com/python/cpython/commit/a776da90b8f2a1342f4f9bfd23a62cea9a0497c6


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42927>
_______________________________________

From report at bugs.python.org  Sun Jan 31 18:06:26 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 31 Jan 2021 23:06:26 +0000
Subject: [issue43088] Regression in math.hypot
In-Reply-To: <1612132425.22.0.477732752771.issue43088@roundup.psfhosted.org>
Message-ID: <1612134386.65.0.757777904001.issue43088@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Thanks for the report.  This is fixed in Python 3.10 where your script outputs:   [1.1102230246251565e-16, 1.1102230246251565e-16]

There isn't much that can be done about it for Python 3.9.

----------
assignee:  -> rhettinger
nosy: +rhettinger
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43088>
_______________________________________

From report at bugs.python.org  Sun Jan 31 18:16:38 2021
From: report at bugs.python.org (Tim Peters)
Date: Sun, 31 Jan 2021 23:16:38 +0000
Subject: [issue43088] Regression in math.hypot
In-Reply-To: <1612132425.22.0.477732752771.issue43088@roundup.psfhosted.org>
Message-ID: <1612134998.59.0.793494584567.issue43088@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

I agree this doesn't occur in 3.10, but think Raymond pasted wrong outputs. Here:

Python 3.10.0a4+ (heads/master:64fc105b2d, Jan 28 2021, 15:31:11)
[MSC v.1928 64 bit (AMD64)] on win32
>>> x  = 0.6102683302836215
>>> y1 = 0.7906090004346522
>>> y2 = y1 + 1e-16
>>> from math import hypot
>>> hypot(x, y1)
0.998744224772008
>>> hypot(x, y2)
0.9987442247720081

Those both appear to be the results "as if" computed to infinite precision and then correctly rounded back to Python's float precision.

----------
nosy: +tim.peters

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43088>
_______________________________________

From report at bugs.python.org  Sun Jan 31 18:32:48 2021
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 31 Jan 2021 23:32:48 +0000
Subject: [issue42986] pegen parser: Crash on SyntaxError with f-string on
 Windows
In-Reply-To: <1611183086.81.0.804124765933.issue42986@roundup.psfhosted.org>
Message-ID: <1612135968.98.0.194265932747.issue42986@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42986>
_______________________________________

From report at bugs.python.org  Sun Jan 31 18:39:36 2021
From: report at bugs.python.org (Charles Karney)
Date: Sun, 31 Jan 2021 23:39:36 +0000
Subject: [issue43088] Regression in math.hypot
In-Reply-To: <1612132425.22.0.477732752771.issue43088@roundup.psfhosted.org>
Message-ID: <1612136376.36.0.147333565238.issue43088@roundup.psfhosted.org>


Charles Karney <charles at karney.com> added the comment:

Many thanks!  Was the 3.9 version of hypot introduced in 3.0?  I'm fixing my code to call sqrt(x**2 + y**2) if necessary and I'd like to know what range of versions this version should apply for.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43088>
_______________________________________

From report at bugs.python.org  Sun Jan 31 19:01:16 2021
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 01 Feb 2021 00:01:16 +0000
Subject: [issue43088] Regression in math.hypot
In-Reply-To: <1612132425.22.0.477732752771.issue43088@roundup.psfhosted.org>
Message-ID: <1612137676.05.0.455626789919.issue43088@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

>  I'd like to know what range of versions this version should apply for.

Only 3.8 and 3.9.

Prior to that, we used the C compiler's hypot() which tended to be very good but was implementation dependent, only covered the two argument case, and made no particular guarantees about accuracy, commutativity, or monotonicity.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43088>
_______________________________________

From report at bugs.python.org  Sun Jan 31 20:18:02 2021
From: report at bugs.python.org (Chris Jerdonek)
Date: Mon, 01 Feb 2021 01:18:02 +0000
Subject: [issue31212] datetime: min date (0001-01-01 00:00:00) can't be
 converted to local timestamp
In-Reply-To: <1502817992.35.0.826006067807.issue31212@psf.upfronthosting.co.za>
Message-ID: <1612142282.78.0.486737159293.issue31212@roundup.psfhosted.org>


Change by Chris Jerdonek <chris.jerdonek at gmail.com>:


----------
nosy: +chris.jerdonek

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31212>
_______________________________________

From report at bugs.python.org  Sun Jan 31 20:46:54 2021
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 01 Feb 2021 01:46:54 +0000
Subject: [issue24275] lookdict_* give up too soon
In-Reply-To: <1432444109.96.0.971324850141.issue24275@psf.upfronthosting.co.za>
Message-ID: <1612144014.42.0.446874420194.issue24275@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
nosy: +methane

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24275>
_______________________________________

From report at bugs.python.org  Sun Jan 31 21:59:47 2021
From: report at bugs.python.org (Charles Karney)
Date: Mon, 01 Feb 2021 02:59:47 +0000
Subject: [issue43088] Regression in math.hypot
In-Reply-To: <1612132425.22.0.477732752771.issue43088@roundup.psfhosted.org>
Message-ID: <1612148387.41.0.809175384258.issue43088@roundup.psfhosted.org>


Charles Karney <charles at karney.com> added the comment:

Thanks for the info.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43088>
_______________________________________

From report at bugs.python.org  Sun Jan 31 22:01:44 2021
From: report at bugs.python.org (=?utf-8?b?0JHQvtGA0LjRgSDQktC10YDRhdC+0LLRgdC60LjQuQ==?=)
Date: Mon, 01 Feb 2021 03:01:44 +0000
Subject: [issue43089] The optional argument to random.Random() is called "x"
 not "seed"
Message-ID: <1612148504.79.0.846022332701.issue43089@roundup.psfhosted.org>


New submission from ????? ?????????? <boris.verk at gmail.com>:

The documentation https://docs.python.org/3/library/random.html#random.Random says:

> class random.Random([seed])?

But in reality the parameter is called "x" not "seed" (CPython 3.9):

>>> import random
>>> random.Random(seed=0)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
TypeError: __init__() got an unexpected keyword argument 'seed'
>>> random.Random(x=0)
<random.Random object at 0x20ddc10>

Same goes for random.SystemRandom

It would be better to rename "x" to "seed" but that's not backwards compatible.

----------
components: Library (Lib)
messages: 386052
nosy: boris
priority: normal
pull_requests: 23224
severity: normal
status: open
title: The optional argument to random.Random() is called "x" not "seed"
type: enhancement
versions: Python 3.10

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43089>
_______________________________________

From report at bugs.python.org  Sun Jan 31 22:30:14 2021
From: report at bugs.python.org (Ned Deily)
Date: Mon, 01 Feb 2021 03:30:14 +0000
Subject: [issue42504] Failure to build with MACOSX_DEPLOYMENT_TARGET=11 on Big
 Sur
In-Reply-To: <1606662964.61.0.531913261121.issue42504@roundup.psfhosted.org>
Message-ID: <1612150214.54.0.760640165449.issue42504@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset 49926cf2bcc8b44d9b8f148d81979ada191dd9d5 by Ronald Oussoren in branch 'master':
bpo-42504: Ensure that get_config_var('MACOSX_DEPLOYMENT_TARGET') is a string (GH-24341)
https://github.com/python/cpython/commit/49926cf2bcc8b44d9b8f148d81979ada191dd9d5


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42504>
_______________________________________

From report at bugs.python.org  Sun Jan 31 22:30:30 2021
From: report at bugs.python.org (miss-islington)
Date: Mon, 01 Feb 2021 03:30:30 +0000
Subject: [issue42504] Failure to build with MACOSX_DEPLOYMENT_TARGET=11 on Big
 Sur
In-Reply-To: <1606662964.61.0.531913261121.issue42504@roundup.psfhosted.org>
Message-ID: <1612150230.04.0.340187703412.issue42504@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +23225
pull_request: https://github.com/python/cpython/pull/24410

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42504>
_______________________________________

From report at bugs.python.org  Sun Jan 31 23:22:55 2021
From: report at bugs.python.org (Ned Deily)
Date: Mon, 01 Feb 2021 04:22:55 +0000
Subject: [issue42504] Failure to build with MACOSX_DEPLOYMENT_TARGET=11 on Big
 Sur
In-Reply-To: <1606662964.61.0.531913261121.issue42504@roundup.psfhosted.org>
Message-ID: <1612153375.99.0.448558234856.issue42504@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset d6675fee1aac1af87dc31c411d04a5bfc1f39079 by Miss Islington (bot) in branch '3.9':
bpo-42504: Ensure that get_config_var('MACOSX_DEPLOYMENT_TARGET') is a string (GH-24341) (GH-24410)
https://github.com/python/cpython/commit/d6675fee1aac1af87dc31c411d04a5bfc1f39079


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42504>
_______________________________________

From report at bugs.python.org  Sun Jan 31 23:50:23 2021
From: report at bugs.python.org (Ned Deily)
Date: Mon, 01 Feb 2021 04:50:23 +0000
Subject: [issue43052] _dyld_shared_cache_contains_path needs
 SYSTEM_VERSION_COMPAT=0
In-Reply-To: <1611815996.85.0.805200252907.issue43052@roundup.psfhosted.org>
Message-ID: <1612155023.47.0.815900592825.issue43052@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

> This can be observed by using the python 3.9.1 universal2 installer and using it on
> x86_64 Big Sur or with Rossetta 2 on arm64 Big Sur.

When not manually setting SYSTEM_VERSION_COMPAT=1,  I cannot reproduce this behavior on current Big Sur (11.1) systems, either x86_64 or arm64 systems, either with the 3.9.1 python.org universal2 installer (which was built on Big Sur with deployment target of 10.9) or by building on 11.1 with MACOSX_DEPLOYMENT_TARGET=10.15:

$ ./configure MACOSX_DEPLOYMENT_TARGET=10.15
$ make
$ ./python -m sysconfig | grep DEPLOYMENT_TARGET
	CONFIG_ARGS = "'MACOSX_DEPLOYMENT_TARGET=10.15'"
	MACOSX_DEPLOYMENT_TARGET = "10.15"
$ ./python -c "from ctypes.util import find_library; print(find_library('AppKit'))"
/System/Library/Frameworks/AppKit.framework/AppKit
$ sw_vers
ProductName:	macOS
ProductVersion:	11.1
BuildVersion:	20C69
$ uname -a
Darwin vana.local 20.2.0 Darwin Kernel Version 20.2.0: Wed Dec  2 20:39:59 PST 2020; root:xnu-7195.60.75~1/RELEASE_X86_64 x86_64

===========
$ arch
arm64
$ arch -arm64 /usr/local/bin/python3.9 -c 'import sys;print(sys.version)'
3.9.1 (v3.9.1:1e5d33e9b9, Dec  7 2020, 12:44:01)
[Clang 12.0.0 (clang-1200.0.32.27)]
$ arch -arm64 /usr/local/bin/python3.9 -c "from ctypes.util import find_library; print(find_library('AppKit'))"
/System/Library/Frameworks/AppKit.framework/AppKit
$ arch -x86_64 /usr/local/bin/python3.9 -c "from ctypes.util import find_library; print(find_library('AppKit'))"
/System/Library/Frameworks/AppKit.framework/AppKit

So, I believe that, while this is an issue when building Python on macOS 10.15 and executing on macOS 11, it is not a problem for the current python.org universal2 installers. Am I missing something?

Further, I believe this issue is essentially a duplicate of Issue42619 which has a draft (work-in-progress) PR to address this in a different way.  We should consider consolidating these issues.

Note that legacy 10.9+ x86_64-only installers *will* see the find_library() failure because they are built on macOS 10.9. A fix for Issue42619 would solve that problem for future "legacy" installers built on 10.9 (although we intend to no longer produce such installers for Python 3.10.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue43052>
_______________________________________