[issue32987] tokenize.py parses unicode identifiers incorrectly

[Terry J. Reedy]

Terry J. Reedy <tjreedy at udel.edu> added the comment:

I verified on Win10 with 3.5 (which cannot be patched) and 3.7.0b2 that ab·cd is accepted as a name and that tokenize fails as described.

----------
nosy: +terry.reedy
stage:  -> needs patch
versions: +Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32987>
_______________________________________