[issue12675] tokenize module happily tokenizes code with syntax errors

[Irit Katriel]

Irit Katriel <iritkatriel at gmail.com> added the comment:

Reproduced on 3.11.

----------
nosy: +iritkatriel
versions: +Python 3.11 -Python 2.7, Python 3.3, Python 3.4

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue12675>
_______________________________________