[issue30455] Generate all tokens related code and docs from Grammar/Tokens

[Serhiy Storchaka]

Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Could anybody please make a review? There are two alternate PRs: PR 1860 and PR 10370. The difference between them is that the former one uses Lib/token.py as a source, and the latter one uses Grammar/Tokens as a source and generates Lib/token.py too.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30455>
_______________________________________