[issue30455] Generate C code from token.py and not vice versa

[Serhiy Storchaka]

New submission from Serhiy Storchaka:

Currently Lib/token.py is generated from Include/token.h. This contradicts common practice when the C code is generated from the Python code (see for example opcode.py and sre_constants.py). In additional the table in Parser/tokenizer.c should be manually supported matching Include/token.h.

Generating Include/token.h and Parser/tokenizer.c from Lib/token.py would be simpler and more reliable.

----------
components: Interpreter Core, Library (Lib)
messages: 294350
nosy: Albert-Jan Nijburg, benjamin.peterson, haypo, meador.inge, r.david.murray, serhiy.storchaka
priority: normal
severity: normal
status: open
title: Generate C code from token.py and not vice versa
type: enhancement
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue30455>
_______________________________________