[issue29812] test for token.py, and consistency tests for tokenize.py

[Berker Peksag]

Berker Peksag added the comment:

Yes, they are. I like the idea of generating C files from Lib/token.py. Let's see what David thinks about issue 30455.

----------
nosy: +berker.peksag

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue29812>
_______________________________________