[issue29812] test for token.py, and consistency tests for tokenize.py

[Berker Peksag]

Changes by Berker Peksag <berker.peksag at gmail.com>:


----------
stage: needs patch -> patch review

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue29812>
_______________________________________