[issue12675] tokenize module happily tokenizes code with syntax errors

[Ezio Melotti]

Changes by Ezio Melotti <ezio.melotti at gmail.com>:


----------
stage:  -> test needed

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue12675>
_______________________________________