[issue12675] tokenize module happily tokenizes code with syntax errors

[Eric Snow]

Changes by Eric Snow <ericsnowcurrently at gmail.com>:


----------
nosy: +ericsnow

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue12675>
_______________________________________