[issue33899] Tokenize module does not mirror "end-of-input" is newline behavior

[Ned Deily]

Ned Deily <nad at python.org> added the comment:

I don't have a strong opinion about 2.7 here.  Ultimately, it's Benjamin's call.  But it might make sense to revert for 2.7 since it hasn't been released yet.

----------
nosy: +benjamin.peterson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33899>
_______________________________________