[issue33899] Tokenize module does not mirror "end-of-input" is newline behavior

[Aaron Meurer]

Aaron Meurer <asmeurer at gmail.com> added the comment:

Is it expected behavior that comments produce NEWLINE if they don't have a newline and don't produce NEWLINE if they do (that is, '# comment' produces NEWLINE but '# comment\n' does not)?

----------
nosy: +asmeurer

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33899>
_______________________________________