[issue9974] tokenizer.untokenize not invariant with line continuations

[Brian Bossé]

Brian Bossé <penrif at gmail.com> added the comment:

Yup, that's related to ENDMARKER being tokenized to its own line, even if EOF happens at the end of the last line of actual code.  I don't know if anything relies on that behavior so I can't really suggest changing it.

My patch handles the described situation, albeit a bit poorly as I mentioned in comment 2.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue9974>
_______________________________________