[issue2182] tokenize: does not allow CR for a newline

[Guido van Rossum]

Guido van Rossum <guido at python.org> added the comment:

I still think it shouldn't be tokenize's business to handle this.  I'm
not quite sure how exec() manages to do this; I note that this gives a
syntax error:

exec('x = 1\rprint x\r')

__________________________________
Tracker <report at bugs.python.org>
<http://bugs.python.org/issue2182>
__________________________________