[issue13832] tokenization assuming ASCII whitespace; missing multiline case

[Benjamin Peterson]

Benjamin Peterson <benjamin at python.org> added the comment:

The tokenizer doesn't consider unicode spaces, either.

----------
resolution:  -> fixed
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue13832>
_______________________________________