[issue25311] Add f-string support to tokenize.py

[Eric V. Smith]

Eric V. Smith added the comment:

Multi-line string tests were added in changeset 91c44dc35dfd. That will make changes for this issue safer. Updated patch to come.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue25311>
_______________________________________