[issue2134] function generate_tokens at tokenize.py yields wrong token for colon

[Terry J. Reedy]

Terry J. Reedy <tjreedy at udel.edu> added the comment:

I have not looked at this, but a new parameter would be a new feature. Its a moot point until there is an agreed on patch for a current version.

----------
nosy: +tjreedy
type: behavior -> feature request
versions: +Python 3.2 -Python 2.4, Python 2.5, Python 2.6

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue2134>
_______________________________________