Guido van Rossum added the comment: I'm with Martin. Adam, why do you think tokenize should use bytes instead of text strings? ---------- nosy: +gvanrossum __________________________________ Tracker <report at bugs.python.org> <http://bugs.python.org/issue1420> __________________________________