SyntaxError not honoured in list comprehension?

[jmfauth]

Thank you all for the discussion and the explanations.

> Mark Dickinson

I toyed a littled bit this afternoon and I wrote a colouriser
(British spelling?) with the tokenize module. It is quite
simple and easy.

BTW, if I understand correctly the module tokenize import
the module token. So your example becomes:

>>> from cStringIO import StringIO
>>> import tokenize
>>> for tok in tokenize.generate_tokens(StringIO("print9.0").readline):
        print tokenize.tok_name[tok[0]], tok[1]

NAME print9
NUMBER .0
ENDMARKER
>>>