[Python-checkins] r43464 - python/trunk/Lib/tokenize.py

guido.van.rossum python-checkins at python.org
Thu Mar 30 23:43:36 CEST 2006


Author: guido.van.rossum
Date: Thu Mar 30 23:43:35 2006
New Revision: 43464

Modified:
   python/trunk/Lib/tokenize.py
Log:
Insert a safety space after numbers as well as names in untokenize().


Modified: python/trunk/Lib/tokenize.py
==============================================================================
--- python/trunk/Lib/tokenize.py	(original)
+++ python/trunk/Lib/tokenize.py	Thu Mar 30 23:43:35 2006
@@ -182,7 +182,7 @@
     for tok in iterable:
         toknum, tokval = tok[:2]
 
-        if toknum == NAME:
+        if toknum in (NAME, NUMBER):
             tokval += ' '
 
         if toknum == INDENT:


More information about the Python-checkins mailing list