[Python-checkins] r51527 - python/trunk/Lib/tokenize.py

jeremy.hylton python-checkins at python.org
Wed Aug 23 23:26:46 CEST 2006


Author: jeremy.hylton
Date: Wed Aug 23 23:26:46 2006
New Revision: 51527

Modified:
   python/trunk/Lib/tokenize.py
Log:
Replace dead code with an assert.

Now that COMMENT tokens are reliably followed by NL or NEWLINE,
there is never a need to add extra newlines in untokenize.


Modified: python/trunk/Lib/tokenize.py
==============================================================================
--- python/trunk/Lib/tokenize.py	(original)
+++ python/trunk/Lib/tokenize.py	Wed Aug 23 23:26:46 2006
@@ -168,10 +168,7 @@
 
     def add_whitespace(self, start):
         row, col = start
-        while row > self.prev_row:
-            print row, "<", self.prev_row
-            self.tokens.append("\n")
-            self.prev_row += 1
+        assert row <= self.prev_row
         col_offset = col - self.prev_col
         if col_offset:
             self.tokens.append(" " * col_offset)


More information about the Python-checkins mailing list