[pypy-svn] r14310 - pypy/branch/dist-2.4.1/pypy/interpreter/pyparser

[arigo at codespeak.net]

Author: arigo
Date: Tue Jul  5 20:40:49 2005
New Revision: 14310

Modified:
   pypy/branch/dist-2.4.1/pypy/interpreter/pyparser/pytokenize.py
Log:
Patch the automata to recognize the triple-quote constuctions
r''', u''', etc.



Modified: pypy/branch/dist-2.4.1/pypy/interpreter/pyparser/pytokenize.py
==============================================================================
--- pypy/branch/dist-2.4.1/pypy/interpreter/pyparser/pytokenize.py	(original)
+++ pypy/branch/dist-2.4.1/pypy/interpreter/pyparser/pytokenize.py	Tue Jul  5 20:40:49 2005
@@ -87,7 +87,7 @@
      't': 1, 'u': 1, 'v': 1, 'w': 1,
      'x': 1, 'y': 1, 'z': 1},
 
-    {'"': 20, "'": 19, '0': 1, '1': 1,
+    {'"': 16, "'": 15, '0': 1, '1': 1,
      '2': 1, '3': 1, '4': 1, '5': 1,
      '6': 1, '7': 1, '8': 1, '9': 1,
      'A': 1, 'B': 1, 'C': 1, 'D': 1,
@@ -105,7 +105,7 @@
      'v': 1, 'w': 1, 'x': 1, 'y': 1,
      'z': 1},
 
-    {'"': 20, "'": 19, '0': 1, '1': 1,
+    {'"': 16, "'": 15, '0': 1, '1': 1,
      '2': 1, '3': 1, '4': 1, '5': 1,
      '6': 1, '7': 1, '8': 1, '9': 1,
      'A': 1, 'B': 1, 'C': 1, 'D': 1,