[Python-checkins] cpython (3.4): Issue 21977: Minor improvements to the regexes in the tokenizer example.

[raymond.hettinger]

http://hg.python.org/cpython/rev/bb28542af060
changeset:   91672:bb28542af060
branch:      3.4
parent:      91669:407110796b16
user:        Raymond Hettinger <python at rcn.com>
date:        Mon Jul 14 01:52:00 2014 -0700
summary:
  Issue 21977:  Minor improvements to the regexes in the tokenizer example.

files:
  Doc/library/re.rst |  4 ++--
  1 files changed, 2 insertions(+), 2 deletions(-)


diff --git a/Doc/library/re.rst b/Doc/library/re.rst
--- a/Doc/library/re.rst
+++ b/Doc/library/re.rst
@@ -1340,9 +1340,9 @@
             ('ASSIGN',  r':='),          # Assignment operator
             ('END',     r';'),           # Statement terminator
             ('ID',      r'[A-Za-z]+'),   # Identifiers
-            ('OP',      r'[+*\/\-]'),    # Arithmetic operators
+            ('OP',      r'[+\-*/]'),     # Arithmetic operators
             ('NEWLINE', r'\n'),          # Line endings
-            ('SKIP',    r'[ \t]'),       # Skip over spaces and tabs
+            ('SKIP',    r'[ \t]+'),      # Skip over spaces and tabs
         ]
         tok_regex = '|'.join('(?P<%s>%s)' % pair for pair in token_specification)
         get_token = re.compile(tok_regex).match

-- 
Repository URL: http://hg.python.org/cpython