CVS: 'python/dist/src/Lib tokenize.py'

Tue, 8 Apr 1997 10:24:41 -0400

Update of /projects/cvsroot/python/dist/src/Lib
In directory monty:/usr/people/guido/python/src/Lib

Modified Files:
	tokenize.py 
Log Message:
Ka-Ping's muich improved version of March 26, 1997:

#     Ignore now accepts \f as whitespace.  Operator now includes '**'.
#     Ignore and Special now accept \n or \r\n at the end of a line.
#     Imagnumber is new.  Expfloat is corrected to reject '0e4'.

--Guido van Rossum (home page: http://www.python.org/~guido/)