[Python-checkins] CVS: python/dist/src/Lib/test/output test_tokenize,1.2,1.3

[Ka-Ping Yee]

Update of /cvsroot/python/python/dist/src/Lib/test/output
In directory usw-pr-cvs1:/tmp/cvs-serv29727/test/output

Modified Files:
	test_tokenize 
Log Message:
Add tokenizer support and tests for u'', U"", uR'', Ur"", etc.


Index: test_tokenize
===================================================================
RCS file: /cvsroot/python/python/dist/src/Lib/test/output/test_tokenize,v
retrieving revision 1.2
retrieving revision 1.3
diff -C2 -r1.2 -r1.3
*** test_tokenize	1998/04/03 19:56:40	1.2
--- test_tokenize	2001/01/15 22:04:30	1.3
***************
*** 1,25 ****
  test_tokenize
! 1,0-1,35:	COMMENT	"# Tests for the 'tokenize' module.\012"
! 2,0-2,43:	COMMENT	'# Large bits stolen from test_grammar.py. \012'
! 3,0-3,1:	NL	'\012'
! 4,0-4,11:	COMMENT	'# Comments\012'
  5,0-5,3:	STRING	'"#"'
! 5,3-5,4:	NEWLINE	'\012'
! 6,0-6,3:	COMMENT	"#'\012"
! 7,0-7,3:	COMMENT	'#"\012'
! 8,0-8,3:	COMMENT	'#\\\012'
[...1167 lines suppressed...]
! 173,0-173,6:	NAME	'import'
! 173,7-173,10:	NAME	'sys'
! 173,10-173,11:	OP	','
! 173,12-173,16:	NAME	'time'
! 173,16-173,17:	NEWLINE	'\n'
! 174,0-174,1:	NAME	'x'
! 174,2-174,3:	OP	'='
! 174,4-174,7:	NAME	'sys'
! 174,7-174,8:	OP	'.'
! 174,8-174,15:	NAME	'modules'
! 174,15-174,16:	OP	'['
! 174,16-174,22:	STRING	"'time'"
! 174,22-174,23:	OP	']'
! 174,23-174,24:	OP	'.'
! 174,24-174,28:	NAME	'time'
! 174,28-174,29:	OP	'('
! 174,29-174,30:	OP	')'
! 174,30-174,31:	NEWLINE	'\n'
! 175,0-175,1:	NL	'\n'
! 176,0-176,0:	ENDMARKER	''