[Patches] [ python-Patches-1170272 ] [ast branch] unicode literal fixes

[SourceForge.net]

Patches item #1170272, was opened at 2005-03-25 00:19
Message generated for change (Tracker Item Submitted) made by Item Submitter
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=305470&aid=1170272&group_id=5470

Category: Parser/Compiler
Group: AST
Status: Open
Resolution: None
Priority: 5
Submitted By: John Ehresman (jpe)
Assigned to: Nobody/Anonymous (nobody)
Summary: [ast branch] unicode literal fixes

Initial Comment:
Attached patch fixes test_eval by dealing with unicode
input correctly.  I'm also compiling tokenizer.c
directly rather than tokenizer_pgen.c --
tokenizer_pgen.c simply defines PGEN and then includes
tokenizer.c, which disables some of the unicode
support.  I don't think tokenizer_pgen.c is needed.


----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=305470&aid=1170272&group_id=5470