Parser Generator?

Jason Evans joevans at gmail.com
Sun Aug 26 16:12:30 EDT 2007


On Aug 24, 1:21 pm, "Jack" <nos... at invalid.com> wrote:
> "Jason Evans" <joev... at gmail.com> wrote in message
> >    http://www.canonware.com/Parsing/
>
> Thanks Jason. Does Parsing.py support Unicode characters (especially CJK)?
> I'll take a look.

Parsers typically deal with tokens rather than individual characters,
so the scanner that creates the tokens is the main thing that Unicode
matters to.  I have written Unicode-aware scanners for use with
Parsing-based parsers, with no problems.  This is pretty easy to do,
since Python has built-in support for Unicode strings.

Jason




More information about the Python-list mailing list