On Jul 4, 4:35 pm, John Nagle <na... at animats.com> wrote: > The temptation is to write tokenizers in C, but that's an admission > of language design failure. No it isn't. It's only a failure of Python to be the language that does everything *you* want. Carl Banks