[PyPy-issue] [issue340] rewrite PyPy's tokenizer

[Fijal]

Fijal <fijall at gmail.com> added the comment:

As explained below it's for example slow. Feel free to drop by on #pypy on IRC 
(we generally don't handle such large tasks over issue tracker)

_______________________________________________________
PyPy development tracker <pypy-dev-issue at codespeak.net>
<https://codespeak.net/issue/pypy-dev/issue340>
_______________________________________________________