tokenizer..

John john.thai at dspfactory.com
Wed Jun 6 17:30:16 EDT 2001


Hello,

    Is there a built in function or module which allows me to get tokens
from a string?
I know there's the tokenize module but that needs a callable object and it
seems to loop forever...

John





More information about the Python-list mailing list