[Python-Dev] "".tokenize() ?

[M.-A. Lemburg]

Gustavo Niemeyer submitted a patch which adds a tokenize like
method to strings and Unicode:

"one, two and three".tokenize([",", "and"])
-> ["one", " two ", "three"]

I like this method -- should I review the code and then check it in ?

PS: Haven't gotten any response regarding the .decode() method yet...
should I take this as "no objections" ?

-- 
Marc-Andre Lemburg
______________________________________________________________________
Company & Consulting:                           http://www.egenix.com/
Python Software:                        http://www.lemburg.com/python/