[python-ldap] Performance improvement for schema.tokenizer.split_tokens

[Christian Heimes]

On 2017-02-18 11:08, Michael Ströder wrote:
> Could you please also test with Tests/t_ldap_schema_tokenizer.py in recent python-ldap
> 2.4.32? Maybe you already did.

No, I didn't. I haven't noticed that you added tests for the tokenizer 3
days ago. Thanks for the hint.

Your test cases revealed two issue in my implementation: empty quoted
string and () without surrounding white space. I addressed both edge
cases and fixed my regular expression.

Christian