[I18n-sig] Unicode surrogates: just say no!

[Fredrik Lundh]

Guido wrote:
> I assert that it's easy enough to write code that is indifferent to
> sizeof(Py_UNICODE).  See SRE as a proof.

I just checked in a couple of patches which fixes some obvious
problems for sizeof(Py_UNICODE) > 2 (so sue me ;-).

most everything seems to work (the UTF-16 codec is a notable
exception).

there's a new (experimental) define in Include/unicodeobject.h:

    #undef USE_UCS4_STORAGE

if defined, Py_UNICODE is set to the same thing as Py_UCS4.
Cray users may want to define it...

Cheers /F