Python - Next Release Questions

[Fredrik Lundh]

Neil Hodgson <neilh at hare.net.au> wrote:
> > Call me an egotistical eurocentric what-have-you, but I'd just as
> > soon be given a choice, not given UTF-16 only.
>
>    Is the new support UTF-16? I though it was only going to be UCS-2. I
> would much prefer to see UTF-16 as it has a better chance of acceptance in
> East Asian work but it may be extra work for now.

the string type stores unicode characters as 16-bit unsigned
integers.  escape codes are currently not supported.

however, the unicode package supports pluggable converters.
here's a list of converters in the current release:

ascii cp037 cp1006 cp1026 cp1250 cp1251 cp1252 cp1253 cp1254 cp1255
cp1256 cp1257 cp1258 cp424 cp437 cp500 cp737 cp775 cp850 cp852 cp855
cp856 cp857 cp860 cp861 cp862 cp863 cp864 cp865 cp866 cp869 cp874
cp875 iso8859-1 iso8859-10 iso8859-13 iso8859-14 iso8859-15 iso8859-2
iso8859-3 iso8859-4 iso8859-5 iso8859-6 iso8859-7 iso8859-8 iso8859-9
koi8-r latin-1 mac-cyrillic mac-greek mac-iceland mac-latin2 mac-roman
mac-turkish raw-unicode-escape unicode-escape unicode-internal utf-16
utf-16-be utf-16-le utf-8

</F>