[Ironpython-users] Unicode

[Ivan Pozdeev]

>> Hi,

>> I just noticed that the non-BMP Unicode Literals don't seem to work correctly
>> in IronPython, this seems to work correctly in cPython 2.7.8:

>> Python 2.7.8 (default, Jun 30 2014, 16:03:49) [MSC v.1500 32 bit (Intel)] on win32
>>>>> u"\U00010042"
>> u'\U00010042'

>> IronPython 2.7.4 (2.7.0.40) on .NET 4.0.30319.18444 (32-bit)
>>>>> u"\U00010042"
>> 'B'

>> I guess this truncation is caused by the UTF-16 nature of .NET strings. I
>> guess the most sensible thing IronPython could do here is to create the correct surrogate pair:

>>>>> System.Text.Encoding.UTF32.GetString((0x42, 0, 1, 0))
>> u'\ud800\udc42'

> Yup, as well as in CPython 'narrow' builds. Check sys.maxunicode to determine the
> flavor of the build you're working in.

Whoops, sorry, in CPython's 'narrow' build , it is represented by a surrogate
pair but the truncation doesn't happen. The latter is indeed a bug.

>> Best regards

>> Markus Schaber

>> CODESYS(r) a trademark of 3S-Smart Software Solutions GmbH

>> Inspiring Automation Solutions

>> 3S-Smart Software Solutions GmbH
>> Dipl.-Inf. Markus Schaber | Product Development Core Technology
>> Memminger Str. 151 | 87439 Kempten | Germany
>> Tel. +49-831-54031-979 | Fax +49-831-54031-50

>> E-Mail: m.schaber at codesys.com | Web: http://www.codesys.com | CODESYS store: http://store.codesys.com
>> CODESYS forum: http://forum.codesys.com

>> Managing Directors: Dipl.Inf. Dieter Hess, Dipl.Inf. Manfred Werner | Trade
>> register: Kempten HRB 6186 | Tax ID No.: DE 167014915

>> This e-mail may contain confidential and/or privileged information. If you
>> are not the intended recipient (or have received
>> this e-mail in error) please notify the sender immediately and destroy this
>> e-mail. Any unauthorised copying, disclosure
>> or distribution of the material in this e-mail is strictly forbidden.

>> _______________________________________________
>> Ironpython-users mailing list
>> Ironpython-users at python.org
>> https://mail.python.org/mailman/listinfo/ironpython-users






-- 
Best regards,
 Ivan                            mailto:vano at mail.mipt.ru