[issue24870] Optimize coding with surrogateescape and surrogatepass error handlers

[STINNER Victor]

STINNER Victor added the comment:

Ok, I prepared the code for the UTF-8 optimization.

@Serhiy: would you like to rebase your patch  faster_surrogates_hadling.patch?

Attached utf8.patch is a less optimal implementation which only changes PyUnicode_DecodeUTF8Stateful(). Maybe it's enough?

I would like to see a benchmark here to choose the good compromise between performance and code complexity.

----------
Added file: http://bugs.python.org/file40540/utf8.patch

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue24870>
_______________________________________