[New-bugs-announce] [issue12911] Expose a private accumulator C API

[Antoine Pitrou]

New submission from Antoine Pitrou <pitrou at free.fr>:

In 47176e8d7060, I fixed json to not blow memory when serializing a large container of small objects.
It turns out that the repr() of tuple objects (and, very likely, list objects and possibly other containers) has the same problem. For example, Martin's 256GB machine can't serialize a two billion-element tuple:
http://www.python.org/dev/buildbot/all/builders/AMD64%20debian%20parallel%20custom/builds/6/steps/test/logs/stdio

So I propose to expose a private C API for the "accumulator" pattern introduced in 47176e8d7060 (with, e.g., the _PyAccumulator prefix), and to use that API from relevant code.

----------
components: Interpreter Core
messages: 143598
nosy: mark.dickinson, pitrou, rhettinger
priority: normal
severity: normal
status: open
title: Expose a private accumulator C API
type: resource usage
versions: Python 3.2, Python 3.3

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue12911>
_______________________________________