[Python-Dev] PEP 574 -- Pickle protocol 5 with out-of-band data

[Nick Coghlan]

On 29 March 2018 at 04:39, Antoine Pitrou <solipsis at pitrou.net> wrote:
>
> Hi,
>
> I'd like to submit this PEP for discussion.  It is quite specialized
> and the main target audience of the proposed changes is
> users and authors of applications/libraries transferring large amounts
> of data (read: the scientific computing & data science ecosystems).
>
> https://www.python.org/dev/peps/pep-0574/
>
> The PEP text is also inlined below.

+1 from me, which you already knew :)

For folks that haven't read Eric Snow's PEP 554 about exposing
multiple interpreter support as a Python level API, Antoine's proposed
zero-copy-data-management enhancements for pickle complement that
nicely, since they allow the three initial communication primitives in
PEP 554 (passing None, bytes, memory views) to be more efficiently
expanded to handling arbitrary objects by sending first the pickle
data, then the out-of-band memory views, and finally None as an
end-of-message marker.

Cheers,
Nick.

-- 
Nick Coghlan   |   ncoghlan at gmail.com   |   Brisbane, Australia