[issue17560] problem using multiprocessing with really big objects?

[Olivier Grisel]

Olivier Grisel added the comment:

> In 3.3 you can do
>
>     from multiprocessing.forking import ForkingPickler
>     ForkingPickler.register(MyType, reduce_MyType)
>
> Is this sufficient for you needs?  This is private (and its definition has moved in 3.4) but it could be made public.

Indeed I forgot that the multiprocessing pickler was made already made
pluggable in Python 3.3. I needed backward compat for python 2.6 in
joblib hence I had to rewrite a bunch of the class hierarchy.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue17560>
_______________________________________