[issue23992] multiprocessing: MapResult shouldn't fail fast upon exception

Davin Potts report at bugs.python.org
Sat Sep 12 18:05:40 CEST 2015


Davin Potts added the comment:

The patches make good sense to me -- I have no comments to add in a review.

I spent more time than I care to admit concerned with the idea that error_callback (exposed by map_async which map sits on top of) should perhaps be called not just once at the end but each time an exception occurs.  Motivated by past jobs which failed overall to yield any results because one out of a million of the inputs triggered an error, I thought the idea very appealing and experimented with implementing it (with happy results).  Googling for it though, I found plenty of examples of people asking questions about how callback and error_callback are intended to work -- though the documentation is not explicit on this particular point, most of those search results correctly document in the wild that error_callback is called only once at the end just like callback.  I think it best to leave that functionality just as you have it now.

Thanks for creating the patch -- looks great to me.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue23992>
_______________________________________


More information about the Python-bugs-list mailing list