[Mailman-Users] Uncaught runner exception

[Lothar Schilling]

Thank you and sorry for my belated answer. Was out of office for a few
days, carneval season in Germany...

Am 02.03.2019 um 23:20 schrieb Mark Sapiro:
> On 3/1/19 9:00 PM, Mark Sapiro wrote:
>> To try to diagnose this further, you could try:
>>
>> === modified file 'Mailman/Archiver/pipermail.py'
>> --- Mailman/Archiver/pipermail.py	2018-05-03 21:23:47 +0000
>> +++ Mailman/Archiver/pipermail.py	2019-03-02 04:51:23 +0000
>> @@ -60,9 +60,12 @@
>>      else:
>>          # Mixed case; assume that small parts of the last name will be
>>          # in lowercase, and check them against the list.
>> -        while i>0 and (L[i-1][0] in lowercase or
>> -                       L[i-1].lower() in smallNameParts):
>> -            i = i - 1
>> +        try:
>> +            while i>0 and (L[i-1][0] in lowercase or
>> +                           L[i-1].lower() in smallNameParts):
>> +                i = i - 1
>> +        except:
>> +            syslog('error', 'Exception in fixAuthor: %s', author)
>>      author = SPACE.join(L[-1:] + L[i:-1]) + ', ' + SPACE.join(L[:i])
>>      return author
>>
>>
>> and see what gets logged in Mailman's error log and what the archived
>> message looks like
>>
Following your instruction errors get now logged like this (where x is
lower case, X upper case alphabet).

Mar 06 10:36:56 2019 (16870) Exception in fixAuthor: Kxx Wxxx
Mar 06 10:36:56 2019 (16870) Exception in fixAuthor: NXX - Fx▒xxxxxxx XX
x.X.
Mar 06 10:36:57 2019 (16870) Exception in fixAuthor: Fx▒xxxxxxxx
Tx▒xxxxxxx x.X.
Mar 06 10:36:57 2019 (16870) Exception in fixAuthor: RXX x.X.

The missing characters ▒ are German "Umlaute".

The messages have now been archived and look ok, not mutilated anyhow.
But of course they are still stuck in qfiles/shunt

> Also, in your original post you posted
>
>
>> Feb 28 12:29:02 2019 (3123) Uncaught runner exception: 'ascii' codec
>> can't decode byte 0xb5 in position 26: ordinal not in range(128)
>> Feb 28 12:29:02 2019 (3123) Traceback (most recent call last):
>>   File "/usr/lib/mailman/Mailman/Queue/Runner.py", line 119, in _oneloop
>>     self._onefile(msg, msgdata)
>>   File "/usr/lib/mailman/Mailman/Queue/Runner.py", line 190, in _onefile
>>     keepqueued = self._dispose(mlist, msg, msgdata)
>>   File "/usr/lib/mailman/Mailman/Queue/ArchRunner.py", line 77, in _dispose
>>     mlist.ArchiveMail(msg)
>>   File "/usr/lib/mailman/Mailman/Archiver/Archiver.py", line 216, in
>> ArchiveMail
>>     h.processUnixMailbox(f)
>>   File "/usr/lib/mailman/Mailman/Archiver/pipermail.py", line 596, in
>> processUnixMailbox
>>     self.add_article(a)
>>   File "/usr/lib/mailman/Mailman/Archiver/pipermail.py", line 640, in
>> add_article
>>     author = fixAuthor(article.decoded['author'])
>>   File "/usr/lib/mailman/Mailman/Archiver/pipermail.py", line 63, in
>> fixAuthor
>>     while i>0 and (L[i-1][0] in lowercase or [error message stops right
>> here]
> Following that in the log there should be two more lines, one describing
> the UnicodeDecodeError exception and one referring to the message being
> shunted and pointing to a qfiles/shunt/*.pck file. You can see the
> contents of that file with either Mailman's bin/show_qfiles or
> bin/dumpdb commands and the From: header in the message may give more info.
>
As for the "From: headers", some appear distorted, some don't:

From: =?UTF-8?Q?Lxxxx_M=c3=bcxxxx?= <xx at xxx-xxxxxxx.xxxg>
From: Kxx Wxxxx <xx at xxx-xxxxxxx.xxx>