[Mailman-Developers] exceptions in new bin/arch CVS code
Marc MERLIN
marc_news@vasoftware.com
Wed, 12 Dec 2001 00:17:49 -0800
--DocE+STaALJfprDB
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
I've run a big list archive through arch, and I'm finding a few bugs:
(I ran cleanarch on it first, and the same archive works with mm 2.0's
archiver)
#1
moremagic:/var/local/mailman/bin# ./arch svlug /tmp/mesg
#00001 <199807080009.RAA06108@meg.mall-net.com>
figuring article archives
1998-July
Traceback (most recent call last):
File "./arch", line 129, in ?
main()
File "./arch", line 118, in main
archiver.processUnixMailbox(fp, Article)
File "/var/local/mailman/Mailman/Archiver/pipermail.py", line 525, in processUnixMailbox
m = mbox.next()
File "/var/local/mailman/Mailman/pythonlib/mailbox.py", line 38, in next
return self.factory(_Subfile(self.fp, start, stop))
File "/var/local/mailman/Mailman/Mailbox.py", line 77, in scrubber
return mailbox.scrub(msg)
File "/var/local/mailman/Mailman/Mailbox.py", line 97, in scrub
return self._scrubber(self._mlist, msg)
File "/var/local/mailman/Mailman/Handlers/Scrubber.py", line 154, in process
url = save_attachment(mlist, part)
File "/var/local/mailman/Mailman/Handlers/Scrubber.py", line 301, in save_attachment
fp.write(decodedpayload)
TypeError: argument must be string or read-only character buffer, not instance
I've narrowed the message that triggers the bug down to:
----------------------------------------------------------------------------
>From owner-svlug@svlug.svlug.org Tue Jul 7 17:20:00 1998
From: Chris DiBona <foo@domain>
To: svlug@svlug.org
Subject: foo
Message-ID: <Pine.LNX.3.96.980707171759.5714C-100000@spider.precognitive.com>
MIME-Version: 1.0
Content-Type: MULTIPART/MIXED; BOUNDARY=------------A5D4C271202F9966AFAA3659
Content-ID: <Pine.LNX.3.96.980707171759.5714D@spider.precognitive.com>
--------------A5D4C271202F9966AFAA3659
Content-Type: TEXT/PLAIN; CHARSET=us-ascii
Content-ID: <Pine.LNX.3.96.980707171759.5714E@spider.precognitive.com>
--------------A5D4C271202F9966AFAA3659--
----------------------------------------------------------------------------
#2
moremagic:/var/local/mailman/bin# ./arch svlug /tmp/mesg2
Traceback (most recent call last):
File "./arch", line 129, in ?
main()
File "./arch", line 118, in main
archiver.processUnixMailbox(fp, Article)
File "/var/local/mailman/Mailman/Archiver/pipermail.py", line 525, in processUnixMailbox
m = mbox.next()
File "/var/local/mailman/Mailman/pythonlib/mailbox.py", line 38, in next
return self.factory(_Subfile(self.fp, start, stop))
File "/var/local/mailman/Mailman/Mailbox.py", line 77, in scrubber
return mailbox.scrub(msg)
File "/var/local/mailman/Mailman/Mailbox.py", line 97, in scrub
return self._scrubber(self._mlist, msg)
File "/var/local/mailman/Mailman/Handlers/Scrubber.py", line 114, in process
url = save_attachment(mlist, part, filter_html=0)
File "/var/local/mailman/Mailman/Handlers/Scrubber.py", line 214, in save_attachment
decodedpayload = msg.get_payload(decode=1)
File "/usr/lib/python2.1/site-packages/email/Message.py", line 123, in get_payload
return Utils._bdecode(payload)
File "/usr/lib/python2.1/site-packages/email/Utils.py", line 56, in _bdecode
value = base64.decodestring(s)
File "/usr/lib/python2.1/base64.py", line 47, in decodestring
decode(f, g)
File "/usr/lib/python2.1/base64.py", line 31, in decode
s = binascii.a2b_base64(line)
binascii.Error: Incorrect padding
The faulty message is attached (/tmp/mesg2)
#3
Traceback (most recent call last):
File "./arch", line 129, in ?
main()
File "./arch", line 118, in main
archiver.processUnixMailbox(fp, Article)
File "/var/local/mailman/Mailman/Archiver/pipermail.py", line 525, in processUnixMailbox
m = mbox.next()
File "/var/local/mailman/Mailman/pythonlib/mailbox.py", line 38, in next
return self.factory(_Subfile(self.fp, start, stop))
File "/var/local/mailman/Mailman/Mailbox.py", line 77, in scrubber
return mailbox.scrub(msg)
File "/var/local/mailman/Mailman/Mailbox.py", line 97, in scrub
return self._scrubber(self._mlist, msg)
File "/var/local/mailman/Mailman/Handlers/Scrubber.py", line 154, in process
url = save_attachment(mlist, part)
File "/var/local/mailman/Mailman/Handlers/Scrubber.py", line 301, in save_attachment
fp.write(decodedpayload)
TypeError: argument must be string or read-only character buffer, not instance
I don't know if the problem is like #1 or not (probably)
----------------------------------------------------------------------------
>From owner-svlug@svlug.svlug.org Thu Feb 11 13:12:28 1999
From: linux <linux@mrfoda.com>
To: svlug@svlug.org
Date: Thu, 11 Feb 1999 11:57:38 -0800
Subject: [svlug]
X-mailer: Phoenix Mail 0.92 Standard Edition
MIME-Version: 1.0
Content-type: multipart/mixed; boundary=-----Phoenix-Boundary-07081998-
Content-Length: 1801
Lines: 35
-------Phoenix-Boundary-07081998-
Content-type: text/plain; charset=ISO-8859-1
Content-transfer-encoding: Quoted-printable
Hello all, I am brand new to Linux and to networking. I would like to get
some opinions from experienced Linux users on a configuration of three
systems. Here is how it brakes down:
(...)
-------Phoenix-Boundary-07081998---
----------------------------------------------------------------------------
--
Microsoft is to operating systems & security ....
.... what McDonalds is to gourmet cooking
Home page: http://marc.merlins.org/ | Finger marc_f@merlins.org for PGP key
--DocE+STaALJfprDB
Content-Type: text/plain; charset=us-ascii
Content-Disposition: attachment; filename=mesg2
>From owner-svlug@svlug.svlug.org Fri Dec 18 17:54:07 1998
From: "Hyouck Kim" <foo@domain>
To: "Linux Usergroup" <svlug@svlug.org>
Subject: [svlug] I Think
MIME-Version: 1.0
Content-Type: multipart/alternative;
boundary="----=_NextPart_000_0081_01BE2B34.E5B83120"
Content-Length: 2676
Lines: 49
This is a multi-part message in MIME format.
------=_NextPart_000_0081_01BE2B34.E5B83120
Content-Type: text/plain;
charset="euc-kr"
Content-Transfer-Encoding: base64
SGkuDQoNCkkgdGhpbmsgbGludXggbmVlcyB2aXN1YWwgbW9kZWxpbmcgdG9vbHMgbGlrZSByYXRp
b25hbCByb3NlLg0KDQpJIGtub3cgdGhhdCB0aGVyZSBhcmUgc2V2ZXJhbCBqYXZhIHZlcnNpb25z
LiBCdXQgaXQgaXMgbm90IGFzIHBvd2VyZnVsIGFzIHJhdGlvbmFsJ3MuDQoNCk5vd2FkYXlzIEkg
ZGV2ZWxvcCBhIHVuaXggYXBwbGljYXRpb24gb24gbXkgbGludXggc3lzdGVtLiBCdXQgdG8gZGVz
aWduIGEgbW9kZWwsDQoNCkkgbXVzdCB0dXJuIHRvIFdpbmRvd3MgYW5kIGF0IHRoYXQgdGltZSwg
SSBmZWVsIGV4dHJlbWVseSB1bmNvdmVuaWVudC4NCg0KRG8geW91IGtub3cgYW55IHByb2plY3Qg
YWJvdXQgbGludXggdmlzdWFsIG1vZGVsaW5nIHRvb2w/DQoNClRoYW5rIHlvdS4NCg0KDQo=
------=_NextPart_000_0081_01BE2B34.E5B83120
Content-Type: text/html;
charset="euc-kr"
Content-Transfer-Encoding: base64
PCFET0NUWVBFIEhUTUwgUFVCTElDICItLy9XM0MvL0RURCBXMyBIVE1MLy9FTiI+DQo8SFRNTD4N
CjxIRUFEPg0KDQo8TUVUQSBjb250ZW50PSJ0ZXh0L2h0bWw7IGNoYXJzZXQ9a3NfY181NjAxLTE5
ODciIGh0dHAtZXF1aXY9Q29udGVudC1UeXBlPg0KPE1FVEEgY29udGVudD0nIk1TSFRNTCA0Ljcy
LjMxMTAuNyInIG5hbWU9R0VORVJBVE9SPg0KPC9IRUFEPg0KPEJPRFkgYmdDb2xvcj0jZmZmZmZm
Pg0KPERJVj48Rk9OVCBjb2xvcj0jMDAwMDAwIHNpemU9Mj5IaS48L0ZPTlQ+PC9ESVY+DQo8RElW
PjxGT05UIGNvbG9yPSMwMDAwMDAgc2l6ZT0yPjwvRk9OVD4mbmJzcDs8L0RJVj4NCjxESVY+PEZP
TlQgc2l6ZT0yPkkgdGhpbmsgbGludXggbmVlcyB2aXN1YWwgbW9kZWxpbmcgdG9vbHMgbGlrZSBy
YXRpb25hbCANCnJvc2UuPC9GT05UPjwvRElWPg0KPERJVj48Rk9OVCBzaXplPTI+PC9GT05UPiZu
YnNwOzwvRElWPg0KPERJVj48Rk9OVCBzaXplPTI+SSBrbm93IHRoYXQgdGhlcmUgYXJlIHNldmVy
YWwgamF2YSB2ZXJzaW9ucy4gQnV0IGl0IGlzIG5vdCBhcyANCnBvd2VyZnVsIGFzIHJhdGlvbmFs
J3MuPC9GT05UPjwvRElWPg0KPERJVj48Rk9OVCBzaXplPTI+PC9GT05UPiZuYnNwOzwvRElWPg0K
PERJVj48Rk9OVCBzaXplPTI+Tm93YWRheXMgSSBkZXZlbG9wIGEgdW5peCBhcHBsaWNhdGlvbiBv
biBteSBsaW51eCBzeXN0ZW0uIEJ1dCANCnRvIGRlc2lnbiBhIG1vZGVsLDwvRk9OVD48L0RJVj4N
CjxESVY+PEZPTlQgc2l6ZT0yPjwvRk9OVD4mbmJzcDs8L0RJVj4NCjxESVY+PEZPTlQgc2l6ZT0y
PkkgbXVzdCB0dXJuIHRvIFdpbmRvd3MgYW5kIGF0IHRoYXQgdGltZSwgSSBmZWVsIGV4dHJlbWVs
eSANCnVuY292ZW5pZW50LjwvRk9OVD48L0RJVj4NCjxESVY+PEZPTlQgc2l6ZT0yPjwvRk9OVD4m
bmJzcDs8L0RJVj4NCjxESVY+PEZPTlQgc2l6ZT0yPkRvIHlvdSBrbm93IGFueSBwcm9qZWN0IGFi
b3V0IGxpbnV4IHZpc3VhbCBtb2RlbGluZyANCnRvb2w/PC9GT05UPjwvRElWPg0KPERJVj48Rk9O
VCBzaXplPTI+PC9GT05UPiZuYnNwOzwvRElWPg0KPERJVj48Rk9OVCBzaXplPTI+VGhhbmsgeW91
LjwvRk9OVD48L0RJVj4NCjxESVY+PEZPTlQgc2l6ZT0yPjwvRk9OVD4mbmJzcDs8L0RJVj4NCjxE
SVY+PEZPTlQgc2l6ZT0yPjwvRk9OVD4mbmJzcDs8L0RJVj48L0JPRFk+PC9IVE1MPg0K
------=_NextPart_000_0081_01BE2B34.E5B83120--
--DocE+STaALJfprDB--