[Mailman-Users] mailman python-2.4 using 96% cpu
Goodman, William
wgoodman at jcvi.org
Fri Feb 6 22:42:43 CET 2009
Sorry to say Mike this is after applying all patches... but it now
archiving
top - 16:33:18 up 1 day, 23:08, 2 users, load average: 2.87, 2.24,
1.32
Tasks: 106 total, 3 running, 103 sleeping, 0 stopped, 0 zombie
Cpu(s): 58.7%us, 3.5%sy, 0.0%ni, 37.4%id, 0.2%wa, 0.0%hi, 0.2%si,
0.0%st
Mem: 3866604k total, 1600176k used, 2266428k free, 442080k buffers
Swap: 4194296k total, 4k used, 4194292k free, 373852k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
8969 mailman 25 0 150m 12m 2748 R 93 0.3 5:37.84 python2.4
8971 mailman 16 0 147m 9952 2808 S 9 0.3 1:42.04 python2.4
8967 mailman 16 0 151m 12m 2748 S 1 0.3 0:20.62 python2.4
2 root RT -5 0 0 0 S 0 0.0 0:06.35 migration/0
10760 postfix 16 0 54212 2624 2064 S 0 0.1 0:00.12 local
10895 postfix 15 0 54252 2356 1820 S 0 0.1 0:00.11 cleanup
# ps -fwp 8969
UID PID PPID C STIME TTY TIME CMD
mailman 8969 8965 73 16:25 ? 00:06:43 /usr/bin/python2.4
/opt/software/mailman/bin/qrunner --runner=IncomingRunner:0:1 -s
# ps -fwp 8971
UID PID PPID C STIME TTY TIME CMD
mailman 8971 8965 22 16:25 ? 00:02:10 /usr/bin/python2.4
/opt/software/mailman/bin/qrunner --runner=OutgoingRunner:0:1 -s
# ps -fwp 8967
UID PID PPID C STIME TTY TIME CMD
mailman 8967 8965 4 16:25 ? 00:00:28 /usr/bin/python2.4
/opt/software/mailman/bin/qrunner --runner=BounceRunner:0:1 -s
Any other suggestions are welcomed.
Bill
-----Original Message-----
From: mailman-users-bounces+wgoodman=jcvi.org at python.org
[mailto:mailman-users-bounces+wgoodman=jcvi.org at python.org] On Behalf Of
Goodman, William
Sent: Thursday, February 05, 2009 4:10 PM
To: Mark Sapiro; mailman-users at python.org
Subject: Re: [Mailman-Users] mailman python-2.4 using 96% cpu
Hi Mike,
Theses are the high cpu grabbers:
mailman 4764 4751 74 Feb04 ? 17:00:03 /usr/bin/python2.4
/opt/software/mailman/bin/qrunner --runner=IncomingRunner:0:1 -s
UID PID PPID C STIME TTY TIME CMD
mailman 4766 4751 22 Feb04 ? 05:08:33 /usr/bin/python2.4
/opt/software/mailman/bin/qrunner --runner=OutgoingRunner:0:1 -s
UID PID PPID C STIME TTY TIME CMD
mailman 4760 4751 4 Feb04 ? 01:01:34 /usr/bin/python2.4
/opt/software/mailman/bin/qrunner --runner=BounceRunner:0:1 -s
Also there's a dead like to the patch location you sent me.
Bill
-----Original Message-----
From: Mark Sapiro [mailto:mark at msapiro.net]
Sent: Thursday, February 05, 2009 3:47 PM
To: Goodman, William; mailman-users at python.org
Subject: RE: [Mailman-Users] mailman python-2.4 using 96% cpu
Goodman, William wrote:
>What release did you upgrade from?
>>From 2.1.7 to 2.1.12rc1
OK
>What's in Mailman's logs?
[...]
>snipet from error:
>Feb 04 19:13:23 2009 (4759) Traceback (most recent call last):
> File "/opt/software/mailman/Mailman/Queue/Runner.py", line 120, in
>_oneloop
> self._onefile(msg, msgdata)
> File "/opt/software/mailman/Mailman/Queue/Runner.py", line 191, in
>_onefile
> keepqueued = self._dispose(mlist, msg, msgdata)
> File "/opt/software/mailman/Mailman/Queue/ArchRunner.py", line 73, in
>_dispose
> mlist.ArchiveMail(msg)
> File "/opt/software/mailman/Mailman/Archiver/Archiver.py", line 216,
>in ArchiveMail
> h.processUnixMailbox(f)
> File "/opt/software/mailman/Mailman/Archiver/pipermail.py", line 564,
>in processUnixMailbox
> m = mbox.next()
> File "/usr/lib64/python2.4/mailbox.py", line 35, in next
> return self.factory(_Subfile(self.fp, start, stop))
> File "/opt/software/mailman/Mailman/Mailbox.py", line 89, in scrubber
> return mailbox.scrub(msg)
> File "/opt/software/mailman/Mailman/Mailbox.py", line 109, in scrub
> return self._scrubber(self._mlist, msg)
> File "/opt/software/mailman/Mailman/Handlers/Scrubber.py", line 408,
>in process
> replace_payload_by_text(msg, sep.join(text), charset)
> File "/opt/software/mailman/Mailman/Handlers/Scrubber.py", line 170,
>in replace_payload_by_text
> msg.set_payload(text, charset)
> File "/usr/lib64/python2.4/email/Message.py", line 218, in
set_payload
> self.set_charset(charset)
> File "/usr/lib64/python2.4/email/Message.py", line 242, in
set_charset
> raise TypeError(charset)
>TypeError: us-ascii
This is a problem in the 2.1.12rc1 release. See the post at
<http://mail.python.org/pipermail/mailman-announce/2009-January/000129.h
tml>
for the fix. There are a couple of other problems too. I will be
releasing 2.1.12rc2 in a day or so.
[...]
>snipet from smtp-failure:
>.org>
>Feb 04 17:27:18 2009 (4766) delivery to mailman-owner at lists.tigr.org
>failed with code -1: (111, 'Connection refused') Feb 04 17:27:18 2009
>(4766) Low level smtp error: (111, 'Connection refused'), msgid:
><20090204222702.7F98420066 at lists.jcvi.org>
>Feb 04 17:27:18 2009 (4766) delivery to mailman-owner at lists.tigr.org
>failed with code -1: (111, 'Connection refused') Feb 04 17:27:18 2009
>(4766) Low level smtp error: (111, 'Connection refused'), msgid:
><20090204222701.70F4F20070 at lists.jcvi.org>
>Feb 04 17:27:18 2009 (4766) delivery to mailman-owner at lists.tigr.org
>failed with code -1: (111, 'Connection refused') Feb 04 17:27:18 2009
>(4766) Low level smtp error: (111, 'Connection refused'), msgid:
><20090204222702.9D7D82006D at lists.jcvi.org>
>Feb 04 17:27:18 2009 (4766) delivery to mailman-owner at lists.tigr.org
>failed with code -1: (111, 'Connection refused')
Your MTA is not accepting connects from Mailman, at least part of the
time. See the FAQ at <http://wiki.list.org/x/-IA9> for debugging hints
if this is an ongoing problem.
>
>What's in Mailman's qfiles/in/ directory?
>empty
>
>What are the other two high cpu runners (pids 4951 and 4946)?
>Yes that's it.
Yes, but which runners are they?
ps -fwp 4946 4951
>Does Mailman work normally except for this high cpu usage?
>
>First after moving my lists server all basic functions work, however
>the list server is not archiving, even when I select daily.
The not archiving is the issue referred to above. Once you apply the
patch from
<http://mail.python.org/pipermail/mailman-announce/2009-January/000129.h
tml>,
you can check that you have no 'old' files in qfiles/shunt and run
bin/unshunt to archive the the messages that were shunted during
archiving.
>This is most likely because users cannot reply because they get bounced
>with:
>
>Your message did not reach some or all of the intended recipients.
>Subject: RE: [Mylist] Test message
>Sent: 2/4/2009 6:12 PM
>The following recipient(s) could not be reached:
>
>mylist at jcvi.org on 2/4/2009 6:12 PM
>
>The e-mail account does not exist at the organization this message was
>sent to. Check the e-mail address, or contact the recipient directly to
>find out the correct address.
>
><EXCHANGE.XXXX.ORG #5.1.1>
This is an MTA issue. Were these list's working before the upgrade?
--
Mark Sapiro <mark at msapiro.net> The highway is for gamblers,
San Francisco Bay Area, California better use your sense - B. Dylan
------------------------------------------------------
Mailman-Users mailing list
Mailman-Users at python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3 Searchable Archives:
http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe:
http://mail.python.org/mailman/options/mailman-users/wgoodman%40jcvi.org
Security Policy: http://wiki.list.org/x/QIA9
More information about the Mailman-Users
mailing list