[Mailman-Users] mailman python-2.4 using 96% cpu

Goodman, William wgoodman at jcvi.org
Fri Feb 6 22:42:43 CET 2009


Sorry to say Mike this is after applying all patches... but it now
archiving

top - 16:33:18 up 1 day, 23:08,  2 users,  load average: 2.87, 2.24,
1.32
Tasks: 106 total,   3 running, 103 sleeping,   0 stopped,   0 zombie
Cpu(s): 58.7%us,  3.5%sy,  0.0%ni, 37.4%id,  0.2%wa,  0.0%hi,  0.2%si,
0.0%st
Mem:   3866604k total,  1600176k used,  2266428k free,   442080k buffers
Swap:  4194296k total,        4k used,  4194292k free,   373852k cached

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
 8969 mailman   25   0  150m  12m 2748 R   93  0.3   5:37.84 python2.4
 8971 mailman   16   0  147m 9952 2808 S    9  0.3   1:42.04 python2.4
 8967 mailman   16   0  151m  12m 2748 S    1  0.3   0:20.62 python2.4
    2 root      RT  -5     0    0    0 S    0  0.0   0:06.35 migration/0
10760 postfix   16   0 54212 2624 2064 S    0  0.1   0:00.12 local
10895 postfix   15   0 54252 2356 1820 S    0  0.1   0:00.11 cleanup

# ps -fwp 8969
UID        PID  PPID  C STIME TTY          TIME CMD
mailman   8969  8965 73 16:25 ?        00:06:43 /usr/bin/python2.4
/opt/software/mailman/bin/qrunner --runner=IncomingRunner:0:1 -s 

# ps -fwp 8971
UID        PID  PPID  C STIME TTY          TIME CMD
mailman   8971  8965 22 16:25 ?        00:02:10 /usr/bin/python2.4
/opt/software/mailman/bin/qrunner --runner=OutgoingRunner:0:1 -s

# ps -fwp 8967
UID        PID  PPID  C STIME TTY          TIME CMD
mailman   8967  8965  4 16:25 ?        00:00:28 /usr/bin/python2.4
/opt/software/mailman/bin/qrunner --runner=BounceRunner:0:1 -s

Any other suggestions are welcomed.

Bill

-----Original Message-----
From: mailman-users-bounces+wgoodman=jcvi.org at python.org
[mailto:mailman-users-bounces+wgoodman=jcvi.org at python.org] On Behalf Of
Goodman, William
Sent: Thursday, February 05, 2009 4:10 PM
To: Mark Sapiro; mailman-users at python.org
Subject: Re: [Mailman-Users] mailman python-2.4 using 96% cpu

Hi Mike,

Theses are the high cpu grabbers:

mailman   4764  4751 74 Feb04 ?        17:00:03 /usr/bin/python2.4
/opt/software/mailman/bin/qrunner --runner=IncomingRunner:0:1 -s

UID        PID  PPID  C STIME TTY          TIME CMD
mailman   4766  4751 22 Feb04 ?        05:08:33 /usr/bin/python2.4
/opt/software/mailman/bin/qrunner --runner=OutgoingRunner:0:1 -s

UID        PID  PPID  C STIME TTY          TIME CMD
mailman   4760  4751  4 Feb04 ?        01:01:34 /usr/bin/python2.4
/opt/software/mailman/bin/qrunner --runner=BounceRunner:0:1 -s 

Also there's a dead like to the patch location you sent me.

Bill

-----Original Message-----
From: Mark Sapiro [mailto:mark at msapiro.net]
Sent: Thursday, February 05, 2009 3:47 PM
To: Goodman, William; mailman-users at python.org
Subject: RE: [Mailman-Users] mailman python-2.4 using 96% cpu

Goodman, William wrote:

>What release did you upgrade from?
>>From 2.1.7 to 2.1.12rc1


OK


>What's in Mailman's logs?
[...]
>snipet from error:
>Feb 04 19:13:23 2009 (4759) Traceback (most recent call last):
>  File "/opt/software/mailman/Mailman/Queue/Runner.py", line 120, in 
>_oneloop
>    self._onefile(msg, msgdata)
>  File "/opt/software/mailman/Mailman/Queue/Runner.py", line 191, in 
>_onefile
>    keepqueued = self._dispose(mlist, msg, msgdata)
>  File "/opt/software/mailman/Mailman/Queue/ArchRunner.py", line 73, in

>_dispose
>    mlist.ArchiveMail(msg)
>  File "/opt/software/mailman/Mailman/Archiver/Archiver.py", line 216, 
>in ArchiveMail
>    h.processUnixMailbox(f)
>  File "/opt/software/mailman/Mailman/Archiver/pipermail.py", line 564,

>in processUnixMailbox
>    m = mbox.next()
>  File "/usr/lib64/python2.4/mailbox.py", line 35, in next
>    return self.factory(_Subfile(self.fp, start, stop))
>  File "/opt/software/mailman/Mailman/Mailbox.py", line 89, in scrubber
>    return mailbox.scrub(msg)
>  File "/opt/software/mailman/Mailman/Mailbox.py", line 109, in scrub
>    return self._scrubber(self._mlist, msg)
>  File "/opt/software/mailman/Mailman/Handlers/Scrubber.py", line 408, 
>in process
>    replace_payload_by_text(msg, sep.join(text), charset)
>  File "/opt/software/mailman/Mailman/Handlers/Scrubber.py", line 170, 
>in replace_payload_by_text
>    msg.set_payload(text, charset)
>  File "/usr/lib64/python2.4/email/Message.py", line 218, in
set_payload
>    self.set_charset(charset)
>  File "/usr/lib64/python2.4/email/Message.py", line 242, in
set_charset
>    raise TypeError(charset)
>TypeError: us-ascii


This is a problem in the 2.1.12rc1 release. See the post at
<http://mail.python.org/pipermail/mailman-announce/2009-January/000129.h
tml>
for the fix. There are a couple of other problems too. I will be
releasing 2.1.12rc2 in a day or so.


[...]
>snipet from smtp-failure:
>.org>
>Feb 04 17:27:18 2009 (4766) delivery to mailman-owner at lists.tigr.org 
>failed with code -1: (111, 'Connection refused') Feb 04 17:27:18 2009
>(4766) Low level smtp error: (111, 'Connection refused'), msgid: 
><20090204222702.7F98420066 at lists.jcvi.org>
>Feb 04 17:27:18 2009 (4766) delivery to mailman-owner at lists.tigr.org 
>failed with code -1: (111, 'Connection refused') Feb 04 17:27:18 2009
>(4766) Low level smtp error: (111, 'Connection refused'), msgid: 
><20090204222701.70F4F20070 at lists.jcvi.org>
>Feb 04 17:27:18 2009 (4766) delivery to mailman-owner at lists.tigr.org 
>failed with code -1: (111, 'Connection refused') Feb 04 17:27:18 2009
>(4766) Low level smtp error: (111, 'Connection refused'), msgid: 
><20090204222702.9D7D82006D at lists.jcvi.org>
>Feb 04 17:27:18 2009 (4766) delivery to mailman-owner at lists.tigr.org 
>failed with code -1: (111, 'Connection refused')


Your MTA is not accepting connects from Mailman, at least part of the
time. See the FAQ at <http://wiki.list.org/x/-IA9> for debugging hints
if this is an ongoing problem.

>
>What's in Mailman's qfiles/in/ directory?
>empty
>
>What are the other two high cpu runners (pids 4951 and 4946)?
>Yes that's it.


Yes, but which runners are they?

ps -fwp 4946 4951



>Does Mailman work normally except for this high cpu usage?
>
>First after moving my lists server all basic functions work, however 
>the list server is not archiving, even when I select daily.


The not archiving is the issue referred to above. Once you apply the
patch from
<http://mail.python.org/pipermail/mailman-announce/2009-January/000129.h
tml>,
you can check that you have no 'old' files in qfiles/shunt and run
bin/unshunt to archive the the messages that were shunted during
archiving.


>This is most likely because users cannot reply because they get bounced
>with:
> 
>Your message did not reach some or all of the intended recipients.
>Subject: RE: [Mylist] Test message
>Sent: 2/4/2009 6:12 PM
>The following recipient(s) could not be reached:
>
>mylist at jcvi.org on 2/4/2009 6:12 PM
>
>The e-mail account does not exist at the organization this message was 
>sent to. Check the e-mail address, or contact the recipient directly to

>find out the correct address.
>
><EXCHANGE.XXXX.ORG #5.1.1>


This is an MTA issue. Were these list's working before the upgrade?

-- 
Mark Sapiro <mark at msapiro.net>        The highway is for gamblers,
San Francisco Bay Area, California    better use your sense - B. Dylan

------------------------------------------------------
Mailman-Users mailing list
Mailman-Users at python.org
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3 Searchable Archives:
http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe:
http://mail.python.org/mailman/options/mailman-users/wgoodman%40jcvi.org

Security Policy: http://wiki.list.org/x/QIA9


More information about the Mailman-Users mailing list