[Mailman-Users] mailman python-2.4 using 96% cpu

[Goodman, William]

What release did you upgrade from?
>From 2.1.7 to 2.1.12rc1

What's in Mailman's logs?
snipet from bounce:
Feb 05 13:48:17 2009 (4760) gme_conference: bounce message w/no
discernable addresses:
<200902051848.n15ImFX1011268 at independence.tigr.org>
Feb 05 13:48:17 2009 (4760) gme_conference: forwarding unrecognized,
message-id: <200902051848.n15ImFX1011268 at independence.tigr.org>
snipet from error:
Feb 04 19:13:23 2009 (4759) Traceback (most recent call last):
  File "/opt/software/mailman/Mailman/Queue/Runner.py", line 120, in
_oneloop
    self._onefile(msg, msgdata)
  File "/opt/software/mailman/Mailman/Queue/Runner.py", line 191, in
_onefile
    keepqueued = self._dispose(mlist, msg, msgdata)
  File "/opt/software/mailman/Mailman/Queue/ArchRunner.py", line 73, in
_dispose
    mlist.ArchiveMail(msg)
  File "/opt/software/mailman/Mailman/Archiver/Archiver.py", line 216,
in ArchiveMail
    h.processUnixMailbox(f)
  File "/opt/software/mailman/Mailman/Archiver/pipermail.py", line 564,
in processUnixMailbox
    m = mbox.next()
  File "/usr/lib64/python2.4/mailbox.py", line 35, in next
    return self.factory(_Subfile(self.fp, start, stop))
  File "/opt/software/mailman/Mailman/Mailbox.py", line 89, in scrubber
    return mailbox.scrub(msg)
  File "/opt/software/mailman/Mailman/Mailbox.py", line 109, in scrub
    return self._scrubber(self._mlist, msg)
  File "/opt/software/mailman/Mailman/Handlers/Scrubber.py", line 408,
in process
    replace_payload_by_text(msg, sep.join(text), charset)
  File "/opt/software/mailman/Mailman/Handlers/Scrubber.py", line 170,
in replace_payload_by_text
    msg.set_payload(text, charset)
  File "/usr/lib64/python2.4/email/Message.py", line 218, in set_payload
    self.set_charset(charset)
  File "/usr/lib64/python2.4/email/Message.py", line 242, in set_charset
    raise TypeError(charset)
TypeError: us-ascii
snipet from qrunner:
(pid: 4948, sig: None, sts: 15, class: CommandRunner, slice: 1/1)
Feb 04 17:25:24 2009 (4759) ArchRunner qrunner started.
Feb 04 17:25:24 2009 (4762) CommandRunner qrunner started.
Feb 04 17:25:24 2009 (4760) BounceRunner qrunner started.
Feb 04 17:25:24 2009 (4765) NewsRunner qrunner started.
Feb 04 17:25:24 2009 (4764) IncomingRunner qrunner started.
Feb 04 17:25:24 2009 (4767) VirginRunner qrunner started.
Feb 04 17:25:24 2009 (4766) OutgoingRunner qrunner started.
Feb 04 17:25:24 2009 (4768) RetryRunner qrunner started.
snipet from smtp-failure:
.org>
Feb 04 17:27:18 2009 (4766) delivery to mailman-owner at lists.tigr.org
failed with code -1: (111, 'Connection refused')
Feb 04 17:27:18 2009 (4766) Low level smtp error: (111, 'Connection
refused'), msgid: <20090204222702.7F98420066 at lists.jcvi.org>
Feb 04 17:27:18 2009 (4766) delivery to mailman-owner at lists.tigr.org
failed with code -1: (111, 'Connection refused')
Feb 04 17:27:18 2009 (4766) Low level smtp error: (111, 'Connection
refused'), msgid: <20090204222701.70F4F20070 at lists.jcvi.org>
Feb 04 17:27:18 2009 (4766) delivery to mailman-owner at lists.tigr.org
failed with code -1: (111, 'Connection refused')
Feb 04 17:27:18 2009 (4766) Low level smtp error: (111, 'Connection
refused'), msgid: <20090204222702.9D7D82006D at lists.jcvi.org>
Feb 04 17:27:18 2009 (4766) delivery to mailman-owner at lists.tigr.org
failed with code -1: (111, 'Connection refused')

The other logs show normal logging nor errors or warnings

What's in Mailman's qfiles/in/ directory?
empty

What are the other two high cpu runners (pids 4951 and 4946)?
Yes that's it.

Does Mailman work normally except for this high cpu usage?

First after moving my lists server all basic functions work, however the
list server is not archiving, even when I select daily.
This is most likely because users cannot reply because they get bounced
with:
 
Your message did not reach some or all of the intended recipients.
Subject: RE: [Mylist] Test message
Sent: 2/4/2009 6:12 PM
The following recipient(s) could not be reached:

mylist at jcvi.org on 2/4/2009 6:12 PM

The e-mail account does not exist at the organization this message was
sent to. Check the e-mail address, or contact the recipient directly to
find out the correct address.

<EXCHANGE.XXXX.ORG #5.1.1>


-----Original Message-----
From: Mark Sapiro [mailto:mark at msapiro.net] 
Sent: Thursday, February 05, 2009 2:14 PM
To: Goodman, William; mailman-users at python.org
Subject: Re: [Mailman-Users] mailman python-2.4 using 96% cpu

Goodman, William wrote:
> 
>After downloading and installing the latest version of 
>mailman-2.1.12rc1 and I'm using Apache-2.2-11 and 
>Postfix-2.3.3-2.1.el5_2. On CentOS 5.2 (RedhHat) for some reason I 
>can't understand the CPU usage is at 96% for mailman. When I do a top I

>get:
> 
>top - 11:18:13 up 16:38,  1 user,  load average: 2.78, 2.76, 2.62
>Tasks: 122 total,   2 running, 120 sleeping,   0 stopped,   0 zombie
>Cpu(s): 33.4%us,  2.3%sy,  0.0%ni, 64.0%id,  0.2%wa,  0.0%hi,  0.1%si, 
>0.0%st
>Mem:   3866536k total,  2471544k used,  1394992k free,   409096k
buffers
>Swap:  4194296k total,        0k used,  4194296k free,  1435408k cached
> 
>PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
>
>4949 mailman   25   0  175m  37m 2760 R   97  1.0 944:03.94 python2.4
>
>4951 mailman   16   0  168m  30m 2828 S   12  0.8 288:29.09 python2.4
>
>4946 mailman   16   0  171m  33m 2752 S    2  0.9  57:05.67 python2.4
>
>11093 postfix   15   0 54512 2848 2228 S    1  0.1   0:00.29 smtpd
>
>14 root      10  -5     0    0    0 S    0  0.0   1:02.48 events/0
>
>3935 root      10  -5     0    0    0 S    0  0.0   2:42.83 kjournald
>
>6479 root      15   0 88068 3232 2516 S    0  0.1   0:00.17 sshd
>
>10942 postfix   15   0 54212 2624 2064 S    0  0.1   0:00.20 local
>
>11157 postfix   15   0 54252 2360 1820 S    0  0.1   0:00.11 cleanup
>
>11172 postfix   16   0 55140 2356 1820 S    0  0.1   0:00.10 cleanup
>
> 
>When I search for that PID I get this:
> 
># ps -ef | grep 4949
>mailman   4949  4938 94 Feb03 ?        15:44:50 /usr/bin/python2.4
>/opt/software/mailman/bin/qrunner --runner=IncomingRunner:0:1 -s


What release did you upgrade from?

What's in Mailman's logs?

What's in Mailman's qfiles/in/ directory?

What are the other two high cpu runners (pids 4951 and 4946)?

Does Mailman work normally except for this high cpu usage?

-- 
Mark Sapiro <mark at msapiro.net>        The highway is for gamblers,
San Francisco Bay Area, California    better use your sense - B. Dylan