[Mailman-Users] Mailman / Sendmail horribly slowperformance..suggestions please?!?
Andrew Falgout
Andrew.Falgout at usm.edu
Mon Aug 25 16:30:38 CEST 2003
I've included some of the diagnostics that was requested. As of this moment
there are 7423 messages in the qfiles directory for mailman. And it
continues to grow. Please let me know if my thinking is flawed on how mails
flow through the system.
1. Message to a list hits sendmail initially and goes into the mqueue
directory for sendmail for processing.
2. Sendmail delivers the message to the mailman wrapper which places the
message in the qfiles directory for qrunner to process.
3. qrunner picks up these messages one by one, and delivers the message to
each of the recpts listed for the list.
How does qrunner decide which email to process? Is there a way to have it
process a certain message in the qfiles directory? Are there any utilities
for determining what is in the queue or why it was queued by qrunner.
I really do appreciate all the help.
Yes.. I am using sendmail as my MTA.
Trying 127.0.0.1...
Connected to localhost.
Escape character is '^]'.
220 ocean.otr.usm.edu ESMTP Sendmail 8.11.6/8.11.6; Mon, 25 Aug 2003
09:21:56 -0500
(ocean) root $ time host python.org
DNS lookups are almost instantaneous.
python.org has address 194.109.137.226
host python.org 0.04s user 0.01s system 97% cpu 0.051 total
(ocean) root $ dig -t python.org
(/var/spool/mailman/qfiles)
;; Warning, ignoring invalid type python.org
; <<>> DiG 9.2.1 <<>> -t python.org
;; global options: printcmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 19709
;; flags: qr rd ra; QUERY: 1, ANSWER: 13, AUTHORITY: 0, ADDITIONAL: 13
;; QUESTION SECTION:
;. IN NS
;; ANSWER SECTION:
. 5402 IN NS G.ROOT-SERVERS.NET.
. 5402 IN NS H.ROOT-SERVERS.NET.
. 5402 IN NS I.ROOT-SERVERS.NET.
. 5402 IN NS J.ROOT-SERVERS.NET.
. 5402 IN NS K.ROOT-SERVERS.NET.
. 5402 IN NS L.ROOT-SERVERS.NET.
. 5402 IN NS M.ROOT-SERVERS.NET.
. 5402 IN NS A.ROOT-SERVERS.NET.
. 5402 IN NS B.ROOT-SERVERS.NET.
. 5402 IN NS C.ROOT-SERVERS.NET.
. 5402 IN NS D.ROOT-SERVERS.NET.
. 5402 IN NS E.ROOT-SERVERS.NET.
. 5402 IN NS F.ROOT-SERVERS.NET.
;; ADDITIONAL SECTION:
A.ROOT-SERVERS.NET. 600537 IN A 198.41.0.4
B.ROOT-SERVERS.NET. 600537 IN A 128.9.0.107
C.ROOT-SERVERS.NET. 510409 IN A 192.33.4.12
D.ROOT-SERVERS.NET. 510409 IN A 128.8.10.90
E.ROOT-SERVERS.NET. 602151 IN A 192.203.230.10
F.ROOT-SERVERS.NET. 510409 IN A 192.5.5.241
G.ROOT-SERVERS.NET. 602151 IN A 192.112.36.4
H.ROOT-SERVERS.NET. 602151 IN A 128.63.2.53
I.ROOT-SERVERS.NET. 510408 IN A 192.36.148.17
J.ROOT-SERVERS.NET. 602151 IN A 192.58.128.30
K.ROOT-SERVERS.NET. 510408 IN A 193.0.14.129
L.ROOT-SERVERS.NET. 510408 IN A 198.32.64.12
M.ROOT-SERVERS.NET. 510409 IN A 202.12.27.33
;; Query time: 3 msec
;; SERVER: 131.95.84.2#53(131.95.84.2)
;; WHEN: Mon Aug 25 09:24:48 2003
;; MSG SIZE rcvd: 436
----- Original Message -----
From: "Jon Carnes" <jonc at nc.rr.com>
To: "Andrew Falgout" <Andrew.Falgout at usm.edu>
Cc: <mailman-users at python.org>; "Richard Barrett" <r.barrett at ftel.co.uk>
Sent: Monday, August 25, 2003 9:09 AM
Subject: Re: [Mailman-Users] Mailman / Sendmail horribly
slowperformance..suggestions please?!?
> The description of the problem fits right in with the primary DNS
> resolver not working and the server having to fall back to the secondary
> for each look up.
>
> That might not be your problem, but in anycase, you should run a
> local-caching Nameserver on your mailserver. Then check to see how long
> it takes to do dns lookups:
> host -t mx some.host.com
> dig -t mx some.host.com
>
> The "dig" command will tell you how long it took to get the dns
> information. The "host" command will simply give you the information
> you requested - which in this case is a listing of the Mailservers for
> the domain some.host.com
>
> You might also want to tweak your sendmail configuration:
> http://www.trilug.org/~jonc/mailserver/PartIII.html
>
> BTW: the many MTA's use the "sendmail aliases style", the fact that
> Mailman is using it to communicate with your MTA does not insure that
> you are using Sendmail as your MTA.
>
> To find out which MTA you are using:
> telnet localhost 25
>
> Read the header it displays. It should indicate what service is acting
> as your MTA. As an example, here is what I get:
> 220 Anncons4.nc.rr.com ESMTP Sendmail 8.12.8/8.12.8; Mon, 25 Aug 2003
> 10:07:09 -0400
>
> As you can see, I'm running Sendmail on this particular server.
>
> Good Luck - Jon Carnes
>
> On Mon, 2003-08-25 at 09:28, Andrew Falgout wrote:
> > The error log is at 0 bytes. I have not overridden the Defaults.py
which
> > shows Defaults.py:MTA_ALIASES_STYLE = 'sendmail'. So I assume that
means
> > that sendmail is the MTA.
> >
> > Aug 25 08:08:31 2003 (27798) smtp for 2 recips, completed in 1.045
seconds
> > Aug 25 08:08:31 2003 (27798) smtp for 2 recips, completed in 1.149
seconds
> > Aug 25 08:12:47 2003 (27798) smtp for 1 recips, completed in 0.208
seconds
> > Aug 25 08:12:47 2003 (27798) smtp for 1 recips, completed in 0.241
seconds
> > Aug 25 08:14:25 2003 (31184) smtp for 1 recips, completed in 0.701
seconds
> > Aug 25 08:14:25 2003 (31184) smtp for 1 recips, completed in 0.716
seconds
> > Aug 25 08:17:21 2003 (31184) smtp for 1 recips, completed in 0.167
seconds
> > Aug 25 08:17:21 2003 (31184) smtp for 1 recips, completed in 0.179
seconds
> > Aug 25 08:19:34 2003 (31184) smtp for 1 recips, completed in 3.962
seconds
> > Aug 25 08:19:34 2003 (31184) smtp for 1 recips, completed in 4.234
seconds
> >
> > This is just a few of the lines in my /var/log/mailman/smtp file. There
are
> > a few bounces from time to time, but not on great frequency. I did send
an
> > email to a test list, and attempted to time when I would see my email
> > address in the post log, but after 10 minutes I have not seen it. This
> > really confuses me, because the mail system on this server delivers mail
> > directly to a mailbox in seconds. Why the delay?
> >
> > ----- Original Message -----
> > From: "Richard Barrett" <r.barrett at ftel.co.uk>
> > To: "Andrew Falgout" <Andrew.Falgout at usm.edu>
> > Cc: <mailman-users at python.org>
> > Sent: Sunday, August 24, 2003 3:36 PM
> > Subject: Re: [Mailman-Users] Mailman / Sendmail horribly slow
> > performance..suggestions please?!?
> >
> >
> > >
> > > On Sunday, August 24, 2003, at 12:51 am, Andrew Falgout wrote:
> > >
> > > > I'm currently running mailman-2.0.13-1 eith sendmail-8.11.6-25.72.
> > > > Posts
> > > > are processed very fast, but delivery is more than slow. It takes
1-2
> > > > minutes per post to delivery mail. Evaluating what is going on in
the
> > > > queue is a little more than cumbersome. Over the course of 3-4 days
> > > > mails
> > > > have been piling up in the qfiles directory to the tune of 4000
mails
> > > > and
> > > > waiting. There are mails 3 days old waiting to go out. I'm looking
> > > > for
> > > > ways to evaluate what is in the queue, why it's in the queue, and
how
> > > > to
> > > > tell qrunner to report more information on what it's thinking. Like
> > > > perhaps the msgid of the email it's trying to process at this time.
> > > >
> > > Are you using the local sendmail instance as the outgoing SMTP server?
> > >
> > > Regardless, what do the Mailman post, smtp and smtp-failure logs show
> > > about mail being handled by the system. How does this tie in with the
> > > MTA's mail log.
> > >
> > > If your outgoing mail is being handled by the local sendmail MTA then
I
> > > would normally expect Mailman to handoff to the MTA without much
delay.
> > > If MM is having problems handing off to sendmail then you might find
> > > some evidence of this in the smtp-failure log.
> > > > --
> > > > Thank You,
> > > > Andrew
> > > >
> > >
> -+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+--+-+-
> > > > +-+-+-
> > > > - Andrew Wilson Falgout (RHCE) Linux, E Pluribus
> > > > UNIX! -
> > > > - Systems Admin II, TIU Office: (601) 266-5603
> > > > -
> > > > - University of Southern Mississippi
> > > > -
> > > > - Fax: (601) 266-6788
> > > > -
> > >
> -+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-
> > > > +-+-+-+
> > >
> > >
> > > ------------------------------------------------------
> > > Mailman-Users mailing list
> > > Mailman-Users at python.org
> > > http://mail.python.org/mailman/listinfo/mailman-users
> > > Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
> > > Searchable Archives:
> > http://www.mail-archive.com/mailman-users%40python.org/
> > >
> > > This message was sent to: andrew.falgout at usm.edu
> > > Unsubscribe or change your options at
> > >
> >
http://mail.python.org/mailman/options/mailman-users/andrew.falgout%40usm.edu
> > >
> >
> >
> >
> > ------------------------------------------------------
> > Mailman-Users mailing list
> > Mailman-Users at python.org
> > http://mail.python.org/mailman/listinfo/mailman-users
> > Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
> > Searchable Archives:
http://www.mail-archive.com/mailman-users%40python.org/
> >
> > This message was sent to: jonc at nc.rr.com
> > Unsubscribe or change your options at
> > http://mail.python.org/mailman/options/mailman-users/jonc%40nc.rr.com
>
>
> ------------------------------------------------------
> Mailman-Users mailing list
> Mailman-Users at python.org
> http://mail.python.org/mailman/listinfo/mailman-users
> Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
> Searchable Archives:
http://www.mail-archive.com/mailman-users%40python.org/
>
> This message was sent to: andrew.falgout at usm.edu
> Unsubscribe or change your options at
>
http://mail.python.org/mailman/options/mailman-users/andrew.falgout%40usm.edu
>
More information about the Mailman-Users
mailing list