[Mailman-Users] non-delivery to virtual domain

Tue Nov 2 16:13:58 CET 2010

David Newman wrote:

>On 10/31/10 10:22 PM, Mark Sapiro wrote:
>> On 10/31/10 4:56 PM, David Newman wrote:
>>> On 10/31/10 9:09 AM, Mark Sapiro wrote:
>>>>
>>>> [...]
>
>Here's a log snapshot of a message sent to s at domain1.tld, a Mailman list
>with subscribers 'dnewman at networktest.com' and 'dnewman at domain1.tld'.
>
>This is after removing 'hash:/usr/local/mailman/data/domain1-tld' from
>virtual_alias_maps as you suggested and reloading Mailman and postfix.
>
>I'm embedded one comment and one question:
>
>Nov  1 11:51:29 mail postfix/postfix-script[5384]: refreshing the
>Postfix mail system
>Nov  1 11:51:29 mail postfix/master[19348]: reload -- version 2.6.5,
>configuration /etc/postfix
>Nov  1 11:51:59 mail postfix/smtpd[32434]: connect from
>mail3.networktest.com[69.55.234.104]
>Nov  1 11:51:59 mail postfix/trivial-rewrite[29411]: warning: do not
>list domain domain1.tld in BOTH mydestination and virtual_mailbox_domains
>
>This is a possible clue. I think postfix is set up so that domain1.tld
>*is* a virtual domain. The server -- Mailserver, an email server
>appliance from Allard Software -- stores domain info in a SQL database
>and postfix calls that database here:
>
>virtual_mailbox_domains =   proxy:mysql:/etc/postfix/sql/domains.cf

Right. domain1.tld is defined to be a local domain because it is
(indirectly) in mydestination. It is also in virtual_mailbox_domains
and Postfix wants it to be in one or the other (either local or
virtual) not both.

Note that if you remove it from mydestination and make it strictly a
virtual_mailbox_domain, delivery TO s at domain1.com will stop working.
See the FAQ at <http://wiki.list.org/x/ZoCj>.

>Anyway, carrying on:
>
>Nov  1 11:51:59 mail postfix/smtpd[32434]: A91E1130CB:
>client=mail3.networktest.com[69.55.234.104]
>Nov  1 11:51:59 mail postfix/cleanup[25359]: A91E1130CB:
>message-id=<4CCF0C4E.8000704 at networktest.com>
>Nov  1 11:51:59 mail postfix/smtpd[32434]: disconnect from
>mail3.networktest.com[69.55.234.104]
>Nov  1 11:51:59 mail postfix/qmgr[20853]: A91E1130CB:
>from=<dnewman at networktest.com>, size=1495, nrcpt=1 (queue active)
>Nov  1 11:51:59 mail spamd[10619]: spamd: connection from localhost
>[127.0.0.1] at port 45013
>Nov  1 11:51:59 mail spamd[10619]: spamd: processing message
><4CCF0C4E.8000704 at networktest.com> for s at mail.domain1.tld:62
>Nov  1 11:52:00 mail spamd[10619]: spamd: clean message (-0.0/5.0) for
>s at mail.domain1.tld:62 in 1.1 seconds, 1467 bytes.
>Nov  1 11:52:00 mail spamd[10619]: spamd: result: . 0 -
>T_RP_MATCHES_RCVD
>scantime=1.1,size=1467,user=s at mail.domain1.tld,uid=62,required_score=5.0,rhost=localhost,raddr=127.0.0.1,rport=45013,mid=<4CCF0C4E.8000704 at networktest.com>,autolearn=ham
>
>Nov  1 11:52:01 mail postfix/pickup[1233]: 03422130CD: uid=506
>from=<dnewman at networktest.com>
>Nov  1 11:52:01 mail postfix/pipe[16800]: A91E1130CB:
>to=<s at mail.domain1.tld>, orig_to=<s at domain1.tld>, relay=spamassassin,
>delay=1.6, delays=0.33/0.02/0/1.2, dsn=2.0.0, status=sent (delivered via
>spamassassin service)
>Nov  1 11:52:01 mail postfix/qmgr[20853]: A91E1130CB: removed

These (A91E1130CB) messages are the receipt if the mail from
dnewman at networktest.com to s at domain1.com and its delivery to
spamassassin.

>Nov  1 11:52:01 mail postfix/cleanup[25359]: 03422130CD:
>message-id=<4CCF0C4E.8000704 at networktest.com>
>Nov  1 11:52:01 mail postfix/qmgr[20853]: 03422130CD:
>from=<dnewman at networktest.com>, size=1762, nrcpt=1 (queue active)
>Nov  1 11:52:01 mail spamd[18056]: prefork: child states: II
>Nov  1 11:52:01 mail postfix/local[28131]: 03422130CD:
>to=<s at mail.domain1.tld>, relay=local, delay=0.32,
>delays=0.03/0.02/0/0.26, dsn=2.0.0, status=sent (delivered to command:
>/usr/local/mailman/mail/mailman post s)
>Nov  1 11:52:01 mail postfix/qmgr[20853]: 03422130CD: removed

And these (03422130CD) are the mail being requeued after spamassassin
and delivered vi the local alias to Mailman.

>Nov  1 11:52:02 mail postfix/smtpd[32434]: connect from localhost[127.0.0.1]
>Nov  1 11:52:02 mail postfix/trivial-rewrite[29411]: warning: do not
>list domain domain1.tld in BOTH mydestination and virtual_mailbox_domains
>Nov  1 11:52:02 mail postfix/smtpd[32434]: 80A72130CB:
>client=localhost[127.0.0.1]
>Nov  1 11:52:02 mail postfix/trivial-rewrite[29411]: warning: do not
>list domain domain1.tld in BOTH mydestination and virtual_mailbox_domains
>Nov  1 11:52:02 mail postfix/cleanup[25359]: 80A72130CB:
>message-id=<4CCF0C4E.8000704 at networktest.com>
>Nov  1 11:52:02 mail postfix/smtpd[32434]: disconnect from
>localhost[127.0.0.1]
>Nov  1 11:52:02 mail postfix/qmgr[20853]: 80A72130CB:
>from=<s-bounces at domain1.tld>, size=2697, nrcpt=2 (queue active)
>Nov  1 11:52:02 mail spamd[10619]: spamd: connection from localhost
>[127.0.0.1] at port 5435
>Nov  1 11:52:02 mail spamd[10619]: spamd: processing message
><4CCF0C4E.8000704 at networktest.com> for dnewman at domain1.tld:62
>Nov  1 11:52:07 mail spamd[10619]: spamd: clean message (0.0/5.0) for
>dnewman at domain1.tld:62 in 4.8 seconds, 2638 bytes.
>Nov  1 11:52:07 mail spamd[10619]: spamd: result: . 0 -
>scantime=4.8,size=2638,user=dnewman at domain1.tld,uid=62,required_score=5.0,rhost=localhost,raddr=127.0.0.1,rport=5435,mid=<4CCF0C4E.8000704 at networktest.com>,autolearn=ham
>
>Nov  1 11:52:07 mail postfix/pickup[1233]: 7027A130CD: uid=506
>from=<s-bounces at domain1.tld>
>Nov  1 11:52:07 mail postfix/cleanup[25359]: 7027A130CD:
>message-id=<4CCF0C4E.8000704 at networktest.com>
>Nov  1 11:52:07 mail postfix/pipe[16800]: 80A72130CB:
>to=<dnewman at networktest.com>, relay=spamassassin, delay=4.9,
>delays=0.04/0/0/4.9, dsn=2.0.0, status=sent (delivered via spamassassin
>service)
>Nov  1 11:52:07 mail postfix/pipe[16800]: 80A72130CB:
>to=<dnewman at domain1.tld>, relay=spamassassin, delay=4.9,
>delays=0.04/0/0/4.9, dsn=2.0.0, status=sent (delivered via spamassassin
>service)
>
>
>I don't understand this entry. Since 's at domain1.tld' never received the
>message, and since postfix says it was delivered OK, and since there's
>no indication of trouble in the Mailman logs, what happened to the message?
>
>
>Nov  1 11:52:07 mail postfix/qmgr[20853]: 80A72130CB: removed
>Nov  1 11:52:07 mail postfix/qmgr[20853]: 7027A130CD:
>from=<s-bounces at domain1.tld>, size=2759, nrcpt=1 (queue active)
>Nov  1 11:52:07 mail spamd[18056]: prefork: child states: II
>Nov  1 11:52:11 mail postfix/smtp[7413]: 7027A130CD:
>to=<dnewman at networktest.com>,
>relay=mail3.networktest.com[69.55.234.104]:25, delay=3.6,
>delays=0.03/0.04/0.39/3.1, dsn=2.0.0, status=sent (250 2.0.0 Ok: queued
>as EC0D3256A73)
>Nov  1 11:52:11 mail postfix/qmgr[20853]: 7027A130CD: removed

There are two message deliveries above.

80A72130CB is the delivery of the message from mailman with two
recipients, dnewman at domain1.tld and dnewman at networktest.com, and was
processed through spamassassin (there are spamd reports) and the two
entries immediately prior to your last comment above say that
Postfix's pipe delivery piped the message to spamassassin for both
recipients.

Then, 7027A130CD is the requeue from spamassassin of the message to
dnewman at networktest.com which was then delivered via SMTP to the MTA
at mail3.networktest.com.

But, there is apparently no requeue from spamassassin of the message to
the dnewman at domain1.tld recipient.

My guess is that your spamassassin process doesn't properly handle
messages with multiple recipients.

There are two things you could try. You could set

SMTP_MAX_RCPTS = 1

in mm_cfg.py to tell Mailman to deliver each recipient as a separate
message.

Or, probably better, you could put

spamassassin_destination_recipient_limit = 1

in main.cf to cause Postfix to pipe only one recipient at a time to the
spamassassin handler (see man 8 pipe).

[...]
>> Also, it appears you are taking
>> <http://mailman.sourceforge.net/mailman-install/postfix-virtual.html>
>> much too literally. That section describes a complicated situation which
>> is not typically encountered in practice. And yes, it should probably be
>> heavily revised.
>
>Clarity is desirable and too rare in technical writing. I'd be glad to
>propose revisions to sections 6.1.1 and 6.1.2 of the docs once I
>understand how this should work.

Thank you. I'd appreciate that.

However, it now seems to me that you actually had the Mailman part of
Postfix reasonably OK at the outset. The real issue now appears to me
the use and configuration of spamassassin filtering in Postfix.

Also note, You are doing way too much spamassassin scanning. You are
scanning the inbound message before delivering it to Mailman, and then
you are scanning the message again on its way from Mailman to the
recipients. It might be better to set up a separate listener in
Postfix on a different port and have Mailman deliver there and in
Postfix only accept mail from Mailman (or localhost) on that port and
bypass spamassassin for that mail.

-- 
Mark Sapiro <mark at msapiro.net>        The highway is for gamblers,
San Francisco Bay Area, California    better use your sense - B. Dylan