[ mailman-Bugs-723123 ] Runs out of memory on larger (5M) messages.

[SourceForge.net]

Bugs item #723123, was opened at 2003-04-17 09:20
Message generated for change (Comment added) made by bwarsaw
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=100103&aid=723123&group_id=103

Category: mail delivery
Group: 2.1 (stable)
Status: Open
Resolution: None
Priority: 9
Submitted By: Steve Mertz (xerouz)
Assigned to: Nobody/Anonymous (nobody)
Summary: Runs out of memory on larger (5M) messages.

Initial Comment:
When trying to send an email with a 5M attachment,
Mailman seems to run out of memory.  On the console I get:

marcos:mailman {106} Traceback (most recent call last):
  File "/usr/local/mailman/bin/qrunner", line 270, in ?
    main()
  File "/usr/local/mailman/bin/qrunner", line 230, in main
    qrunner.run()
  File "/usr/local/mailman/Mailman/Queue/Runner.py",
line 59, in run
    filecnt = self._oneloop()
  File "/usr/local/mailman/Mailman/Queue/Runner.py",
line 111, in _oneloop
    self._shunt.enqueue(msg, msgdata)
  File
"/usr/local/mailman/Mailman/Queue/Switchboard.py", line
91, in enqueue
    msgsave = cPickle.dumps(_msg, 1)
MemoryError: out of memory


The system is: OpenBSD 3.1, with 512M ram. Mailman
version 2.1.1

It would be nice to be able to have large attachments
as I want to use this for my company's support email
which quite often has larger than 10M files attached.

Thanks,
-- Steve

----------------------------------------------------------------------

>Comment By: Barry A. Warsaw (bwarsaw)
Date: 2003-05-12 00:11

Message:
Logged In: YES 
user_id=12800

This is going to be a difficult one Steve.  The problem is
that too much of Mailman wants to keep the message in
memory, starting from the email package.  I'm not sure what
the best approach is, but it's probably going to include
stripping out large attachements and not carrying them
around during processing.


----------------------------------------------------------------------

Comment By: Steve Mertz (xerouz)
Date: 2003-04-24 11:08

Message:
Logged In: YES 
user_id=61424

Now, I'm getting errors in of a different kind:

Apr 24 10:03:18 2003 (22458) Uncaught runner exception: out
of memory
Apr 24 10:03:18 2003 (22458) Traceback (most recent call last):
  File "/usr/local/mailman/Mailman/Queue/Runner.py", line
105, in _oneloop 
    self._onefile(msg, msgdata)
  File "/usr/local/mailman/Mailman/Queue/Runner.py", line
155, in _onefile
    keepqueued = self._dispose(mlist, msg, msgdata)
  File "/usr/local/mailman/Mailman/Queue/IncomingRunner.py",
line 130, in _dispose
    more = self._dopipeline(mlist, msg, msgdata, pipeline)
  File "/usr/local/mailman/Mailman/Queue/IncomingRunner.py",
line 153, in _dopipeline
    sys.modules[modname].process(mlist, msg, msgdata)
  File "/usr/local/mailman/Mailman/Handlers/ToDigest.py",
line 71, in process
    g.flatten(msg, unixfrom=1)
  File "/usr/local/mailman/pythonlib/email/Generator.py",
line 100, in flatten
    self._write(msg)
  File "/usr/local/mailman/pythonlib/email/Generator.py",
line 128, in _write
    self._dispatch(msg)
  File "/usr/local/mailman/pythonlib/email/Generator.py",
line 154, in _dispatch
    meth(msg)
  File "/usr/local/mailman/pythonlib/email/Generator.py",
line 267, in _handle_multipart
    print >> self._fp, '\n--' + boundary + '--',
MemoryError: out of memory

Apr 24 10:03:18 2003 (22458) SHUNTING:
1051196594.0123+3c7e0d1a0cd1e29359dea6cc2bb51307e06ad0df


----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=100103&aid=723123&group_id=103