[ python-Bugs-1457783 ] Malloc error on MacOSX/imaplib

[SourceForge.net]

Bugs item #1457783, was opened at 2006-03-24 10:10
Message generated for change (Settings changed) made by etrepum
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=105470&aid=1457783&group_id=5470

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: Python Interpreter Core
Group: Python 2.4
>Status: Closed
>Resolution: Duplicate
Priority: 5
Submitted By: Andreas Jung (ajung)
Assigned to: Nobody/Anonymous (nobody)
Summary: Malloc error on MacOSX/imaplib

Initial Comment:
I am using Python 2.4.2 on MacOSX (10.4.5). Fetching
mails with larger attachments (2MB or so) using IMAP
(with getmail) fails:

python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
    File "/opt/python-2.4.2/bin/getmail", line 558, in main
    go(configs)
python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
    File "/opt/python-2.4.2/bin/getmail", line 112, in go
    msg = retriever.getmsg(msgid)
    File
"/opt/python-2.4.2/lib/python2.4/site-packages/getmailcore/_retrieverbases.py",
line 383, in getmsg
    return self._getmsgbyid(msgid)
    File
"/opt/python-2.4.2/lib/python2.4/site-packages/getmailcore/_retrieverbases.py",
line 750, in _getmsgbyid
    return self._getmsgpartbyid(msgid, '(RFC822)')
    File
"/opt/python-2.4.2/lib/python2.4/site-packages/getmailcore/_retrieverbases.py",
line 731, in _getmsgpartbyid
    response = self._parse_imapuidcmdresponse('FETCH',
uid, part)
    File
"/opt/python-2.4.2/lib/python2.4/site-packages/getmailcore/_retrieverbases.py",
line 621, in _parse_imapuidcmdresponse
    result, resplist = self.conn.uid(cmd, *args)
    File "/opt/python-2.4.2/lib/python2.4/imaplib.py",
line 725, in uid
    typ, dat = self._simple_command(name, command, *args)
    File "/opt/python-2.4.2/lib/python2.4/imaplib.py",
line 1028, in _simple_command
    return self._command_complete(name,
self._command(name, *args))
    File "/opt/python-2.4.2/lib/python2.4/imaplib.py",
line 858, in _command_complete
    typ, data = self._get_tagged_response(tag)
    File "/opt/python-2.4.2/lib/python2.4/imaplib.py",
line 959, in _get_tagged_response
    self._get_response()
    File "/opt/python-2.4.2/lib/python2.4/imaplib.py",
line 921, in _get_response
    data = self.read(size)
    File "/opt/python-2.4.2/lib/python2.4/imaplib.py",
line 1123, in read
    data = self.sslobj.read(size-read)
python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
python2.4(5615) malloc: *** vm_allocate(size=262144)
failed (error code=3)
python2.4(5615) malloc: *** error: can't allocate region
python2.4(5615) malloc: *** set a breakpoint in
szone_error to debug
  MemoryError



----------------------------------------------------------------------

>Comment By: Bob Ippolito (etrepum)
Date: 2006-03-29 13:06

Message:
Logged In: YES 
user_id=139309

This is a duplicate of http://python.org/sf/1092502

The implementation of realloc on Darwin never frees memory, so when using a 
large buffer size on incomplete reads you end up with lots of small strings that 
actually take up a large allocation.

----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=105470&aid=1457783&group_id=5470