right list for SIGABRT python binary question ?

Karsten Hilbert Karsten.Hilbert at gmx.net
Mon Oct 30 13:21:18 EDT 2017


On Mon, Oct 30, 2017 at 02:02:25PM +0100, M.-A. Lemburg wrote:

> PS: Please CC me on replies as I don't regularly read c.l.p anymore.

Sure.

> >> Could you check whether you have similar import errors with
> >> other modules that have C extensions ? E.g. lxml.
> >>
> >> What you're seeing appears to be a compilation problem
> >> with Python 2.7.14 on Debian. The executable doesn't appear
> >> to export its symbols to the .so files, or only some of them.
> > 
> > Let's see:
> > ... using -dbg packages for everything, the imports work ...
> 
> Ah, so you were mixing debug packages with non-debug ones. This
> explains the import errors.

I am not sure I do.

I installed normal and -dbg packages for modules with
c extensions, say psycopg2:

	python-psycopg2:
	  Installiert:           2.7.3-1
	  Installationskandidat: 2.7.3-1
	  Versionstabelle:
	 *** 2.7.3-1 990
	        990 http://httpredir.debian.org/debian buster/main i386 Packages
	        500 http://httpredir.debian.org/debian unstable/main i386 Packages
	        100 /var/lib/dpkg/status
	     2.6.2-1 500
	        500 http://httpredir.debian.org/debian stretch/main i386 Packages
	python-psycopg2-dbg:
	  Installiert:           2.7.3-1
	  Installationskandidat: 2.7.3-1
	  Versionstabelle:
	 *** 2.7.3-1 990
	        990 http://httpredir.debian.org/debian buster/main i386 Packages
	        500 http://httpredir.debian.org/debian unstable/main i386 Packages
	        100 /var/lib/dpkg/status
	     2.6.2-1 500
	        500 http://httpredir.debian.org/debian stretch/main i386 Packages

Now, when running either python2.7 or python2.7-dbg, which
are installed alongside

	python2.7-dbg:
	  Installiert:           2.7.14-2
	  Installationskandidat: 2.7.14-2
	  Versionstabelle:
	 *** 2.7.14-2 990
	        990 http://httpredir.debian.org/debian buster/main i386 Packages
	        500 http://httpredir.debian.org/debian unstable/main i386 Packages
	        100 /var/lib/dpkg/status
	     2.7.13-2 500
	        500 http://httpredir.debian.org/debian stretch/main i386 Packages

	python2.7:
	  Installiert:           2.7.14-2
	  Installationskandidat: 2.7.14-2
	  Versionstabelle:
	 *** 2.7.14-2 990
	        990 http://httpredir.debian.org/debian buster/main i386 Packages
	        500 http://httpredir.debian.org/debian unstable/main i386 Packages
	        100 /var/lib/dpkg/status
	     2.7.13-2 500
	        500 http://httpredir.debian.org/debian stretch/main i386 Packages

the Debian version does (should ?) take care to import either
the -dbg or the normal version of modules. It seems it so
does because when I got both module versions installed I
don't get any import errors. So I don't think I am mixing, at
least not to my knowledge.

(But I still get the SIGABORT on shutdown regardless.)

> Do you just see the SIGABRT when running the debug versions or
> also with the production versions (memory management works differently
> in Python debug mode) ?

Either version fails.

Why haven't I tried running this under python3 ?  Because the
whole shebang is part of a wxPython application (GNUmed) and
there are no Debian packages for wxPython/wxPhoenix on py3 as
far as I know.

> BTW: It would help if you'd post the stack trace with symbols.
> The one you posted in one of your earlier emails only includes
> addresses.

I'd gladly comply if I knew how. This is what apt says about python2.7-dbg:

	Package: python2.7-dbg
	Version: 2.7.14-2
	Description-en: Debug Build of the Python Interpreter (version 2.7)
	 The package holds two things:
	 .
	 - A Python interpreter configured with --pydebug. Dynamically loaded modules
	   are searched as <foo>_d.so first. Third party extensions need a separate
	   build to be used by this interpreter.
	 - Debug information for standard python interpreter and extensions.

So from that I conferred it does contain symbols.

I am getting a fresh run under gdb with python2.7-dbg. Maybe
you can point out where you'd have expected to see symbols
and help me figure out which -dbg package is missing on this
Debian system:

	[...]
	==> verifying target database schema ...
	==> checking migrated data for plausibility ...
	Done bootstrapping GNUmed database: We very likely succeeded.
	log: /home/ncq/Projekte/gm-git/gnumed/gnumed/server/bootstrap/bootstrap-latest.log
	Debug memory block at address p=0x6aab7c: API ''
	    0 bytes originally requested
	    The 3 pad bytes at p-3 are not all FORBIDDENBYTE (0xfb):
	        at p-3: 0x33 *** OUCH
	        at p-2: 0x47 *** OUCH
	        at p-1: 0x00 *** OUCH
	    Because memory is corrupted at the start, the count of bytes requested
	       may be bogus, and checking the trailing pad bytes may segfault.
	    The 4 pad bytes at tail=0x6aab7c are not all FORBIDDENBYTE (0xfb):
	        at tail+0: 0x00 *** OUCH
	        at tail+1: 0x00 *** OUCH
	        at tail+2: 0x00 *** OUCH
	        at tail+3: 0x00 *** OUCH
	    The block was made by call #0 to debug malloc/realloc.
	Fatal Python error: bad ID: Allocated using API '', verified using API 'o'

	Program received signal SIGABRT, Aborted.
	0xb7fd9ce9 in __kernel_vsyscall ()
	(gdb) bt
	#0  0xb7fd9ce9 in __kernel_vsyscall ()
	#1  0xb7d70dd0 in __libc_signal_restore_set (set=0xbfffed40) at ../sysdeps/unix/sysv/linux/nptl-signals.h:79
	#2  __GI_raise (sig=6) at ../sysdeps/unix/sysv/linux/raise.c:48
	#3  0xb7d72297 in __GI_abort () at abort.c:89
	#4  0x0055fb74 in Py_FatalError (msg=0xbfffefec "bad ID: Allocated using API '\037', verified using API 'o'") at ../Python/pythonrun.c:1700
	#5  0x00499adb in _PyObject_DebugCheckAddressApi (api=111 'o', p=0x6aab7c <_Py_ZeroStruct>) at ../Objects/obmalloc.c:1640
	#6  0x004997a5 in _PyObject_DebugFreeApi (api=111 'o', p=0x6aab7c <_Py_ZeroStruct>) at ../Objects/obmalloc.c:1527
	#7  0x0049964f in _PyObject_DebugFree (p=0x6aab7c <_Py_ZeroStruct>) at ../Objects/obmalloc.c:1471
	#8  0x00471043 in int_dealloc (v=0x6aab7c <_Py_ZeroStruct>) at ../Objects/intobject.c:139
	#9  0x00497bee in _Py_Dealloc (op=False) at ../Objects/object.c:2262
	#10 0x00489bad in dict_dealloc (mp=0xb79f10d4) at ../Objects/dictobject.c:1085
	Python Exception <class 'UnicodeDecodeError'> 'utf-8' codec can't decode byte 0xb7 in position 3: invalid start byte: 
	#11 0x00497bee in _Py_Dealloc (op=) at ../Objects/object.c:2262
	Python Exception <class 'UnicodeDecodeError'> 'utf-8' codec can't decode byte 0xb7 in position 3: invalid start byte: 
	#12 0x004b9ab7 in subtype_dealloc (self=) at ../Objects/typeobject.c:1035
	Python Exception <class 'UnicodeDecodeError'> 'utf-8' codec can't decode byte 0xb7 in position 3: invalid start byte: 
	#13 0x00497bee in _Py_Dealloc (op=) at ../Objects/object.c:2262
	#14 0x0044dc7a in instancemethod_dealloc (im=0xb79e9034) at ../Objects/classobject.c:2388
	#15 0x00497bee in _Py_Dealloc (op=<instancemethod at remote 0xb79e9034>) at ../Objects/object.c:2262
	#16 0x004885d7 in insertdict_by_entry (mp=0xb7891214, key='_shutdown', hash=598970216, ep=0x88e1ec, value=None) at ../Objects/dictobject.c:519
	#17 0x00488857 in insertdict (mp=0xb7891214, key='_shutdown', hash=598970216, value=None) at ../Objects/dictobject.c:556
	#18 0x0048910f in dict_set_item_by_hash_or_entry (
	    op={'current_thread': <function at remote 0xb79f23a4>, '_BoundedSemaphore': None, 'currentThread': <function at remote 0xb79f23a4>, '_Timer': None, '_format_exc': None, 'Semaphore': <function at remote 0xb79ec174>, '_deque': None, 'activeCount': <function at remote 0xb79f24e4>, '_profile_hook': None, '_sleep': None, '_trace_hook': None, 'ThreadError': <type at remote 0xb7850414>, '_enumerate': None, '_start_new_thread': None, 'BoundedSemaphore': <function at remote 0xb79ec4e4>, '_shutdown': None, '__all__': ['activeCount', 'active_count', 'Condition', 'currentThread', 'current_thread', 'enumerate', 'Event', 'Lock', 'RLock', 'Semaphore', 'BoundedSemaphore', 'Thread', 'Timer', 'setprofile', 'settrace', 'local', 'stack_size'], '_Event': <type at remote 0xb79ee224>, 'active_count': <function at remote 0xb79f24e4>, '__package__': None, '_Condition': <type at remote 0xb7850bd4>, '_RLock': <type at remote 0xb78509e4>, '_test': <function at remote 0xb79f2624>, 'local': <type at remote 0x6fd420>, '__doc__': "Thread modul...(truncated), key='_shutdown', hash=598970216, ep=0x0, value=None) at ../Objects/dictobject.c:795
	#19 0x00489285 in PyDict_SetItem (
	    op={'current_thread': <function at remote 0xb79f23a4>, '_BoundedSemaphore': None, 'currentThread': <function at remote 0xb79f23a4>, '_Timer': None, '_format_exc': None, 'Semaphore': <function at remote 0xb79ec174>, '_deque': None, 'activeCount': <function at remote 0xb79f24e4>, '_profile_hook': None, '_sleep': None, '_trace_hook': None, 'ThreadError': <type at remote 0xb7850414>, '_enumerate': None, '_start_new_thread': None, 'BoundedSemaphore': <function at remote 0xb79ec4e4>, '_shutdown': None, '__all__': ['activeCount', 'active_count', 'Condition', 'currentThread', 'current_thread', 'enumerate', 'Event', 'Lock', 'RLock', 'Semaphore', 'BoundedSemaphore', 'Thread', 'Timer', 'setprofile', 'settrace', 'local', 'stack_size'], '_Event': <type at remote 0xb79ee224>, 'active_count': <function at remote 0xb79f24e4>, '__package__': None, '_Condition': <type at remote 0xb7850bd4>, '_RLock': <type at remote 0xb78509e4>, '_test': <function at remote 0xb79f2624>, 'local': <type at remote 0x6fd420>, '__doc__': "Thread modul...(truncated), key='_shutdown', value=None) at ../Objects/dictobject.c:848
	#20 0x00492758 in _PyModule_Clear (m=<module at remote 0xb78a1154>) at ../Objects/moduleobject.c:125
	#21 0x0054a33b in PyImport_Cleanup () at ../Python/import.c:530
	#22 0x0055c53c in Py_Finalize () at ../Python/pythonrun.c:458
	#23 0x0055fe9c in Py_Exit (sts=0) at ../Python/pythonrun.c:1783
	#24 0x0055e0fc in handle_system_exit () at ../Python/pythonrun.c:1151
	#25 0x0055e152 in PyErr_PrintEx (set_sys_last_vars=1) at ../Python/pythonrun.c:1161
	#26 0x0055dd5b in PyErr_Print () at ../Python/pythonrun.c:1064
	#27 0x0055d61f in PyRun_SimpleFileExFlags (fp=0x7ee010, filename=0xbffff7e6 "./bootstrap_gm_db_system.py", closeit=1, flags=0xbffff4f4) at ../Python/pythonrun.c:952
	#28 0x0055cc4e in PyRun_AnyFileExFlags (fp=0x7ee010, filename=0xbffff7e6 "./bootstrap_gm_db_system.py", closeit=1, flags=0xbffff4f4) at ../Python/pythonrun.c:752
	#29 0x00577cb0 in Py_Main (argc=5, argv=0xbffff684) at ../Modules/main.c:645
	#30 0x004259c8 in main (argc=5, argv=0xbffff684) at ../Modules/python.c:20
	(gdb) q
	A debugging session is active.

		Inferior 1 [process 12740] will be killed.

	Quit anyway? (y or n) y

Does that help ?

Thanks,
Karsten
-- 
GPG key ID E4071346 @ eu.pool.sks-keyservers.net
E167 67FD A291 2BEA 73BD  4537 78B9 A9F9 E407 1346



More information about the Python-list mailing list