Threading - Why Not Lock Objects Rather than lock the interpreter

[Andrew MacIntyre]

On Sat, 5 Dec 2003, Christopher A. Craig wrote:

> michael at foord.net (Fuzzyman) writes:
>
> > Looking at threading code it seems that the Global Interpreter Lock is
> > a bit of a 'brute force' way of preventing two threads attempting to
> > access sensitive objects simultaneously....
> >
> > Why not have a new type of object with a 'lock' facility... if an
> > object is locked then any thread trying to access the object other
> > than the one obtaining the lock is blocked until the lock is
> > released..... rather than blocking *all* threads until one thread has
> > finished with the object.....
> >
> > It could be implemented as a new attribute of existing objects... or
> > new types of objects.....
>
> It would slow down the interpreter drastically.  The important thing
> here is that for the above to be true, you'ld need to define
> "sensitive objects" to be "objects with a reference count" (i.e. all
> of them).  Because of that if you did this you'ld be doing about as
> much locking and unlocking as you would code execution.  For example,
> calling the following function would require at least 2 lock/unlock
> pairs (there may be more, I'm not thinking too hard about it):
>
> def donothing(): pass

As an example of what can happen, I played around with building a
pre 2.3alpha CVS Python with OpenWatcom on OS/2.

Building the Python core as a DLL resulted in a Pystone rating 25% less
than a static linked Python.exe.

This was traced to the OpenWatcom malloc() implementation always using
thread locks when linked to code in a DLL, even when extra threads are
never created (ie only the primary thread is running).  Enabling PyMalloc
fixed that.

While Python does many malloc()s and free()s, it does many, many more
object accesses.

So the performance degradation from an object locking strategy can be
savage.

--
Andrew I MacIntyre                     "These thoughts are mine alone..."
E-mail: andymac at bullseye.apana.org.au  (pref) | Snail: PO Box 370
        andymac at pcug.org.au             (alt) |        Belconnen  ACT  2616
Web:    http://www.andymac.org/               |        Australia