simultaneous multiple requests to very simple database

[phr at localhost.localdomain]

I agree with you, there's a crying need for something like that and
there's no single "one obvious way to do it" answer.

Have you looked at bsddb?  See also www.sleepycat.com.