Running queries on large data structure

[Paul Rubin]

Christoph Haas <email at christoph-haas.de> writes:
> So the question is: would you rather force the data into a relational 
> database and write object-relational wrappers around it? Or would you 
> pickle it and load it later and work on the data? The latter application 
> is currently a CGI. I'm open to whatever. :)

The obvious solution is don't use a CGI.  Use a continuously-running
server process that keeps the structure in memory.  Write update
records out to disk as they arrive, and reload them if you need to
restart the server.