anydbm is slow

[Laurent Szyster]

Amir Michail wrote:
> 
> Hi,
> 
> I'm trying to write out a large database file using anydbm.
> However, it's quite slow.  Writing out a 200 meg file can take
> hours.
> 
> In fact, I do most of the work using an internal map and write out
> that map at the end since I thought this would be faster.  (I have
> lots of memory.) However, it's still very slow.
> 
> Any hints?

Have a look at cdb:

	http://cr.yp.to/cdb.html

it's been designed to exactly do what you want: quickly write
a large dbm-like database to disk.

Unfortunately, I don't know of any Python binding for that library
or any port of it for Windows or Mac.


Laurent Szyster