Python choice of database

[Jeremy Sanders]

On Mon, 20 Jun 2005 23:42:21 -0800, EP wrote:

> until my records (text - maybe 50KB average) unexpectedly blossomed into
> the 10,000-1,000,000 ranges.  If I or someone else (who innocently doesn't
> know better) opens up one of the directories with ~150,000 files in it,
> the machine's personality gets a little ugly (it seems buggy but is just
> very busy; no crashing).  Under 10,000 files per directory seems to work
> just fine, though.

Yes. Programs like "squid" use subdirectories to avoid this problem. If
your key is a surname, then you can just use the first letter to divide
the names up, for instance, or part of the hash value.

Many Linux FSs can cope with lots of files, but it doesn't hurt to try to
avoid this.

Jeremy