memory efficient set/dictionary

[Rafael Darder Calvo]

> > > Please recommend a module that allows persistent set/dict storage +
> > > fast query that best fits my problem,
> >
> > What is the problem you are trying to solve? How many keys do you have?
>
> Corpus processing. There are in the order of billions to tens of
> billions keys (64bit integers).
>
I would recommend you to use a database since it meets your
requirements (off-memory, fast, persistent). The bsdddb module
(berkeley db) even gives you a dictionary like interface.
http://www.python.org/doc/lib/module-bsddb.html

regards,
Rafa