Large Dictionaries

[Richie Hindle]

[Chris]
> Has anyone written a fast hash module which is more optimal for
> large datasets ?

PyJudy might be what you're looking for, though I've never used it:

  http://www.dalkescientific.com/Python/PyJudy.html

"Judy's key benefits are scalability, high performance, and memory
efficiency. A Judy array is extensible and can scale up to a very large
number of elements, bounded only by machine memory." ... "PyJudy arrays
are similar to Python dictionaries and sets."

-- 
Richie Hindle
richie at entrian.com