Writing huge Sets() to disk

[Istvan Albert]

Martin MOKREJŠ wrote:


> But nevertheless, imagine 1E6 words of size 15. That's maybe 1.5GB of raw
> data. Will sets be appropriate you think?

You started out with 20E20 then cut back to 1E15 keys
now it is down to one million but you claim that these
will take 1.5 GB.

On my system storing 1 million words of length 15
as keys of a python dictionary is around 75MB.

I.