Suggestions on mechanism or existing code - maintain persistence of file download history

[R.Wieser]

jkn,

> I think a combination of hashing the URL,

I hope you're not thinking of saving the hash (into the "done" list) instead 
if the URL itself.   While hash collisions do not happen often (especially 
not in a small list), you cannot rule them out.  And when that happens that 
would mean you would be skipping downloads ...

Regards,
Rudy Wieser