Suggestions on mechanism or existing code - maintain persistence of file download history

jkn jkn_gg at nicorp.f9.co.uk
Fri Jan 31 09:18:12 EST 2020


On Friday, January 31, 2020 at 9:41:32 AM UTC, R.Wieser wrote:
> jkn,
> 
> > I think a combination of hashing the URL,
> 
> I hope you're not thinking of saving the hash (into the "done" list) instead 
> if the URL itself.   While hash collisions do not happen often (especially 
> not in a small list), you cannot rule them out.  And when that happens that 
> would mean you would be skipping downloads ...
> 
> Regards,
> Rudy Wieser

Hi Rudy



More information about the Python-list mailing list