Pure Python Data Mangling or Encrypting

Randall Smith randall at tnr.cc
Tue Jun 30 13:43:11 EDT 2015


On 06/29/2015 03:49 PM, Jon Ribbens wrote:
> On 2015-06-29, Randall Smith <randall at tnr.cc> wrote:
>> Same reason newer filesystems like BTRFS use checkusms (BTRFS uses
>> CRC32).  The storage machine runs periodic file integrity checks.  It
>> has no control over the underlying filesystem.
>
> True, but presumably neither does it have anything it can do to
> rectify the situation if it finds a problem, and the client will
> have to keep its own secure hash of its file anyway. (Unless I suppose
> the server actually can request a new copy from the client or another
> server if it finds a corrupt file?)
>

Yes.  The storage servers are monitored for integrity.  They can request 
a new copy, though frequent corruption results in the server being 
marked as unreliable.

-Randall




More information about the Python-list mailing list