[Borgbackup] how to back up 300 million files

[Maurice Libes]

Le 04/05/2017 à 12:59, Marian Beermann a écrit :
> On 04.05.2017 12:47, Maurice Libes wrote:
>> other answer/question from another point of view of a neophyte:
>>
>> Is borg an appropriate solution in this case of very small files (12kb)
>> , since borg will never split the files into chunks?
>> so don't we lose the benefit of deduplication ?
>> or am I wrong?
>> I don't remember what is the limit for a file to be split into chunks
>>
> Small files won't be split into chunks, but they will still be
> deduplicated.
If they are not split, so you talk about deduplication at the file 
"level", if I understand?

like another incremental backup  which do not backup again the same 
files which are already presents?

(let's say it is not what I call deduplication,
for me deduplication is a process at the block file level, but may be it 
is a question of terms)

ML
> However, only one bit in a file needs to change and borg
> will store the whole ~12kb. Whether this is a problem is
> application-dependent, i.e. are files actually changed. If files are not
> modified, it's not an issue.
>
> Cheers, Marian
> _______________________________________________
> Borgbackup mailing list
> Borgbackup at python.org
> https://mail.python.org/mailman/listinfo/borgbackup


-------------- next part --------------
A non-text attachment was scrubbed...
Name: maurice_libes.vcf
Type: text/x-vcard
Size: 176 bytes
Desc: not available
URL: <http://mail.python.org/pipermail/borgbackup/attachments/20170504/8cd73e4c/attachment.vcf>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 2971 bytes
Desc: Signature cryptographique S/MIME
URL: <http://mail.python.org/pipermail/borgbackup/attachments/20170504/8cd73e4c/attachment.bin>