[Borgbackup] invalid ChunkerParams value

Maurice Libes maurice.libes at osupytheas.fr
Tue Sep 19 04:11:23 EDT 2017



Le 18/09/2017 à 20:59, Dave Cottingham a écrit :
> Ran borg create with "--chunker-params 20,24,22,4095" and it says:
>
> borg create: error: argument --chunker-params: invalid ChunkerParams 
> value: '20,24,22,4095'
>
> Why is this an invalid value?

strange, I made the same test yesterday, and it worked


here is my command line

borg create -v  --stats/*--chunker-params 18,22,20,4095*/   \
borg at myserver.fr:/mnt/provigo-borg/testplus4Mchunk1M::sauve-09-18 /home/libes/Documents/testborg/


  in my case I wanted to decrease the size of chunks to 1Mb (2^20)
  to see how much we could gain on a dataset of 137Gb (composed only by 
files greater than 4Mb)

the results is  that we gain just a little bit : 2Gb of dedup with 
chunks of 1Mb
I imagined it could be more :-\

what is strange is that the duration time is lesser, but not very 
signiticative
may be due to the server load?
I would have thought that with a half chunk size , the duration time 
would be longer because there was the double of chunk

here below my results

I/ chunks of 2Mb default

==================================

------------------------------------------------------------------------------

Archive name: sauve-09-18

Time (start): Mon, 2017-09-18 12:25:25

Time (end):   Mon, 2017-09-18 15:14:17

/*Duration: 2 hours 48 minutes 52.60 seconds*/

Number of files: 2395

------------------------------------------------------------------------------

                        Original size      Compressed size    Deduplicated size

This archive:/*  137.95 GB            137.95 GB            108.37 GB*/

All archives:              137.95 GB            137.95 GB            108.37 GB

                        Unique chunks         Total chunks

Chunk index:/*       43245                55125*/

------------------------------------------------------------------------------

II//*chunks of 1Mb  2^20*/

==================================

borg create -v  --stats --chunker-params 18,22,20,4095  borg at myserver.fr: \
/mnt/provigo-borg/testplus4Mchunk1M::sauve-09-18 /home/libes/Documents/testborg/

------------------------------------------------------------------------------

Archive name: sauve-09-18

Time (start): Mon, 2017-09-18 18:11:57

Time (end):   Mon, 2017-09-18 20:56:40

/*Duration: 2 hours 44 minutes 42.61 seconds*/

Number of files: 2395

------------------------------------------------------------------------------

                        Original size      Compressed size    Deduplicated size

/*This archive:              137.95 GB            137.95 GB            
106.94 GB*/

All archives:              137.95 GB            137.95 GB            106.94 GB

                        Unique chunks         Total chunks

Chunk index:/*     83381               107820*/

------------------------------------------------------------------------------


>
> Thanks,
> Dave Cottingham
>
>
>
> _______________________________________________
> Borgbackup mailing list
> Borgbackup at python.org
> https://mail.python.org/mailman/listinfo/borgbackup

-- 
M. LIBES
Service Informatique OSU Pytheas - UMS 3470 CNRS
Batiment Oceanomed
Campus de Luminy
13288 Marseille cedex 9
Tel: 04860 90529

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/borgbackup/attachments/20170919/b253f548/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 2935 bytes
Desc: Signature cryptographique S/MIME
URL: <http://mail.python.org/pipermail/borgbackup/attachments/20170919/b253f548/attachment.bin>


More information about the Borgbackup mailing list