[Borgbackup] performance problem

Giuseppe Arvati giuseppe.arvati at gmail.com
Fri Aug 25 06:02:08 EDT 2017


Hello,

I’m trying to use borg as backup tool for a file server but I’m not able 
to finish the backup during the night. The server is an Proliant 8 core 
Intel(R) Xeon(R)  E5540  @ 2.53GHz with raid 5 scsi controller. Borg 
version is 1.0.11

I have mainly 3 directory to back up:
184G    /dati/utenti
354G    /dati/gruppi
90G     /dati/passa

and I would to backup all three directory every day between 23:00 and 
4:00 ( but it can be 22:00 – 5:00 ). Now I use rsync to copy new o 
modified files on NAS and it take about 30 minutes to complete but I do 
not have an history and a deduplication.

The first directory one take about 11 hours to backup 184GB so is not 
possible to complete all 3 directory during the night.

I tried first to backup on NAS connected via 1Gb NSF link without 
compression and encryption and I create 2 archive:
utenti-2017-07-06                    Thu, 2017-07-06 19:00:01
utenti-2017-07-19                    Wed, 2017-07-19 15:03:46

the first archive took about 14 hours to finish
the second archive took about 9 hours to finish
too slow!!

So I thought was a link performance problem and I tried again on local 
storage but without important improvement.

Command line: /usr/bin/borg create -v --stat ::utenti-{now:%Y-%m-%d} 
/dati/utenti
utenti-2017-07-25                    Tue, 2017-07-25 13:05:00
utenti-2017-07-26                    Wed, 2017-07-26 19:00:00
utenti-2017-08-24                    Thu, 2017-08-24 13:00:00

the 1st archive took about 12 hours to finish
the 2nd  archive took about 11 hours to finish
the 3rd archive took about 11 hours to finish with  with –ignore-inode
too slow again !!

185 GB of data aren’t a big archive and I think borg generally works 
faster than I experienced.

Where are my mistakes ? Missing options, error during archive init 
phase, server performance, …
What can I test ?

Thank you for any hints

Giuseppe


More information about the Borgbackup mailing list