[Borgbackup] Slow backup speed

Marc Pope marcpope at me.com
Tue Oct 30 15:40:11 EDT 2018


What about running it from the client? NFS overhead is likely the problem. You could run it using a ssh command to the client from the server. 

> On Oct 30, 2018, at 1:59 PM, Zack Coffey <clickwir at gmail.com> wrote:
> 
> I think you are right, it's not a bandwidth issue. But NFS dealing with that many small functions may be the bottleneck. 
> 
> I've seen NFS be the bottleneck many times when dealing with large amounts of small files or small changes. Big file transfers, it blazes. Tons of tiny ones, grinds to a halt. Some NFS mount tweaks can help that though.
> 
>> On Tue, Oct 30, 2018 at 2:55 AM Sebastian Pölsterl <sebp at k-d-w.org> wrote:
>> Hi,
>> 
>> I'm using borg via borgmatic to backup of about 10TB of data. Since 
>> incremental backups take about 13 hours, I was wondering if there's any 
>> configuration option that can be used to speed things up, or if 13 hours 
>> is an expected duration.
>> 
>> In total, the volume contains about 25 million files, but changes are 
>> rare. Backups are created daily and are carried out over a gigabit 
>> network connection with the client's disk mounted via NFS on the server 
>> running borg. Backups are created with --files-cache ctime,size and lz4 
>> compression. Based on monitoring bandwidth usage, I would say that 
>> network bandwidth is not the bottleneck.
>> 
>> Is there any configuration option I have been missing so far that could 
>> help to speed up daily backups?
>> 
>> Thanks for your help!
>> 
>> -- 
>> Sebastian
>> _______________________________________________
>> Borgbackup mailing list
>> Borgbackup at python.org
>> https://mail.python.org/mailman/listinfo/borgbackup
> _______________________________________________
> Borgbackup mailing list
> Borgbackup at python.org
> https://mail.python.org/mailman/listinfo/borgbackup
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/borgbackup/attachments/20181030/ec44d923/attachment.html>


More information about the Borgbackup mailing list