[Borgbackup] Does anyone backup VMs using private Linux VM-bridges with SSHFS?

[Heiko Helmle]

Hi Thorsten,

from my experience with proxmox and borg in particular:

your biggest challenge is probably the large amount of data to parse by borg on every backup (basic proxmox backups are always-full), and the fact that borg is single-threaded. This blew up our single-job backup process to last about 10 hours every day. As it only takes up a single CPU, impact is minimal, but your backup process taking that long might be unexpected.

So if you want to go borg, consider running several jobs in parallel (to different repos then). I'd seriously look into proxmox backup server though, as it allows proxmox to do true incremental backups and greatly decreases the amount of data that gets moved around.

Also be aware that the default chunker settings result in almost no deduplication with the proxmox archive format. I had good results with --chunker-params 16,23,16,4095, but you definitely need a few test runs to find the values that fit your workload.

Best Regards
 Heiko

-----Original Message-----
From: Borgbackup <borgbackup-bounces+heiko.helmle=horiba.com at python.org> On Behalf Of Thorsten Schöning
Sent: Mittwoch, 7. Juli 2021 09:00
To: borgbackup at python.org
Subject: [Borgbackup] Does anyone backup VMs using private Linux VM-bridges with SSHFS?

Hi all,

I have Proxmox running multiple different VMs and am considering backing those up using Borg with SSHFS. The goal is to have backup managed by the Proxmox-host only using PULL, like is pretty common with SSH+RSYNC.

Though, that setup is mentioned in the FAQs to be somewhat slow, because a lot of data needs to pass SSH, while with a client-server setup the client within the VM only sends actually changed chunks.

OTOH, I can easily create private bridges in Proxmox not bridged to any physical interface, but implementing a private network for the VMs and the host only. this could easily be a private backup network this way, not creating any public traffic at all in theory.

https://forum.proxmox.com/attachments/xproxmox-root-server-architektur-1024x595-png-pagespeed-ic-nq1avqgasy-png.27234/
https://forum.proxmox.com/threads/whats-the-preferred-counterpart-for-internalnetwork-of-virtualbox.91686/#post-399961

From my understanding that would only keep the CPU overhead because of SSH, but without too much network related latency, without bandwidth limits of real physical NICs etc.


Or am I missing something? Does anyone has any experience with that approach?

Thanks!

Mit freundlichen Grüßen

Thorsten Schöning

--
AM-SoFT IT-Service - Bitstore Hameln GmbH Mitglied der Bitstore Gruppe - Ihr Full-Service-Dienstleister für IT und TK

E-Mail: Thorsten.Schoening at AM-SoFT.de
Web:    http://www.AM-SoFT.de/

Tel:   05151-  9468- 0
Tel:   05151-  9468-55
Fax:   05151-  9468-88
Mobil:  0178-8 9468-04

AM-SoFT IT-Service - Bitstore Hameln GmbH, Brandenburger Str. 7c, 31789 Hameln AG Hannover HRB 221853 - Geschäftsführer: Janine Galonska


Für Rückfragen stehe ich Ihnen sehr gerne zur Verfügung.

Mit freundlichen Grüßen

Thorsten Schöning


Tel: 05151 9468 0
Fax: 05151 9468 88
Mobil:
Webseite: https://www.am-soft.de

AM-Soft IT-Service - Bitstore Hameln GmbH i.G. ist ein Mitglied der Bitstore Gruppe - Ihr Full-Service-Dienstleister für IT und TK

AM-Soft IT-Service - Bitstore Hameln GmbH i.G.
Brandenburger Str. 7c
31789 Hameln
Tel: 05151 9468 0

Bitstore IT-Consulting GmbH
Zentrale - Berlin Lichtenberg
Frankfurter Allee 285
10317 Berlin
Tel: 030 453 087 80

CBS IT-Service - Bitstore Kaulsdorf UG
Tel: 030 453 087 880 1

Büro Dallgow-Döberitz
Tel: 03322 507 020

Büro Kloster Lehnin
Tel: 033207 566 530

PCE IT-Service - Bitstore Darmstadt UG
Darmstadt
Tel: 06151 392 973 0

Büro Neuruppin
Tel: 033932 606 090

ACI EDV Systemhaus - Bitstore Dresden GmbH Dresden
Tel: 0351 254 410

Das Systemhaus - Bitstore Magdeburg GmbH Magdeburg
Tel: 0391 636 651 0

Allerdata.IT - Bitstore Wittenberg GmbH
Wittenberg
Tel: 03491 876 735 7

Büro Liebenwalde
Tel: 033054 810 00

HSA - das Büro - Bitstore Altenburg UG
Altenburg
Tel: 0344 784 390 97

Bitstore IT – Consulting GmbH
NL Piesteritz
Piesteritz
Tel: 03491 644 868 6

Solltec IT-Services - Bitstore Braunschweig UG Braunschweig
Tel: 0531 206 068 0

MF Computer Service - Bitstore Gütersloh GmbH Gütersloh
Tel: 05245 920 809 3

Firmensitz: AM-Soft IT-Service - Bitstore Hameln GmbH i.G. , Brandenburger Str. 7c , 31789 Hameln Geschäftsführer Janine Galonska






_______________________________________________
Borgbackup mailing list
Borgbackup at python.org
https://mail.python.org/mailman/listinfo/borgbackup
Als GmbH eingetragen im Handelsregister Bad Homburg v.d.H. HRB 9816, USt.ID-Nr. DE 114 165 789 Geschäftsführer: Dr. Hiroshi Nakamura, Dr. Robert Plank, Markus Bode, Takashi Nagano, Junichi Tajika, Ergin Cansiz.