[Borgbackup] Prune and backup failure

[Bzzzz]

Server: Debian buster
Client: Debian stretch + backports
BB libs installed as regular packages on both machines
BB installed via pip3 on both machines
======================================

Hi listers,

I had an issue with BB ; I don't know if it comes from the serveur or
the client but it is not the first time, last time was a few months ago
and the only solution I found to cure that was to erase this machine's
repo and make another backup.

This time, it made it's backup without any quirks, but when I tried to
prune backups older than 3 months, it threw python errors finishing by:
	FileNotFoundError: [Errno 2] No such file or directory:
	'/BORG/data/0/510'
(/BORG is where the repo is NFS mounted)

Effectively, this file doesn't exist in the repo.

Although there's nothing about memory or disks into log files, this
machine being old may have disks unknown problem(s) (it boots on raid-1),
I do not think there's a memory failure as it has been pushed up to OOM
without any error thrown.

So, I've got 2 questions:

1)- does it come from the client or from the server?

2)- what could be the reason of this?


=============================== LAST LOG: NEW BACKUP
# time BORG_BACKUP_SRV-4.sh
 
PING borg.srv (192.168.1.200) 56(84) bytes of data.
64 bytes from borg.srv (192.168.1.200): icmp_seq=1 ttl=64 time=0.194 ms
64 bytes from borg.srv (192.168.1.200): icmp_seq=2 ttl=64 time=0.237 ms

--- borg.srv ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1001ms
rtt min/avg/max/mdev = 0.194/0.215/0.237/0.026 ms

[ ok ] Stopping postgresql (via systemctl): postgresql.service.

Local Exception
Traceback (most recent call last):
  File "/usr/local/lib/python3.5/dist-packages/borg/repository.py", line
1317, in get_fd ts, fd = self.fds[segment]
  File "/usr/local/lib/python3.5/dist-packages/borg/lrucache.py", line
21, in __getitem__ value = self._cache[key]  # raise KeyError if not
found KeyError: 510

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.5/dist-packages/borg/archiver.py", line
4501, in main exit_code = archiver.run(args)
  File "/usr/local/lib/python3.5/dist-packages/borg/archiver.py", line
4433, in run return set_ec(func(args))
  File "/usr/local/lib/python3.5/dist-packages/borg/archiver.py", line
153, in wrapper kwargs['manifest'], kwargs['key'] =
Manifest.load(repository, compatibility) File
"/usr/local/lib/python3.5/dist-packages/borg/helpers.py", line 365, in
load cdata = repository.get(cls.MANIFEST_ID) File
"/usr/local/lib/python3.5/dist-packages/borg/repository.py", line 1073,
in get return self.io.read(segment, offset, id) File
"/usr/local/lib/python3.5/dist-packages/borg/repository.py", line 1437,
in read fd = self.get_fd(segment) File
"/usr/local/lib/python3.5/dist-packages/borg/repository.py", line 1319,
in get_fd fd = open_fd() File
"/usr/local/lib/python3.5/dist-packages/borg/repository.py", line 1300,
in open_fd fd = open(self.segment_filename(segment), 'rb')
FileNotFoundError: [Errno 2] No such file or directory:
'/BORG/data/0/510'

Platform: Linux srv-4 4.9.0-11-rt-686-pae #1 SMP PREEMPT RT Debian
4.9.189-3+deb9u1 (2019-09-20) i686 Linux: debian 9.11 
Borg: 1.1.10  Python: CPython 3.5.3 msgpack: 0.5.6
PID: 19059  CWD: /root
sys.argv: ['/usr/local/bin/borg', 'create', '--verbose',
'--exclude-caches', '--show-rc', '--filter', 'AME', '--list', '--stats',
'--checkpoint-interval', '600', '--compression', 'auto,zlib,6',
'--exclude-from', '/usr/local/sbin/BORG_EXCLUSIONS.list',
'::{hostname}-{utcnow}Z', '/'] SSH_ORIGINAL_COMMAND: None

terminating with error status, rc 2

[ ok ] Starting postgresql (via systemctl): postgresql.service.

real    0m39.998s
user    0m2.184s
sys     0m2.876s
=============================== /LAST LOG: NEW BACKUP