Backups not getting removed on a hardened repo

[zbe]

Immutability is set to 7 days. Backup has 3 day retention period and 2 synthetic fulls per week (Wed, Sat).
When synthetic fulls are being run for the first time I get "Failed to pre-process the job Error: boost::filesystem::remove: Operation not permitted:" error and then on Retry 1 it returns success.

After 7 (I guess) days backups are getting removed from configuration so everything looks like it's working fine, but in reality all the old backup files are still there on the server and I have to remove them manually. (RIght now I tried setting retention time to 7 days so it matches immutability set on repo, so will see if that helps.)

I see the same behaviour on two different hardened repos, one on proxmox and one on truenas. Both use (experimental) zfs.

The problem, as I see it, is non-removal of immutable flag on files that are older than 7 days.

This is/was Case #07669424, but it was closed so I'm just repeating same thing on the forum.

[zbe]

Ok so after finally taking some time to check logs, I get this when deploying services:

Code: Select all

truenas veeamtransport[3368431]: Interrupted system call
truenas veeamtransport[3368431]: Failed to read data from pipe.
truenas veeamtransport[3368431]: --tr:Failed to dispatch remoting protocol.
truenas veeamtransport[3368431]: --tr:Failed to handle immutable repository service commands.
truenas veeamtransport[3368431]: --tr:Immutable repository service failed.
truenas veeamtransport[3368417]: Interrupted system call
truenas veeamtransport[3368417]: Failed to read data from pipe.
truenas veeamtransport[3368417]: --tr:Failed to dispatch remoting protocol.
truenas veeamtransport[3368417]: --tr:Failed to handle Environment service commands.
truenas veeamtransport[3368417]: --tr:Environment service failed.
truenas veeamtransport[3368339]: Couldn't open log file: /var/log/VeeamBackup/VeeamTransportSvc.log
truenas veeamtransport[3368339]: Couldn't open log file: /var/log/VeeamBackup/VeeamTransportSvc.log
truenas systemd[1]: veeamtransport.service: Deactivated successfully.

Mind you, there is no error anywhere in GUI – it shows everything succeeded.
So, apparently there should be veeamimmureposvc.service present and running but I don't have it anywhere. Would probably be enough if someone could paste the content of the service here.