Daily Copy To Tape of incr. forever jobs find no new RPs

[mecki]

Hello,

I got a customer who is using several endpoint backup job and one hyperV job in Veeam B&R 9update1 running to two repositories on a workday schedule at 18:00. Every job has been finished around 22:00.
There is a "normal" (no GFS) tape copy copy running at 8:30 (a.m.) each day with the two repositories as source object. That job is configured with synthetic full on tape (only) each workday too and scheduled to run on these days.

I expect now that the tape job will build a full copy on tape with the restore points saved the day before, but sometimes the job found no new restore points on the day it was running for some source jobs (not all), and doesn't took the restore point(s) (not copied before) as reference for the full to tape. On the next scheduled run (next day almost) of that tape copy job theses source jobs that not has been copied to tape will now be copied to tape, but the jobs copied before will not copied then...

All source jobs has been ended on the day before!

Any similar behavior or unreliable behavior of the copy to tape job from incremental forever restore points seen? My customer needs a full copy on tape each day, but fulls on disk each day are no option...and all backups of the day before have to be copied.

Thanking in advance. Support ticket opened #01802118 in early phase...

example in the logs of not finding restore points (but there are new restore points of the day before)
[18.05.2016 08:30:11] <01> Info [CTapeDailySynthesizedBackupCalendarSpecifics] Virtual full backup dates between 18.05.2016 00:00:00 and 18.05.2016 08:30:11: 18.05.2016 00:00:00
[18.05.2016 08:30:11] <01> Info [CTapeSynStorageReplacer] Synthesized full backup was not created for 18.05.2016: there are no new restore points between 18.05.2016 and 18.05.2016

it is only looking for RP from 0:00 up to the scheduled run and not before.
I'll test now scheduling the tape copy job on the same day as the source jobs...

Regards,

Martin
VMCE and VMCT

[mecki]

some additional info from the logs here you are able to see that the first time all source job has been copied, next time one, then some, then these not...

Code: Select all

Backup to Tape job: DAILYneu
Created by KIB01\administrator at 13.05.2016 11:30.
InProgress
2 of 3 backups processed
Mittwoch, 18. Mai 2016 08:30:05
Success12Start time08:30:05Total size1,4 TBTape library: HP MSL G3 Series 6.40 (VHBK01)
Used tapes: KJ4632L7 [KJ4632L7]
Warning0End timeData read1,3 TB
Error0DurationTransferred1,3 TB
Details
NameStatusStart timeEnd timeSizeReadTransferredDurationDetails
Backup Job KIBAPS05Success08:30:100,0 KB0,0 KB0,0 KB0:00:00 
Backup Job KIBEST01Success08:30:110,0 KB0,0 KB0,0 KB0:00:00 
Backup Job KOM02Success08:30:1109:30:30389,3 GB389,3 GB389,3 GB1:00:19Synthetic full
Backup Job KIBIXH01Success08:30:110,0 KB0,0 KB0,0 KB0:00:00 
Backup Job PRINT01Success08:30:110,0 KB0,0 KB0,0 KB0:00:00 
Backup Job VHAIDA01Success08:30:110,0 KB0,0 KB0,0 KB0:00:00 
Backup Job VHAPS03Success08:30:110,0 KB0,0 KB0,0 KB0:00:00 
Backup Job VHAPS02Success08:30:110,0 KB0,0 KB0,0 KB0:00:00 
Backup Job VHBK01Success08:30:110,0 KB0,0 KB0,0 KB0:00:00 
Backup Job VHDMS01Success08:30:1111:01:09722,2 GB722,2 GB722,2 GB2:30:58Synthetic full
Backup Job VHITWOSuccess08:30:110,0 KB0,0 KB0,0 KB0:00:00 
Backup Job VHHOST01Success08:30:110,0 KB0,0 KB0,0 KB0:00:00 
HyperV01InProgress08:30:11275,4 GB267,0 GB267,0 GBSynthetic full
 
Backup to Tape job: DAILYneu
Created by KIB01\administrator at 13.05.2016 11:30.
Warning
9 of 9 backups processed
Dienstag, 17. Mai 2016 08:30:04
Success13Start time08:30:04Total size3,2 TBTape library: HP MSL G3 Series 6.40 (VHBK01)
Used tapes: KJ4631L7 [KJ4631L7]
Failed to export tape KJ4631L7: no free I/E port found
Warning0End time12:16:22Data read3,2 TB
Error0Duration3:46:17Transferred3,2 TB
Details
NameStatusStart timeEnd timeSizeReadTransferredDurationDetails
Backup Job KIBAPS05Success08:30:0909:36:38933,7 GB933,7 GB933,7 GB1:06:29Synthetic full
Backup Job KIBEST01Success08:30:0909:42:4862,2 GB62,2 GB62,2 GB1:12:38Synthetic full
Backup Job KIBIXH01Success08:30:0909:50:1174,9 GB74,9 GB74,9 GB1:20:01Synthetic full
Backup Job PRINT01Success08:30:0910:03:36148,7 GB148,7 GB148,7 GB1:33:26Synthetic full
Backup Job KOM02Success08:30:090,0 KB0,0 KB0,0 KB0:00:00 
Backup Job VHAPS03Success08:30:0911:30:061,1 TB1,1 TB1,1 TB2:59:56Synthetic full
Backup Job VHAIDA01Success08:30:0910:10:4259,3 GB59,3 GB59,3 GB1:40:33Synthetic full
Backup Job VHAPS02Success08:30:0910:18:02104,8 GB104,8 GB104,8 GB1:47:52Synthetic full
Backup Job VHBK01Success08:30:090,0 KB0,0 KB0,0 KB0:00:00 
Backup Job VHDMS01Success08:30:090,0 KB0,0 KB0,0 KB0:00:00 
Backup Job VHITWOSuccess08:30:0912:16:07716,2 GB716,2 GB716,2 GB3:45:57Synthetic full
Backup Job VHHOST01Success08:30:0911:31:5125,4 GB25,4 GB25,4 GB3:01:41Synthetic full
HyperV01Success08:30:090,0 KB0,0 KB0,0 KB0:00:00 
 
Backup to Tape job: DAILYneu
Created by KIB01\administrator at 13.05.2016 11:30.
Success
3 of 3 backups processed
Montag, 16. Mai 2016 08:30:18
Success13Start time08:30:18Total size1,4 TBTape library: HP MSL G3 Series 6.40 (VHBK01)
Used tapes: KJ4630L7 [KJ4630L7]
Warning0End time11:34:18Data read1,4 TB
Error0Duration3:03:59Transferred1,4 TB
Details
NameStatusStart timeEnd timeSizeReadTransferredDurationDetails
Backup Job KIBAPS05Success08:30:230,0 KB0,0 KB0,0 KB0:00:00 
Backup Job KIBEST01Success08:30:240,0 KB0,0 KB0,0 KB0:00:00 
Backup Job PRINT01Success08:30:240,0 KB0,0 KB0,0 KB0:00:00 
Backup Job KIBIXH01Success08:30:240,0 KB0,0 KB0,0 KB0:00:00 
Backup Job KOM02Success08:30:2409:29:40392,5 GB392,5 GB392,5 GB0:59:16Synthetic full
Backup Job VHAPS02Success08:30:240,0 KB0,0 KB0,0 KB0:00:00 
Backup Job VHAIDA01Success08:30:240,0 KB0,0 KB0,0 KB0:00:00 
Backup Job VHBK01Success08:30:240,0 KB0,0 KB0,0 KB0:00:00 
Backup Job VHDMS01Success08:30:2410:58:31720,6 GB720,6 GB720,6 GB2:28:07Synthetic full
Backup Job VHAPS03Success08:30:240,0 KB0,0 KB0,0 KB0:00:00 
Backup Job VHHOST01Success08:30:240,0 KB0,0 KB0,0 KB0:00:00 
Backup Job VHITWOSuccess08:30:240,0 KB0,0 KB0,0 KB0:00:00 
HyperV01Success08:30:2411:34:03276,3 GB276,3 GB276,3 GB3:03:38Synthetic full
 
Backup to Tape job: DAILYneu
Created by KIB01\administrator at 13.05.2016 11:30.
Success
0 of 0 backups processed
Samstag, 14. Mai 2016 08:30:18
Success13Start time08:30:18Total size0,0 KB 
Warning0End time08:30:29Data read0,0 KB
Error0Duration0:00:10Transferred0,0 KB
Details
NameStatusStart timeEnd timeSizeReadTransferredDurationDetails
Backup Job KIBAPS05Success08:30:230,0 KB0,0 KB0,0 KB0:00:00 
Backup Job KIBEST01Success08:30:240,0 KB0,0 KB0,0 KB0:00:00 
Backup Job KIBIXH01Success08:30:240,0 KB0,0 KB0,0 KB0:00:00 
Backup Job KOM02Success08:30:240,0 KB0,0 KB0,0 KB0:00:00 
Backup Job PRINT01Success08:30:240,0 KB0,0 KB0,0 KB0:00:00 
Backup Job VHAIDA01Success08:30:240,0 KB0,0 KB0,0 KB0:00:00 
Backup Job VHAPS02Success08:30:240,0 KB0,0 KB0,0 KB0:00:00 
Backup Job VHAPS03Success08:30:240,0 KB0,0 KB0,0 KB0:00:00 
Backup Job VHDMS01Success08:30:240,0 KB0,0 KB0,0 KB0:00:00 
Backup Job VHBK01Success08:30:240,0 KB0,0 KB0,0 KB0:00:00 
Backup Job VHHOST01Success08:30:240,0 KB0,0 KB0,0 KB0:00:00 
Backup Job VHITWOSuccess08:30:240,0 KB0,0 KB0,0 KB0:00:00 
HyperV01Success08:30:240,0 KB0,0 KB0,0 KB0:00:00 
 
Backup to Tape job: DAILYneu (Full)
Created by KIB01\administrator at 13.05.2016 11:30.
Success
13 of 13 backups processed
Freitag, 13. Mai 2016 11:33:50
Success13Start time11:33:50Total size4,6 TBTape library: HP MSL G3 Series 6.40 (VHBK01)
Used tapes: KJ4627L7 [KJ4627L7]
Warning0End time18:16:19Data read4,6 TB
Error0Duration6:42:29Transferred4,6 TB
Details
NameStatusStart timeEnd timeSizeReadTransferredDurationDetails
Backup Job KIBAPS05Success11:33:5412:41:57932,8 GB932,8 GB932,8 GB1:08:02Synthetic full
Backup Job KIBIXH01Success11:33:5512:54:1874,8 GB74,8 GB74,8 GB1:20:23Synthetic full
Backup Job KIBEST01Success11:33:5512:47:2962,2 GB62,2 GB62,2 GB1:13:33Synthetic full
Backup Job KOM02Success11:33:5513:45:30397,0 GB397,0 GB397,0 GB2:11:34Synthetic full
Backup Job PRINT01Success11:33:5513:58:21148,9 GB148,9 GB148,9 GB2:24:26Synthetic full
Backup Job VHAPS02Success11:33:5514:12:19104,7 GB104,7 GB104,7 GB2:38:23Synthetic full
Backup Job VHAIDA01Success11:33:5514:05:0659,1 GB59,1 GB59,1 GB2:31:11Synthetic full
Backup Job VHBK01Success11:33:5515:25:4222,1 GB22,1 GB22,1 GB3:51:47Synthetic full
Backup Job VHAPS03Success11:33:5515:23:521,1 TB1,1 TB1,1 TB3:49:57Synthetic full
Backup Job VHHOST01Success11:33:5516:56:0725,4 GB25,4 GB25,4 GB5:22:11Synthetic full
Backup Job VHDMS01Success11:33:5516:54:22719,6 GB719,6 GB719,6 GB5:20:27Synthetic full
HyperV01Success11:33:5518:13:45277,3 GB277,3 GB277,3 GB6:39:49Synthetic full
Backup Job VHITWOSuccess11:33:5517:40:16716,1 GB716,1 GB716,1 GB6:06:21Synthetic full

Veeam Backup & Replication 9.0.0.1491

[mecki]

Really nobody to get copy of full backups to tape from incremental forever? I switched now to run the copy copy the smae day as the source backups, nothing change, there are still missing backup jobs in the copy to tape job.

[mecki]

I tested now starting the copy to tape Job during running source endpoint Jobs, but it helped only the first time after configuring that Job. The next time there are still copies missing. The source jobs run.
I think the Task to recocnize new restore points isn't stable.

[Dima P.]

Hello mecki,

I am sorry for keeping silence. Can you clarify how synthesized full backup option is configured for simple backup to tape job? Thanks.