GFS copy full restore point selection

Availability for the Always-On Enterprise

GFS copy full restore point selection

Veeam Logoby skrause » Wed Nov 16, 2016 3:16 pm

So I have a copy job that is set up as a GFS job that runs daily and keeps 5 weekly archive backups. I have "read entire restore point from source" checked.

All of my source jobs run active fulls every week, and, in the case of one server, that full is what I absolutely have to have archived by the GFS job as this server is where our DBA copies the full backups of our critical SQL servers for the week. That source job runs at 2am with the active full happening Sunday morning (completes by 3am). I have set my backup copy job to archive weekly and set the restore point schedule to look for Sunday 0400. The sync interval for the copy job starts at noon.

Looking at the report for the job (and the size of the VIB files on Sunday), it looks like the job is actually running the full copies on Saturday at noon instead of Sunday at noon which I thought it would be doing with the restore point selection I made.

How do I get a GFS copy job to run its archive full on the day I specify?
Steve Krause
Veeam Certified Architect
skrause
Expert
 
Posts: 296
Liked: 45 times
Joined: Mon Dec 08, 2014 2:58 pm
Full Name: Steve Krause

Re: GFS copy full restore point selection

Veeam Logoby foggy » Wed Nov 16, 2016 3:25 pm

On Saturday at noon there's no full backup created on source yet, right? Does it create full backup (VBK) on Sunday then?
foggy
Veeam Software
 
Posts: 14716
Liked: 1075 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: GFS copy full restore point selection

Veeam Logoby skrause » Wed Nov 16, 2016 3:29 pm

On the source job(s)?

Correct, the fulls for all of the jobs that are source in this particular GFS job run an active full overnight (between 7pm Sat and 4am Sun) to create .VBK.

All of the most recent points on the source jobs as of noon on Saturday are the .vibs from Friday "night".
Steve Krause
Veeam Certified Architect
skrause
Expert
 
Posts: 296
Liked: 45 times
Joined: Mon Dec 08, 2014 2:58 pm
Full Name: Steve Krause

Re: GFS copy full restore point selection

Veeam Logoby foggy » Wed Nov 16, 2016 3:36 pm

So is VBK created by the the copy job during the next cycle (on Sunday)?
foggy
Veeam Software
 
Posts: 14716
Liked: 1075 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: GFS copy full restore point selection

Veeam Logoby skrause » Wed Nov 16, 2016 4:00 pm

No, a VBK was created on Saturday at noon, then there is a VIB created on Sunday at noon which is very large.
Steve Krause
Veeam Certified Architect
skrause
Expert
 
Posts: 296
Liked: 45 times
Joined: Mon Dec 08, 2014 2:58 pm
Full Name: Steve Krause

Re: GFS copy full restore point selection

Veeam Logoby rbrambley » Wed Nov 16, 2016 4:11 pm

I think what you are seeing is the daily .vbk veeam has to create by default. For example, if understand your settings from above, you have a BCJ with 0 dailys and 5 weeklys. Lets say you start this job on a Fri.

Fri - the BCJ witll create a new daily .vbk
Sat - the BCJ will create a temporary .vib, merge with the existing .vbk, and delete the .vib.
Sun - same as SAT and this .vbk becomes your first Weekly

You have 1 .vbk at this point

Mon - same as Sun, but Veeam keeps the 1 Weekly .vbk and starts a new daily .vbk

And so on, until you eventually have 5 weekly .vbks and 1 daily .vbk
rbrambley
Veeam Software
 
Posts: 445
Liked: 54 times
Joined: Tue Jun 16, 2009 1:23 pm
Full Name: Rich Brambley

Re: GFS copy full restore point selection

Veeam Logoby skrause » Wed Nov 16, 2016 4:19 pm

I am copying the entire from source, there are no transform operations being done. When it reaches the point at which it copies the new full, it just deletes the VIB files per retention.
Steve Krause
Veeam Certified Architect
skrause
Expert
 
Posts: 296
Liked: 45 times
Joined: Mon Dec 08, 2014 2:58 pm
Full Name: Steve Krause

Re: GFS copy full restore point selection

Veeam Logoby foggy » Wed Nov 16, 2016 4:21 pm

I suggest reviewing the setup with support.
foggy
Veeam Software
 
Posts: 14716
Liked: 1075 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: GFS copy full restore point selection

Veeam Logoby rbrambley » Wed Nov 16, 2016 4:27 pm

Veeam BCJs don't copy the source backup files as is. BCJs read the data from the source files and then use the temp .vib and merge as I described. It's a common misunderstanding, but BCJs use the same data, but create their own new chain of files.

It gets really confusing and unpredictable when actual job windows overlap the sync schedule, and it's hard to follow what you are seeing exactly in these forums. Your best bet is to open a ticket with Veeam Support so they can see your settings and what's actually happening.
rbrambley
Veeam Software
 
Posts: 445
Liked: 54 times
Joined: Tue Jun 16, 2009 1:23 pm
Full Name: Rich Brambley

Re: GFS copy full restore point selection

Veeam Logoby foggy » Wed Nov 16, 2016 4:29 pm

Steve uses active fulls with backup copy jobs, so merge is out of the picture. Anyway, it's better to troubleshoot this with support, indeed.
foggy
Veeam Software
 
Posts: 14716
Liked: 1075 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: GFS copy full restore point selection

Veeam Logoby skrause » Fri Nov 18, 2016 7:35 pm

Ok Thanks.

Since 9.5 came out since I was last in the office on Wednesday morning, I guess I will hold off on sending in a ticket with support until I have that installed and can see if the issue resolves itself.
Steve Krause
Veeam Certified Architect
skrause
Expert
 
Posts: 296
Liked: 45 times
Joined: Mon Dec 08, 2014 2:58 pm
Full Name: Steve Krause

Re: GFS copy full restore point selection

Veeam Logoby foggy » Fri Nov 18, 2016 10:11 pm

Sounds reasonable. Keep us informed on the results.
foggy
Veeam Software
 
Posts: 14716
Liked: 1075 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: GFS copy full restore point selection

Veeam Logoby skrause » Mon Nov 28, 2016 3:02 pm

So the good news: It looks like the copy job has figured out the full restore point selection on its own after the upgrade to 9.5.
The bad news: It ran a full copy on both Saturday and Sunday which scares me a bit for my retention policy if it decides to do the same thing this weekend as I only have a 1 week "buffer" in my retention settings vs policy (I keep 5 weeks, we are only required to keep 4).

Hopefully this was a one-time adjustment. I will watch it Saturday/Sunday and will open a ticket then if the double-full happens again.
Steve Krause
Veeam Certified Architect
skrause
Expert
 
Posts: 296
Liked: 45 times
Joined: Mon Dec 08, 2014 2:58 pm
Full Name: Steve Krause

Re: GFS copy full restore point selection

Veeam Logoby skrause » Mon Dec 05, 2016 2:02 pm

So it looks like 3/4 of my jobs are now, after the update to 9.5 running an active full on BOTH Saturday and Sunday which has just destroyed my retention policy as well as created a huge cramp on my disk space. In each case, the restore point to copy in the job settings is between 0200-0400 on Sunday. The only job I have that copies only once is set to Saturday 2200 as a GFS point, but it is doing the Full copy on Saturday morning (8 am) so it is still selecting the point to copy in a non-intuitive fashion.

Ticket 01994952
Steve Krause
Veeam Certified Architect
skrause
Expert
 
Posts: 296
Liked: 45 times
Joined: Mon Dec 08, 2014 2:58 pm
Full Name: Steve Krause

Re: GFS copy full restore point selection

Veeam Logoby skrause » Thu Dec 08, 2016 6:34 pm

So support at this point is saying that it is being caused by a "synthetic operation" happening on Saturdays. When I told them I use Copy Full they told me it was in the source jobs, which are weekly active fulls.

I am in a situation where this is obviously an issue with how Veeam selects when to run with the restore point selection logic for GFS copy jobs. Just getting this up the chain where someone can agree that it is the issue is the problem.

Usually I would roll with it while a fix is worked on but I will be out of the office for the rest of the month (vacation + organization offices closed) starting the middle of next week so my very manual workarounds to make sure I keep my retention while not running out of disk space are not feasible.

I guess I am going to have to create additional copy jobs using a different day to copy the full and run a longer retention time.
Steve Krause
Veeam Certified Architect
skrause
Expert
 
Posts: 296
Liked: 45 times
Joined: Mon Dec 08, 2014 2:58 pm
Full Name: Steve Krause

Next

Return to Veeam Backup & Replication



Who is online

Users browsing this forum: Bing [Bot], Google [Bot], Yahoo [Bot] and 27 guests