Comprehensive data protection for all workloads
albertwt
Veeam Legend
Posts: 879
Liked: 46 times
Joined: Nov 05, 2009 12:24 pm
Location: Sydney, NSW
Contact:

Copy interval has expired Incremental copy was not processed

Post by albertwt »

Hi All,

Why is that when I still got enough disk space in the Backup Copy (Secondary), the backup copy job still failed with the below error:
Copy interval has expired, Incremental copy was not processed during the copy interval
Some VMs were not processed during the copy interval
Backup location [E:\Backups] is getting low on free disk space (628.4 GB free of 13.5 TB).

Thanks in advance.
--
/* Veeam software enthusiast user & supporter ! */
foggy
Veeam Software
Posts: 21069
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Copy interval has expired Incremental copy was not proce

Post by foggy » 1 person likes this post

The message itself means that the job didn't get enough time to copy all the required data within the copy interval. What are the job interval and scheduling settings?
albertwt
Veeam Legend
Posts: 879
Liked: 46 times
Joined: Nov 05, 2009 12:24 pm
Location: Sydney, NSW
Contact:

Re: Copy interval has expired Incremental copy was not proce

Post by albertwt »

foggy wrote:The message itself means that the job didn't get enough time to copy all the required data within the copy interval. What are the job interval and scheduling settings?
1 copy everyday starting at 10:00 AM and the interval is continuously.
--
/* Veeam software enthusiast user & supporter ! */
veremin
Product Manager
Posts: 20270
Liked: 2252 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: Copy interval has expired Incremental copy was not proce

Post by veremin » 1 person likes this post

That means that one day is simply not enough for the backup copy job to process all of the changes generated. Have you thought about increasing it? Thanks.
albertwt
Veeam Legend
Posts: 879
Liked: 46 times
Joined: Nov 05, 2009 12:24 pm
Location: Sydney, NSW
Contact:

Re: Copy interval has expired Incremental copy was not proce

Post by albertwt »

OK, do you mean by changing it from:

Image
--
/* Veeam software enthusiast user & supporter ! */
Gostev
Chief Product Officer
Posts: 31459
Liked: 6648 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Copy interval has expired Incremental copy was not proce

Post by Gostev » 1 person likes this post

If you are doing full (initial) pass without seeding, then you can just try leaving everything as is: the job will finish transferring full backup, and incremental backups should be fine since generally they are at least 10 time smaller. You can check out the job report to estimate how much more time is needed to complete full backup transfer.
bryan3636
Novice
Posts: 3
Liked: never
Joined: Aug 19, 2016 5:46 pm
Full Name: Bryan Hardesty
Contact:

Re: Copy interval has expired Incremental copy was not proce

Post by bryan3636 »

I don't understand why copy even uses an interval. If there's new data to copy, then just start copying. Don't stop until everything has been copied. It it wasn't for me going over WAN I would think xcopy does a better job than veeam's copy. I'd love to learn why I'm wrong.
Gostev
Chief Product Officer
Posts: 31459
Liked: 6648 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Copy interval has expired Incremental copy was not proce

Post by Gostev » 3 people like this post

Because it's not just a copy of existing backup files, like xcopy - Backup Copy allows you to pick and choose only selected VMs from different jobs. And "don't stop until everything has been copied" approach is simply not suitable for an enterprise IT that needs to ensure offsite RPOs are met.

That said, I've long wanted to add basic, "dumbed down" mode for Backup Copy jobs that basically repeats xcopy and only copies entire backup files - this will allow some major simplification at the cost of major functionality loss, but it seems that quite some customers just want something simple like this.
JaySt
Service Provider
Posts: 415
Liked: 75 times
Joined: Jun 09, 2015 7:08 pm
Full Name: JaySt
Contact:

Re: Copy interval has expired Incremental copy was not proce

Post by JaySt » 1 person likes this post

Gostev wrote: That said, I've long wanted to add basic, "dumbed down" mode for Backup Copy jobs that basically repeats xcopy and only copies entire backup files - this will allow some major simplification at the cost of major functionality loss, but it seems that quite some customers just want something simple like this.
i agree, and i can confirm the request for simplification. Almost every customer has difficulty understanding copy job intervals and scheduling of it. This tells something about the current implementation in my opinion. People seem to expect a simpler approach. I don't see many users(not yet) think of configuring things in a way SLAs are enforced in a strict/enterprise way. But that could also tell something about the type of users i get to deal with :)
Veeam Certified Engineer
ober72
Veeam Vanguard
Posts: 698
Liked: 136 times
Joined: Jan 24, 2014 4:10 pm
Full Name: Geoff Burke
Contact:

Re: Copy interval has expired Incremental copy was not proce

Post by ober72 »

I agree fully with JaySt, it seems people have a hard time understanding this. I keep getting the question, can't it just copy today's backups until finished. Of course the error email also does not help as it seeds panic :)
Geoff Burke
VMCA2022, VMCE2023, CKA, CKAD
Veeam Vanguard, Veeam Legend
BGA-Robert
Service Provider
Posts: 60
Liked: 8 times
Joined: Feb 03, 2016 5:06 pm
Full Name: Robert Wakefield
Contact:

Re: Copy interval has expired Incremental copy was not proce

Post by BGA-Robert »

Yes, I'll take the dumbed down version too. Meeting an Enterprise RPO is only one aspect of what's trying to be accomplished with a backup copy job and I'm not always looking to be shoe-horned into this functionality. Lack of flexibility with backup copy scheduling can be very frustrating
dellock6
Veeam Software
Posts: 6137
Liked: 1928 times
Joined: Jul 26, 2009 3:39 pm
Full Name: Luca Dell'Oca
Location: Varese, Italy
Contact:

Re: Copy interval has expired Incremental copy was not proce

Post by dellock6 »

But whatever is the approach, if a backup copy cannot be completed in a given interval, why are you configuring that interval? It will never be completed regardless the software uses xcopy or the native backup copy job... I think you have better chances to complete a copy without raw xcopy that has no data reduction capability. Xcopying daily when the infrastructure only allows you to do it every three days for example, is non-sense to be honest.
Luca Dell'Oca
Principal EMEA Cloud Architect @ Veeam Software

@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2022
Veeam VMCE #1
albertwt
Veeam Legend
Posts: 879
Liked: 46 times
Joined: Nov 05, 2009 12:24 pm
Location: Sydney, NSW
Contact:

Re: Copy interval has expired Incremental copy was not proce

Post by albertwt »

Gostev wrote:Because it's not just a copy of existing backup files, like xcopy - Backup Copy allows you to pick and choose only selected VMs from different jobs. And "don't stop until everything has been copied" approach is simply not suitable for an enterprise IT that needs to ensure offsite RPOs are met.

That said, I've long wanted to add basic, "dumbed down" mode for Backup Copy jobs that basically repeats xcopy and only copies entire backup files - this will allow some major simplification at the cost of major functionality loss, but it seems that quite some customers just want something simple like this.
Selecting a specific VMs for the Backup Copy job is the nicest thing that I like :D so that I do not have to copy the whole backup job.
--
/* Veeam software enthusiast user & supporter ! */
veremin
Product Manager
Posts: 20270
Liked: 2252 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: Copy interval has expired Incremental copy was not proce

Post by veremin » 1 person likes this post

Selecting a specific VMs for the Backup Copy job is the nicest thing that I like :D so that I do not have to copy the whole backup job.
Thinking aloud - with dumbed down mode (assuming we had one), it would be only possible if you're utilizing per-VM chains. Thanks.
dellock6
Veeam Software
Posts: 6137
Liked: 1928 times
Joined: Jul 26, 2009 3:39 pm
Full Name: Luca Dell'Oca
Location: Varese, Italy
Contact:

Re: Copy interval has expired Incremental copy was not proce

Post by dellock6 » 1 person likes this post

Thinking aloud - which you should anyway, as there are really not that many reasons to keep using the monolithic files :)
Luca Dell'Oca
Principal EMEA Cloud Architect @ Veeam Software

@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2022
Veeam VMCE #1
albertwt
Veeam Legend
Posts: 879
Liked: 46 times
Joined: Nov 05, 2009 12:24 pm
Location: Sydney, NSW
Contact:

Re: Copy interval has expired Incremental copy was not proce

Post by albertwt »

Luca,

So for the Backup copy job, can I utilize per VM backup job chain even if I'm not using the Dedupe storage system as the Backup Repository ?
What's the benefits ?
--
/* Veeam software enthusiast user & supporter ! */
mkretzer
Veeam Legend
Posts: 1140
Liked: 387 times
Joined: Dec 17, 2015 7:17 am
Contact:

Re: Copy interval has expired Incremental copy was not proce

Post by mkretzer »

The performance of per-VM is SO MUCH BETTER especially for synthetic operations.

The downside is that if you have many VMs (we have about 1400) you can get deadlocks and other problems which in our environment lead to defective backup chains.

This should be fixed in 9.5 according to support!
albertwt
Veeam Legend
Posts: 879
Liked: 46 times
Joined: Nov 05, 2009 12:24 pm
Location: Sydney, NSW
Contact:

Re: Copy interval has expired Incremental copy was not proce

Post by albertwt »

Mkretzer,

What does it means by "synthetic operations" is it the merging of the backup chains into the VBK file on both Reverse & forward incremental 8) ?
--
/* Veeam software enthusiast user & supporter ! */
mkretzer
Veeam Legend
Posts: 1140
Liked: 387 times
Joined: Dec 17, 2015 7:17 am
Contact:

Re: Copy interval has expired Incremental copy was not proce

Post by mkretzer » 1 person likes this post

Yes exactly...

Gesendet von meinem Nexus 6P mit Tapatalk
foggy
Veeam Software
Posts: 21069
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Copy interval has expired Incremental copy was not proce

Post by foggy »

albertwt wrote:So for the Backup copy job, can I utilize per VM backup job chain even if I'm not using the Dedupe storage system as the Backup Repository ?
Per-VM backup chains setting can be used for the repository of any type.
JaySt
Service Provider
Posts: 415
Liked: 75 times
Joined: Jun 09, 2015 7:08 pm
Full Name: JaySt
Contact:

Re: Copy interval has expired Incremental copy was not proce

Post by JaySt »

dellock6 wrote:But whatever is the approach, if a backup copy cannot be completed in a given interval, why are you configuring that interval? It will never be completed regardless the software uses xcopy or the native backup copy job... I think you have better chances to complete a copy without raw xcopy that has no data reduction capability. Xcopying daily when the infrastructure only allows you to do it every three days for example, is non-sense to be honest.
That's true, in theory. What's your take then, on why users could get confused by copy job process implementation as it currently is? I think it's the interval itself. Back-up jobs for example are scheduled with a start time, but no configured duration (or interval) either. Maybe users expect the same from a copy job: 1)Start it at set time, just run and do what i configured it to do 2) finish when you finish and 3) i'll monitor if it takes to long , just like with my back-ups. 4.) oh, and when the next copy job scheduled start kicks off , and the last didn't finish just yet, just say "job already running" without interupting (just like back-up jobs) which will show up in my reports.

Maybe lots of disadvantages....but i still see a "dumbed down" version(as an option) as a welcome feature.
Veeam Certified Engineer
tsymons@ventra.us
Novice
Posts: 3
Liked: 1 time
Joined: Oct 12, 2016 8:35 pm
Full Name: Tom symons
Contact:

Re: Copy interval has expired Incremental copy was not proce

Post by tsymons@ventra.us » 1 person likes this post

These frustrate me too. I just want a job that I can configure to copy offsite on the weekends and not get useless error messages in my inbox. I just want to know when it's done. Please add a way to configure this.
foggy
Veeam Software
Posts: 21069
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Copy interval has expired Incremental copy was not proce

Post by foggy »

Hi Tom, what kind of messages are you getting?
tsymons@ventra.us
Novice
Posts: 3
Liked: 1 time
Joined: Oct 12, 2016 8:35 pm
Full Name: Tom symons
Contact:

Re: Copy interval has expired Incremental copy was not proce

Post by tsymons@ventra.us »

I just looked at the error message again. I think I just have something goofy going on. My copy job is allowed to run from 12am saturday morning to midnight sunday night. At 12:00:08 AM Saturday I get an email ever week that the job failed: "Incremental copy was not processed during the copy interval". The job then restarts sometime after that and finishes. Perhaps my problem is different.
foggy
Veeam Software
Posts: 21069
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Copy interval has expired Incremental copy was not proce

Post by foggy »

Your issue looks more like this one, so I recommend to contact support after reviewing the referred thread.
itrabbit
Influencer
Posts: 20
Liked: 6 times
Joined: Nov 24, 2016 6:50 am
Full Name: Matt Dunleavy
Contact:

Re: Copy interval has expired Incremental copy was not proce

Post by itrabbit »

I would really like the option to just copy backup until complete or an option to continuously copy. i.e as soon as a new backup is found it will upload until complete.

I wanted to set my copy to copy every 1 hour any new snapshots, if it finds one it starts copying, if it doesn't it will check the following hour. However, I am uploading over the WAN and if a new backup occurs the time to upload is 4 hours.

While I understand RDOs and all that enterprise nonsense, if its in the middle of copying a backup, don't stop just continue and skip the next hour.

While you might say just set your copy interval to 5 hours. However, it must wait 5 hours to recheck again? and even then the new backup occurs it still could be in the middle or towards the end of the 5 hours, so it will get to the 5 hour mark and cancel it again.

I don't know why Veeam hasn't implemented, a simple check box "Continue copy even if next next interval is reached".


Please
kubimike
Veteran
Posts: 373
Liked: 41 times
Joined: Feb 03, 2017 2:34 pm
Full Name: MikeO
Contact:

[MERGED] Backup Copy job failure

Post by kubimike »

Hello, Im hoping someone would help me think through why I have a failed job. Perhaps a sync issue and just let it run, next job might be OK?

job details:
Copy Every: 1 Day 3:30AM
Schedule: 3:00AM - 11:59AM Everyday of the week.

From the looks of it the copy job is starting a new interval right in between the job.
Here are two pictures from the failed job.
Image
Image

Successful job retry?
Image
veremin
Product Manager
Posts: 20270
Liked: 2252 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: Copy interval has expired Incremental copy was not proce

Post by veremin »

Backup job job failed to process all source VMs, as a result the given error was generated. During next interval the job managed to catch up. Thanks.
paallergy
Enthusiast
Posts: 51
Liked: 10 times
Joined: May 18, 2010 7:10 pm
Full Name: Jonathan Schultz
Contact:

Re: Copy interval has expired Incremental copy was not proce

Post by paallergy »

Simplified Backup Copy Job Request:
- Remove copy interval
- Start backup copy job after backup job finishes
- Continue backup copy job until job is finished
- Backup copy job still subject to network throttling
- Backup copy job still subject to schedule

Keep full options (including copy interval) for those who still need them
veremin
Product Manager
Posts: 20270
Liked: 2252 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: Copy interval has expired Incremental copy was not proce

Post by veremin »

Your request has been noted. There are plans to add something similar down the road, so stay tuned.
Post Reply

Who is online

Users browsing this forum: Google [Bot] and 223 guests