The prediction of the Best Backup Windows

Availability for the Always-On Enterprise

The prediction of the Best Backup Windows

Veeam Logoby DataCenterAI » Thu Sep 14, 2017 5:44 am 2 people like this post

Is it a good idea to predict the best backup windows with machine learning?
We can monitor the historic network/storage/CPU/RAM usage, and then predict the best time time slots for backup or VM cloning. Based on those predictions, we can also support an elastic backup frequency and make it automatic rather than reply on a dummy scheduler. Thus, the machine learning technologies can mitigate the performance degradation caused by backup, as well as reduce the data loss caused by improper scheduling. In short, make backup intelligent.
DataCenterAI
Novice
 
Posts: 4
Liked: 2 times
Joined: Thu Sep 14, 2017 5:25 am
Full Name: Jeremy Wei

Re: The prediction of the Best Backup Windows

Veeam Logoby Shestakov » Thu Sep 14, 2017 12:17 pm 1 person likes this post

Hi Jeremy and welcome to the community!
I really like the idea and we are already working on something similar in Veeam ONE.
The only issue is that it`s hard to tell how much time newly created job is going to take. Much easier is to reschedule existing jobs.
Shestakov
Veeam Software
 
Posts: 5027
Liked: 419 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

Re: The prediction of the Best Backup Windows

Veeam Logoby nitramd » Thu Sep 14, 2017 1:42 pm

An interesting idea indeed. This might help reduce storage resource contention.

+1 for making backup scheduling a bit more intelligent.
nitramd
Enthusiast
 
Posts: 42
Liked: 7 times
Joined: Thu Feb 16, 2017 8:05 pm

Re: The prediction of the Best Backup Windows

Veeam Logoby Shestakov » Thu Sep 14, 2017 3:09 pm

By the way, will you allow Veeam to re-schedule jobs for you or you just want to get suggestion?
Thanks!
Shestakov
Veeam Software
 
Posts: 5027
Liked: 419 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

Re: The prediction of the Best Backup Windows

Veeam Logoby DataCenterAI » Thu Sep 14, 2017 5:23 pm

Indeed, some people said RPO/RTO is OMG, and so we developed a machine learning engine which can help Veeam accomplish this feature shortly.
DataCenterAI
Novice
 
Posts: 4
Liked: 2 times
Joined: Thu Sep 14, 2017 5:25 am
Full Name: Jeremy Wei

Re: The prediction of the Best Backup Windows

Veeam Logoby Shestakov » Thu Sep 14, 2017 5:27 pm

Have you already developed it?
Shestakov
Veeam Software
 
Posts: 5027
Liked: 419 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

Re: The prediction of the Best Backup Windows

Veeam Logoby DataCenterAI » Thu Sep 14, 2017 10:37 pm

Yes. We've done it and licensed it to a couple of backup vendors and some end customers
DataCenterAI
Novice
 
Posts: 4
Liked: 2 times
Joined: Thu Sep 14, 2017 5:25 am
Full Name: Jeremy Wei

Re: The prediction of the Best Backup Windows

Veeam Logoby Shestakov » Fri Sep 15, 2017 11:43 am

Nice. Do I understand correctly that you have created your own machine learning job scheduler and sell it to backup vendors?
Different companies use different backup logic and show different statistics to use as data for machine learning.
Shestakov
Veeam Software
 
Posts: 5027
Liked: 419 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

Re: The prediction of the Best Backup Windows

Veeam Logoby DataCenterAI » Mon Sep 18, 2017 1:26 am

Not a scheduler. The machine learning engine provides a set of APIs with predictive models and suggestions for integration.
DataCenterAI
Novice
 
Posts: 4
Liked: 2 times
Joined: Thu Sep 14, 2017 5:25 am
Full Name: Jeremy Wei

Re: The prediction of the Best Backup Windows

Veeam Logoby Shestakov » Mon Sep 18, 2017 12:59 pm

Got it. Thanks!
Shestakov
Veeam Software
 
Posts: 5027
Liked: 419 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov


Return to Veeam Backup & Replication



Who is online

Users browsing this forum: No registered users and 35 guests