Availability for the Always-On Enterprise
Post Reply
DataCenterAI
Novice
Posts: 4
Liked: 2 times
Joined: Sep 14, 2017 5:25 am
Full Name: Jeremy Wei
Contact:

The prediction of the Best Backup Windows

Post by DataCenterAI » Sep 14, 2017 5:44 am 2 people like this post

Is it a good idea to predict the best backup windows with machine learning?
We can monitor the historic network/storage/CPU/RAM usage, and then predict the best time time slots for backup or VM cloning. Based on those predictions, we can also support an elastic backup frequency and make it automatic rather than reply on a dummy scheduler. Thus, the machine learning technologies can mitigate the performance degradation caused by backup, as well as reduce the data loss caused by improper scheduling. In short, make backup intelligent.

Shestakov
Veeam Software
Posts: 5924
Liked: 514 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: The prediction of the Best Backup Windows

Post by Shestakov » Sep 14, 2017 12:17 pm 1 person likes this post

Hi Jeremy and welcome to the community!
I really like the idea and we are already working on something similar in Veeam ONE.
The only issue is that it`s hard to tell how much time newly created job is going to take. Much easier is to reschedule existing jobs.

nitramd
Expert
Posts: 125
Liked: 19 times
Joined: Feb 16, 2017 8:05 pm
Contact:

Re: The prediction of the Best Backup Windows

Post by nitramd » Sep 14, 2017 1:42 pm

An interesting idea indeed. This might help reduce storage resource contention.

+1 for making backup scheduling a bit more intelligent.

Shestakov
Veeam Software
Posts: 5924
Liked: 514 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: The prediction of the Best Backup Windows

Post by Shestakov » Sep 14, 2017 3:09 pm

By the way, will you allow Veeam to re-schedule jobs for you or you just want to get suggestion?
Thanks!

DataCenterAI
Novice
Posts: 4
Liked: 2 times
Joined: Sep 14, 2017 5:25 am
Full Name: Jeremy Wei
Contact:

Re: The prediction of the Best Backup Windows

Post by DataCenterAI » Sep 14, 2017 5:23 pm

Indeed, some people said RPO/RTO is OMG, and so we developed a machine learning engine which can help Veeam accomplish this feature shortly.

Shestakov
Veeam Software
Posts: 5924
Liked: 514 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: The prediction of the Best Backup Windows

Post by Shestakov » Sep 14, 2017 5:27 pm

Have you already developed it?

DataCenterAI
Novice
Posts: 4
Liked: 2 times
Joined: Sep 14, 2017 5:25 am
Full Name: Jeremy Wei
Contact:

Re: The prediction of the Best Backup Windows

Post by DataCenterAI » Sep 14, 2017 10:37 pm

Yes. We've done it and licensed it to a couple of backup vendors and some end customers

Shestakov
Veeam Software
Posts: 5924
Liked: 514 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: The prediction of the Best Backup Windows

Post by Shestakov » Sep 15, 2017 11:43 am

Nice. Do I understand correctly that you have created your own machine learning job scheduler and sell it to backup vendors?
Different companies use different backup logic and show different statistics to use as data for machine learning.

DataCenterAI
Novice
Posts: 4
Liked: 2 times
Joined: Sep 14, 2017 5:25 am
Full Name: Jeremy Wei
Contact:

Re: The prediction of the Best Backup Windows

Post by DataCenterAI » Sep 18, 2017 1:26 am

Not a scheduler. The machine learning engine provides a set of APIs with predictive models and suggestions for integration.

Shestakov
Veeam Software
Posts: 5924
Liked: 514 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: The prediction of the Best Backup Windows

Post by Shestakov » Sep 18, 2017 12:59 pm

Got it. Thanks!

Post Reply

Who is online

Users browsing this forum: Majestic-12 [Bot] and 37 guests