Comprehensive data protection for all workloads
Post Reply
DataCenterAI
Novice
Posts: 4
Liked: 2 times
Joined: Sep 14, 2017 5:25 am
Full Name: Jeremy Wei
Contact:

The prediction of the Best Backup Windows

Post by DataCenterAI » 2 people like this post

Is it a good idea to predict the best backup windows with machine learning?
We can monitor the historic network/storage/CPU/RAM usage, and then predict the best time time slots for backup or VM cloning. Based on those predictions, we can also support an elastic backup frequency and make it automatic rather than reply on a dummy scheduler. Thus, the machine learning technologies can mitigate the performance degradation caused by backup, as well as reduce the data loss caused by improper scheduling. In short, make backup intelligent.
Shestakov
Veteran
Posts: 7328
Liked: 781 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: The prediction of the Best Backup Windows

Post by Shestakov » 1 person likes this post

Hi Jeremy and welcome to the community!
I really like the idea and we are already working on something similar in Veeam ONE.
The only issue is that it`s hard to tell how much time newly created job is going to take. Much easier is to reschedule existing jobs.
nitramd
Veteran
Posts: 297
Liked: 85 times
Joined: Feb 16, 2017 8:05 pm
Contact:

Re: The prediction of the Best Backup Windows

Post by nitramd »

An interesting idea indeed. This might help reduce storage resource contention.

+1 for making backup scheduling a bit more intelligent.
Shestakov
Veteran
Posts: 7328
Liked: 781 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: The prediction of the Best Backup Windows

Post by Shestakov »

By the way, will you allow Veeam to re-schedule jobs for you or you just want to get suggestion?
Thanks!
DataCenterAI
Novice
Posts: 4
Liked: 2 times
Joined: Sep 14, 2017 5:25 am
Full Name: Jeremy Wei
Contact:

Re: The prediction of the Best Backup Windows

Post by DataCenterAI »

Indeed, some people said RPO/RTO is OMG, and so we developed a machine learning engine which can help Veeam accomplish this feature shortly.
Shestakov
Veteran
Posts: 7328
Liked: 781 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: The prediction of the Best Backup Windows

Post by Shestakov »

Have you already developed it?
DataCenterAI
Novice
Posts: 4
Liked: 2 times
Joined: Sep 14, 2017 5:25 am
Full Name: Jeremy Wei
Contact:

Re: The prediction of the Best Backup Windows

Post by DataCenterAI »

Yes. We've done it and licensed it to a couple of backup vendors and some end customers
Shestakov
Veteran
Posts: 7328
Liked: 781 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: The prediction of the Best Backup Windows

Post by Shestakov »

Nice. Do I understand correctly that you have created your own machine learning job scheduler and sell it to backup vendors?
Different companies use different backup logic and show different statistics to use as data for machine learning.
DataCenterAI
Novice
Posts: 4
Liked: 2 times
Joined: Sep 14, 2017 5:25 am
Full Name: Jeremy Wei
Contact:

Re: The prediction of the Best Backup Windows

Post by DataCenterAI »

Not a scheduler. The machine learning engine provides a set of APIs with predictive models and suggestions for integration.
Shestakov
Veteran
Posts: 7328
Liked: 781 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: The prediction of the Best Backup Windows

Post by Shestakov »

Got it. Thanks!
Post Reply

Who is online

Users browsing this forum: Google [Bot] and 179 guests