-
- Novice
- Posts: 4
- Liked: 2 times
- Joined: Sep 14, 2017 5:25 am
- Full Name: Jeremy Wei
- Contact:
The prediction of the Best Backup Windows
Is it a good idea to predict the best backup windows with machine learning?
We can monitor the historic network/storage/CPU/RAM usage, and then predict the best time time slots for backup or VM cloning. Based on those predictions, we can also support an elastic backup frequency and make it automatic rather than reply on a dummy scheduler. Thus, the machine learning technologies can mitigate the performance degradation caused by backup, as well as reduce the data loss caused by improper scheduling. In short, make backup intelligent.
We can monitor the historic network/storage/CPU/RAM usage, and then predict the best time time slots for backup or VM cloning. Based on those predictions, we can also support an elastic backup frequency and make it automatic rather than reply on a dummy scheduler. Thus, the machine learning technologies can mitigate the performance degradation caused by backup, as well as reduce the data loss caused by improper scheduling. In short, make backup intelligent.
-
- Veteran
- Posts: 7328
- Liked: 781 times
- Joined: May 21, 2014 11:03 am
- Full Name: Nikita Shestakov
- Location: Prague
- Contact:
Re: The prediction of the Best Backup Windows
Hi Jeremy and welcome to the community!
I really like the idea and we are already working on something similar in Veeam ONE.
The only issue is that it`s hard to tell how much time newly created job is going to take. Much easier is to reschedule existing jobs.
I really like the idea and we are already working on something similar in Veeam ONE.
The only issue is that it`s hard to tell how much time newly created job is going to take. Much easier is to reschedule existing jobs.
-
- Veteran
- Posts: 298
- Liked: 85 times
- Joined: Feb 16, 2017 8:05 pm
- Contact:
Re: The prediction of the Best Backup Windows
An interesting idea indeed. This might help reduce storage resource contention.
+1 for making backup scheduling a bit more intelligent.
+1 for making backup scheduling a bit more intelligent.
-
- Veteran
- Posts: 7328
- Liked: 781 times
- Joined: May 21, 2014 11:03 am
- Full Name: Nikita Shestakov
- Location: Prague
- Contact:
Re: The prediction of the Best Backup Windows
By the way, will you allow Veeam to re-schedule jobs for you or you just want to get suggestion?
Thanks!
Thanks!
-
- Novice
- Posts: 4
- Liked: 2 times
- Joined: Sep 14, 2017 5:25 am
- Full Name: Jeremy Wei
- Contact:
Re: The prediction of the Best Backup Windows
Indeed, some people said RPO/RTO is OMG, and so we developed a machine learning engine which can help Veeam accomplish this feature shortly.
-
- Veteran
- Posts: 7328
- Liked: 781 times
- Joined: May 21, 2014 11:03 am
- Full Name: Nikita Shestakov
- Location: Prague
- Contact:
Re: The prediction of the Best Backup Windows
Have you already developed it?
-
- Novice
- Posts: 4
- Liked: 2 times
- Joined: Sep 14, 2017 5:25 am
- Full Name: Jeremy Wei
- Contact:
Re: The prediction of the Best Backup Windows
Yes. We've done it and licensed it to a couple of backup vendors and some end customers
-
- Veteran
- Posts: 7328
- Liked: 781 times
- Joined: May 21, 2014 11:03 am
- Full Name: Nikita Shestakov
- Location: Prague
- Contact:
Re: The prediction of the Best Backup Windows
Nice. Do I understand correctly that you have created your own machine learning job scheduler and sell it to backup vendors?
Different companies use different backup logic and show different statistics to use as data for machine learning.
Different companies use different backup logic and show different statistics to use as data for machine learning.
-
- Novice
- Posts: 4
- Liked: 2 times
- Joined: Sep 14, 2017 5:25 am
- Full Name: Jeremy Wei
- Contact:
Re: The prediction of the Best Backup Windows
Not a scheduler. The machine learning engine provides a set of APIs with predictive models and suggestions for integration.
-
- Veteran
- Posts: 7328
- Liked: 781 times
- Joined: May 21, 2014 11:03 am
- Full Name: Nikita Shestakov
- Location: Prague
- Contact:
Re: The prediction of the Best Backup Windows
Got it. Thanks!
Who is online
Users browsing this forum: Amazon [Bot], Mehl and 301 guests