How to protect large cluster

Hyper-V specific discussions

How to protect large cluster

Veeam Logoby samh22a » Sun Nov 10, 2013 2:16 pm

Hi,

Currently looking at Veeam for an internal project to protect a big Hyper-V cluster (5000 Vms).

I can't figure out how to automatically protect newly created VM, and to split the backup load onto multiple jobs..let's say 50 VMs per job.

Is there a way to specify 1 job per CSV ? And then automatically detect newly added CSV ?

Thanks,
Sam
samh22a
Service Provider
 
Posts: 35
Liked: 2 times
Joined: Sun Nov 10, 2013 2:03 pm

Re: How to protect large cluster

Veeam Logoby Gostev » Sun Nov 10, 2013 3:37 pm

Hi, you can populate the job with hosts and clusters (in addition to individual VMs). Thanks!
Gostev
Veeam Software
 
Posts: 21396
Liked: 2350 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Baar, Switzerland

Re: How to protect large cluster

Veeam Logoby samh22a » Sun Nov 10, 2013 3:47 pm

Hi,

Isn't this not very optimal ? as VM changes very frequently on a specific host..the same job may have 100 vm one day, and 100 totally different vm the next day ?
samh22a
Service Provider
 
Posts: 35
Liked: 2 times
Joined: Sun Nov 10, 2013 2:03 pm

Re: How to protect large cluster

Veeam Logoby Gostev » Sun Nov 10, 2013 4:19 pm

Yes, it's not very optimal for highly dynamic environments. For those, creating the job on a cluster lever is better.
Gostev
Veeam Software
 
Posts: 21396
Liked: 2350 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Baar, Switzerland

Re: How to protect large cluster

Veeam Logoby samh22a » Sun Nov 10, 2013 4:22 pm

Make sense.
I'm still new to Veeam..so I'm trying to understand how everything works together.

As for the job at the cluster level: can we have multiple job to split the load at the cluster level ? If there's 5k vm within my cluster, I really doubt a single job can handle it all.
samh22a
Service Provider
 
Posts: 35
Liked: 2 times
Joined: Sun Nov 10, 2013 2:03 pm

Re: How to protect large cluster

Veeam Logoby tsightler » Sun Nov 10, 2013 5:09 pm

For more sophisticated management of a large cluster, the best option is probably to use Powershell, potentially in concert with some orchestration, to automate the creation and maintenance of jobs. It should be fairly easy to create a Powershell that list VMs for each CSV and adds them to a job, although I'll have to admit I've only done this for VMware. I would guess the first step would be to grab a list VM objects with Get-VM, then the list of CSV objects with Get-ClusterSharedVolume. At that point simply looping through the CSV objects to determine which VMs live on them should be a simple matter of comparing field (I think the VMCPath property of the VM object would be matched against the FriendlyVolumeName property of the CSV object).

So once you have the list of VM objects it should be pretty easy to create the job and/or add VMs to an existing job. If you use some orachstration you can even trigger a script to add a VM to the appropriate job automatically as soon as the VM is created, otherwise a simple scheduled run of the script each day would pick up new objects and create new jobs.

That's the conceptual idea anyway. I've seen this done for plenty of environments with VMware so I don't think it would be too difficult with Hyper-V, but I'll admit that's a platform I'm still ramping up my knowledge on.
tsightler
Veeam Software
 
Posts: 4772
Liked: 1740 times
Joined: Fri Jun 05, 2009 12:57 pm
Full Name: Tom Sightler

Re: How to protect large cluster

Veeam Logoby paulhardy » Mon Dec 09, 2013 11:15 am

Is there anyway of grouping the VM's in some sort of folder structure like you can with VMware which Veeam can then use as the backup selection criteria?
paulhardy
Influencer
 
Posts: 14
Liked: never
Joined: Thu Jul 30, 2009 4:08 pm
Location: Cambridge
Full Name: Paul Hardy

Re: How to protect large cluster

Veeam Logoby Vitaliy S. » Mon Dec 09, 2013 2:09 pm

Hi Paul,

Not sure there are native ways to do that. The only workaround I can think of is hosts group, but again it is not the same as VMware VM folder.

Thanks!
Vitaliy S.
Veeam Software
 
Posts: 19570
Liked: 1104 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov

Re: How to protect large cluster

Veeam Logoby Gostev » Mon Dec 09, 2013 10:15 pm

Unfortunately, unlike VMware, Hyper-V does not provide VM folders. But, we have some ideas on how we can resolve this in the future versions.
Gostev
Veeam Software
 
Posts: 21396
Liked: 2350 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Baar, Switzerland

Re: How to protect large cluster

Veeam Logoby samh22a » Thu Jan 23, 2014 8:03 pm

Hi,

What would be the maximum recommended number of VM per job when using a hardware VSS provider ?

Until Veeam can work with folders or CSV, I think I'll have to do it manually.

Being able to create 1 job per CSV from the GUI would be ideal in my case.

Thanks
samh22a
Service Provider
 
Posts: 35
Liked: 2 times
Joined: Sun Nov 10, 2013 2:03 pm

Re: How to protect large cluster

Veeam Logoby Gostev » Thu Jan 23, 2014 11:20 pm

Hello, there is no limit on number of VMs per job (no matter of VSS provider). Thanks!
Gostev
Veeam Software
 
Posts: 21396
Liked: 2350 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Baar, Switzerland

Re: How to protect large cluster

Veeam Logoby foggy » Fri Jan 24, 2014 5:30 am

Just take your backup window as well as VBK size and dedupe rate considerations into account when combining VMs into jobs.
foggy
Veeam Software
 
Posts: 14752
Liked: 1083 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: How to protect large cluster

Veeam Logoby jake1110 » Tue Feb 04, 2014 7:29 pm

Definitely break the jobs down by CSV, makes it easier to run the jobs concurrently. Although there's no hard limit to the number of VM's a job can have, I always experienced performance issues if added say 50+ VM's in a job. Also, if you have too many jobs running concurrently on a Veeam server, performance tends to suffer from what I observed. For my 250+ jobs(remote sites), I broke down those jobs into three different Veeam management servers to balance the load. I tried kicking off the jobs at once on one Veeam server and it choked, even with excessive hardware specs. After splitting the jobs into three servers, I now run 25 jobs at a time each starting within 30 minutes of each other. Works well for me.

Good luck with a cluster that has 5000+ VMs though. It's going to take a lot of fine tuning on your part to make it work.
jake1110
Enthusiast
 
Posts: 40
Liked: 2 times
Joined: Thu Sep 20, 2012 6:19 pm
Location: Des Moines, IA
Full Name: Jake Ernst

Re: How to protect large cluster

Veeam Logoby samh22a » Mon Feb 10, 2014 4:43 am

How did you split the job per CSV ? Did you used a custom script ?
samh22a
Service Provider
 
Posts: 35
Liked: 2 times
Joined: Sun Nov 10, 2013 2:03 pm

Re: How to protect large cluster

Veeam Logoby v.Eremin » Mon Feb 10, 2014 8:45 am

If you want to create backup jobs, using CSV as their source, then, the best option will be PS scripting, indeed. Especially, in case of large clusters.

Should any assistance with PS scripting be needed, feel free to create a topic at the corresponding subforum.

Thanks.
v.Eremin
Veeam Software
 
Posts: 13291
Liked: 973 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

Next

Return to Microsoft Hyper-V



Who is online

Users browsing this forum: stehei and 10 guests