feature request: split vbk

Availability for the Always-On Enterprise

feature request: split vbk

Veeam Logoby hyvokar » Mon May 23, 2016 10:34 am

Hi!

Would it be possible to have an option to split huge vkb files in to smaller ones, so they could be picked up by windows deduplication?
Now I have to split the backup copy jobs in the smaller ones to keep vbks below 1TB.
Bed?! Beds for sleepy people! Lets get a kebab and go to a disco!
MS MCSA, MCITP, MCTS, MCP
VMWare VCP5-DCV
Veeam VMCE
hyvokar
Service Provider
 
Posts: 248
Liked: 15 times
Joined: Fri Nov 21, 2014 10:05 pm

Re: feature request: split vkb

Veeam Logoby dellock6 » Mon May 23, 2016 11:06 am

Hi,
have you checked per-vm backup chains?

https://helpcenter.veeam.com/backup/vsp ... files.html

You can have multiple backup files without splitting the backup job.
Luca Dell'Oca
EMEA Cloud Architect @ Veeam Software

@dellock6
http://www.virtualtothecore.com
vExpert 2011-2012-2013-2014-2015-2016
Veeam VMCE #1
dellock6
Veeam Software
 
Posts: 4876
Liked: 1280 times
Joined: Sun Jul 26, 2009 3:39 pm
Location: Varese, Italy
Full Name: Luca Dell'Oca

Re: feature request: split vkb

Veeam Logoby hyvokar » Mon May 23, 2016 11:17 am

Wouldnt that effectively disable VBR's inline deduplication?
Bed?! Beds for sleepy people! Lets get a kebab and go to a disco!
MS MCSA, MCITP, MCTS, MCP
VMWare VCP5-DCV
Veeam VMCE
hyvokar
Service Provider
 
Posts: 248
Liked: 15 times
Joined: Fri Nov 21, 2014 10:05 pm

Re: feature request: split vkb

Veeam Logoby dellock6 » Mon May 23, 2016 11:20 am

Luca Dell'Oca
EMEA Cloud Architect @ Veeam Software

@dellock6
http://www.virtualtothecore.com
vExpert 2011-2012-2013-2014-2015-2016
Veeam VMCE #1
dellock6
Veeam Software
 
Posts: 4876
Liked: 1280 times
Joined: Sun Jul 26, 2009 3:39 pm
Location: Varese, Italy
Full Name: Luca Dell'Oca

Re: feature request: split vbk

Veeam Logoby hyvokar » Mon May 23, 2016 2:39 pm

So.. the post basically says "yes, you will lose vbr's deduplicating, but it doesnt matter, since it's practically useless" ?
Bed?! Beds for sleepy people! Lets get a kebab and go to a disco!
MS MCSA, MCITP, MCTS, MCP
VMWare VCP5-DCV
Veeam VMCE
hyvokar
Service Provider
 
Posts: 248
Liked: 15 times
Joined: Fri Nov 21, 2014 10:05 pm

Re: feature request: split vbk

Veeam Logoby dellock6 » Mon May 23, 2016 2:43 pm

No,the opposite. We say that data reduction comes from source-side deduplication and compression, so the switch to per-vm chains will not affect the final data reduction too much.
Luca Dell'Oca
EMEA Cloud Architect @ Veeam Software

@dellock6
http://www.virtualtothecore.com
vExpert 2011-2012-2013-2014-2015-2016
Veeam VMCE #1
dellock6
Veeam Software
 
Posts: 4876
Liked: 1280 times
Joined: Sun Jul 26, 2009 3:39 pm
Location: Varese, Italy
Full Name: Luca Dell'Oca

Re: feature request: split vbk

Veeam Logoby hyvokar » Mon May 23, 2016 2:52 pm

Ok.. I'm a bit confused here.
In my cases, I'm close to 2x dedupe ratio on VBR (mainly windows servers). How much more space I should reserve for my backups if I enable per-vm backup chains?


E: I think I got it. So in per-vm backup chains, the deduplication is similar if I had only one VM / job? So I just basically have to test it to see how much more space it requires.
Anyway, this still does not solve the problem where the single VM's backup is larger than 1TB.
Bed?! Beds for sleepy people! Lets get a kebab and go to a disco!
MS MCSA, MCITP, MCTS, MCP
VMWare VCP5-DCV
Veeam VMCE
hyvokar
Service Provider
 
Posts: 248
Liked: 15 times
Joined: Fri Nov 21, 2014 10:05 pm

Re: feature request: split vbk

Veeam Logoby foggy » Mon May 23, 2016 3:09 pm

hyvokar wrote:In my cases, I'm close to 2x dedupe ratio on VBR (mainly windows servers).

Do you probably mean overall data reduction compared to the size of source VMs?

hyvokar wrote:E: I think I got it. So in per-vm backup chains, the deduplication is similar if I had only one VM / job? So I just basically have to test it to see how much more space it requires.

That's correct.
foggy
Veeam Software
 
Posts: 14337
Liked: 1054 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: feature request: split vbk

Veeam Logoby hyvokar » Mon May 23, 2016 3:12 pm

foggy wrote:Do you probably mean overall data reduction compared to the size of source VMs?

The dedupe ratio from the backup report. Compression not included.
Bed?! Beds for sleepy people! Lets get a kebab and go to a disco!
MS MCSA, MCITP, MCTS, MCP
VMWare VCP5-DCV
Veeam VMCE
hyvokar
Service Provider
 
Posts: 248
Liked: 15 times
Joined: Fri Nov 21, 2014 10:05 pm

Re: feature request: split vbk

Veeam Logoby SyNtAxx » Mon May 23, 2016 4:29 pm

I would also like the ability to chop up .vbk files (I use per vm chains) into small files. I have vms that are multiple tbs in size, and this causes issues for replication of those files. While the per vm chains greatly reduced the issue of not all files being replicate din a timely manner, I still have those massive vms still causing issues. It would be nice to split the .vbk files for those large vms into smaller more managable bites (pardon pun) in order to replicate more easily. Example, a setting in the backup job to split backup files larger than 1tb into some user configurable sub grouping, for example 250gb. This is a good idea.

-Nick
SyNtAxx
Expert
 
Posts: 125
Liked: 13 times
Joined: Fri Jan 02, 2015 7:12 pm

Re: feature request: split vbk

Veeam Logoby foggy » Mon May 23, 2016 4:37 pm

Would per-disk backup files address this to some extent?
foggy
Veeam Software
 
Posts: 14337
Liked: 1054 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: feature request: split vbk

Veeam Logoby hyvokar » Tue May 24, 2016 2:32 pm

foggy wrote:Would per-disk backup files address this to some extent?

No, not really. Often the case is that the VM has 50-60GB OS disk, and huge (multi tb) data disk.
Bed?! Beds for sleepy people! Lets get a kebab and go to a disco!
MS MCSA, MCITP, MCTS, MCP
VMWare VCP5-DCV
Veeam VMCE
hyvokar
Service Provider
 
Posts: 248
Liked: 15 times
Joined: Fri Nov 21, 2014 10:05 pm

Re: feature request: split vbk

Veeam Logoby hyvokar » Tue May 24, 2016 9:32 pm

foggy wrote:That's correct.


I did a test using a 3 medium sized VMs. I created two identical backup copy jobs and targetted them to different repositories, one "normal" and one using per-vm backup files.
The results was a bit surprising. The one with per-vm backup files was *smaller* than one with single huge backup file. No idea how that's possible.
Bed?! Beds for sleepy people! Lets get a kebab and go to a disco!
MS MCSA, MCITP, MCTS, MCP
VMWare VCP5-DCV
Veeam VMCE
hyvokar
Service Provider
 
Posts: 248
Liked: 15 times
Joined: Fri Nov 21, 2014 10:05 pm

Re: feature request: split vbk

Veeam Logoby Gostev » Tue May 24, 2016 11:47 pm

Surprising indeed.
Gostev
Veeam Software
 
Posts: 21156
Liked: 2304 times
Joined: Sun Jan 01, 2006 1:01 am
Full Name: Anton Gostev

Re: feature request: split vbk

Veeam Logoby Delo123 » Mon May 30, 2016 6:40 am

Per VM backup chains work beautifuly, combined with scale-out repositories fulls can now be seperated from the incrementals which in a lot of cases mean windows dedupe enige has more than enough time to complete it's dedupe cycle on the fulls since the repository will now only be used once a week / month. However it's still no solution for vm's with big disks. Altough sometimes a big pain we have now started doing complicated things to be able to split up data on individual vm's, not only for backup purposes but espacially for restore. Ever tried to instant recover and then vmotion a 3tb+ vm? I can assure you you will be sweating all day :)
Delo123
Expert
 
Posts: 330
Liked: 92 times
Joined: Fri Dec 28, 2012 5:20 pm
Full Name: Guido Meijers

Next

Return to Veeam Backup & Replication



Who is online

Users browsing this forum: Bing [Bot], kks, leonid.venglinski, NightBird, rkovhaev, tsightler, Yahoo [Bot] and 53 guests