Availability for the Always-On Enterprise
hyvokar
Service Provider
Posts: 319
Liked: 19 times
Joined: Nov 21, 2014 10:05 pm
Contact:

feature request: split vbk

Post by hyvokar » May 23, 2016 10:34 am

Hi!

Would it be possible to have an option to split huge vkb files in to smaller ones, so they could be picked up by windows deduplication?
Now I have to split the backup copy jobs in the smaller ones to keep vbks below 1TB.
Bed?! Beds for sleepy people! Lets get a kebab and go to a disco!
MS MCSA, MCITP, MCTS, MCP
VMWare VCP5-DCV
Veeam VMCE

dellock6
Veeam Software
Posts: 5508
Liked: 1522 times
Joined: Jul 26, 2009 3:39 pm
Full Name: Luca Dell'Oca
Location: Varese, Italy
Contact:

Re: feature request: split vkb

Post by dellock6 » May 23, 2016 11:06 am

Hi,
have you checked per-vm backup chains?

https://helpcenter.veeam.com/backup/vsp ... files.html

You can have multiple backup files without splitting the backup job.
Luca Dell'Oca
EMEA Cloud Architect @ Veeam Software

@dellock6
http://www.virtualtothecore.com/en/
vExpert 2011-2012-2013-2014-2015-2016-2017-2018
Veeam VMCE #1

hyvokar
Service Provider
Posts: 319
Liked: 19 times
Joined: Nov 21, 2014 10:05 pm
Contact:

Re: feature request: split vkb

Post by hyvokar » May 23, 2016 11:17 am

Wouldnt that effectively disable VBR's inline deduplication?
Bed?! Beds for sleepy people! Lets get a kebab and go to a disco!
MS MCSA, MCITP, MCTS, MCP
VMWare VCP5-DCV
Veeam VMCE

dellock6
Veeam Software
Posts: 5508
Liked: 1522 times
Joined: Jul 26, 2009 3:39 pm
Full Name: Luca Dell'Oca
Location: Varese, Italy
Contact:

Re: feature request: split vkb

Post by dellock6 » May 23, 2016 11:20 am

Luca Dell'Oca
EMEA Cloud Architect @ Veeam Software

@dellock6
http://www.virtualtothecore.com/en/
vExpert 2011-2012-2013-2014-2015-2016-2017-2018
Veeam VMCE #1

hyvokar
Service Provider
Posts: 319
Liked: 19 times
Joined: Nov 21, 2014 10:05 pm
Contact:

Re: feature request: split vbk

Post by hyvokar » May 23, 2016 2:39 pm

So.. the post basically says "yes, you will lose vbr's deduplicating, but it doesnt matter, since it's practically useless" ?
Bed?! Beds for sleepy people! Lets get a kebab and go to a disco!
MS MCSA, MCITP, MCTS, MCP
VMWare VCP5-DCV
Veeam VMCE

dellock6
Veeam Software
Posts: 5508
Liked: 1522 times
Joined: Jul 26, 2009 3:39 pm
Full Name: Luca Dell'Oca
Location: Varese, Italy
Contact:

Re: feature request: split vbk

Post by dellock6 » May 23, 2016 2:43 pm

No,the opposite. We say that data reduction comes from source-side deduplication and compression, so the switch to per-vm chains will not affect the final data reduction too much.
Luca Dell'Oca
EMEA Cloud Architect @ Veeam Software

@dellock6
http://www.virtualtothecore.com/en/
vExpert 2011-2012-2013-2014-2015-2016-2017-2018
Veeam VMCE #1

hyvokar
Service Provider
Posts: 319
Liked: 19 times
Joined: Nov 21, 2014 10:05 pm
Contact:

Re: feature request: split vbk

Post by hyvokar » May 23, 2016 2:52 pm

Ok.. I'm a bit confused here.
In my cases, I'm close to 2x dedupe ratio on VBR (mainly windows servers). How much more space I should reserve for my backups if I enable per-vm backup chains?


E: I think I got it. So in per-vm backup chains, the deduplication is similar if I had only one VM / job? So I just basically have to test it to see how much more space it requires.
Anyway, this still does not solve the problem where the single VM's backup is larger than 1TB.
Bed?! Beds for sleepy people! Lets get a kebab and go to a disco!
MS MCSA, MCITP, MCTS, MCP
VMWare VCP5-DCV
Veeam VMCE

foggy
Veeam Software
Posts: 16949
Liked: 1380 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: feature request: split vbk

Post by foggy » May 23, 2016 3:09 pm

hyvokar wrote:In my cases, I'm close to 2x dedupe ratio on VBR (mainly windows servers).
Do you probably mean overall data reduction compared to the size of source VMs?
hyvokar wrote:E: I think I got it. So in per-vm backup chains, the deduplication is similar if I had only one VM / job? So I just basically have to test it to see how much more space it requires.
That's correct.

hyvokar
Service Provider
Posts: 319
Liked: 19 times
Joined: Nov 21, 2014 10:05 pm
Contact:

Re: feature request: split vbk

Post by hyvokar » May 23, 2016 3:12 pm

foggy wrote:Do you probably mean overall data reduction compared to the size of source VMs?
The dedupe ratio from the backup report. Compression not included.
Bed?! Beds for sleepy people! Lets get a kebab and go to a disco!
MS MCSA, MCITP, MCTS, MCP
VMWare VCP5-DCV
Veeam VMCE

SyNtAxx
Expert
Posts: 148
Liked: 15 times
Joined: Jan 02, 2015 7:12 pm
Contact:

Re: feature request: split vbk

Post by SyNtAxx » May 23, 2016 4:29 pm

I would also like the ability to chop up .vbk files (I use per vm chains) into small files. I have vms that are multiple tbs in size, and this causes issues for replication of those files. While the per vm chains greatly reduced the issue of not all files being replicate din a timely manner, I still have those massive vms still causing issues. It would be nice to split the .vbk files for those large vms into smaller more managable bites (pardon pun) in order to replicate more easily. Example, a setting in the backup job to split backup files larger than 1tb into some user configurable sub grouping, for example 250gb. This is a good idea.

-Nick

foggy
Veeam Software
Posts: 16949
Liked: 1380 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: feature request: split vbk

Post by foggy » May 23, 2016 4:37 pm

Would per-disk backup files address this to some extent?

hyvokar
Service Provider
Posts: 319
Liked: 19 times
Joined: Nov 21, 2014 10:05 pm
Contact:

Re: feature request: split vbk

Post by hyvokar » May 24, 2016 2:32 pm

foggy wrote:Would per-disk backup files address this to some extent?
No, not really. Often the case is that the VM has 50-60GB OS disk, and huge (multi tb) data disk.
Bed?! Beds for sleepy people! Lets get a kebab and go to a disco!
MS MCSA, MCITP, MCTS, MCP
VMWare VCP5-DCV
Veeam VMCE

hyvokar
Service Provider
Posts: 319
Liked: 19 times
Joined: Nov 21, 2014 10:05 pm
Contact:

Re: feature request: split vbk

Post by hyvokar » May 24, 2016 9:32 pm

foggy wrote: That's correct.
I did a test using a 3 medium sized VMs. I created two identical backup copy jobs and targetted them to different repositories, one "normal" and one using per-vm backup files.
The results was a bit surprising. The one with per-vm backup files was *smaller* than one with single huge backup file. No idea how that's possible.
Bed?! Beds for sleepy people! Lets get a kebab and go to a disco!
MS MCSA, MCITP, MCTS, MCP
VMWare VCP5-DCV
Veeam VMCE

Gostev
Veeam Software
Posts: 23112
Liked: 2916 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: feature request: split vbk

Post by Gostev » May 24, 2016 11:47 pm

Surprising indeed.

Delo123
Expert
Posts: 361
Liked: 109 times
Joined: Dec 28, 2012 5:20 pm
Full Name: Guido Meijers
Contact:

Re: feature request: split vbk

Post by Delo123 » May 30, 2016 6:40 am

Per VM backup chains work beautifuly, combined with scale-out repositories fulls can now be seperated from the incrementals which in a lot of cases mean windows dedupe enige has more than enough time to complete it's dedupe cycle on the fulls since the repository will now only be used once a week / month. However it's still no solution for vm's with big disks. Altough sometimes a big pain we have now started doing complicated things to be able to split up data on individual vm's, not only for backup purposes but espacially for restore. Ever tried to instant recover and then vmotion a 3tb+ vm? I can assure you you will be sweating all day :)

Post Reply

Who is online

Users browsing this forum: daniel.triplehorn, Exabot [Bot], foggy, Google [Bot] and 48 guests