Availability for the Always-On Enterprise
haslund
Veeam Software
Posts: 487
Liked: 88 times
Joined: Feb 16, 2012 7:35 am
Full Name: Rasmus Haslund
Location: Denmark
Contact:

Re: feature request: split vbk

Post by haslund » May 28, 2017 10:53 am

SyNtAxx wrote:I would also like the ability to chop up .vbk files (I use per vm chains) into small files. I have vms that are multiple tbs in size, and this causes issues for replication of those files. While the per vm chains greatly reduced the issue of not all files being replicate din a timely manner, I still have those massive vms still causing issues. It would be nice to split the .vbk files for those large vms into smaller more managable bites (pardon pun) in order to replicate more easily. Example, a setting in the backup job to split backup files larger than 1tb into some user configurable sub grouping, for example 250gb. This is a good idea.

-Nick
Can you elaborate a bit more on what you mean by replicating backup files? If you utilize a Veeam Backup Copy job to move backups off-site we will only move changed blocks, not actual files which might solve your issue if you are using something different than Veeam to replicate/copy backup files.
Rasmus Haslund
Principal Technologist, Global Education Services @ Veeam Software
Veeam Certified Architect #1 | Veeam Certified Trainer #4 [v7,v8,v9] | Veeam Certified Trainer Mentor #1
Twitter: @haslund
Blog: www.perfectcloud.org

final
Enthusiast
Posts: 32
Liked: 11 times
Joined: Aug 14, 2016 7:19 pm
Contact:

Re: feature request: split vbk

Post by final » Jun 27, 2017 9:56 am 1 person likes this post

+1 for splitting VBKs. Windows Server 2016 deduplication only processes the first 4GB of a file (this is a fixed limit of Server 2016 deduplication according to Will Gries, the technology owner at MS). We have a single VM with a total size of 10TB and hence cannot really use deduplication on this.

ERecker
Lurker
Posts: 1
Liked: 1 time
Joined: Aug 18, 2017 7:52 am
Full Name: Enno Recker
Contact:

Re: feature request: split vbk

Post by ERecker » Aug 18, 2017 8:16 am 1 person likes this post

+1 for splitting VBKs

We also have a file server with individual volumes larger than 4TB. We use windows dedup and are about to upgrade archive servers to windows server 2016. It is already stated, that windows server 2016 stops dedup after processing the first 4TB of an individual file.
This Feature should be also usable within copy Jobs.

regards

fika
Influencer
Posts: 15
Liked: 1 time
Joined: Sep 20, 2017 8:10 am
Full Name: fika
Contact:

Re: feature request: split vbk

Post by fika » Sep 20, 2017 8:15 am 1 person likes this post

One more +1 for splitting VBKs !
It would really help syncing operations, some storage locations are also limited in file size and/or perform badly with huge large files.

There are many threads already voting for this :
veeam-agent-for-windows-f33/feature-req ... 35133.html
veeam-backup-replication-f2/feature-req ... 27833.html
veeam-backup-replication-f2/ability-to- ... 25340.html
veeam-backup-replication-f2/vbk-file-si ... t7895.html
veeam-backup-replication-f2/is-there-a- ... 37204.html
veeam-agent-for-windows-f33/split-vbk-f ... 25117.html
veeam-agent-for-windows-f33/any-way-to- ... 32186.html
...

I then think this feature should really be considered :wink:

Thank you to Veeam support !

ayates
Lurker
Posts: 2
Liked: 1 time
Joined: Sep 29, 2017 11:05 am
Full Name: Anthony Yates
Contact:

[MERGED] Feature Request - Split VBK to improve tape backup

Post by ayates » Sep 29, 2017 11:23 am 1 person likes this post

Hi,

Is there any plans to have option to split VBK files?
Reason I ask is because of tape backups and parallel processing.

At the moment we can enable tape parallel processing and it will write our per VM backups to both tape drives at the same time.
However lets say you have lots of average size VMs and one really big VM that is a few TB in size and bigger than the combined total of the smaller VMs.
What happens then is for half the time the tape drives are working in parallel because the small VMs go to one drive and the big VM goes to the other.
But once the smaller VMs have completed you are then left with the big VM writing to one tape drive only and not making use of the second tape drive.
I assume the reason is because it's one big VBK file and it can only write that one file to one tape drive at a time.

If it did something similar to say CommVault where it splits the files into chunks then it could write different chunks to different tape drives at the same time and have both tape drives working in parallel nearly 100% of the time.

Cheers,

Anthony

foggy
Veeam Software
Posts: 17116
Liked: 1399 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: feature request: split vbk

Post by foggy » Oct 01, 2017 9:58 pm 1 person likes this post

Hi Anthony, thanks for your request. I'm merging your thread into another existing similar discussion.

DonZoomik
Enthusiast
Posts: 62
Liked: 17 times
Joined: Nov 25, 2016 1:56 pm
Contact:

Re: feature request: split vbk

Post by DonZoomik » Oct 20, 2017 8:48 am 1 person likes this post

No news in upcoming 9.5 Update 3?

v.Eremin
Veeam Software
Posts: 15412
Liked: 1164 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: feature request: split vbk

Post by v.Eremin » Oct 20, 2017 8:59 am 1 person likes this post

Unfortunately, Update 3 will not have this functionality implemented - priority has been given to other (more demanded) features. Thanks.

Xamber
Lurker
Posts: 1
Liked: never
Joined: Nov 10, 2017 7:34 am
Contact:

[MERGED] [Request] Split backup files to smaller archives

Post by Xamber » Nov 10, 2017 8:14 am

Hi,

Spoke with some guy from the support on the phone and he told me that i should make a forum post regarding my request.

We would like to at least have the possibility to split a large backup job into smaller files meanwhile the backup job is running.

I see two possible ways in doing so, either split the files up per machine backed up. So that if you have 10 VM's they're split up by each separate VM.
Second idea would be to split the large files into smaller archive files. Just like some compression software like winrar, backupfile.r00, backupfile.r01 and so on.

The reason for asking this is, we've got about 30 machines setup for backing up each day, and take a full backup every two weeks. The total space allocation is about 26TB in total and in order to speed up the backup we're pushing all data over to a NAS that has an 1.2TB cache NVME drive, but when the full backup is running there is not enough space on the NVME drive and the backup will fail due to the one single large 26TB backup file.

I don't think that we're the only ones the would benefit from this feature.

Thanks for reading and i hope this is somewhat coherent.

PTide
Veeam Software
Posts: 4550
Liked: 374 times
Joined: May 19, 2015 1:46 pm
Contact:

Re: feature request: split vbk

Post by PTide » Nov 10, 2017 8:31 am

Hi,

Thank you for the feature request. You're right, it's been already requested several times, so I'm merging your topic to the existing thread. Btw, have you tried per-VM backup files feature?

Thanks

Delo123
Expert
Posts: 361
Liked: 109 times
Joined: Dec 28, 2012 5:20 pm
Full Name: Guido Meijers
Contact:

Re: feature request: split vbk

Post by Delo123 » Nov 13, 2017 10:43 am

Nice request. We would also like to have split VBK's. Yes, we habe, Per-VM has no use with big VM's....

acatic
Novice
Posts: 5
Liked: 1 time
Joined: Oct 07, 2013 3:08 pm
Contact:

Re: feature request: split vbk

Post by acatic » Dec 22, 2017 2:04 pm

+1. Single large file server. Split by size or by vdisks.

oyvindo
Novice
Posts: 8
Liked: 1 time
Joined: Aug 11, 2016 10:15 pm
Full Name: Oyvind Overby
Contact:

[MERGED] [Feature Request]-Split vbk into manageable size ch

Post by oyvindo » May 10, 2018 3:57 pm

Today, even the average notebook comes with an SSD of 512Gb or even 1 TB as standard. Desktop users probably have several drives totaling many Terrabytes
Backing up such huge disks as a single vbk file is risky, to say the least, especially if the objective is to make reliable backups, often over WLAN links and ultimately to internet cloud Storage over WAN.
Therefor, I would expect Veeam to offer simple and user-friendly solution that are able to break the vbk file into smaller manageable chunks that allows for successful retries in case of line drops or time-outs.

In my case, it takes me more that 24 hours to copy the vbk file – which for me renders Veeam useless as my cloud provider rejects a single session spanning more than 24 hours.

Viking

madmadmaddog
Lurker
Posts: 2
Liked: never
Joined: Dec 13, 2017 10:10 pm
Full Name: Matt
Contact:

[MERGED] Splitting 5 to 10TB vbk files

Post by madmadmaddog » May 18, 2018 3:35 pm

I’m wondering if anyone knows of a tool that would split a large 5 to 10TB vbk file into 20 or less pieces? Please not looking to change Veeam configuration, been there and done that. These files are already exist and I’m stuck with them for years, due a mandatory retention policy. I want to get them off my Data Domain and into Azure cold storage which has a limit of 4.7TB per file/blob.

All the utilities I’ve tried are a decade old and designed to split GB files to MB chunks.
I’ve tried and rejected:
7z – largest file piece is only 22GB
Gsplit – too old not designed for TB files
Hjsplit – too old not designed for TB files
Sfsplit – too old not designed for TB files
Looking at linux “split”, but again all the information I can find is large GB to to smaller GB at best.

Thanks,

ferrus
Veeam ProPartner
Posts: 191
Liked: 23 times
Joined: Dec 03, 2015 3:41 pm
Location: UK
Contact:

Re: feature request: split vbk

Post by ferrus » Aug 07, 2018 11:17 am

+1 to the tally for this request. Specifically because of this limitation I've just run into ...
Veeam Backup & Replication does not split one backup file across multiple extents.
https://helpcenter.veeam.com/docs/backu ... tml?ver=95

Have a single VM which creates a weekly 11TB vbk file. It's quite difficult to juggle storage when each extent I add, has to have the full space free.

Post Reply

Who is online

Users browsing this forum: No registered users and 20 guests