Large VIB file on a small static server

Availability for the Always-On Enterprise

Re: Large VIB file on a small static server

Veeam Logoby Vitaliy S. » Wed Mar 26, 2014 12:41 pm

Veeam does not modify any blocks, so it cannot influence the size of the incremental files of the VMs you protect. Please review this topic for possible reasons of this high change rate. Thanks!
Vitaliy S.
Veeam Software
 
Posts: 19218
Liked: 1070 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov

[MERGED] CBT issues

Veeam Logoby blodsbror » Sun May 04, 2014 9:49 pm

Hi,

I have a job with 12 Windows 2003 servers (IIS webservers) that each have a 250GB 'data' disk comprosed of website data. For each incremental backup with CBT enabled, it reads about 1TB of data and generates around 400GB of backup data on average. This number seems really high, as there absolutely wouldn't be that amount of changed data on these servers each day. Even when I run an incremental straight after the last, approximately the same amount is backed up each time - when really the number should be very low (such as 1-10GB).

What could be causing this large incremental backup size ? I know there isn't that amount of changes in the data - so is there any tips to improving this ?. At this rate, I'll need a huge amount of storage to have just 2 weeks retention.

many thanks!
blodsbror
Enthusiast
 
Posts: 49
Liked: 1 time
Joined: Wed Apr 02, 2014 7:40 pm
Full Name: Evan Williams

Re: Large VIB file on a small static server

Veeam Logoby foggy » Mon May 05, 2014 5:50 am

Evan, please review this thread, probably will give you some hints to justify the amount of changes.
foggy
Veeam Software
 
Posts: 14310
Liked: 1052 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

[MERGED] Identify cause of high CBT rate

Veeam Logoby metrobg » Fri May 30, 2014 12:44 am

We are using VMware ESXI 5.1u1 as part of a disaster recovery system for a client. We are currently using VEEAM Incrementals to backup the data to a local data store.

VEEAM is backing up 30 - 40 GB a day, which I believe is based on VMware CBT, on one of the VMs. This VM is a file & Exchange server.

What would be useful that we have not found yet is a program that will identify which programs on the Host OS (Windows 2008) that are creating all of the changed blocks. Does anyone know of such a program?


We have made a copy of the entire environment in our lab and with no users accessing the file/exchange server we get similar amounts of data that needs to be backed up.

Any Help is appreciated.
metrobg
Lurker
 
Posts: 1
Liked: never
Joined: Sat Jul 20, 2013 11:45 pm
Full Name: Gilbert Graves

Re: Large VIB file on a small static server

Veeam Logoby foggy » Fri May 30, 2014 6:38 am

Gilbert, please review this existing thread for some hint on what could cause such amount of changed blocks. Also, since Veeam B&R is a block-level solution, there's no ability to correlate those blocks to the applications inside the guest OS.
foggy
Veeam Software
 
Posts: 14310
Liked: 1052 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Large VIB file on a small static server

Veeam Logoby Gostev » Fri May 30, 2014 9:33 pm

Exchange and SQL servers generate tons of transaction logs, which is the main reason for large incremental backup size. Plus, both make many small and quite random updates of their respective database files, which also contributes to the amount of changed blocks.
Gostev
Veeam Software
 
Posts: 21139
Liked: 2299 times
Joined: Sun Jan 01, 2006 1:01 am
Full Name: Anton Gostev

[MERGED] Backup File Sizes are too Large V6.5

Veeam Logoby ColtsFanMN » Wed Aug 13, 2014 3:48 pm

I'm having an issue with my backup file sizes.. it's not an error yet, but at this rate, I will be out of disk space soon.

I am running B&R 6.5 right now, full backup each day, in a VMware environment to removable media.

My backup sizes are 'out of range' for the actual size of the data on the drives, even without deduplication (which I am using).

All the servers are on 'thick provisioned' drives in VMware. There are no 'orphaned' snapshot files present.

For instance, this are what I am seeing:

Server 1:
Veeam shows:
Drive size: 225GB
Read size: 231GB
Transferred: 126GB
Server shows:
Drive size: 225GB
Used size: 76GB

So VEEAM is showing transferring 50GB more data than is actually present on the drive, even without deduplication.

Server 2:
Veeam shows:
Drive size: 525GB
Read size: 523GB
Transferred: 326GB
Server shows:
Drive size: 525GB
Used size: 290GB

So VEEAM is showing transferring 35GB more data than is actually present on the drive, even without deduplication.

I have 13 VMs backing up, all with similar numbers.. How is VEEAM backing up more than is actually present on the servers? Also, I will note that I deleted 30GB of old files off the first server I listed, this made NO change in my backup file size the next day (or even weeks later). What is going on?

Please help!
ColtsFanMN
Influencer
 
Posts: 16
Liked: never
Joined: Mon Oct 28, 2013 3:49 pm

Re: Large VIB file on a small static server

Veeam Logoby Vitaliy S. » Wed Aug 13, 2014 4:07 pm

Hello,

Please take a look at the third page of this topic, where Tom explained the behavior you most likely experience.

Thank you!
Vitaliy S.
Veeam Software
 
Posts: 19218
Liked: 1070 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov

Re: Large VIB file on a small static server

Veeam Logoby ColtsFanMN » Wed Aug 13, 2014 5:57 pm

Vitaliy S. wrote:Hello,

Please take a look at the third page of this topic, where Tom explained the behavior you most likely experience.

Thank you!


NO THIS DOES NOT APPLY. PLEASE READ MY POST AND RETURN IT AS A SEPERATE POST!

THANKS.
ColtsFanMN
Influencer
 
Posts: 16
Liked: never
Joined: Mon Oct 28, 2013 3:49 pm

Re: Large VIB file on a small static server

Veeam Logoby Vitaliy S. » Wed Aug 13, 2014 6:15 pm 1 person likes this post

ColtsFanMN wrote:Also, I will note that I deleted 30GB of old files off the first server I listed, this made NO change in my backup file size the next day (or even weeks later).

The reason why your post has been merged to this thread can be found in this quote:
tsightler wrote:If you create a 40GB virtual disk, add 20GB of data to it, and then delete it, then take a Veeam backup, the Veeam increment will 20GB (assuming no compression)..... For example, I was once able to use a Veeam backup to recover a file that had been created and deleted on the same day by using an NTFS "undelete" program on a Veeam backup from a week earlier. This is something that would have been completely not possible with a traditional backup product. Also, a Veeam backup of a powered off VM is a forensically accurate image of the system, which can be very valuable for security related analysis.

Please be aware that with NTFS, when you write data to the disk and then delete it, the data doesn't actually get removed from the disk, so virtual disk blocks still contain the same dirty data blocks. If you want to make your full backups smaller, then you should sdelete your virtual disks. Please search these forums for existing topics describing how to use this utility.

ColtsFanMN wrote:NO THIS DOES NOT APPLY. PLEASE READ MY POST AND RETURN IT AS A SEPERATE POST!

It seems like the explanation above about "dirty" blocks on NTFS does apply to your case. Thanks!
Vitaliy S.
Veeam Software
 
Posts: 19218
Liked: 1070 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov

[MERGED]Backup Exchange 2010 DAG - files too big!

Veeam Logoby out2getyou » Mon Jan 05, 2015 4:08 am

Hi All,

I currently have two mailbox servers in a DAG. I created 1 job that contains both passive and active mailbox servers. The initial full backup (which contains both servers) was about 1.31 TB. Every increment after that (1 daily incremental) for 1 week varied between 70-100 GB (both servers). So the obvious question is, why are the incremental backups so big? Surely we cannot be generating 30-50 GBs of email per day? we only have 200+ staff . Thats close to 5-7 GB per person!

Is there a way to make these incremental smaller? its eating up my storage :(

Thanks guys.
out2getyou
Novice
 
Posts: 3
Liked: never
Joined: Mon Jan 05, 2015 3:56 am

Re: Large VIB file on a small static server

Veeam Logoby Dima P. » Mon Jan 05, 2015 2:20 pm

Hello,
I’ve merged your post to the existing discussions. If you suspect increment growing unpredictably large, please review this thread for possible solution. Thank you.
Dima P.
Veeam Software
 
Posts: 5834
Liked: 418 times
Joined: Mon Feb 04, 2013 2:07 pm
Location: SPb
Full Name: Dmitry Popov

Re: Large VIB file on a small static server

Veeam Logoby deduplicat3d » Wed Feb 11, 2015 6:28 pm

I have an open case 00746249

They are insisting that I am changing files and that is why I have large incrementals. I had the problem saturday morning and tuesday morning, these are forever incremental backups. Most VM's appears not to have this problem but 2, that are on separate hosts separate domains have the issue. Some jobs are not impacted at all. I have not done any defrag, disk check, virus scanner hasn't changed settings. I've browsed throughout the servers and almost all of the files have old modified and accessed times (it's a file server, people are usually only changing and accessing current documents).

I can't have this happen again as it will fill up the disk on the backup server. Is there a way to cross reference the blocks that have changed with files or to do some sort of analysis. I uploaded logs to support and a bunch of screen shots.
deduplicat3d
Enthusiast
 
Posts: 98
Liked: 11 times
Joined: Fri Nov 04, 2011 8:21 pm
Full Name: Corey

Re: Large VIB file on a small static server

Veeam Logoby foggy » Wed Feb 11, 2015 8:50 pm

As it is mentioned above, there's no ability to correlate the changed blocks with files. What you could do to verify what's changed, is fire up two restore points using Instant Recovery and compare files between them. There's also a couple of other guesses in the referred thread, might give you some thoughts.
foggy
Veeam Software
 
Posts: 14310
Liked: 1052 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

[MERGED] Troubleshooting backup size

Veeam Logoby tomhkr » Wed May 27, 2015 7:13 am

I have a virtual Windows 2012 R2 server acting as a file server for users home directories.

Yesterday I looked at the backup sizes this server generates and they are questionable large.
The volume being backed up is sized at 2.3 TB and has about 3,600,000 files on it.
It is a NTFS volume with an allocation unit size of 4096 bytes. Residing on an VMFS-volume with block size 1 MB.

Yesterdays incremental backup of the volume, using CBT, was 23.9 GB.

Looking at all files that were either modified or changed yesterday, they are only about 2 GB in total.
Total of about 3500 files were created or modified, of these about 3100 were smaller than 64 KB and 2500 smaller than 4 KB.
I understand that CBT takes whole changed blocks but this is ridiculous. Even with an assumed CBT block size of 1024 KB; 3500 files would be 3.5 GB, not 23.9 GB.

How can I troubleshoot and find out what is causing this massive leverage in backup size?
tomhkr
Enthusiast
 
Posts: 36
Liked: 7 times
Joined: Mon Feb 03, 2014 7:40 am

PreviousNext

Return to Veeam Backup & Replication



Who is online

Users browsing this forum: No registered users and 26 guests