Discussions specific to the VMware vSphere hypervisor
cffit
Expert
Posts: 338
Liked: 34 times
Joined: Jan 20, 2012 2:36 pm
Full Name: Christensen Farms
Contact:

Post v8 Upgrade Observations

Post by cffit » Nov 10, 2014 8:57 pm 3 people like this post

I'm not sure if there is an area for this already, but I was going to list a few observations after upgrading from v7 to v8 so far.

1. Full backups this weekend were synthetic and took 20 hours instead of the usual 30 hours. So a 33% decrease in time from v7.
2. Files to tape took 4 hours whereas they were taking 7 hours with v7. I believe this is due to the issue with indexing and large numbers of small files that VEEAM struggled with before.

The upgrade was smooth and fast. No negatives or warnings to speak of so far. Thanks VEEAM!

Vitaliy S.
Product Manager
Posts: 22289
Liked: 1413 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: Post v8 Upgrade Observations

Post by Vitaliy S. » Nov 10, 2014 9:11 pm

Yes, these enhancements are mentioned in our What's New doc, so thanks for confirming it in your environment. BTW, what is used for your target storage for the backup jobs?

cffit
Expert
Posts: 338
Liked: 34 times
Joined: Jan 20, 2012 2:36 pm
Full Name: Christensen Farms
Contact:

Re: Post v8 Upgrade Observations

Post by cffit » Nov 10, 2014 9:23 pm

Yep, I expected to see improvements, I was just giving some actual numbers to show other users what I saw. We only have HP MSA SAN that the VEEAM server is connected to via 1GB iSCSI. This link is pretty much maxed out during backups, so I'm sure it is a bottleneck. To see the improvements I mentioned must show that there are other efficiencies that help reduce the backup times.

Gostev
SVP, Product Management
Posts: 24017
Liked: 3254 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Post v8 Upgrade Observations

Post by Gostev » Nov 10, 2014 11:14 pm

To be absolutely honest, I did not expect improvement in synthetic full performance on existing jobs, so this is an interesting observation (even though I have no explanation for that). May be one of those quiet "under the hood" improvements that did not even make it into What's New. Thanks for sharing!

tinto1970
Enthusiast
Posts: 78
Liked: 25 times
Joined: Sep 26, 2013 8:40 am
Full Name: Alessandro Tinivelli
Location: Bologna, Italy
Contact:

Re: Post v8 Upgrade Observations

Post by tinto1970 » Nov 11, 2014 3:04 pm

last night was the first night of v8 here. I was expecting longer times because the greater part of my VMs have disk increased in size since their birth, so the CBT has been reset to workaround the known bug.
I think i'm seeing shorter times instead. Keeping an eye on this.
Alessandro Tinivelli aka Tinto
@tinto1970

lp@albersdruck.de
Enthusiast
Posts: 81
Liked: 32 times
Joined: Mar 25, 2013 7:37 pm
Full Name: Lars Pisanec
Contact:

Re: Post v8 Upgrade Observations

Post by lp@albersdruck.de » Nov 12, 2014 6:13 am

As I posted in a thread that got moved to Hyper-V forum:

Again for reference: support case #00673959

v7:
05.11.2014 22:57:54 :: Busy: Source 13% > Proxy 26% > Network 8% > Target 49%
05.11.2014 22:53:03 :: Hard disk 2 (512,0 GB) 2,2 GB read at 11 MB/s [CBT] 03:51

04.11.2014 23:04:57 :: Busy: Source 13% > Proxy 27% > Network 19% > Target 60%
04.11.2014 23:00:21 :: Hard disk 2 (512,0 GB) 2,2 GB read at 12 MB/s [CBT] 03:38

04.11.2014 00:33:59 :: Busy: Source 15% > Proxy 28% > Network 1% > Target 48%
04.11.2014 00:29:22 :: Hard disk 2 (512,0 GB) 2,3 GB read at 12 MB/s [CBT] 03:35

02.11.2014 22:12:08 :: Busy: Source 15% > Proxy 13% > Network 21% > Target 48%
02.11.2014 22:06:46 :: Hard disk 2 (512,0 GB) 3,6 GB read at 16 MB/s [CBT] 04:19

v8:
09.11.2014 11:01:12 :: Busy: Source 40% > Proxy 38% > Network 37% > Target 48%
09.11.2014 10:46:05 :: Hard disk 2 (512,0 GB) 2,0 GB read at 16 MB/s [CBT] 13:39

09.11.2014 12:32:52 :: Busy: Source 40% > Proxy 23% > Network 44% > Target 48%
09.11.2014 12:19:50 :: Hard disk 2 (512,0 GB) 236,0 MB read at 22 MB/s [CBT] 11:42

09.11.2014 13:00:42 :: Busy: Source 98% > Proxy 17% > Network 2% > Target 2%
09.11.2014 12:47:49 :: Hard disk 2 (512,0 GB) 249,0 MB read at 32 MB/s [CBT] 12:06

10.11.2014 22:07:17 :: Busy: Source 48% > Proxy 6% > Network 36% > Target 48%
10.11.2014 21:50:38 :: Hard disk 2 (512,0 GB) 2,2 GB read at 12 MB/s [CBT] 15:13

I marked the time increase in v8 in bold.

A screenshot from the latest run in v8:
Image
You can see that activity is only at the end of the job. I do not have a screenshot from v7, though. It was a lot more even distributed, as in "action" from start to finish as opposed to only "action" at the end.

Reverse Incremental with hot add, happens when I change to network mode, too.

Another observation: if I create a new backup job (same settings) it works fine and fast.
Can I create a job with the same settings and point it to the already existing backup chain or does the new job have to create a new chain? (space considerations)

stefanbrun
Service Provider
Posts: 23
Liked: 3 times
Joined: Apr 26, 2011 7:36 am
Full Name: Stefan Brun | MSupport Networks AG
Location: Lengnau, Switzerland
Contact:

Re: Post v8 Upgrade Observations

Post by stefanbrun » Nov 12, 2014 8:35 am

VMWare Backup

statistics v7:
Source: 76
Proxy: 32
Network: 23
Target: 1
Runtime: 20:31 min
Processed 11.9TB / Read: 34.8 GB / Transferred 11.5 GB (3x)

statistics v8 (last backup 20hours ago):
Source: 89
Proxy: 50
Network: 15
Target: 6
Runtime: 39:49 min
Processed 12.0TB / Read: 62.3 GB / Transferred 43.0 GB (1.4x)

statistics v8 (last backup 4hours ago):
Source: 87
Proxy: 28
Network: 12
Target: 0
Runtime: 39:31 min
Processed 12.0TB / Read: 18.6 GB / Transferred 6.4 GB (2.9x)


statistics v8 (last backup 24hours ago):
Source: 89
Proxy: 38
Network: 13
Target: 5
Runtime: 41:30 min
Processed 12.0TB / Read: 65.8 GB / Transferred 32.3 GB (2x)


In the new v8 Tasks i didn't find a constant which takes always longer.

Backup Mode: Direct SAN
Incremental - Syntethetic Full - Tranformation
Compression Level: High
Storage Target: LAN Target

foggy
Veeam Software
Posts: 17712
Liked: 1481 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Post v8 Upgrade Observations

Post by foggy » Nov 12, 2014 12:08 pm

lp@albersdruck.de wrote:Can I create a job with the same settings and point it to the already existing backup chain or does the new job have to create a new chain? (space considerations)
You can map the new job to existing backup chain to continue it.

anorton
Influencer
Posts: 21
Liked: never
Joined: Sep 06, 2011 11:56 am
Full Name: Aaron Norton
Contact:

Re: Post v8 Upgrade Observations

Post by anorton » Nov 12, 2014 12:33 pm

I am in the same boat where my backups have gotten longer times now. The post was moved to the Hyper-V forum but it seems that the hypervisor doesn't matter.

stefanbrun
Service Provider
Posts: 23
Liked: 3 times
Joined: Apr 26, 2011 7:36 am
Full Name: Stefan Brun | MSupport Networks AG
Location: Lengnau, Switzerland
Contact:

Re: Post v8 Upgrade Observations

Post by stefanbrun » Nov 13, 2014 9:13 am

Create a NEW Backup Job and adding the existing backup chain didn't solve the longer backup time. Its the same as before.

DeXa
Influencer
Posts: 14
Liked: never
Joined: Feb 28, 2013 12:50 pm
Full Name: Ivo Trankolov
Contact:

Re: Post v8 Upgrade Observations

Post by DeXa » Nov 18, 2014 11:53 am

Hi All,

My observations are almost the same - backup times went up ... a LOT! Most of the time the job Is doing nothing, just sitting. It usually hangs on completion of one of the following subtasks:
- Releasing Guest
- Creating VM Snapshot
- Using backup proxy **** for disk Hard disk 1 [san/nbd]
And also hangs on trying to complete the following subtasks:
- Finalizing
- Coping data from disks (but showing zeroes on speed and kb/mb read)
After some time (usually more than an hour) it continues without errors and eventually the whole task Is complete.
CID: 00681602

ITP-Stan
Service Provider
Posts: 95
Liked: 11 times
Joined: Feb 18, 2013 10:45 am
Full Name: Stan (IF-IT4U)
Contact:

Re: Post v8 Upgrade Observations

Post by ITP-Stan » Nov 18, 2014 2:44 pm

tinto1970 wrote:I was expecting longer times because the greater part of my VMs have disk increased in size since their birth, so the CBT has been reset to workaround the known bug.
I think you are mistakingly thinking that v8 will do this for VM's that have their disk increased at one time. v8 will only do this for VM's who have their disk size increased FROM NOW ON.
So you could increase the disk size of your VM's now, to trigger this (and check for CBT skip and larger timespan) or use the scripts provided in the KB or forum topic.

I have just upgraded to v8 and started fresh with a new job, because previously i was using synthetic full. Now you can't to do active or synthetic fulls if you want to take advantage of the new "Forward incremental - forever backup method". See the Veeam v8 user guide.

Will let you know my findings, job is running.

anorton
Influencer
Posts: 21
Liked: never
Joined: Sep 06, 2011 11:56 am
Full Name: Aaron Norton
Contact:

Re: Post v8 Upgrade Observations

Post by anorton » Nov 18, 2014 7:57 pm

What version of VMware is everyone running? I am running 5.5 Update 2

JimmyO
Enthusiast
Posts: 55
Liked: 9 times
Joined: Apr 27, 2014 8:19 pm
Contact:

Re: Post v8 Upgrade Observations

Post by JimmyO » Nov 20, 2014 7:35 am

Any comment from Veeam on this one? I have not yet upgraded and I´m not sure I should unless these longer backup times has been fixed.

Are there any statistics on how many customers there are experiencing changes in backup times (faster/same/slower) ?

For me, longer backup times would render the system unusable.

anorton
Influencer
Posts: 21
Liked: never
Joined: Sep 06, 2011 11:56 am
Full Name: Aaron Norton
Contact:

Re: Post v8 Upgrade Observations

Post by anorton » Nov 20, 2014 12:38 pm

I am working one on one with Veeam on a couple of scenarios. I am currently running version and version side by side with the same jobs to see what the issue is. I will posy results as we find them.

Post Reply

Who is online

Users browsing this forum: No registered users and 13 guests