Comprehensive data protection for all workloads
Post Reply
PeakSoftware
Novice
Posts: 8
Liked: never
Joined: Jun 22, 2012 3:34 pm
Full Name: George Lambson
Contact:

Pinpointing Bottlenecks

Post by PeakSoftware » Jun 28, 2012 3:13 pm

Does anyone have any suggestions for pinpointing the bottleneck in backup processes? The report shows my source is the bottleneck, but I'm not quite sure where to go from there.

foggy
Veeam Software
Posts: 18291
Liked: 1568 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Pinpointing Bottlenecks

Post by foggy » Jun 28, 2012 3:26 pm

George, that means that source storage data retrieval speed is a bottleneck. What is your setup and what transport mode do you use to read the VMs data from the storage?

PeakSoftware
Novice
Posts: 8
Liked: never
Joined: Jun 22, 2012 3:34 pm
Full Name: George Lambson
Contact:

Re: Pinpointing Bottlenecks

Post by PeakSoftware » Jun 28, 2012 3:50 pm

I am running Hyper-V and the VHDs are on an iSCSI storage device directly attached to the host server. I have done some HDD throughput tests and the results are nearly the same as local storage.

PeakSoftware
Novice
Posts: 8
Liked: never
Joined: Jun 22, 2012 3:34 pm
Full Name: George Lambson
Contact:

Re: Pinpointing Bottlenecks

Post by PeakSoftware » Jun 28, 2012 3:52 pm

BTW, these are incremental backups as where the first full backup shows the network to be the bottleneck at 98% which is what I would expect going over a VPN to an off-site location. Is it normal to see the source as the bottleneck at 99% with an incremental backup?

Gostev
SVP, Product Management
Posts: 24818
Liked: 3573 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Pinpointing Bottlenecks

Post by Gostev » Jun 28, 2012 3:55 pm

Yes, especially if CBT is not used.

PeakSoftware
Novice
Posts: 8
Liked: never
Joined: Jun 22, 2012 3:34 pm
Full Name: George Lambson
Contact:

Re: Pinpointing Bottlenecks

Post by PeakSoftware » Jun 28, 2012 6:25 pm

CBT is enabled.

Gostev
SVP, Product Management
Posts: 24818
Liked: 3573 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Pinpointing Bottlenecks

Post by Gostev » Jun 28, 2012 6:36 pm

"Enabled" is not equal to "Used" though ;)
Do you see [CBT] letter next to each virtual disk in the real-time statistics?

PeakSoftware
Novice
Posts: 8
Liked: never
Joined: Jun 22, 2012 3:34 pm
Full Name: George Lambson
Contact:

Re: Pinpointing Bottlenecks

Post by PeakSoftware » Jun 28, 2012 8:51 pm

Good to know. Yes it is there. It also shows it was read at 4MB/s. Is there a place I might be limiting the job to that 4MB/s? My repository is limited to 3MB/s because it's going over a WAN, but I don't see anywhere else to limit a data ingestion/througput rate.

Gostev
SVP, Product Management
Posts: 24818
Liked: 3573 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Pinpointing Bottlenecks

Post by Gostev » Jun 28, 2012 10:18 pm

Bad random I/O performance of the storage, for example.

mongie
Expert
Posts: 152
Liked: 24 times
Joined: May 16, 2011 4:00 am
Full Name: Alex Macaronis
Location: Brisbane, Australia
Contact:

Re: Pinpointing Bottlenecks

Post by mongie » Jun 28, 2012 10:38 pm

I've been trying to pinpoint the bottleneck in my system - i have a similar issue.

The random read/write you speak of - what block size would be used?

Gostev
SVP, Product Management
Posts: 24818
Liked: 3573 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Pinpointing Bottlenecks

Post by Gostev » Jun 28, 2012 11:54 pm

No idea... but you can launch Process Monitor and see for yourself.

dellock6
Veeam Software
Posts: 5734
Liked: 1626 times
Joined: Jul 26, 2009 3:39 pm
Full Name: Luca Dell'Oca
Location: Varese, Italy
Contact:

Re: Pinpointing Bottlenecks

Post by dellock6 » Jun 29, 2012 6:57 am

If your storage has some kind of management console, you can take a look at it and see the performances during backup activities, like IOPS or MBs. Also, knowing model and disks could help to understand the estimated speed and check it against the real speed.

Luca.
Luca Dell'Oca
Principal EMEA Cloud Architect @ Veeam Software

@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2019
Veeam VMCE #1

vMO
Expert
Posts: 176
Liked: 21 times
Joined: Jul 08, 2011 8:16 am
Contact:

Re: Pinpointing Bottlenecks

Post by vMO » Jun 29, 2012 1:25 pm

is hyper-v "onhost" or "offhost" proxy used?

Post Reply

Who is online

Users browsing this forum: Bing [Bot] and 29 guests