Comprehensive data protection for all workloads
Post Reply
PeakSoftware
Novice
Posts: 8
Liked: never
Joined: Jun 22, 2012 3:34 pm
Full Name: George Lambson
Contact:

Pinpointing Bottlenecks

Post by PeakSoftware »

Does anyone have any suggestions for pinpointing the bottleneck in backup processes? The report shows my source is the bottleneck, but I'm not quite sure where to go from there.
foggy
Veeam Software
Posts: 21069
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Pinpointing Bottlenecks

Post by foggy »

George, that means that source storage data retrieval speed is a bottleneck. What is your setup and what transport mode do you use to read the VMs data from the storage?
PeakSoftware
Novice
Posts: 8
Liked: never
Joined: Jun 22, 2012 3:34 pm
Full Name: George Lambson
Contact:

Re: Pinpointing Bottlenecks

Post by PeakSoftware »

I am running Hyper-V and the VHDs are on an iSCSI storage device directly attached to the host server. I have done some HDD throughput tests and the results are nearly the same as local storage.
PeakSoftware
Novice
Posts: 8
Liked: never
Joined: Jun 22, 2012 3:34 pm
Full Name: George Lambson
Contact:

Re: Pinpointing Bottlenecks

Post by PeakSoftware »

BTW, these are incremental backups as where the first full backup shows the network to be the bottleneck at 98% which is what I would expect going over a VPN to an off-site location. Is it normal to see the source as the bottleneck at 99% with an incremental backup?
Gostev
Chief Product Officer
Posts: 31460
Liked: 6648 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Pinpointing Bottlenecks

Post by Gostev »

Yes, especially if CBT is not used.
PeakSoftware
Novice
Posts: 8
Liked: never
Joined: Jun 22, 2012 3:34 pm
Full Name: George Lambson
Contact:

Re: Pinpointing Bottlenecks

Post by PeakSoftware »

CBT is enabled.
Gostev
Chief Product Officer
Posts: 31460
Liked: 6648 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Pinpointing Bottlenecks

Post by Gostev »

"Enabled" is not equal to "Used" though ;)
Do you see [CBT] letter next to each virtual disk in the real-time statistics?
PeakSoftware
Novice
Posts: 8
Liked: never
Joined: Jun 22, 2012 3:34 pm
Full Name: George Lambson
Contact:

Re: Pinpointing Bottlenecks

Post by PeakSoftware »

Good to know. Yes it is there. It also shows it was read at 4MB/s. Is there a place I might be limiting the job to that 4MB/s? My repository is limited to 3MB/s because it's going over a WAN, but I don't see anywhere else to limit a data ingestion/througput rate.
Gostev
Chief Product Officer
Posts: 31460
Liked: 6648 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Pinpointing Bottlenecks

Post by Gostev »

Bad random I/O performance of the storage, for example.
mongie
Expert
Posts: 152
Liked: 24 times
Joined: May 16, 2011 4:00 am
Full Name: Alex Macaronis
Location: Brisbane, Australia
Contact:

Re: Pinpointing Bottlenecks

Post by mongie »

I've been trying to pinpoint the bottleneck in my system - i have a similar issue.

The random read/write you speak of - what block size would be used?
Gostev
Chief Product Officer
Posts: 31460
Liked: 6648 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Pinpointing Bottlenecks

Post by Gostev »

No idea... but you can launch Process Monitor and see for yourself.
dellock6
Veeam Software
Posts: 6137
Liked: 1928 times
Joined: Jul 26, 2009 3:39 pm
Full Name: Luca Dell'Oca
Location: Varese, Italy
Contact:

Re: Pinpointing Bottlenecks

Post by dellock6 »

If your storage has some kind of management console, you can take a look at it and see the performances during backup activities, like IOPS or MBs. Also, knowing model and disks could help to understand the estimated speed and check it against the real speed.

Luca.
Luca Dell'Oca
Principal EMEA Cloud Architect @ Veeam Software

@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2022
Veeam VMCE #1
vMO
Expert
Posts: 176
Liked: 21 times
Joined: Jul 08, 2011 8:16 am
Contact:

Re: Pinpointing Bottlenecks

Post by vMO »

is hyper-v "onhost" or "offhost" proxy used?
Post Reply

Who is online

Users browsing this forum: No registered users and 261 guests