Host-based backup of VMware vSphere VMs.
Post Reply
Elinet
Novice
Posts: 4
Liked: never
Joined: Oct 06, 2015 4:09 pm
Full Name: Elinet
Contact:

Bootleneck: "Source" without reason

Post by Elinet »

Goodmorning,

I'm Nicola from Elinet.
I've already used veeam as a backup solution in the past.

At the moment i'm facing a problem regarding the bottleneck of bacakups. My backup speed when i start a job is around 12MB/s.

Veeam is installed in a VM inside a Host with ESXi 6.0. I configured all the environment with the Vcenter server. As backup repository i added a CIFS share and an ISCSI disk (for test). All of them are from my NAS.
Veeam's proxy configuration: Virtual Appliance.
I configured NAS, ESXi, and all VMs with jumbo frames at 9000.

If i try to upload or download a large file from my NAS by CIFS, the average speed is 100 MB/s.

The main Datastore of my Virtual environment is conneted by ISCSI. Disk peformance are good between VMs (around 80 MB/s).

I'm not understand why bottleneck still remaining "Source".

What i'm doing wrong?

regards
PTide
Product Manager
Posts: 6408
Liked: 724 times
Joined: May 19, 2015 1:46 pm
Contact:

Re: Bootleneck: "Source" without reason

Post by PTide »

Hi,

Was it a full backup run or an incremental one? Could you please provide a full bottleneck statistics for full backup and job session log? Also please check if you have any kind of IO throttling configured. Btw, have you checked IO queue length on your storage during the job run?

Thank you.
dellock6
Veeam Software
Posts: 6137
Liked: 1928 times
Joined: Jul 26, 2009 3:39 pm
Full Name: Luca Dell'Oca
Location: Varese, Italy
Contact:

Re: Bootleneck: "Source" without reason

Post by dellock6 »

Also, remember a file copy is a pure sequential read/write activity, almost any backup operation is not, so a direct comparison between the two operations cannot be done.
It's like saying how fast my car can run on a 100km straight line, or trying to be as fast as possible in racetrack with turns...
Luca Dell'Oca
Principal EMEA Cloud Architect @ Veeam Software

@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2022
Veeam VMCE #1
Elinet
Novice
Posts: 4
Liked: never
Joined: Oct 06, 2015 4:09 pm
Full Name: Elinet
Contact:

Re: Bootleneck: "Source" without reason

Post by Elinet »

Thanks all for replying me
dellock6 wrote:Also, remember a file copy is a pure sequential read/write activity, almost any backup operation is not, so a direct comparison between the two operations cannot be done.
It's like saying how fast my car can run on a 100km straight line, or trying to be as fast as possible in racetrack with turns...
Mine was only an example just to have more details. I noticed a huge gap between them so i wanted to write it.
PTide wrote:Hi,
Was it a full backup run or an incremental one? Could you please provide a full bottleneck statistics for full backup and job session log? Also please check if you have any kind of IO throttling configured. Btw, have you checked IO queue length on your storage during the job run?
Thank you.
I did my tests with an Active Full.
i don't have any kind of throttling configured in veeam (I checked the link too)

Here some other options i modified:
- Backup Repository. (CIFS and ISCSI) I removed "Limit Maximum concurrent Task" and "Limit combined data rate to"
- Vmware Proxy. I change transport mode to "Virtual appliance".
- Job Backup. I changed "Storage optimization" to "LAN target" (in my CIFS test. Local Target on my ISCSI Test).

This is what i changed from default settings.

i will post ASAP all the job statistics

Thanks all

Regards
Elinet
Novice
Posts: 4
Liked: never
Joined: Oct 06, 2015 4:09 pm
Full Name: Elinet
Contact:

Re: Bootleneck: "Source" without reason

Post by Elinet »

PTide
Product Manager
Posts: 6408
Liked: 724 times
Joined: May 19, 2015 1:46 pm
Contact:

Re: Bootleneck: "Source" without reason

Post by PTide »

Ok, that really seems like slow reads from storage. Have you checked datastore I/O queue depth during backup on your ESXi?
foggy
Veeam Software
Posts: 21069
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Bootleneck: "Source" without reason

Post by foggy »

I'd also try network mode, just to compare.
Elinet
Novice
Posts: 4
Liked: never
Joined: Oct 06, 2015 4:09 pm
Full Name: Elinet
Contact:

Re: Bootleneck: "Source" without reason

Post by Elinet »

Last updates

i've tried also "network mode" without results.

I made some changes to the Virtual disk of the VM running veeam.

it was configured with "Thick provisoned"
Now i changed with "Thick provisoned Eager zeroed". I also deleted all snapshot of the machine and change disk type to "independent persistent".

...nothing changed :(

maybe i need to do some other tuning?
Gostev
Chief Product Officer
Posts: 31455
Liked: 6646 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Bootleneck: "Source" without reason

Post by Gostev »

Possibly... but we can't troubleshoot storage issues over the forum posts effectively, so please open a support case and have our engineers take a closer look at your deployment.
Post Reply

Who is online

Users browsing this forum: dbeerts, Google [Bot] and 93 guests