Slow Backup Speed (7-30 MB/s)

VMware specific discussions

Re: Slow Backup Speed (7-30 MB/s)

Veeam Logoby xxstyler20xx » Sat Jan 23, 2016 11:24 am

Hot Add mode takes me to 17 MBps
for testing I installed the transport feature on one of our test VM...

Just for understanding.. The VEEAM runs on an physical server and the backup runs from the NetApp to the VEEAM server over Network..
will the backup still be written on the VEEAM in Hot-Add Mode??
for my understanding.. the backup stays on the NetApp and don't pass the network

Just seen that they have disabled CBT too... :?
xxstyler20xx
Novice
 
Posts: 8
Liked: never
Joined: Sat Jan 23, 2016 9:56 am

Re: Slow Backup Speed (7-30 MB/s)

Veeam Logoby Shestakov » Sat Jan 23, 2016 12:00 pm

What backup method do you use? You may try to switch to the fastest, simple incremental mode.
Data path for backup job is always: Disk > Backup proxy > Network > Backup repository > Disk regardless what transport mode is chosen.
What do you use as a backup repository?
Thanks!
Shestakov
Veeam Software
 
Posts: 4861
Liked: 395 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

Re: Slow Backup Speed (7-30 MB/s)

Veeam Logoby xxstyler20xx » Sat Jan 23, 2016 12:16 pm

--What backup method do you use? --
-- You may try to switch to the fastest, simple incremental mode.---
It's a incremental (recommended) in advanced propertys synthetic full is selected one time per week.
Should I enable CBT on the Job? But then I have to delete all snapshots on the VEEAM right?

Also we have a lot of Databases on the VM's can there occour any big problems when I change this settings?

--Data path for backup job is always: Disk > Backup proxy > Network > Backup repository > Disk regardless what transport mode is chosen.--
Ok and can there occour any problems on the VM where the proxy is running.. ? It's a test server.. we don't use it very often but we do..
Now the Proxy is set to default (VEEAM Server) and transport mode is automatic

--What do you use as a backup repository?--
In the Job the "default repository" is selected which is the veeam server

Thanks!
xxstyler20xx
Novice
 
Posts: 8
Liked: never
Joined: Sat Jan 23, 2016 9:56 am

Re: Slow Backup Speed (7-30 MB/s)

Veeam Logoby Shestakov » Sat Jan 23, 2016 8:14 pm

xxstyler20xx wrote:It's a incremental (recommended) in advanced propertys synthetic full is selected one time per week.
Should I enable CBT on the Job? But then I have to delete all snapshots on the VEEAM right?

What vSphere version are you at(including patches)? CBT should speed up the backup process, but beware of CBT bug in ESXi 6.
It`s recommended not to keep snapshots. May I ask why you need them?
xxstyler20xx wrote:Ok and can there occour any problems on the VM where the proxy is running.. ? It's a test server.. we don't use it very often but we do..
Now the Proxy is set to default (VEEAM Server) and transport mode is automatic

No problems should arise on that VM. Please provide full bottleneck stats to see the wider picture.
Thanks!
Shestakov
Veeam Software
 
Posts: 4861
Liked: 395 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

Re: Slow Backup Speed (7-30 MB/s)

Veeam Logoby xxstyler20xx » Sat Jan 23, 2016 10:51 pm

What vSphere version are you at(including patches)? CBT should speed up the backup process, but beware of [url=forums.veeam.com/vmware-vsphere-f24/there-s-a-new-cbt-bug-in-esxi-6-t31280.html]CBT bug in ESXi 6[/url].
It`s recommended not to keep snapshots. May I ask why you need them?


Why I need them. Just to have a backup if some users delete any files..
I am using vsphere 6.0.0 .. Have to take a closer look to it on monday (because patches)



No problems should arise on that VM. Please provide full bottleneck stats to see the wider picture.
Thanks!


Maybe a stupid question but where can I find more Information about the bottle neck ?
In the statistic window of the current job it only says Bottleneck: Source 99% Proxy 5% Network 0%

The wired thing is that I have a incremental job running since 4 am 1TB data which has a speed of 12 MBs and its still running..
Now the secound incremental job started with 3 VM's same time with a speed of 22 MBs - 30MBs
(I splitted the 6 VM's in two jobs because I thought it would be little bit faster then.
xxstyler20xx
Novice
 
Posts: 8
Liked: never
Joined: Sat Jan 23, 2016 9:56 am

Re: Slow Backup Speed (7-30 MB/s)

Veeam Logoby foggy » Mon Jan 25, 2016 9:57 am

xxstyler20xx wrote:the backup stays on the NetApp and don't pass the network

That one confuses me, could you please elaborate on your setup? If I'm getting you right, you have NetApp as a source storage, Veeam B&R as a physical backup server utilizing the default proxy server and storing backups on the Veeam B&R itself, right?

Then, you said you've tried hotadd - have you installed a dedicated proxy VM on the source host for this and checked that it is effectively used during the job? With NetApp you can also try direct SAN access mode, typically the fastest of all the three.

xxstyler20xx wrote:Should I enable CBT on the Job? But then I have to delete all snapshots on the VEEAM right?

CBT does not delete any snapshots, enabling it should improve your overall job performance.
foggy
Veeam Software
 
Posts: 14742
Liked: 1080 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Slow Backup Speed (7-30 MB/s)

Veeam Logoby Shestakov » Mon Jan 25, 2016 11:03 am

xxstyler20xx wrote:Why I need them. Just to have a backup if some users delete any files..

Snapshots are not backups. I`d suggest to make a copy of the primary backup to be more protected.
xxstyler20xx wrote:CBT does not delete any snapshots, enabling it should improve your overall job performance.

That`s correct, but as was mentioned you need to install the latest vSphere 1b update first to avoid problems.
Shestakov
Veeam Software
 
Posts: 4861
Liked: 395 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

Re: Slow Backup Speed (7-30 MB/s)

Veeam Logoby xxstyler20xx » Mon Jan 25, 2016 12:16 pm

The problem is that a other company has set up the system and configuration.. and they want to see money now everytime i need help.. so i try to fix this on my own but I'am totally new with this.

So thanks for your help and your patience!
---Our Configuration----
We have a Cisco UCS with VMWare ESX
a NetApp where the VM's and Snapshots are located. (NFS)
The "dailyjob" incremental backup will saved on the VEEAM with is a phisycal HP ProLiant Server.

--HOTADD---
I just installed the Transport role on one of our VM's (Testserver) and then I selected in the incremental job that is should use the Testserver as proxy and disabled the "default proxy"

CBT gaves me a big boost the backup was finish in 5 hours instead of 38 hours


But for me it seems that the HP Server is the main bottleneck when I copy a file on the server (1.5GB) it takes 3min but it's a raid 5 with 7 discs and 4x1GB Network Team
xxstyler20xx
Novice
 
Posts: 8
Liked: never
Joined: Sat Jan 23, 2016 9:56 am

Re: Slow Backup Speed (7-30 MB/s)

Veeam Logoby foggy » Mon Jan 25, 2016 12:22 pm

So what are the job performance ad bottleneck stats after those changes?
foggy
Veeam Software
 
Posts: 14742
Liked: 1080 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Slow Backup Speed (7-30 MB/s)

Veeam Logoby xxstyler20xx » Mon Jan 25, 2016 12:34 pm

Bottleneck: Source
Can you tell me where I find the LOGs of the jobs?
xxstyler20xx
Novice
 
Posts: 8
Liked: never
Joined: Sat Jan 23, 2016 9:56 am

Re: Slow Backup Speed (7-30 MB/s)

Veeam Logoby kawiMTF » Mon Jan 25, 2016 12:38 pm

Hello

Below are the relative log path lists for Veeam Backup & Replication.

    - Windows 2003, XP – C:\Documents and Settings\All Users\Application Data\Veeam\Backup\
    - Windows Vista, 7 - C:\Users\All Users\Veeam\Backup\
    - Windows 2008/2008 R2/2012 - C:\ProgramData\Veeam\Backup\
    - Linux - /var/log/VeeamBackup/

Typical log files requested for a manual log compilation will be:

    - The task's folder located in the parent directory, zipped. This will contain all relevant job/task/agent data.
    - All logs from the parent directory named svc.*.log, util.*.log, as well as the VeeamBackupManager.log and VeeamShell.log

For gathering the logs you can use the support assistant:
http://www.veeam.com/kb1832
Best regards,
Karl

-----------------------
Veeam Platinum Partner
Veeam Vanguard / VMCE v9 / VMTSP v9 / VMSP v9
vExpert / VCA6-DVC / VCA5-DVC / VCA5-Cloud
MCP / MCSA 2012
Personal blog: https://www.driftar.ch
Twitter: @widmerkarl
kawiMTF
Veeam Vanguard
 
Posts: 116
Liked: 20 times
Joined: Tue Jan 06, 2015 10:03 am
Location: Switzerland
Full Name: Karl Widmer

Re: Slow Backup Speed (7-30 MB/s)

Veeam Logoby xxstyler20xx » Mon Jan 25, 2016 1:16 pm

Only found this..
Load: Source 99% > Proxy 5% > Network 0% > Target 0%
Primary bottleneck: Source

Source1.log
.2016 03:59:34] < 91036> cli| - 0%, workload src: 99/0/0, ntf: 0/0/0

Success 6 Start time 03:06:25 Total size 3,5 TB Backup size 132,2 GB
Warning 0 End time 07:55:38 Data read 263,1 GB Dedupe 1,0x
Error 0 Duration 4:49:13 Transferred 132,1 GB Compression 1,7x
Details
Name Status Start time End time Size Read Transferred Duration
---- Success 03:10:00 03:59:39 40,0 GB 34,0 GB 774,6 MB 0:49:39
Success 03:10:00 03:19:26 300,0 GB 2,3 GB 751,0 MB 0:09:26
Success 03:10:00 05:32:21 1,1 TB 90,1 GB 69,4 GB 2:22:21
Success 03:19:17 05:16:23 1,1 TB 33,2 GB 17,7 GB 1:57:06
Success 03:59:31 05:25:36 752,1 GB 46,5 GB 9,1 GB 1:26:04
Success 05:19:23 07:55:22 273,4 GB 57,1 GB 34,4 GB 2:35:59
With CDB Enable
xxstyler20xx
Novice
 
Posts: 8
Liked: never
Joined: Sat Jan 23, 2016 9:56 am

Re: Slow Backup Speed (7-30 MB/s)

Veeam Logoby xxstyler20xx » Tue Jan 26, 2016 6:16 am

meant CBT :roll:
Can someone explain to me why CBT fails sometimes?

On Saturday I tested CBT for the first time and it fails for VM1 (that was no problem because it is the smallest one)
but yesterday it worked for VM1 but failed for VM2 which is the biggest one so the job is still running...
xxstyler20xx
Novice
 
Posts: 8
Liked: never
Joined: Sat Jan 23, 2016 9:56 am

Re: Slow Backup Speed (7-30 MB/s)

Veeam Logoby Shestakov » Tue Jan 26, 2016 11:41 am

Shestakov
Veeam Software
 
Posts: 4861
Liked: 395 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

Re: Slow Backup Speed (7-30 MB/s)

Veeam Logoby silbro » Thu Feb 04, 2016 1:31 pm

Hello everyone

So I'm back and I've invested more time trying to solve this problem. I upgraded to Veeam 9 to test if that makes a difference, then I reinstalled Veeam 8 and tested again. Same results, except! and now this makes the problem even more strange, that I started to notice it's certain VMs having this problem. I have 4 VMs I'm backing up. 3 Linux VMs and 1 Windows VM. 2 out of the 3 Linux VMs have a speed of 95MB/s while the other one drops to 3-9MB/s just like the Windows VM. I even had the backup jobs run at the same time. I've also taken the MGMT of the esxi to the 4Cables in LACP hoping to get more speed. It seems to me, that the VMs must be the problem... I compared them to each other (f.e. if they are on the same storage or have the vm tools missing and compared harddrive settings. They are all identical... I'm using vcenter 6, esxi 6... might this be a problem?
silbro
Novice
 
Posts: 9
Liked: never
Joined: Wed Feb 11, 2015 8:03 am
Full Name: Silvio Brossi

PreviousNext

Return to VMware vSphere



Who is online

Users browsing this forum: No registered users and 5 guests