Comprehensive data protection for all workloads
Post Reply
uncletpot
Novice
Posts: 5
Liked: never
Joined: Sep 21, 2015 10:53 am
Full Name: Stuart Samuel
Contact:

Process rate very slow - Help

Post by uncletpot »

Hi

I am currently trialing Veeam Backup and Replication and struggling with current process rate.

Here is a brief overview of the Infrastructure we are using...

Infrastructure

Dedicated Backup Server (Veeam B and R currently installed on) - HP Proliant D320e Gen 8 - Windows Server 2012 R2 - 16GB RAM - 4 Core - 500GB Hard Disk -

Internal Backup Storage - QNAP Turbo Nas TS420U 10TB

Offsite External Backup Storage - Currently using Samsung M3 4TB USB 3.0 Slimline Portable Hard Drive on a daily rotation.

Jobs

Backup

Virtual (Hyper V)

Daily - 6 Virtual Machines
Weekly - 7 Virtual Machines aswell as the daily above so 13 in total.

Backup Copy

Continuous 11 Backup copy jobs to USB external disk which I rotate daily every morning.

File Copy

Backup of a file server (Netgear ReadyNas Pro 4) to Internal Backup Storage (QNAP Turbo Nas TS420U 10TB) then secondary job to backup to USB disk.

What I am currently struggling with this getting the backup copy jobs to USB to finish in time within the overnight time frame bracket.

Looking at each backup copy job or file copy job to USB 3.0 external disk we are not exceeding speeds of 7MB/s.

A brief example is when attempting to backup our file server I start the backup copy to USB job around 6pm on the Friday evening and the job is still running.

Here is a brief stat for that backup. File server backup size: 510.5GB, process rate 2 MB /s duration of the backup tok 63:38:04

Any other jobs I have backing upto external USB I also get similar speeds.

I have tested with Data Reduction and compression turned off and turned on and there seems to be no difference in speeds.

I was then advised to turn of parallel processing and test by running one job and still not getting greater speeds then 7MB/s.

The current USB disk I change every day is directly connected to the backup server. The Nas storage which we use for internal storage is on the same network as the backup server via ethernet.

When I did a manual test by copying a file from the Nas to the external USB disk which is connected to the backup server I get speeds of around 20 MB/s.

Any feedback on how I can get the backup speeds to USB better would be gratelly apprecicated as this is the only issue stopping me purchasing the software.

Thanks
foggy
Veeam Software
Posts: 21070
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Process rate very slow - Help

Post by foggy »

Stuart, comparing backup copy random I/O pattern to a sequential one of simple copy is not correct.

What are the bottleneck stats for the backup copy jobs?
uncletpot
Novice
Posts: 5
Liked: never
Joined: Sep 21, 2015 10:53 am
Full Name: Stuart Samuel
Contact:

Re: Process rate very slow - Help

Post by uncletpot »

Hi Foggy

Thanks for getting back to me. Can you confirm where I can obtain this information?
foggy
Veeam Software
Posts: 21070
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Process rate very slow - Help

Post by foggy »

In the job session log that is available when you click the job in the list.
uncletpot
Novice
Posts: 5
Liked: never
Joined: Sep 21, 2015 10:53 am
Full Name: Stuart Samuel
Contact:

Re: Process rate very slow - Help

Post by uncletpot »

Hi Foggy

Please see stats below.

Backup Job:

Summary

Duration: 2:15:14
Processing Rate: 14 MB/s
Bottleneck: Target

Data

Processed: 450.1 GB (100%)
Read: 106.2 GB
Transferred: 28.2 GB (3.8X)

Status

Success: 1

File Copy Job

Summary

Duration: 63:38:04
Processing Rate: 2 MB/s
Bottleneck: N/A

Data

Processed: 510.5 GB (100%)
Read: 510.5 GB
Transferred: 510.5 GB (1X)

Status

Success: 4

Hope this helps?
foggy
Veeam Software
Posts: 21070
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Process rate very slow - Help

Post by foggy »

uncletpot wrote:Processing Rate: 14 MB/s
Bottleneck: Target
That means that the USB disk cannot provide enough IOPS. Try to target the job to some other storage to see whether it will perform better.
uncletpot
Novice
Posts: 5
Liked: never
Joined: Sep 21, 2015 10:53 am
Full Name: Stuart Samuel
Contact:

Re: Process rate very slow - Help

Post by uncletpot »

Hi Foggy

As you can see here were still only getting 14 MB/s backing up a virtual machine from our host server (hyper v) to our internal qnap storage.

Backup Job:

Summary

Duration: 2:15:14
Processing Rate: 14 MB/s
Bottleneck: Target

Data

Processed: 450.1 GB (100%)
Read: 106.2 GB
Transferred: 28.2 GB (3.8X)

Status

Success: 1

In regards to USB we need a working offsite backup solution as we dont have the bandwidth we need to use USB devices on a daily rotational basis?

The process rate to internal storage is still slow. Process rate to usb is even slower.

Please advise.
PTide
Product Manager
Posts: 6431
Liked: 729 times
Joined: May 19, 2015 1:46 pm
Contact:

Re: Process rate very slow - Help

Post by PTide »

Hi,

How is your repo presented to VBR? Is it SMB/CIFS/iSCSI ?

Btw, what USB HDD do you use?

Thank you.
foggy
Veeam Software
Posts: 21070
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Process rate very slow - Help

Post by foggy »

I thought these were the bottleneck stats for the backup copy job. Could you please share those as well?
uncletpot
Novice
Posts: 5
Liked: never
Joined: Sep 21, 2015 10:53 am
Full Name: Stuart Samuel
Contact:

Re: Process rate very slow - Help

Post by uncletpot »

Foggy they are the bottleneck stats? Please advise?

PTide all repos are CIFS type except backing upto USB is set to Windows. Please advise?
foggy
Veeam Software
Posts: 21070
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Process rate very slow - Help

Post by foggy »

I mean bottleneck stats for the backup copy job to USB drive, not for the original backup job to QNAP.
Post Reply

Who is online

Users browsing this forum: Google [Bot] and 91 guests