Comprehensive data protection for all workloads
foggy
Veeam Software
Posts: 18383
Liked: 1580 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Recommended Backup Job Settings for EMC Data Domain

Post by foggy » Jul 20, 2018 2:07 pm

Sure, the request is accepted.

kaithost
Veeam ProPartner
Posts: 16
Liked: never
Joined: Aug 25, 2011 7:53 am
Full Name: Kai Thost
Contact:

Re: Recommended Backup Job Settings for EMC Data Domain

Post by kaithost » Jul 23, 2018 7:19 am

Thank you foggy!

vdisman
Novice
Posts: 4
Liked: 1 time
Joined: Oct 16, 2019 12:30 pm
Full Name: Basil Disman
Contact:

Re: Recommended Backup Job Settings for EMC Data Domain

Post by vdisman » Oct 16, 2019 12:48 pm

DeadEyedJacks wrote:
Apr 22, 2016 12:46 pm
We tested direct SAN connectivity 8GbFC from physical proxies, but found network transport 10GbE via vSphere hosts actually produced best overall job throughput. Your mileage may vary.
Sorry for necroposting, but 8GbFC hasn't changed a bit.

Do you remember what transfer speeds over FC to/from DD you saw during the tests?

We're seeing some 400-500 MB/s backing up to DD6300 over 8GBFC from a DELL/EMC Unity All-Flash. Stranger still, restore DD->AllFlash yields 250-300 MB/s
I'd expect something closer to 700MB/s. Or shouldn't I?

PS Interestingly though, our 10Gb ethernet is showing worse results, if marginally.

foggy
Veeam Software
Posts: 18383
Liked: 1580 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Recommended Backup Job Settings for EMC Data Domain

Post by foggy » Oct 16, 2019 3:20 pm 1 person likes this post

We're seeing some 400-500 MB/s backing up to DD6300 over 8GBFC from a DELL/EMC Unity All-Flash.
Is it the full backup performance? What is reported in the job session as the main bottleneck? The numbers are pretty decent for a dedupe appliance, I'd say.
Stranger still, restore DD->AllFlash yields 250-300 MB/s
Reading from the dedupe appliance is expectedly slower.

vdisman
Novice
Posts: 4
Liked: 1 time
Joined: Oct 16, 2019 12:30 pm
Full Name: Basil Disman
Contact:

Re: Recommended Backup Job Settings for EMC Data Domain

Post by vdisman » Oct 17, 2019 4:43 am

Hi, foggy!

I like the numbers too since we saw 14 MB/s from a spinning disk EMC (200 from allflash), and then after working with Veeam support and, consequently, creating VddkPreReadBufferSize regkey we got 140 MB/s from 7200 nl sas EMC and 535 MB/s from All-Flash. Never saw 500+ again though. Made a few 100GB active-fulls from All-Flash, and they range from 310 to 460.

Still, Wiki says 8 TB/h for DD6300. It looks like 2 GB/s which should be achieveable via 16GbFC. DeadEyedJacks said that Veeam Enterprise Manager reported throughput of 1TB/s (10Gb LAN) for backups at one site.
I'm not saying I want to see 800 MB/s but I'd be content with constant 600. And if I'm content I can tell my client his speeds are OK and be done with it. )
Reading from the dedupe appliance is expectedly slower.
Yes, and it's only marginally slower than writing to it. Strange, innit?
What is reported in the job session as the main bottleneck?
Yet another interesting question. 3 out 4 it's Target at 85%-...-97%. In general, though, the numbers spin around 90%. Like 89-93 and vice versa. Proxy and Network are at 10%-30%.

PS All the gateway/job settings are recommended (as in this post), VBR/VMW/DD have the latest updates.

foggy
Veeam Software
Posts: 18383
Liked: 1580 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Recommended Backup Job Settings for EMC Data Domain

Post by foggy » Oct 17, 2019 1:15 pm

Is your repository configured for per-VM chains or have you tried parallel jobs otherwise? Ingestion rate of a single write stream is typically limited on dedupe appliances.

vdisman
Novice
Posts: 4
Liked: 1 time
Joined: Oct 16, 2019 12:30 pm
Full Name: Basil Disman
Contact:

Re: Recommended Backup Job Settings for EMC Data Domain

Post by vdisman » Oct 18, 2019 8:41 am

Use per-VM backup files? ON.
I didn 't try parallel jobs per se, but they did happen, and it looked as if they shared this here 450 MB/s channel, individual job speeds dropping respectively. Several VMs in a single job? Tried that before the registry edit, never afterwards. Can do on Monday.

foggy
Veeam Software
Posts: 18383
Liked: 1580 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Recommended Backup Job Settings for EMC Data Domain

Post by foggy » Oct 18, 2019 10:09 am 1 person likes this post

Then it seems that is what your DD is able to chew up.

vdisman
Novice
Posts: 4
Liked: 1 time
Joined: Oct 16, 2019 12:30 pm
Full Name: Basil Disman
Contact:

Re: Recommended Backup Job Settings for EMC Data Domain

Post by vdisman » Oct 23, 2019 9:44 am 1 person likes this post

Hi, Foggy!

I created a job with 9 VMs from different sources in it which gave me peak speed of 817 MB/s. Seems I didn't see the full picture running separate jobs.

Thanks a ton for your directions!

Post Reply

Who is online

Users browsing this forum: allanh, Bing [Bot], derrick.chong, DGrinev and 58 guests