Comprehensive data protection for all workloads
foggy
Veeam Software
Posts: 21069
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Recommended Backup Job Settings for EMC Data Domain

Post by foggy »

Sure, the request is accepted.
kaithost
Veeam ProPartner
Posts: 26
Liked: 1 time
Joined: Aug 25, 2011 7:53 am
Full Name: Kai Thost
Contact:

Re: Recommended Backup Job Settings for EMC Data Domain

Post by kaithost »

Thank you foggy!
vdisman
Novice
Posts: 4
Liked: 1 time
Joined: Oct 16, 2019 12:30 pm
Full Name: Basil Disman
Contact:

Re: Recommended Backup Job Settings for EMC Data Domain

Post by vdisman »

DeadEyedJacks wrote: Apr 22, 2016 12:46 pm We tested direct SAN connectivity 8GbFC from physical proxies, but found network transport 10GbE via vSphere hosts actually produced best overall job throughput. Your mileage may vary.
Sorry for necroposting, but 8GbFC hasn't changed a bit.

Do you remember what transfer speeds over FC to/from DD you saw during the tests?

We're seeing some 400-500 MB/s backing up to DD6300 over 8GBFC from a DELL/EMC Unity All-Flash. Stranger still, restore DD->AllFlash yields 250-300 MB/s
I'd expect something closer to 700MB/s. Or shouldn't I?

PS Interestingly though, our 10Gb ethernet is showing worse results, if marginally.
foggy
Veeam Software
Posts: 21069
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Recommended Backup Job Settings for EMC Data Domain

Post by foggy » 1 person likes this post

We're seeing some 400-500 MB/s backing up to DD6300 over 8GBFC from a DELL/EMC Unity All-Flash.
Is it the full backup performance? What is reported in the job session as the main bottleneck? The numbers are pretty decent for a dedupe appliance, I'd say.
Stranger still, restore DD->AllFlash yields 250-300 MB/s
Reading from the dedupe appliance is expectedly slower.
vdisman
Novice
Posts: 4
Liked: 1 time
Joined: Oct 16, 2019 12:30 pm
Full Name: Basil Disman
Contact:

Re: Recommended Backup Job Settings for EMC Data Domain

Post by vdisman »

Hi, foggy!

I like the numbers too since we saw 14 MB/s from a spinning disk EMC (200 from allflash), and then after working with Veeam support and, consequently, creating VddkPreReadBufferSize regkey we got 140 MB/s from 7200 nl sas EMC and 535 MB/s from All-Flash. Never saw 500+ again though. Made a few 100GB active-fulls from All-Flash, and they range from 310 to 460.

Still, Wiki says 8 TB/h for DD6300. It looks like 2 GB/s which should be achieveable via 16GbFC. DeadEyedJacks said that Veeam Enterprise Manager reported throughput of 1TB/s (10Gb LAN) for backups at one site.
I'm not saying I want to see 800 MB/s but I'd be content with constant 600. And if I'm content I can tell my client his speeds are OK and be done with it. )
Reading from the dedupe appliance is expectedly slower.
Yes, and it's only marginally slower than writing to it. Strange, innit?
What is reported in the job session as the main bottleneck?
Yet another interesting question. 3 out 4 it's Target at 85%-...-97%. In general, though, the numbers spin around 90%. Like 89-93 and vice versa. Proxy and Network are at 10%-30%.

PS All the gateway/job settings are recommended (as in this post), VBR/VMW/DD have the latest updates.
foggy
Veeam Software
Posts: 21069
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Recommended Backup Job Settings for EMC Data Domain

Post by foggy »

Is your repository configured for per-VM chains or have you tried parallel jobs otherwise? Ingestion rate of a single write stream is typically limited on dedupe appliances.
vdisman
Novice
Posts: 4
Liked: 1 time
Joined: Oct 16, 2019 12:30 pm
Full Name: Basil Disman
Contact:

Re: Recommended Backup Job Settings for EMC Data Domain

Post by vdisman »

Use per-VM backup files? ON.
I didn 't try parallel jobs per se, but they did happen, and it looked as if they shared this here 450 MB/s channel, individual job speeds dropping respectively. Several VMs in a single job? Tried that before the registry edit, never afterwards. Can do on Monday.
foggy
Veeam Software
Posts: 21069
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Recommended Backup Job Settings for EMC Data Domain

Post by foggy » 1 person likes this post

Then it seems that is what your DD is able to chew up.
vdisman
Novice
Posts: 4
Liked: 1 time
Joined: Oct 16, 2019 12:30 pm
Full Name: Basil Disman
Contact:

Re: Recommended Backup Job Settings for EMC Data Domain

Post by vdisman » 1 person likes this post

Hi, Foggy!

I created a job with 9 VMs from different sources in it which gave me peak speed of 817 MB/s. Seems I didn't see the full picture running separate jobs.

Thanks a ton for your directions!
Scott46550
Novice
Posts: 4
Liked: never
Joined: Dec 02, 2020 1:40 pm
Full Name: Scott Thompson
Contact:

[MERGED] Best Practice For Veeam & Data Domain

Post by Scott46550 »

I have everything configured for Data Domain and was looking to create a Forever Forward Incremental job. I was wondering what the best advanced settings (Storage Optimization, etc.) would be for the job.
Gostev
Chief Product Officer
Posts: 31428
Liked: 6633 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Best Practice For Veeam & Data Domain

Post by Gostev »

There's a support KB article covering this > KB1745
foggy
Veeam Software
Posts: 21069
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Recommended Backup Job Settings for EMC Data Domain

Post by foggy »

Please also review the thread above and the corresponding best practices guide section. Thanks!
Trelor
Enthusiast
Posts: 47
Liked: 15 times
Joined: Apr 27, 2015 6:02 pm
Contact:

Re: Best Practice For Veeam & Data Domain

Post by Trelor »

Gostev wrote: Dec 02, 2020 6:05 pm There's a support KB article covering this > KB1745
The link to the DellEMC website in the KB no longer exists. Also is there a way around the 60 day limit with GFS backups on the DataDomain. The cost to write a full backup without synthesizing it from incrementals is extreme and takes days to complete.
foggy
Veeam Software
Posts: 21069
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Recommended Backup Job Settings for EMC Data Domain

Post by foggy »

I will check regarding the Dell EMC link, thanks. As for the limit, it is incurred by the storage connections limit so cannot be worked around from the Veeam B&R side except for the periodic fulls option. Fulls can be either active or synthetic though so I'm not sure I'm getting your concern.
foggy
Veeam Software
Posts: 21069
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Best Practice For Veeam & Data Domain

Post by foggy »

Trelor wrote: Dec 07, 2020 9:44 pm The link to the DellEMC website in the KB no longer exists.
Works for me now (requires login).
Post Reply

Who is online

Users browsing this forum: Google [Bot] and 114 guests