Comprehensive data protection for all workloads
Post Reply
lightsout
Expert
Posts: 227
Liked: 62 times
Joined: Apr 10, 2014 4:13 pm
Contact:

Slow backup storage optimization - Veeam 8 Update 2

Post by lightsout »

From the Update 2 release notes: http://www.veeam.com/kb2024

What does this mean exactly for the "slow backup optimization":
Using the default “Automatic proxy selection” setting for backup repositories types providing an option to specify a gateway server disables the cache.
This seems like it could be written better. Does this mean I should leave my repository on automatic selection to make this cache work?

Is there anyway to tell if the cache is active or not in the job log?
beaue
Novice
Posts: 4
Liked: never
Joined: Mar 09, 2015 11:25 pm
Full Name: Beau
Contact:

Re: Slow backup storage optimization - Veeam 8 Update 2

Post by beaue »

I was wondering the same. Not very clear as to what needs to be set to take advantage of this feature.

I've opened a SR to get clarification and I will update this once I hear back.
Gostev
Chief Product Officer
Posts: 31460
Liked: 6648 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Slow backup storage optimization - Veeam 8 Update 2

Post by Gostev »

lightsout wrote:Does this mean I should leave my repository on automatic selection to make this cache work?
The opposite: leaving automatic selection on disables the cache.
lightsout wrote:This seems like it could be written better.
Please suggest a better description, and I will update!
chrisdearden
Veteran
Posts: 1531
Liked: 226 times
Joined: Jul 21, 2010 9:47 am
Full Name: Chris Dearden
Contact:

Re: Slow backup storage optimization - Veeam 8 Update 2

Post by chrisdearden »

Out of interest why is this the case ? is it to avoid large numbers of caches to build / tear down ?
lightsout
Expert
Posts: 227
Liked: 62 times
Joined: Apr 10, 2014 4:13 pm
Contact:

Re: Slow backup storage optimization - Veeam 8 Update 2

Post by lightsout »

Thanks Gostev for the clarification.

Here is my suggestion:
Using the default “Automatic proxy selection” setting for backup repositories when specifying the gateway server disables the cache.
And to follow up my other comment? Is there anyway to tell if this is active, beyond some memory usage increasing?
Gostev
Chief Product Officer
Posts: 31460
Liked: 6648 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Slow backup storage optimization - Veeam 8 Update 2

Post by Gostev »

OK, but not all backup repository types have an option to specify the gateway server, so there is a loss of information in your proposed sentence which can cause even more questions.

How about:
Using the default "Automatic selection" gateway server setting for Shared folder, EMC DataDomain or HP StoreOnce based backup repositories disables the cache.
As far as cache being active - I am sure some debug logs reflect this, but basically the cache is always enabled for 64-bit repository/gateway server OS (aside of this specific limitation we are discussing), so we did not include any special user-facing reporting.
lightsout
Expert
Posts: 227
Liked: 62 times
Joined: Apr 10, 2014 4:13 pm
Contact:

Re: Slow backup storage optimization - Veeam 8 Update 2

Post by lightsout »

That covers all the bases, so yes. :)
Gostev
Chief Product Officer
Posts: 31460
Liked: 6648 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Slow backup storage optimization - Veeam 8 Update 2

Post by Gostev »

OK, changed in the forum topic, and requested the same change in the KB article. Thanks!
ori
Enthusiast
Posts: 65
Liked: 1 time
Joined: Apr 28, 2012 9:51 pm
Full Name: Ori Besser
Contact:

Re: Slow backup storage optimization - Veeam 8 Update 2

Post by ori »

Can you please clarify on
3. Disabling built-in deduplication disables the cache.
Selecting Data Domain as repository automatically disables deduplication in the job, should I turn it on? Wouldn't it impair the Data Domain built in deduplication?
Gostev
Chief Product Officer
Posts: 31460
Liked: 6648 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Slow backup storage optimization - Veeam 8 Update 2

Post by Gostev »

I believe that for Data Domain repositories the cache is always enabled, but I will need to double check.
ian0x0r
Veeam Vanguard
Posts: 235
Liked: 48 times
Joined: Nov 11, 2010 11:53 am
Full Name: Ian Sanderson
Location: UK
Contact:

Re: Slow backup storage optimization - Veeam 8 Update 2

Post by ian0x0r »

Would be good to know if the cache is always enabled for Data Domains either way. Looking forward to an update :mrgreen:
Check out my blog at www.snurf.co.uk :D
Gostev
Chief Product Officer
Posts: 31460
Liked: 6648 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Slow backup storage optimization - Veeam 8 Update 2

Post by Gostev »

Confirmed with the devs that for primary backup jobs, cache is not enabled when deduplication is disabled, simply because it is useless in this scenario. My confusion was due to Backup Copy jobs, where it is always enabled regardless of deduplication setting (due to the Backup Copy jobs architecture specifics). Thanks!
ori
Enthusiast
Posts: 65
Liked: 1 time
Joined: Apr 28, 2012 9:51 pm
Full Name: Ori Besser
Contact:

Re: Slow backup storage optimization - Veeam 8 Update 2

Post by ori »

So would you recommend turning it on for Data Domain jobs? Wouldn't it impair the Data Domain built in deduplication?
olssa
Lurker
Posts: 1
Liked: never
Joined: Aug 12, 2011 12:33 pm
Full Name: Daniel Olsson
Contact:

Re: Slow backup storage optimization - Veeam 8 Update 2

Post by olssa »

ori wrote:So would you recommend turning it on for Data Domain jobs? Wouldn't it impair the Data Domain built in deduplication?
This is something I would like to know as well. Because if I check enable inline deduplication and click next veeam wants to change it to disabled ...because its not recommended, but KB says it should be enabled.
hoFFy
Service Provider
Posts: 183
Liked: 40 times
Joined: Apr 27, 2012 1:10 pm
Full Name: Sebastian Hoffmann
Location: Germany / Lohne
Contact:

Re: Slow backup storage optimization - Veeam 8 Update 2

Post by hoFFy »

I'm wondering whats the best practise when using a NAS as backup target: We used to connect to NAS via iSCSI on the B&R server. Are these caching mechanisms only active when using CIFS? Shall we use CIFS instead of iSCSI now?
Sometimes the performance is VERY poor, unter 10MB/sec when using reversed incremental on a NAS with RAID 6 and 6 HDDs...
VMCE 7 / 8 / 9, VCP-DC 5 / 5.5 / 6, MCITP:SA
Blog: machinewithoutbrain.de
chris.childerhose
Veeam Vanguard
Posts: 572
Liked: 132 times
Joined: Aug 13, 2014 6:03 pm
Full Name: Chris Childerhose
Location: Toronto, ON
Contact:

Re: Slow backup storage optimization - Veeam 8 Update 2

Post by chris.childerhose »

ori wrote:So would you recommend turning it on for Data Domain jobs? Wouldn't it impair the Data Domain built in deduplication?
I am interested in this as well. Looking forward to some direction from Veeam.
-----------------------
Chris Childerhose
Veeam Vanguard / Veeam Legend / Veeam Ceritified Architect / VMCE
vExpert / VCAP-DCA / VCP8 / MCITP
Personal blog: https://just-virtualization.tech
Twitter: @cchilderhose
dellock6
Veeam Software
Posts: 6137
Liked: 1928 times
Joined: Jul 26, 2009 3:39 pm
Full Name: Luca Dell'Oca
Location: Varese, Italy
Contact:

Re: Slow backup storage optimization - Veeam 8 Update 2

Post by dellock6 »

hoFFy wrote:I'm wondering whats the best practise when using a NAS as backup target: We used to connect to NAS via iSCSI on the B&R server. Are these caching mechanisms only active when using CIFS? Shall we use CIFS instead of iSCSI now?
Sometimes the performance is VERY poor, unter 10MB/sec when using reversed incremental on a NAS with RAID 6 and 6 HDDs...
No, they are always enabled as explained if the system running the target datamover is a 64bit system. In case of SMB (sorry I can't say the other name without getting sick...:)) the datamover is the gateway server, that can be automatically selected (and cache is disabled) or manually selected. If you left everything at default, the cache should be disabled since default is to auto-select the gateway.

For iSCSI storage, the datamover is the windows or linux machine mounting the iscsi volume as a local disk. Honestly, unless you're using something really small, the server running windows or linux will always be more powerful than the small NAS, and I would always prefer to use it.

Luca
Luca Dell'Oca
Principal EMEA Cloud Architect @ Veeam Software

@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2022
Veeam VMCE #1
bgutwein
Novice
Posts: 5
Liked: never
Joined: Sep 17, 2012 3:44 pm
Full Name: Brad Gutwein
Contact:

Re: Slow backup storage optimization - Veeam 8 Update 2

Post by bgutwein »

I am also a bit confused with what the best practices are now for backing up to DataDomain. I was under the impression that I needed to disable Veeam deduplication on all of the jobs going to the DD share.

Also, how does Veeam know that I am backing up to a DataDomain? I currently have it set up as a CIFS share attached to the server. I can choose it for the Backup repository on the Storage screen of my backup jobs, but I haven't specified that it is a DD appliance as opposed to another CIFS server...

Will be monitoring this thread for sure!
ian0x0r
Veeam Vanguard
Posts: 235
Liked: 48 times
Joined: Nov 11, 2010 11:53 am
Full Name: Ian Sanderson
Location: UK
Contact:

Re: Slow backup storage optimization - Veeam 8 Update 2

Post by ian0x0r »

So as Gostev has pointed out, caching is disabled if dedupe is disabled on a primary job. Is this because the cache is only handling dedupe data so there is nothing to actually cache if it is disabled?

I'm just guessing here, would be good to know either way. :lol:
Check out my blog at www.snurf.co.uk :D
dellock6
Veeam Software
Posts: 6137
Liked: 1928 times
Joined: Jul 26, 2009 3:39 pm
Full Name: Luca Dell'Oca
Location: Varese, Italy
Contact:

Re: Slow backup storage optimization - Veeam 8 Update 2

Post by dellock6 »

Correct, metadata informations are used to map existing block already stored in the backup set, and leverage deduplication. If you do not want to use Veeam deduplication, there's no need to consume memory for the read cache ;)
Luca Dell'Oca
Principal EMEA Cloud Architect @ Veeam Software

@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2022
Veeam VMCE #1
foggy
Veeam Software
Posts: 21069
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Slow backup storage optimization - Veeam 8 Update 2

Post by foggy »

bgutwein wrote:I am also a bit confused with what the best practices are now for backing up to DataDomain. I was under the impression that I needed to disable Veeam deduplication on all of the jobs going to the DD share.
Here's a good post on this, should give you a detailed answer.
bgutwein wrote:Also, how does Veeam know that I am backing up to a DataDomain? I currently have it set up as a CIFS share attached to the server. I can choose it for the Backup repository on the Storage screen of my backup jobs, but I haven't specified that it is a DD appliance as opposed to another CIFS server...
You can specifically add your storage device as Data Domain repository, as opposed to CIFS repository.
Post Reply

Who is online

Users browsing this forum: Bing [Bot] and 273 guests