Comprehensive data protection for all workloads
Post Reply
Uglybob
Influencer
Posts: 15
Liked: 1 time
Joined: Sep 15, 2015 6:25 am
Contact:

Veeam / Exablox / CIFS Compatibility

Post by Uglybob »

Hi,

I'm currently working with Exablox and Veeam support with a slowness issue when concurrently reading and writing to an Exablox. Case # 01955120

I got told that for Exablox to talk to devs about the issue, I need to post in the forums.
"If you want to still inquire with the developers you can on our forums at veeam.com to discuss integration with Exablox."
So the current issue is if I backup to disk(Exablox), I get about 180-200MB/s. If I backup to tape from the Exablox I get about 100MB/s. If I do both at the same time, BOTH jobs drop to about 20MB/s ea. I've been told by Exablox that the drop in reads is expected but the drop in writes is not. Doing testing on the device itself only showed the writes drop to 150MB/s.

Veeam support are stating that because Exablox use the CIFS protocol, its the protocol itself causing the slowness, even though the gateway server isn't struggling with requests.
"After reviewing the the situation today and going over all the information provided this what I have. As discussed the Exablox OneBlox can only use the following protocols SMB or NFS, so in Veeam the repository was added as a CIFS share. SMB shares cannot host Veeam Data Mover Services. For this reason, data to the SMB share is written from the gateway server. By default, this role is performed by a backup proxy that is used by the job for data transport. The Veeam interface interacts with the gateway server using the data mover service from this point it implements CIFS to interact the storage interface. CIFS is a fairly old protocol it would be better if we could leverage a faster protocol like iSCSI or Fiber Channel. CIFS defines a series of commands used to pass information between networked computers. As seen parallel tasks are hampered with slow processing rates. Nothing is wrong with the configuration of your environment but to make this quicker you can consider scheduling your jobs to not overlap so that the performance is not affected or accept that the parallel read/write tasks will be slow."
The suggestion to reschedule jobs is due to having 3 backups to the Exablox and subsequent back to tape jobs immediately starting after the backup to disk is finished. I did have plans to move more backups jobs to the Exablox but for obviously reasons have put this on indefinite hold unless a solution for the performance can be found.
dellock6
Veeam Software
Posts: 6137
Liked: 1928 times
Joined: Jul 26, 2009 3:39 pm
Full Name: Luca Dell'Oca
Location: Varese, Italy
Contact:

Re: Veeam / Exablox / CIFS Compatibility

Post by dellock6 »

I think that, regardless the technology that Exablox is using, the underlying storage system has a finite IOPS limit, and if you use SMB/CIFS, the gateway server has to write to the array to complete the backup, and then also read from it to do the backup to tape. The concurrency of the two operations seems to be the root cause, but I'm not sure how a chance in Veeam software can change the IO consumption done by two concurrent activities.
Luca Dell'Oca
Principal EMEA Cloud Architect @ Veeam Software

@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2022
Veeam VMCE #1
Uglybob
Influencer
Posts: 15
Liked: 1 time
Joined: Sep 15, 2015 6:25 am
Contact:

Re: Veeam / Exablox / CIFS Compatibility

Post by Uglybob »

Hi Luca,

Thanks for the response. You are right, there are only so many IOPS the device can do but internal testing shows the device is definitely capable of more. We just dont know of its the CIFS protocol itself causing it or how Veeam or Exablox uses that protocol.

We are expecting a drop in performance but just not THAT much.
dellock6
Veeam Software
Posts: 6137
Liked: 1928 times
Joined: Jul 26, 2009 3:39 pm
Full Name: Luca Dell'Oca
Location: Varese, Italy
Contact:

Re: Veeam / Exablox / CIFS Compatibility

Post by dellock6 »

I read above in the quoted text that Exablox can also expose a share via NFS, maybe it's worth a test with this protocol and a Veeam Linux repository instead of a Windows one? In theory NFS is a most efficient protocol, and being probably Exablox based on linux itself, the NFS implementation is better. I'm not saying that SMB is not well done in this machine, but usually those SMB shares are designed to share files, not to receive large amount of IO like a backup operation.
Luca Dell'Oca
Principal EMEA Cloud Architect @ Veeam Software

@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2022
Veeam VMCE #1
Post Reply

Who is online

Users browsing this forum: No registered users and 194 guests