Discussions related to using object storage as a backup target.
Post Reply
wane
Enthusiast
Posts: 39
Liked: 5 times
Joined: Jun 26, 2020 9:47 pm
Full Name: Walter Neu
Contact:

S3 Offloading or Backup Copies - which is faster?

Post by wane »

Hello,
We have the requirement to backup the write-ahead logs of about 100 database servers using VeeamAgent for Linux.The logs themselves are written to a directory on the respective systems.
The Veam Agent job then backs up these files every 30 minutes from directories or mount points or partitions. The Veeam Agent Job is successfully and backed up regularly within a backup job and in less than 30 minutes.
The second challenge, writing copies (immediate copy) to a remote location, often fails and we also have no synchronous data between backup and copies because the copy job takes longer than a backup job, e.g. more than 30 minutes.

We are now considering whether we are faster and more performant with a capacity tier and "copy backups to object storage as sonn as they are created" than with backup copies.

Hence the question of whether it is possible to make a general statement as to whether S3 offloading is faster than backup copies.

By the way: both repositories (backup and backup copies) are All Flash systems.
veremin
Product Manager
Posts: 20284
Liked: 2258 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: S3 Offloading or Backup Copies - which is faster?

Post by veremin »

Hence the question of whether it is possible to make a general statement as to whether S3 offloading is faster than backup copies.
No. It primarily depends on the speed of your Internet connection and the speed of network connection to the remote location. Thanks!
Andreas Neufert
VP, Product Management
Posts: 6748
Liked: 1408 times
Joined: May 04, 2011 8:36 am
Full Name: Andreas Neufert
Location: Germany
Contact:

Re: S3 Offloading or Backup Copies - which is faster?

Post by Andreas Neufert »

What does the current backup copy job show as bottleneck?
wane
Enthusiast
Posts: 39
Liked: 5 times
Joined: Jun 26, 2020 9:47 pm
Full Name: Walter Neu
Contact:

Re: S3 Offloading or Backup Copies - which is faster?

Post by wane »

In this case a backup copy job doesn't show the bottleneck in the statistic window as a backup job does..Maybe because of using Veam Agent, I don't know...
wane
Enthusiast
Posts: 39
Liked: 5 times
Joined: Jun 26, 2020 9:47 pm
Full Name: Walter Neu
Contact:

Re: S3 Offloading or Backup Copies - which is faster?

Post by wane »

veremin wrote: Nov 09, 2021 2:00 pm No. It primarily depends on the speed of your Internet connection and the speed of network connection to the remote location. Thanks!
Our remote site is connected via dark fiber at 40g. I definitely exclude the connection as bottleneck...
Gostev
Chief Product Officer
Posts: 31559
Liked: 6724 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: S3 Offloading or Backup Copies - which is faster?

Post by Gostev »

Then something else is a bottleneck... our support should be able to tell from performance debug logs.

In general, I would expect S3 offloading to be at least a few times slower than Backup Copy in your environment.
wane
Enthusiast
Posts: 39
Liked: 5 times
Joined: Jun 26, 2020 9:47 pm
Full Name: Walter Neu
Contact:

Re: S3 Offloading or Backup Copies - which is faster?

Post by wane » 1 person likes this post

I will open a support ticket and post the result...
wane
Enthusiast
Posts: 39
Liked: 5 times
Joined: Jun 26, 2020 9:47 pm
Full Name: Walter Neu
Contact:

Re: S3 Offloading or Backup Copies - which is faster?

Post by wane » 2 people like this post

We may have found the solution. It was the vCPU configuration. We had 2 cores per 7 sockets. The MS SQL database could not deal with this. We switched to 14 cores and 1 socket, and now everything runs perfectly.
There are restrictions for the MS SQL standard at this point.
Post Reply

Who is online

Users browsing this forum: No registered users and 18 guests