Discussions specific to object storage
Post Reply
dashbrook
Lurker
Posts: 2
Liked: never
Joined: Sep 05, 2019 2:47 pm
Full Name: Dean Ashbrook
Contact:

S3 transfer acceleration process

Post by dashbrook » Oct 10, 2019 4:11 pm

Is there a way to use the Amazon AWS S3 transfer acceleration feature for offloading backups that meet the criteria defined within a scale out repository? I am trying to find a way to increase the transfer speed which is currently taking days to complete. Obviously we could increase our Internet bandwidth to help but I am looking for other options also.

HannesK
Veeam Software
Posts: 4257
Liked: 523 times
Joined: Sep 01, 2014 11:46 am
Location: Austria
Contact:

Re: S3 transfer acceleration process

Post by HannesK » Oct 10, 2019 4:45 pm

Hello,
and welcome to the forums.

If you are talking about snowball: that box does not work. So for Amazon I don't see a "magic" way.

Microsoft has a Databox which is compatible to Azure blob. That means there is a way to send disks to Microsoft, if that's an alternative for you.

Best regards,
Hannes

veremin
Product Manager
Posts: 17021
Liked: 1462 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: S3 transfer acceleration process

Post by veremin » Oct 10, 2019 4:48 pm 1 person likes this post

We haven't tested it, but it's unlikely to work due to requirements mentioned here. And to be honest you won't find a better way to increase offload speed than increasing internet bandwidth. Thanks!

dashbrook
Lurker
Posts: 2
Liked: never
Joined: Sep 05, 2019 2:47 pm
Full Name: Dean Ashbrook
Contact:

Re: S3 transfer acceleration process

Post by dashbrook » Oct 10, 2019 5:29 pm

No, I am asking about the "Transfer Acceleration" setting in the AWS console for a particular bucket. It looks like you have to supply specific DNS names when accessing the bucket to use the feature.

veremin
Product Manager
Posts: 17021
Liked: 1462 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: S3 transfer acceleration process

Post by veremin » Oct 13, 2019 2:42 pm

This and the fact that it seems to work only over IPv6 make me think, it's unlikely to work. Thanks!

Gostev
SVP, Product Management
Posts: 24984
Liked: 3629 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: S3 transfer acceleration process

Post by Gostev » Oct 13, 2019 11:34 pm 1 person likes this post

Actually, I could not find where it says it works ONLY over IPv6?

NiX
Veeam Software
Posts: 29
Liked: 25 times
Joined: Oct 01, 2015 4:53 pm
Full Name: Nicholas Serrecchia
Location: Long Beach, Ca.
Contact:

Re: S3 transfer acceleration process

Post by NiX » Oct 15, 2019 2:23 pm

"To access the bucket that is enabled for Transfer Acceleration, you must use the endpoint bucketname.s3-accelerate.amazonaws.com. or the dual-stack endpoint bucketname.s3-accelerate.dualstack.amazonaws.com to connect to the enabled bucket over IPv6."

Dual-Stack uses both IPv4 and IPv6.

I also do not see anything that pins Transfer Acceleration to IPv6.

But if the customers bandwidth to the Transfer Acceleration endpoint (aka CloudFront) is sub par, I can not see how this can help transfer rates into S3.
Nicholas Serrecchia - Veeam
Solution Architect - Public Cloud - NA

Post Reply

Who is online

Users browsing this forum: No registered users and 2 guests