Testing Veeam B&R v8 and I want to archive data to Amazon s3

Availability for the Always-On Enterprise

Re: Testing Veeam B&R v8 and I want to archive data to Amazo

Veeam Logoby Tomsyr » Wed Nov 19, 2014 11:00 am

A few questions about using AWS S3...
I understand that doing a full recovery of a server isn't practical, but the way I understand it, we should be able to do a file or directory level recovery by running Veeam B&R on an instance in our VPC, and make it available there, or download it to a local resource.
If our goal is off-site storage in the event of a disaster, our main risk is the restore of ALL the data, but AWS would give us the Off-Site protection, and access to critical files immediately...
I saw a comment about data loss on AWS - They state 11 9's of availability. Can you provide a link that shows where users lost data on AWS?
Regarding the comment about picking up the phone for a restore, we're using a MSP for our AWS resources and paying for Amazon support. So far they have been very responsive for other needs (GovCloud is a PITA ;)).

Currently, the AWS gateway appliance is not available to my sites since we have our VPC/S3 in GovCloud. If we were to use V8, wouldn't all the benefits of WAN optimization be addressed anyway?

Lastly - are you aware of any CloudConnect partners that are capable of managing ITAR related data - this basically means that only USA citizens can access our data, which includes the hardware and software that runs the systems.
We are currently evaluating how we are going to store our data off-site, and we HATE tapes and USB drives.

Thanks in advance!
Tom
Tomsyr
Influencer
 
Posts: 22
Liked: never
Joined: Tue Jul 01, 2014 3:39 pm
Full Name: Tom Conklin

Re: Testing Veeam B&R v8 and I want to archive data to Amazo

Veeam Logoby tsightler » Wed Nov 19, 2014 6:44 pm

Tomsyr wrote:I saw a comment about data loss on AWS - They state 11 9's of availability. Can you provide a link that shows where users lost data on AWS?


I believe they actually claim 99.99% availbility for their S3 data storage service (object storage), and 11 9's of "durability". While this may technically be accurate, it can be somewhat misleading as they are referring to the inability to recovery any given object. But if you have a 1TB backup file, that's not going to be stored as 1 object, instead it will be broken down into many smaller objects based on the exact technology you use to push it there. Assuming you use something like Cloudberry this will likely be 10MB "chunks". Which means that a single 1TB backup could easily be 100,000 objects. The risk is that the loss of even one of those chunks could render the entire 1TB backup useless, unlike if your storing a bunch of images, or videos, where the loss of one object is the loss of one picture or Vine.

I'm not saying that 11 9's of durability is bad or anything though, it's probably as high as any other storage medium out there, but just wanted to clarify some of the concepts.

Also to be clear, Veeam doesn't natively use any object storage, although you can potentially use 3rd party option to push Veeam backups to S3 or other object storage. However, if you run a Veeam repository in Amazon you'll need to use EBS storage. It's availability and durability guarantees are different from S3, as are it's pricing. And there have been documented instances of data loss for EBS, by far the largest back in 2011 where, after 3 days of outages and days of recovery, Amazon eventually apologized and said not all data was recoverable. In some cases people reported that they lost data in S3 as well, but that appears to be more of a case that they lost access to their S3 data because they were dependent on systems running in EC2 with EBS backed volumes and once those were offline the data in their S3 buckets wasn't really useful. In some cases Amazon specifically told customers to restore from their own backups. It's pretty easy to Google it up, but here are a few links about that incident.

http://www.bizjournals.com/seattle/blog ... l?page=all
http://www.quora.com/Has-Amazon-S3-ever ... ermanently

Note that I'm not intending to say anything negative about Amazon services. They have proven to be robust and reliable but, like anything built by humans, they can fail, and you have to compare not just the costs, but also the potential risk associated with using them. It's really no different than any other utility.
tsightler
Veeam Software
 
Posts: 4769
Liked: 1738 times
Joined: Fri Jun 05, 2009 12:57 pm
Full Name: Tom Sightler

Re: Testing Veeam B&R v8 and I want to archive data to Amazo

Veeam Logoby Gostev » Wed Nov 19, 2014 7:07 pm

Tomsyr wrote:Lastly - are you aware of any CloudConnect partners that are capable of managing ITAR related data - this basically means that only USA citizens can access our data, which includes the hardware and software that runs the systems.

Hi, Tom. I have asked our VCP team to reach out to our current and upcoming US-based Cloud Connect providers and ask this.
Gostev
Veeam Software
 
Posts: 21396
Liked: 2350 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Baar, Switzerland

Re: Testing Veeam B&R v8 and I want to archive data to Amazo

Veeam Logoby rick.johnson » Wed Nov 19, 2014 8:46 pm

Hi Tom,

I've provided a link below to our Veeam Cloud Connect partner look-up, the feedback i got from ODS (OffsiteDataSync), Cirrity and NewCloud Network is that they in fact familiar with ITAR and are compliant.

http://www.veeam.com/find-a-veeam-cloud-provider.html
rick.johnson
Veeam Software
 
Posts: 1
Liked: never
Joined: Tue Nov 04, 2014 4:11 pm
Full Name: Rick Johnson

Re: Testing Veeam B&R v8 and I want to archive data to Amazo

Veeam Logoby mchesterton » Wed Nov 19, 2014 10:44 pm 1 person likes this post

Hi Tom,

We (OffsiteDataSync) meet the needs and provide service to organizations and entities with ITAR compliance constraints. I'd be happy to discuss this further if / when you are ready.
mchesterton
Service Provider
 
Posts: 2
Liked: 1 time
Joined: Tue Oct 28, 2014 5:09 pm
Full Name: Matthew Chesterton

Re: Testing Veeam B&R v8 and I want to archive data to Amazo

Veeam Logoby Tomsyr » Mon Nov 24, 2014 1:38 pm

Thank you all for your replies!
Tom
Tomsyr
Influencer
 
Posts: 22
Liked: never
Joined: Tue Jul 01, 2014 3:39 pm
Full Name: Tom Conklin

Re: Testing Veeam B&R v8 and I want to archive data to Amazo

Veeam Logoby AntonZ » Thu Dec 04, 2014 4:41 am

Hi guys!
The question to Veeam team and to service providers.
Currently I have 80TBs of backups. My full compressed backup is 5TBs. I need to store everything which is older than 2 months in cloud. So let's count. I will round. My best case scenario is to use Amazon Glaciar - 1 cent per 1gb => $1000 per 100TB of data. My worst case scenario is to use Amazon S3 - 3 cents per 1gb => $3000 per 100TB of data. These numbers work for me.
Now Veeam tells me "you know, you don't need Amazon, you can use any other service provider, let's say, OffsiteDataSync, and pay 16 cents per GB, which is 16(!) or 4 times more expensive for me + you will have an obvious limit of 64TB.
So what are my options with cloud?
AntonZ
Influencer
 
Posts: 13
Liked: never
Joined: Thu Dec 04, 2014 4:22 am
Full Name: Anton

Re: Testing Veeam B&R v8 and I want to archive data to Amazo

Veeam Logoby v.Eremin » Thu Dec 04, 2014 9:43 am

Hi, Anton, kindly, check the adjacent thread talking about similar issue. We've outlined there major benefits of using Cloud Connect against utilization of cheap online storage; should clarify situation for you.

Also, have you tried to estimate the price of restoring 5TB from Amazon Glacier, as well as, the time required for it?

Thanks.
v.Eremin
Veeam Software
 
Posts: 13290
Liked: 971 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

Re: Testing Veeam B&R v8 and I want to archive data to Amazo

Veeam Logoby AntonZ » Thu Dec 04, 2014 12:54 pm

Hi, this is simple. I have a lot of data, which I'll touch only in the case of audit. One week for recovery is fine for me. Also I'm not ready to pay 16 times more for a quicker restore.
I have to store weekly backups for a year, monthly backups for a year, yearly backups for 7 years. Every backup is full...
AntonZ
Influencer
 
Posts: 13
Liked: never
Joined: Thu Dec 04, 2014 4:22 am
Full Name: Anton

Re: Testing Veeam B&R v8 and I want to archive data to Amazo

Veeam Logoby Gostev » Sat Dec 06, 2014 11:20 pm

AntonZ wrote:Also I'm not ready to pay 16 times more for a quicker restore.

Then just pick a different provider, who does not charge you 16 times more? Regular purchasing considerations still apply - look for the best value for the money you can spend.

AntonZ wrote:Now Veeam tells me "you know, you don't need Amazon, you can use any other service provider, let's say, OffsiteDataSync, and pay 16 cents per GB, which is 16(!) or 4 times more expensive for me + you will have an obvious limit of 64TB.

Veeam does not recommend specific service providers, it is completely up to you who to choose. And you should certainly pick the one that works best for you based on your requirements, including price. As I have already demonstrated in the above-linked topic using a specific example - even today, the prices may vary 10 times between two Cloud Connect service providers. Also, consider that v8 has been launched less than a month ago, meaning there is still little to no provider competition out there (very few Cloud Connect service providers are available to choose from). We have hundreds more already signed up and coming in the next few months.

AntonZ wrote:So what are my options with cloud?

Well, we give you all the possible options, really. If you like Amazon prices, and don't care about fast backups and restores - we do support backup to Amazon via VTL Gateway, as already mention on the previous page. Just be sure you fully understand recovery time and especially recovery costs with Amazon cloud storage (unlike backup, getting your data out of Amazon can be extremely expensive).
Gostev
Veeam Software
 
Posts: 21396
Liked: 2350 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Baar, Switzerland

[MERGED] : Anyone using AmazonStorageGateway and S3?

Veeam Logoby tinto1970 » Wed Mar 11, 2015 3:24 pm

Hi all,

we are evaluating the chance to put a copy, or whole our backup files on Amazon web services.

Using Veeam Backup copy seems the more obvious, but I'm worried about performances, because the .vbk will be rewritten i.e. daily

Using S3 as primary backup target would allow me to use a "classic" full+differential backup policy, without activating the 'synthetic full' creation.

Is there anyone who could share his experience with similar utilization of AWS S3? Any suggestion or comment will be appreciated.
Thanks in advance.
Alessandro Tinivelli aka Tinto
@tinto1970
tinto1970
Enthusiast
 
Posts: 69
Liked: 25 times
Joined: Thu Sep 26, 2013 8:40 am
Location: Bologna, Italy
Full Name: Alessandro Tinivelli

Re: Testing Veeam B&R v8 and I want to archive data to Amazo

Veeam Logoby v.Eremin » Wed Mar 11, 2015 3:40 pm

Hi, Alessandro,

Some considerations are provided above, so, please, take a look.

Speaking about copying data offsite, haven't you thought about usage of backup copy job pointed to Cloud Provider of your choice?

Thanks.
v.Eremin
Veeam Software
 
Posts: 13290
Liked: 971 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

[MERGED] : S3 repository

Veeam Logoby abelliniSIBA » Wed May 13, 2015 3:04 pm

Hi all,
I have a local Veeam server (win2k8r2) + Wan Accelerator Local (win 2k8r2) + Wan Accelerator Target on AWS (EC2 instance win2012) and we need to store data on S3 (as repo, mounted as local disk)
on the forum, i found that topic. post100360.html?hilit=aws%20s3%20WAN%20accelerator#p100360
where Luca says ".. In order to save on price of EBS disk for example, you can create a VM with a small disk and attach an S3 bucket as slave disk to that VM."
About that,
Can i ask you if we can use this repository as Veeam Repository?
If so, have you some guide/info to be sure Veeam can contact this repository? (now i'm using a third-parties software to mount S3 bucket as local drive)
With this architecture i have a message from Veeam, for my test task, "can't contact target Repository"
Thanks all for your help
Regards

Alessandro
abelliniSIBA
Novice
 
Posts: 9
Liked: 5 times
Joined: Wed Nov 19, 2014 2:01 pm
Full Name: Alessandro Bellini

Re: Testing Veeam B&R v8 and I want to archive data to Amazo

Veeam Logoby v.Eremin » Wed May 13, 2015 6:15 pm

Your post has been merged into existing topic discussing similar matter. Kindly, take a look at the answers provided, and ask for any assistance, should it be needed.
v.Eremin
Veeam Software
 
Posts: 13290
Liked: 971 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

Re: Testing Veeam B&R v8 and I want to archive data to Amazo

Veeam Logoby abelliniSIBA » Fri May 15, 2015 5:17 pm

v.Eremin wrote:Your post has been merged into existing topic discussing similar matter. Kindly, take a look at the answers provided, and ask for any assistance, should it be needed.


Thanks for your help.
Anyway, can you confirm me that the only way to export backup/restore to/from cloud, having deduplication and compression feature, is to use cloud providers?
Thanks in advance for your help
abelliniSIBA
Novice
 
Posts: 9
Liked: 5 times
Joined: Wed Nov 19, 2014 2:01 pm
Full Name: Alessandro Bellini

PreviousNext

Return to Veeam Backup & Replication



Who is online

Users browsing this forum: adalberto.blanco, Bing [Bot], Google [Bot], reportsrl and 70 guests