-
- Service Provider
- Posts: 42
- Liked: 32 times
- Joined: Aug 07, 2017 11:51 am
- Full Name: William
- Location: Zurich, Switzerland
- Contact:
[Feature Request] Object Storage Migration (Migrate Bucket A to Bucket B)
We need a solution to migrate data between buckets.
Situation
• Object Storage is used for the backup job.
Challenge
• The bucket used by the backup job must be migrated to a new bucket.
Veeam has no way to migrate from object storage to another object storage. This is not supported by Veeam (https://www.veeam.com/kb3067). And it doesn’t work with a simple “copy from bucket a to bucket b”, because the IDs of the object change.
Feature request
• Build in solution, that allows to migrate VB365 backup data from object storage to another object storage.
• This should work for the primary backup job and a copy job.
• On a copy job it must work with object-lock enabled (if enabled on the source and destination bucket)
Examples
• Replace onprem storage (vendor A) with another vendor (B).
• Replace onprem storage (vendor A) with another version of the product / or new product that needs a new cluster (still vendor A, but now it is a new system)
• Migrate between cloud providers (from provider A to provider B)
Optional request: bulk deletion (without object-lock)
• Option to activate bulk deletion of the data in the old bucket after everything is migrated.
• Option to set how many objects should be deleted at the same time (100, 1000 etc.) to make sure the object storage can handle it.
• Of course this is only for buckets without object-lock
Situation
• Object Storage is used for the backup job.
Challenge
• The bucket used by the backup job must be migrated to a new bucket.
Veeam has no way to migrate from object storage to another object storage. This is not supported by Veeam (https://www.veeam.com/kb3067). And it doesn’t work with a simple “copy from bucket a to bucket b”, because the IDs of the object change.
Feature request
• Build in solution, that allows to migrate VB365 backup data from object storage to another object storage.
• This should work for the primary backup job and a copy job.
• On a copy job it must work with object-lock enabled (if enabled on the source and destination bucket)
Examples
• Replace onprem storage (vendor A) with another vendor (B).
• Replace onprem storage (vendor A) with another version of the product / or new product that needs a new cluster (still vendor A, but now it is a new system)
• Migrate between cloud providers (from provider A to provider B)
Optional request: bulk deletion (without object-lock)
• Option to activate bulk deletion of the data in the old bucket after everything is migrated.
• Option to set how many objects should be deleted at the same time (100, 1000 etc.) to make sure the object storage can handle it.
• Of course this is only for buckets without object-lock
-
- Influencer
- Posts: 12
- Liked: 1 time
- Joined: Mar 28, 2017 7:40 am
- Full Name: jwh
- Contact:
Re: [Feature Request] - Object Storage Migration (Migrate Bucket A to Bucket B)
can you not just use a tool to copy a full S3 bucket to a new bucket ?
or from the first main Veeam folder with all the repository data in there ? to a new S3 location.
JW Heins
or from the first main Veeam folder with all the repository data in there ? to a new S3 location.
JW Heins
-
- Service Provider
- Posts: 42
- Liked: 32 times
- Joined: Aug 07, 2017 11:51 am
- Full Name: William
- Location: Zurich, Switzerland
- Contact:
Re: [Feature Request] - Object Storage Migration (Migrate Bucket A to Bucket B)
@Heins: No, as described in the Feature request, Veeam uses the IDs of the objects (therefore it doesn't work to just copy objects, because the IDs will change).
-
- Chief Product Officer
- Posts: 31960
- Liked: 7436 times
- Joined: Jan 01, 2006 1:01 am
- Location: Baar, Switzerland
- Contact:
Re: [Feature Request] - Object Storage Migration (Migrate Bucket A to Bucket B)
Hmm, but why would a copying tool rename objects instead of just copying them?
-
- Service Provider
- Posts: 42
- Liked: 32 times
- Joined: Aug 07, 2017 11:51 am
- Full Name: William
- Location: Zurich, Switzerland
- Contact:
Re: [Feature Request] - Object Storage Migration (Migrate Bucket A to Bucket B)
@Anton:
I mixed up a few things from my VBR feature request - sorry
VB365: It looks like it VB365 uses "name" not "ID" for the backup job. This would make sense, because no version ID is used. My colleague crosschecked the logs from the object storage and confirms this.
Problem (why I opened the feature request): We tested the migration multiple times with a copy from a bucket A to a bucket B. Even from a Storage-1 "bucket-1" to a storage-B "bucket-1" to keep the bucket name the same. On the point where we synchronize the repository we have always the error "unrecognized Guid format". Therefore we expect, that Veeam has something hard-coded or is using something, that changes after the copy (initially I thought the ID like in VBR, but of course, that makes no sense if versioning is deactivated). Therefore I thought that this is a Veeam limitation.
Can you or someone from product management please clarify: Should a copy with a 3rd party tool (s3cmd, cyberduck etc.) work for a bucket migration?
- if yes: I will open a veeam case and edit the feature request
- if no: I will change the background information on the feature request
sorry for the confusion and thanks in advance for your inputs
I mixed up a few things from my VBR feature request - sorry

VB365: It looks like it VB365 uses "name" not "ID" for the backup job. This would make sense, because no version ID is used. My colleague crosschecked the logs from the object storage and confirms this.
Problem (why I opened the feature request): We tested the migration multiple times with a copy from a bucket A to a bucket B. Even from a Storage-1 "bucket-1" to a storage-B "bucket-1" to keep the bucket name the same. On the point where we synchronize the repository we have always the error "unrecognized Guid format". Therefore we expect, that Veeam has something hard-coded or is using something, that changes after the copy (initially I thought the ID like in VBR, but of course, that makes no sense if versioning is deactivated). Therefore I thought that this is a Veeam limitation.
Can you or someone from product management please clarify: Should a copy with a 3rd party tool (s3cmd, cyberduck etc.) work for a bucket migration?
- if yes: I will open a veeam case and edit the feature request
- if no: I will change the background information on the feature request
sorry for the confusion and thanks in advance for your inputs

-
- Veeam Software
- Posts: 3270
- Liked: 791 times
- Joined: Oct 21, 2011 11:22 am
- Full Name: Polina Vasileva
- Contact:
Re: [Feature Request] - Object Storage Migration (Migrate Bucket A to Bucket B)
Hi William,
We're currently looking into some of the possible cross-bucket migration scenarios, however, at the moment officially there's no supported/reliable way of doing it. In some cases, we see that the repository structure was changed after the migration which breaks the compatibility.
We're currently looking into some of the possible cross-bucket migration scenarios, however, at the moment officially there's no supported/reliable way of doing it. In some cases, we see that the repository structure was changed after the migration which breaks the compatibility.
-
- Service Provider
- Posts: 42
- Liked: 32 times
- Joined: Aug 07, 2017 11:51 am
- Full Name: William
- Location: Zurich, Switzerland
- Contact:
Re: [Feature Request] - Object Storage Migration (Migrate Bucket A to Bucket B)
@Polina: Thank you very much for your reply.
Does this mean, that in general it should work? No limitation if the bucket is named differently (new bucket) as long as the structure is the same?
This information would already help a lot
Does this mean, that in general it should work? No limitation if the bucket is named differently (new bucket) as long as the structure is the same?
This information would already help a lot

-
- Veeam Software
- Posts: 3270
- Liked: 791 times
- Joined: Oct 21, 2011 11:22 am
- Full Name: Polina Vasileva
- Contact:
Re: [Feature Request] - Object Storage Migration (Migrate Bucket A to Bucket B)
The bucket name doesn't matter, but the entire structure with all objects and their properties must be identical to the initial repository.
If you want to run any migration tests, note that it's safer to remove the repository from the VB365 console before starting any copy/migration to a new bucket.
If you want to run any migration tests, note that it's safer to remove the repository from the VB365 console before starting any copy/migration to a new bucket.
-
- Service Provider
- Posts: 42
- Liked: 32 times
- Joined: Aug 07, 2017 11:51 am
- Full Name: William
- Location: Zurich, Switzerland
- Contact:
Re: [Feature Request] - Object Storage Migration (Migrate Bucket A to Bucket B)
@Polina: Thank you for the reply and your input. I will try a new migration next week with different tools.
-
- Service Provider
- Posts: 64
- Liked: 8 times
- Joined: Oct 15, 2019 7:51 am
- Contact:
Re: [Feature Request] - Object Storage Migration (Migrate Bucket A to Bucket B)
+1
A customer stores over 600 tb in an Azure storage account and would like to migrate to Wasabi due to a massive cost reduction.
And we had several customer scenarios where aging out the data was the only way, but this results in higher costs as well.
Thanks in advance,
Christian
A customer stores over 600 tb in an Azure storage account and would like to migrate to Wasabi due to a massive cost reduction.
And we had several customer scenarios where aging out the data was the only way, but this results in higher costs as well.
Thanks in advance,
Christian
-
- Lurker
- Posts: 2
- Liked: never
- Joined: Sep 06, 2017 4:40 am
- Full Name: Chris Hanson
- Contact:
Re: [Feature Request] - Object Storage Migration (Migrate Bucket A to Bucket B)
+1
This should be a supported feature given Veeams stance on mobility. Businesses need to be able to choose a storage provider without being locked in.
This should be a supported feature given Veeams stance on mobility. Businesses need to be able to choose a storage provider without being locked in.
-
- Service Provider
- Posts: 248
- Liked: 44 times
- Joined: Jun 10, 2019 12:19 pm
- Full Name: Daniel Johansson
- Contact:
Re: [Feature Request] - Object Storage Migration (Migrate Bucket A to Bucket B)
+1. Obvious and required functionality.
-
- Service Provider
- Posts: 9
- Liked: 5 times
- Joined: Jun 27, 2022 3:26 pm
- Full Name: Florian Klein
- Contact:
Re: [Feature Request] - Object Storage Migration (Migrate Bucket A to Bucket B)
+1. (At least moving from one S3 to another S3)
-
- Veteran
- Posts: 293
- Liked: 25 times
- Joined: Mar 23, 2015 8:30 am
- Contact:
Re: [Feature Request] - Object Storage Migration (Migrate Bucket A to Bucket B)
+1 (copy from S3 bucket to another S3 bucket)
-
- Service Provider
- Posts: 176
- Liked: 53 times
- Joined: Mar 11, 2016 7:41 pm
- Full Name: Cory Wallace
- Contact:
Re: [Feature Request] - Object Storage Migration (Migrate Bucket A to Bucket B)
+1 - We have our VBR bucket and VBMS365 buckets in one Wasabi tenant. I am in a situation where we have (don't ask) "accidental long-term object locking" for years on a VBR bucket. We essentially have to delete our entire account and start fresh since the buckets can't be deleted due to immutability (by design). Since we can't migrate our MS365 data cleanly to another bucket in another account, we have to re-upload from scratch to a new account and let the old one age out which is very expensive for us.
-
- Service Provider
- Posts: 3
- Liked: never
- Joined: Oct 04, 2023 2:01 pm
- Contact:
Re: [Feature Request] - Object Storage Migration (Migrate Bucket A to Bucket B)
Was any solution\workaround found for this?
-
- Product Manager
- Posts: 10083
- Liked: 2679 times
- Joined: May 13, 2017 4:51 pm
- Full Name: Fabian K.
- Location: Switzerland
- Contact:
Re: [Feature Request] - Object Storage Migration (Migrate Bucket A to Bucket B)
Hi Micha
Welcome to the forum.
It's still not supported to migrate data to another object storage.
Could you please describe your own use case to us why you need to migrate data?
Best,
Fabian
Welcome to the forum.
It's still not supported to migrate data to another object storage.
Could you please describe your own use case to us why you need to migrate data?
Best,
Fabian
Product Management Analyst @ Veeam Software
-
- Service Provider
- Posts: 3
- Liked: never
- Joined: Oct 04, 2023 2:01 pm
- Contact:
Re: [Feature Request] - Object Storage Migration (Migrate Bucket A to Bucket B)
Hello Fabian,
Thank you, let me clarify,
We have a S3 Compatible bucket on our own on-prem storage with a multiple Object Storage repositories, this storage and bucket is at full capacity and cannot be extended at all. We have another S3 Compatible bucket on a different free storage and would like to move some of the Object Storage repositories there without losing any historical backups.
Thank you, let me clarify,
We have a S3 Compatible bucket on our own on-prem storage with a multiple Object Storage repositories, this storage and bucket is at full capacity and cannot be extended at all. We have another S3 Compatible bucket on a different free storage and would like to move some of the Object Storage repositories there without losing any historical backups.
-
- Service Provider
- Posts: 47
- Liked: 16 times
- Joined: Sep 09, 2022 12:22 pm
- Full Name: Bjoern
- Location: Zurich
- Contact:
Re: [Feature Request] - Object Storage Migration (Migrate Bucket A to Bucket B)
Hi,
some time ago (when there was no immutability yet) we tested an exit strategy for our buckets.
Migrating Azure Blobs to Wasabi S3 worked totally fine. We used flexify.io for this. Jobs ran successful afterwards again and restore of all data was also successful. Did not notice any issues.
Best regards,
Bjoern
some time ago (when there was no immutability yet) we tested an exit strategy for our buckets.
Migrating Azure Blobs to Wasabi S3 worked totally fine. We used flexify.io for this. Jobs ran successful afterwards again and restore of all data was also successful. Did not notice any issues.
Best regards,
Bjoern
-
- Service Provider
- Posts: 125
- Liked: 31 times
- Joined: Jan 04, 2018 4:51 pm
- Contact:
Re: [Feature Request] - Object Storage Migration (Migrate Bucket A to Bucket B)
We're interested in this too to move between providers for better compatibility and to get rid of versioning warnings on all our backup jobs in VBO.
We need to move the data that has multi-year retention and don't want to be paying for storage twice for those years.
What tools have people used successfully to move between providers? (I can see flexify.io from above post) I've seen that can't just download/upload the data using s3cmd and the like.
We need to move the data that has multi-year retention and don't want to be paying for storage twice for those years.
What tools have people used successfully to move between providers? (I can see flexify.io from above post) I've seen that can't just download/upload the data using s3cmd and the like.
-
- Veteran
- Posts: 293
- Liked: 25 times
- Joined: Mar 23, 2015 8:30 am
- Contact:
Re: [Feature Request] - Object Storage Migration (Migrate Bucket A to Bucket B)
Is an official veeam solution planned for the migration of backupdata from one bucket to another bucket in the future?
-
- Veeam Software
- Posts: 3270
- Liked: 791 times
- Joined: Oct 21, 2011 11:22 am
- Full Name: Polina Vasileva
- Contact:
Re: [Feature Request] - Object Storage Migration (Migrate Bucket A to Bucket B)
It is planned, and we are already building some parts of it. It's not coming in our next release, but hopefully in the foreseeable future.
-
- Veteran
- Posts: 293
- Liked: 25 times
- Joined: Mar 23, 2015 8:30 am
- Contact:
Re: [Feature Request] - Object Storage Migration (Migrate Bucket A to Bucket B)
ok, thanks for the information
-
- Novice
- Posts: 4
- Liked: 1 time
- Joined: Oct 03, 2017 1:52 pm
- Full Name: Andrew
- Contact:
Re: [Feature Request] Object Storage Migration (Migrate Bucket A to Bucket B)
+1 here. being able to migrate from one provider to another would be highly beneficial. We started with an on-prem proof of concept and then moved online and we lost that data. In the future, it would be really helpful to be able to migrate and maintain all our restore points.
-
- Service Provider
- Posts: 74
- Liked: 11 times
- Joined: Jan 02, 2024 9:13 am
- Full Name: Pat
- Contact:
Re: [Feature Request] Object Storage Migration (Migrate Bucket A to Bucket B)
I'm in the same boat right now, trying to find a way to achieve this.
Big +1 for this feature from me.
Big +1 for this feature from me.
-
- Service Provider
- Posts: 311
- Liked: 47 times
- Joined: Jun 30, 2015 9:13 am
- Full Name: Stephan Lang
- Location: Austria
- Contact:
Re: [Feature Request] Object Storage Migration (Migrate Bucket A to Bucket B)
i used S3 Browser (licensed, for unlocking the concurrent item limits) to copy everything from one bucket to another... on the same S3 Storage, but i guess that shouldn matter?
still this would be an "offline" process, so while the copy/move job is running no backups can run... propably not feasible for more then ah few TB of data...
there is ah KB from Veeam, you've to delete ah locking file (but you know this i'm sure, because else it would be some message about the repo is allready connected or something like this...)
but afterwards i was able to add the new bucket and the rescan worked without issues!
my goal was to simply rename the buckets btw...
still this would be an "offline" process, so while the copy/move job is running no backups can run... propably not feasible for more then ah few TB of data...
there is ah KB from Veeam, you've to delete ah locking file (but you know this i'm sure, because else it would be some message about the repo is allready connected or something like this...)
but afterwards i was able to add the new bucket and the rescan worked without issues!
my goal was to simply rename the buckets btw...
Who is online
Users browsing this forum: No registered users and 22 guests