-
- Enthusiast
- Posts: 33
- Liked: 4 times
- Joined: Nov 29, 2018 1:18 am
- Full Name: Kevin Pare
- Contact:
Ubuntu move data?
Long story, but i'm looking for a good idea to move data from one mount to another, both xfs.
Ive tried rsync and rclone on ubuntu, but neither come close to saturating a 1gb link let alone 10gb. both storage servers are very fast. so hopefully someone has a better idea?
Ive tried rsync and rclone on ubuntu, but neither come close to saturating a 1gb link let alone 10gb. both storage servers are very fast. so hopefully someone has a better idea?
-
- Product Manager
- Posts: 14844
- Liked: 3086 times
- Joined: Sep 01, 2014 11:46 am
- Full Name: Hannes Kasparick
- Location: Austria
- Contact:
Re: Ubuntu move data?
Hello,
beside the speed... are you trying to preserve Veeam block cloning? Because then you need to have a tool that works on block level instead of file level.
dd is something I would try (tuning with block size).
Best regards,
Hannes
beside the speed... are you trying to preserve Veeam block cloning? Because then you need to have a tool that works on block level instead of file level.
dd is something I would try (tuning with block size).
Best regards,
Hannes
-
- Veteran
- Posts: 599
- Liked: 87 times
- Joined: Dec 20, 2015 6:24 pm
- Contact:
Re: Ubuntu move data?
If this is a xfs fs with reflinks and source and destination are identical in size, you could use xfs_copy. If they are different and you use reflinks there is no way to keep copy from a to b without dehydrating all data.kspare wrote: ↑Jul 15, 2021 7:23 pm Long story, but i'm looking for a good idea to move data from one mount to another, both xfs.
Ive tried rsync and rclone on ubuntu, but neither come close to saturating a 1gb link let alone 10gb. both storage servers are very fast. so hopefully someone has a better idea?
-
- Product Manager
- Posts: 14844
- Liked: 3086 times
- Joined: Sep 01, 2014 11:46 am
- Full Name: Hannes Kasparick
- Location: Austria
- Contact:
Re: Ubuntu move data?
thanks for xfs_copy, I'll have a look at that tool!
Note: for dd it's okay to copy to a larger volume. once finished, the filesystem can be extended to the volume size.
Note: for dd it's okay to copy to a larger volume. once finished, the filesystem can be extended to the volume size.
-
- Enthusiast
- Posts: 33
- Liked: 4 times
- Joined: Nov 29, 2018 1:18 am
- Full Name: Kevin Pare
- Contact:
Re: Ubuntu move data?
It would be xfs to xfs yes. Just trying to figure out how to optimize our storage better, we do periodic backup copy jobs and they are so slow. May jsut go back to windows repos..,dunno.
-
- Product Manager
- Posts: 14844
- Liked: 3086 times
- Joined: Sep 01, 2014 11:46 am
- Full Name: Hannes Kasparick
- Location: Austria
- Contact:
Re: Ubuntu move data?
looks like I misunderstood the intention of your post. I thought, we are talking about a one-time migration.we do periodic backup copy jobs and they are so slow.
With proper hardware, backup copy jobs do multiple GByte/s. 10Gbit/s network should be the bottleneck if everything was set up correctly. I assume that you have V11 and also enabled per-machine files.
If you say that every kind of copy is slow, then it seems that the environment is slow (independent from Veeam). I don't expect Windows to be faster than Linux in general.
Who is online
Users browsing this forum: Bing [Bot], Semrush [Bot] and 64 guests