Comprehensive data protection for all workloads
Post Reply
kspare
Enthusiast
Posts: 33
Liked: 4 times
Joined: Nov 29, 2018 1:18 am
Full Name: Kevin Pare
Contact:

Ubuntu move data?

Post by kspare »

Long story, but i'm looking for a good idea to move data from one mount to another, both xfs.

Ive tried rsync and rclone on ubuntu, but neither come close to saturating a 1gb link let alone 10gb. both storage servers are very fast. so hopefully someone has a better idea?
HannesK
Product Manager
Posts: 14844
Liked: 3086 times
Joined: Sep 01, 2014 11:46 am
Full Name: Hannes Kasparick
Location: Austria
Contact:

Re: Ubuntu move data?

Post by HannesK »

Hello,
beside the speed... are you trying to preserve Veeam block cloning? Because then you need to have a tool that works on block level instead of file level.

dd is something I would try (tuning with block size).

Best regards,
Hannes
pirx
Veteran
Posts: 599
Liked: 87 times
Joined: Dec 20, 2015 6:24 pm
Contact:

Re: Ubuntu move data?

Post by pirx »

kspare wrote: Jul 15, 2021 7:23 pm Long story, but i'm looking for a good idea to move data from one mount to another, both xfs.

Ive tried rsync and rclone on ubuntu, but neither come close to saturating a 1gb link let alone 10gb. both storage servers are very fast. so hopefully someone has a better idea?
If this is a xfs fs with reflinks and source and destination are identical in size, you could use xfs_copy. If they are different and you use reflinks there is no way to keep copy from a to b without dehydrating all data.
HannesK
Product Manager
Posts: 14844
Liked: 3086 times
Joined: Sep 01, 2014 11:46 am
Full Name: Hannes Kasparick
Location: Austria
Contact:

Re: Ubuntu move data?

Post by HannesK »

thanks for xfs_copy, I'll have a look at that tool!

Note: for dd it's okay to copy to a larger volume. once finished, the filesystem can be extended to the volume size.
kspare
Enthusiast
Posts: 33
Liked: 4 times
Joined: Nov 29, 2018 1:18 am
Full Name: Kevin Pare
Contact:

Re: Ubuntu move data?

Post by kspare »

It would be xfs to xfs yes. Just trying to figure out how to optimize our storage better, we do periodic backup copy jobs and they are so slow. May jsut go back to windows repos..,dunno.
HannesK
Product Manager
Posts: 14844
Liked: 3086 times
Joined: Sep 01, 2014 11:46 am
Full Name: Hannes Kasparick
Location: Austria
Contact:

Re: Ubuntu move data?

Post by HannesK »

we do periodic backup copy jobs and they are so slow.
looks like I misunderstood the intention of your post. I thought, we are talking about a one-time migration.

With proper hardware, backup copy jobs do multiple GByte/s. 10Gbit/s network should be the bottleneck if everything was set up correctly. I assume that you have V11 and also enabled per-machine files.

If you say that every kind of copy is slow, then it seems that the environment is slow (independent from Veeam). I don't expect Windows to be faster than Linux in general.
Post Reply

Who is online

Users browsing this forum: Bing [Bot], Semrush [Bot] and 64 guests