Comprehensive data protection for all workloads
Post Reply
iurbano
Lurker
Posts: 2
Liked: never
Joined: Jul 16, 2015 3:44 pm
Full Name: Israel Urbano
Contact:

Very slow File Copy backup

Post by iurbano »

Hello,

Case # 00970703

Setup:
1 host with hyperv with iscsi disks (sources) and usb disk (destiny).
Content to copy in iscsi disks:
28GB->19000 files
350GB->500000 files
46GB-> 93000 files

When we launch the file copy backup job,the transfer rate starts with 15-20MB/s. After a few seconds or in the first minute, the velocity decrease to KB/sec
Ive tested directly copying the files and the transfer rate is almost always above 10MB/s

The technical of the support case said me that the solution is a workaround, compress previously the files in one... 500GB every day?.

Is that a normal behavior?. Can Veeam copy multiples files normally?

Thanks,
iurbano
Shestakov
Veteran
Posts: 7328
Liked: 781 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: Very slow File Copy backup

Post by Shestakov »

Hello iurbano,
Generally file copy job works slower if there are lots of files, like in your case, that`s why support suggested to use archive file for the job.
I do understand it`s not convenient at all though. We constantly improve the copying mechanism, so I`d suggest to upgrade to the latest VBR version. Thanks!
iurbano
Lurker
Posts: 2
Liked: never
Joined: Jul 16, 2015 3:44 pm
Full Name: Israel Urbano
Contact:

Re: Very slow File Copy backup

Post by iurbano »

Thanks for the reply.

We have installed the last version.

With this velocity is impossible to complete a backup on time.

Copying with a typical copy of windows is faster.
With the feature backup tool of Windows is faster.

If Veeam Backup&Replication has a issue saving a lot of files with file copy backup tool, why dont explain it in the datasheet of the product?. I haven't read anything about this problem in the features of the product.

Thanks,
Iurbano
Shestakov
Veteran
Posts: 7328
Liked: 781 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: Very slow File Copy backup

Post by Shestakov »

Iurbano, I see your point, but even Windows as well as other products, will also work significantly slower if you copy 500 GB in 600 000+ files rather than one 500 GB file.
We understand the issue and will try to find ways to make the process faster. Thanks for the feedback!
caras
Influencer
Posts: 10
Liked: 2 times
Joined: Feb 05, 2015 9:56 am
Contact:

Re: Very slow File Copy backup

Post by caras » 1 person likes this post

I've the same problem like iurbano: the VEEAM file copy function needs 20 minutes until the first file is transferred. After a short performance peak the file transfer rate permanently sinks to 6 KB/s.
VEEAM 8.8.0.2030 @ Win7. File source is Win Server 2008, 1 GB/s network.

The VEEAM backup function at the same hardware runs with 50 MB/s instead.
Shestakov
Veteran
Posts: 7328
Liked: 781 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: Very slow File Copy backup

Post by Shestakov »

Hello,
Do you also copy huge number of small files?
Thanks!
aldanet
Novice
Posts: 3
Liked: never
Joined: Oct 12, 2015 1:36 pm
Full Name: JOSE DARIO ALVAREZ
Contact:

Re: Very slow File Copy backup Case ID # 00970703

Post by aldanet »

Case ID # 00970703

Good night:

I'm new to Veeam, and I'm very upset with his file copy feature.

I/m trying to backup 400GB data, 320K files between 2 VMs on the same Vmware server. Now after 34! hours, it has copied only 96GB. (24%). Robocopy takes about 4 hours to copy all files.

I convinced my customer to buy B&R in order to have a quick way to recover individual files from a backup, even old versions of them. Now I realize that he lost his money. (And perhaps I lost a customer!).

VM backup runs faster, but it seems that a full restore is needed to recover a single file. Am I right?

Thanks

Aldanet
foggy
Veeam Software
Posts: 21069
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Very slow File Copy backup

Post by foggy »

Jose, have you checked file-level recovery functionality in Veeam B&R?
Shestakov
Veteran
Posts: 7328
Liked: 781 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: Very slow File Copy backup

Post by Shestakov »

aldanet wrote:I/m trying to backup 400GB data, 320K files between 2 VMs on the same Vmware server. Now after 34! hours, it has copied only 96GB. (24%).
As stated above, File Copy works relatively slow when copying small files. Try to archive them to a single file.
aldanet wrote:VM backup runs faster, but it seems that a full restore is needed to recover a single file. Am I right?
That`s not correct you don`t need to extract VM image to the local drive or to start up the VM to restore a file.
Thanks!
aldanet
Novice
Posts: 3
Liked: never
Joined: Oct 12, 2015 1:36 pm
Full Name: JOSE DARIO ALVAREZ
Contact:

Re: Very slow File Copy backup

Post by aldanet »

Case ID # 00970703

Very nice the restore feature! You can restore from backups as well as from replicas, any date before..

Forget about File Copy! This application must be rebuilt from scratch!! At least it should show a warning about the number of files limit (no more than 1000, for small applications)

Thanks
JaxIsland7575
Veteran
Posts: 391
Liked: 107 times
Joined: Apr 27, 2015 1:59 pm
Full Name: Ryan Jacksland
Location: NY, USA
Contact:

Re: Very slow File Copy backup

Post by JaxIsland7575 »

This most likely may not apply to this thread, but just in case. I had the same issue with very poor backup copy performance, and found the solution to be that the Veeam Backup server had multiple NIC cards with each card on a different network. I had to go into VBR and set the preferred network to use and once I set the correct network as preferred my backup copy jobs went from 29 hours down to 7 minutes.

Cheers!
VMCE v9
adrianIDC
Expert
Posts: 179
Liked: 9 times
Joined: Mar 03, 2015 10:44 am
Contact:

Re: Very slow File Copy backup

Post by adrianIDC »

Aldanet and Iurbano this problem I have lived also in my hands. :roll:
Veeam solution was a long process that needs to copy these files to be many and as time increases and the speed is obviously low.

What they told me was unit to draw together the files in a rar or iso , for example , so just veeam detects that it is one file which must be copied and faster.

Obviously I chose to leave B&R as backups of my virtual machines and I discarded the copy file option but should have left well programmed directly or not having taken this option here .

With Windows Explorer or robocopy takes much less safe and tested
aldanet
Novice
Posts: 3
Liked: never
Joined: Oct 12, 2015 1:36 pm
Full Name: JOSE DARIO ALVAREZ
Contact:

Re: Very slow File Copy backup Case ID # 00970703

Post by aldanet »

Replicas with a huge number of files are also painful slow. As the process go on, it gets slower and slower.

It seems that bottleneck is in sqlservr.exe with more than 8 GB bytes written! It is spending about 90% of the available process time.

It seems that using a sql database is not a good idea for this application. Another approach for storing the huge file system tree dictionary should be found.
foggy
Veeam Software
Posts: 21069
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Very slow File Copy backup

Post by foggy »

Could you please elaborate on what "replicas" are you talking about? Thanks.
rmutchler
Veeam ProPartner
Posts: 2
Liked: never
Joined: Feb 28, 2011 8:32 pm
Full Name: Ron Mutchler
Location: Des Moines, IA
Contact:

RDX File Copy Performance

Post by rmutchler »

I have a customer using a File Copy job to copy from internal disk to a USB RD1000 with 2TB cartridges. Their performance seems off - It constantly bounces between 65MB/s and 0MB/s. I'm not getting a sustained data transfer on a copy operation.

Any ideas?
PTide
Product Manager
Posts: 6408
Liked: 724 times
Joined: May 19, 2015 1:46 pm
Contact:

Re: Very slow File Copy backup

Post by PTide »

Hi,

File Copy performance may suffer with large amount of small files. Please see the considerations above.

Thanks
Post Reply

Who is online

Users browsing this forum: BackItUp2020 and 289 guests