Very slow File Copy backup

[iurbano]

Hello,

Case # 00970703

Setup:
1 host with hyperv with iscsi disks (sources) and usb disk (destiny).
Content to copy in iscsi disks:
28GB->19000 files
350GB->500000 files
46GB-> 93000 files

When we launch the file copy backup job,the transfer rate starts with 15-20MB/s. After a few seconds or in the first minute, the velocity decrease to KB/sec
Ive tested directly copying the files and the transfer rate is almost always above 10MB/s

The technical of the support case said me that the solution is a workaround, compress previously the files in one... 500GB every day?.

Is that a normal behavior?. Can Veeam copy multiples files normally?

Thanks,
iurbano

[Shestakov]

Hello iurbano,
Generally file copy job works slower if there are lots of files, like in your case, that`s why support suggested to use archive file for the job.
I do understand it`s not convenient at all though. We constantly improve the copying mechanism, so I`d suggest to upgrade to the latest VBR version. Thanks!

[iurbano]

Thanks for the reply.

We have installed the last version.

With this velocity is impossible to complete a backup on time.

Copying with a typical copy of windows is faster.
With the feature backup tool of Windows is faster.

If Veeam Backup&Replication has a issue saving a lot of files with file copy backup tool, why dont explain it in the datasheet of the product?. I haven't read anything about this problem in the features of the product.

Thanks,
Iurbano

[Shestakov]

Iurbano, I see your point, but even Windows as well as other products, will also work significantly slower if you copy 500 GB in 600 000+ files rather than one 500 GB file.
We understand the issue and will try to find ways to make the process faster. Thanks for the feedback!

[caras]

I've the same problem like iurbano: the VEEAM file copy function needs 20 minutes until the first file is transferred. After a short performance peak the file transfer rate permanently sinks to 6 KB/s.
VEEAM 8.8.0.2030 @ Win7. File source is Win Server 2008, 1 GB/s network.

The VEEAM backup function at the same hardware runs with 50 MB/s instead.

[Shestakov]

Hello,
Do you also copy huge number of small files?
Thanks!

[aldanet]

Case ID # 00970703

Good night:

I'm new to Veeam, and I'm very upset with his file copy feature.

I/m trying to backup 400GB data, 320K files between 2 VMs on the same Vmware server. Now after 34! hours, it has copied only 96GB. (24%). Robocopy takes about 4 hours to copy all files.

I convinced my customer to buy B&R in order to have a quick way to recover individual files from a backup, even old versions of them. Now I realize that he lost his money. (And perhaps I lost a customer!).

VM backup runs faster, but it seems that a full restore is needed to recover a single file. Am I right?

Thanks

Aldanet

[foggy]

Jose, have you checked file-level recovery functionality in Veeam B&R?

[Shestakov]

I/m trying to backup 400GB data, 320K files between 2 VMs on the same Vmware server. Now after 34! hours, it has copied only 96GB. (24%).

As stated above, File Copy works relatively slow when copying small files. Try to archive them to a single file.

VM backup runs faster, but it seems that a full restore is needed to recover a single file. Am I right?

That`s not correct you don`t need to extract VM image to the local drive or to start up the VM to restore a file.
Thanks!

[aldanet]

Case ID # 00970703

Very nice the restore feature! You can restore from backups as well as from replicas, any date before..

Forget about File Copy! This application must be rebuilt from scratch!! At least it should show a warning about the number of files limit (no more than 1000, for small applications)

Thanks

[JaxIsland7575]

This most likely may not apply to this thread, but just in case. I had the same issue with very poor backup copy performance, and found the solution to be that the Veeam Backup server had multiple NIC cards with each card on a different network. I had to go into VBR and set the preferred network to use and once I set the correct network as preferred my backup copy jobs went from 29 hours down to 7 minutes.

Cheers!

[adrianIDC]

Aldanet and Iurbano this problem I have lived also in my hands.
Veeam solution was a long process that needs to copy these files to be many and as time increases and the speed is obviously low.

What they told me was unit to draw together the files in a rar or iso , for example , so just veeam detects that it is one file which must be copied and faster.

Obviously I chose to leave B&R as backups of my virtual machines and I discarded the copy file option but should have left well programmed directly or not having taken this option here .

With Windows Explorer or robocopy takes much less safe and tested

[aldanet]

Replicas with a huge number of files are also painful slow. As the process go on, it gets slower and slower.

It seems that bottleneck is in sqlservr.exe with more than 8 GB bytes written! It is spending about 90% of the available process time.

It seems that using a sql database is not a good idea for this application. Another approach for storing the huge file system tree dictionary should be found.

[foggy]

Could you please elaborate on what "replicas" are you talking about? Thanks.

[rmutchler]

I have a customer using a File Copy job to copy from internal disk to a USB RD1000 with 2TB cartridges. Their performance seems off - It constantly bounces between 65MB/s and 0MB/s. I'm not getting a sustained data transfer on a copy operation.

Any ideas?

[PTide]

Hi,

File Copy performance may suffer with large amount of small files. Please see the considerations above.

Thanks