Very slow File Copy backup

Availability for the Always-On Enterprise

Very slow File Copy backup

Veeam Logoby iurbano » Wed Jul 22, 2015 8:21 am

Hello,

Case # 00970703

Setup:
1 host with hyperv with iscsi disks (sources) and usb disk (destiny).
Content to copy in iscsi disks:
28GB->19000 files
350GB->500000 files
46GB-> 93000 files

When we launch the file copy backup job,the transfer rate starts with 15-20MB/s. After a few seconds or in the first minute, the velocity decrease to KB/sec
Ive tested directly copying the files and the transfer rate is almost always above 10MB/s

The technical of the support case said me that the solution is a workaround, compress previously the files in one... 500GB every day?.

Is that a normal behavior?. Can Veeam copy multiples files normally?

Thanks,
iurbano
iurbano
Lurker
 
Posts: 2
Liked: never
Joined: Thu Jul 16, 2015 3:44 pm
Full Name: Israel Urbano

Re: Very slow File Copy backup

Veeam Logoby Shestakov » Wed Jul 22, 2015 8:36 am

Hello iurbano,
Generally file copy job works slower if there are lots of files, like in your case, that`s why support suggested to use archive file for the job.
I do understand it`s not convenient at all though. We constantly improve the copying mechanism, so I`d suggest to upgrade to the latest VBR version. Thanks!
Shestakov
Veeam Software
 
Posts: 5783
Liked: 495 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

Re: Very slow File Copy backup

Veeam Logoby iurbano » Wed Jul 22, 2015 10:42 am

Thanks for the reply.

We have installed the last version.

With this velocity is impossible to complete a backup on time.

Copying with a typical copy of windows is faster.
With the feature backup tool of Windows is faster.

If Veeam Backup&Replication has a issue saving a lot of files with file copy backup tool, why dont explain it in the datasheet of the product?. I haven't read anything about this problem in the features of the product.

Thanks,
Iurbano
iurbano
Lurker
 
Posts: 2
Liked: never
Joined: Thu Jul 16, 2015 3:44 pm
Full Name: Israel Urbano

Re: Very slow File Copy backup

Veeam Logoby Shestakov » Wed Jul 22, 2015 11:37 am

Iurbano, I see your point, but even Windows as well as other products, will also work significantly slower if you copy 500 GB in 600 000+ files rather than one 500 GB file.
We understand the issue and will try to find ways to make the process faster. Thanks for the feedback!
Shestakov
Veeam Software
 
Posts: 5783
Liked: 495 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

Re: Very slow File Copy backup

Veeam Logoby caras » Thu Oct 08, 2015 3:41 pm 1 person likes this post

I've the same problem like iurbano: the VEEAM file copy function needs 20 minutes until the first file is transferred. After a short performance peak the file transfer rate permanently sinks to 6 KB/s.
VEEAM 8.8.0.2030 @ Win7. File source is Win Server 2008, 1 GB/s network.

The VEEAM backup function at the same hardware runs with 50 MB/s instead.
caras
Novice
 
Posts: 4
Liked: 1 time
Joined: Thu Feb 05, 2015 9:56 am

Re: Very slow File Copy backup

Veeam Logoby Shestakov » Thu Oct 08, 2015 4:15 pm

Hello,
Do you also copy huge number of small files?
Thanks!
Shestakov
Veeam Software
 
Posts: 5783
Liked: 495 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

Re: Very slow File Copy backup Case ID # 00970703

Veeam Logoby aldanet » Tue Oct 13, 2015 1:00 am

Case ID # 00970703

Good night:

I'm new to Veeam, and I'm very upset with his file copy feature.

I/m trying to backup 400GB data, 320K files between 2 VMs on the same Vmware server. Now after 34! hours, it has copied only 96GB. (24%). Robocopy takes about 4 hours to copy all files.

I convinced my customer to buy B&R in order to have a quick way to recover individual files from a backup, even old versions of them. Now I realize that he lost his money. (And perhaps I lost a customer!).

VM backup runs faster, but it seems that a full restore is needed to recover a single file. Am I right?

Thanks

Aldanet
aldanet
Novice
 
Posts: 3
Liked: never
Joined: Mon Oct 12, 2015 1:36 pm
Full Name: JOSE DARIO ALVAREZ

Re: Very slow File Copy backup

Veeam Logoby foggy » Tue Oct 13, 2015 10:28 am

Jose, have you checked file-level recovery functionality in Veeam B&R?
foggy
Veeam Software
 
Posts: 16299
Liked: 1302 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Very slow File Copy backup

Veeam Logoby Shestakov » Tue Oct 13, 2015 11:20 am

aldanet wrote:I/m trying to backup 400GB data, 320K files between 2 VMs on the same Vmware server. Now after 34! hours, it has copied only 96GB. (24%).

As stated above, File Copy works relatively slow when copying small files. Try to archive them to a single file.
aldanet wrote:VM backup runs faster, but it seems that a full restore is needed to recover a single file. Am I right?

That`s not correct you don`t need to extract VM image to the local drive or to start up the VM to restore a file.
Thanks!
Shestakov
Veeam Software
 
Posts: 5783
Liked: 495 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

Re: Very slow File Copy backup

Veeam Logoby aldanet » Tue Oct 20, 2015 5:42 pm

Case ID # 00970703

Very nice the restore feature! You can restore from backups as well as from replicas, any date before..

Forget about File Copy! This application must be rebuilt from scratch!! At least it should show a warning about the number of files limit (no more than 1000, for small applications)

Thanks
aldanet
Novice
 
Posts: 3
Liked: never
Joined: Mon Oct 12, 2015 1:36 pm
Full Name: JOSE DARIO ALVAREZ

Re: Very slow File Copy backup

Veeam Logoby JaxIsland7575 » Tue Oct 20, 2015 6:22 pm

This most likely may not apply to this thread, but just in case. I had the same issue with very poor backup copy performance, and found the solution to be that the Veeam Backup server had multiple NIC cards with each card on a different network. I had to go into VBR and set the preferred network to use and once I set the correct network as preferred my backup copy jobs went from 29 hours down to 7 minutes.

Cheers!
VMCE v9
JaxIsland7575
Veeam Vanguard
 
Posts: 364
Liked: 98 times
Joined: Mon Apr 27, 2015 1:59 pm
Location: NY, USA
Full Name: Ryan Jacksland

Re: Very slow File Copy backup

Veeam Logoby adrianIDC » Wed Oct 21, 2015 7:04 am

Aldanet and Iurbano this problem I have lived also in my hands. :roll:
Veeam solution was a long process that needs to copy these files to be many and as time increases and the speed is obviously low.

What they told me was unit to draw together the files in a rar or iso , for example , so just veeam detects that it is one file which must be copied and faster.

Obviously I chose to leave B&R as backups of my virtual machines and I discarded the copy file option but should have left well programmed directly or not having taken this option here .

With Windows Explorer or robocopy takes much less safe and tested
adrianIDC
Expert
 
Posts: 179
Liked: 9 times
Joined: Tue Mar 03, 2015 10:44 am

Re: Very slow File Copy backup Case ID # 00970703

Veeam Logoby aldanet » Mon Nov 16, 2015 6:06 pm

Replicas with a huge number of files are also painful slow. As the process go on, it gets slower and slower.

It seems that bottleneck is in sqlservr.exe with more than 8 GB bytes written! It is spending about 90% of the available process time.

It seems that using a sql database is not a good idea for this application. Another approach for storing the huge file system tree dictionary should be found.
aldanet
Novice
 
Posts: 3
Liked: never
Joined: Mon Oct 12, 2015 1:36 pm
Full Name: JOSE DARIO ALVAREZ

Re: Very slow File Copy backup

Veeam Logoby foggy » Mon Nov 16, 2015 9:18 pm

Could you please elaborate on what "replicas" are you talking about? Thanks.
foggy
Veeam Software
 
Posts: 16299
Liked: 1302 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

RDX File Copy Performance

Veeam Logoby rmutchler » Thu Jul 05, 2018 7:36 pm

I have a customer using a File Copy job to copy from internal disk to a USB RD1000 with 2TB cartridges. Their performance seems off - It constantly bounces between 65MB/s and 0MB/s. I'm not getting a sustained data transfer on a copy operation.

Any ideas?
rmutchler
Veeam ProPartner
 
Posts: 2
Liked: never
Joined: Mon Feb 28, 2011 8:32 pm
Location: Des Moines, IA
Full Name: Ron Mutchler

Next

Return to Veeam Backup & Replication



Who is online

Users browsing this forum: Bing [Bot], DaveWatkins, Google Feedfetcher, jason.smith079 and 49 guests