Very slow file level restore and problem with permissions

Availability for the Always-On Enterprise

Re: Very slow file level restore and problem with permission

Veeam Logoby edv@rubner.com » Tue May 24, 2016 9:30 am

Hello everybody,

I have the following problem:
If I try to perform a restore to a share with the option "Copy To…", then I reach a speed of 25 mb / sec
If I try to perform a restore with the option "Restore -> Overwrite", then I reach a speed of 250 kb / sec

The restore I perform always on the same server
My user has Domain Admin rights

Veeam 9.0 with the last update

Does somebody has any idea?

Thanks and Greetings
Michael
edv@rubner.com
Influencer
 
Posts: 16
Liked: 5 times
Joined: Fri Jun 26, 2015 1:35 pm
Full Name: Rubner EDV

Re: Very slow file level restore and problem with permission

Veeam Logoby foggy » Thu Jul 14, 2016 3:55 pm

This most likely comes down to the fact that if using the Copy To option, the backup is mounted to the remote console, not the backup server or repository, like in case of restore to original location.
foggy
Veeam Software
 
Posts: 16488
Liked: 1320 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Very slow file level restore and problem with permission

Veeam Logoby renelies » Wed Jan 11, 2017 6:48 am

Hi,

There actually is a relative easy solution to speed up restore (in cases where it really takes hours to start cause of the thousands of files you want to copy or restore). I'll try to take it step by step (an we're still on 8, so it might be a bit different)

1. Setup SFTP access to your Multi-OS FLR (https://www.veeam.com/kb2062)
2. Get IP of FLR (also on https://www.veeam.com/kb2062)
3. Download a statically compiled rsync (https://www.symantec.com/connect/downlo ... -rsync-307)
4. SCP it over to your FLR
5. Use rsync :)

It would be easier if Veeam would include rsync in the Busybox installation by default though.
renelies
Lurker
 
Posts: 1
Liked: never
Joined: Wed Jan 11, 2017 6:37 am
Full Name: Rene van Lieshout

Re: Very slow file level restore and problem with permission

Veeam Logoby WRS2200 » Sun Jan 29, 2017 1:20 am

Thanks for the post. This helps a similar issue I have been having.
WRS2200
Enthusiast
 
Posts: 28
Liked: 3 times
Joined: Thu Aug 06, 2015 8:21 pm
Full Name: Weston Strom

Re: Very slow file level restore and problem with permission

Veeam Logoby bertdhont » Thu Mar 09, 2017 10:14 am

We also had some issues with restore speed using File Level Restore.
As a workaround, I did the following:

    1. Start Instant VM Recovery of the VM, but do not power on.
    2. Edit setting of the VM where you want to restore the files,
    add the disk of the restored VM (in Veeam NFS Datastore)
    3. Now the backupdata is available in the VM, and you can restore with robocopy.

The big advantage is that restore is done locally, so there is no network traffic.
Also, if Veeam server is in another VLAN than the VM where you want to restore to, traffic doesn't need to be routed...

I wonder if it isn't possible for Veeam to implement this in the Veeam GUI as an extra option when using File level restore...
bertdhont
Service Provider
 
Posts: 21
Liked: 3 times
Joined: Fri Nov 08, 2013 2:53 pm
Full Name: Bert D'hont

[MERGED] Slow restore speed

Veeam Logoby hyvokar » Mon Oct 16, 2017 8:01 am

Hi!

I need to restore about 10GB worth of data to our web server.
The data consists ~1.5million files. The restore speed I see is 100-200KB/s, and the restore will take for ever.

The data is being restored from older 12x 10k sas raid5 to not-so-old 12x 10k sas raid6 via 1Gb ethernet.
We have physical backup server with 2x xeon E5507 processors and 48GB mem. The backup storage is connected via FC.

Is this kind of performance expected?

I recall asking this before, but would it be possible for veeam to rar guest windows files, so I could take the rar to the web server and unrar there, preserving file attributes.
Bed?! Beds for sleepy people! Lets get a kebab and go to a disco!
MS MCSA, MCITP, MCTS, MCP
VMWare VCP5-DCV
Veeam VMCE
hyvokar
Service Provider
 
Posts: 301
Liked: 18 times
Joined: Fri Nov 21, 2014 10:05 pm

Re: Slow restore speed

Veeam Logoby hyvokar » Tue Oct 17, 2017 4:20 am

Restore took 22 hours.

Got these error messages:

17.10.2017 6:56:03 Warning Total size on disk: 0,0 B (calculating)
17.10.2017 6:56:03 Warning Files to restore: 0 (calculating)
17.10.2017 6:56:03 Warning Folders to restore: 1 (calculating)
Bed?! Beds for sleepy people! Lets get a kebab and go to a disco!
MS MCSA, MCITP, MCTS, MCP
VMWare VCP5-DCV
Veeam VMCE
hyvokar
Service Provider
 
Posts: 301
Liked: 18 times
Joined: Fri Nov 21, 2014 10:05 pm

Re: Slow restore speed

Veeam Logoby lando_uk » Tue Oct 17, 2017 2:06 pm

Yes, file restore sucks, you wont get much response on here as everyone knows how bad it is. It's the only reason we still have to keep Commvault for our file servers.
lando_uk
Expert
 
Posts: 274
Liked: 20 times
Joined: Thu Oct 17, 2013 10:02 am
Location: UK
Full Name: Mark

Re: Very slow file level restore and problem with permission

Veeam Logoby marc.rousseau » Sat Feb 10, 2018 1:27 am

Yes there's a real issue with FLR even with Veeam 9.5U3.

I did a simple test : generate 50000 dummy files of 64k then do a backup.

Start a FLR job, try a "copy to..." to a local drive on Veeam server : 6MB/sec
During this FLR session, simply go to C:\VeeamFLR (where backup is mounted), copy the folder to restore, paste it in the same local drive : 30MB/sec

Someone at Veeam, maybe an advice, a clue ?
marc.rousseau
Enthusiast
 
Posts: 26
Liked: 11 times
Joined: Thu May 01, 2014 9:48 am
Full Name: marc.rousseau

Re: Very slow file level restore and problem with permission

Veeam Logoby Tarqy » Tue Apr 24, 2018 7:53 am 1 person likes this post

Is this being looked at by Veeam?

As above an FLR restore of 41000 files transfers at 250 KB/s (this is for both overwrite and copy to)

Windows file copy from FLR mount point to the remote server and its transfers at between 15-30MB/s (from FLR mount point to local backup server is even quicker!)
VMCE
Tarqy
Service Provider
 
Posts: 26
Liked: 4 times
Joined: Fri Aug 08, 2014 1:51 pm
Full Name: Barry Knox

Re: Very slow file level restore and problem with permission

Veeam Logoby hyvokar » Thu Jun 14, 2018 7:34 pm

Tarqy wrote:Is this being looked at by Veeam?

:D
Bed?! Beds for sleepy people! Lets get a kebab and go to a disco!
MS MCSA, MCITP, MCTS, MCP
VMWare VCP5-DCV
Veeam VMCE
hyvokar
Service Provider
 
Posts: 301
Liked: 18 times
Joined: Fri Nov 21, 2014 10:05 pm

Re: Very slow file level restore and problem with permission

Veeam Logoby Gostev » Fri Jun 15, 2018 11:50 am

If you have support cases open for these particular issues - then most certainly yes, and it could be even fixed already! Otherwise - unlikely.

Please remember to always include case ID with any problem reports, otherwise they are not actionable by me or my team.

Generally speaking, being the one who puts together What's New documentation, I recall significant FLR performance enhancements implemented in almost every release, addressing specific issued determined based on the previously opened support cases.
Gostev
Veeam Software
 
Posts: 22562
Liked: 2736 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Baar, Switzerland

Re: Very slow file level restore and problem with permission

Veeam Logoby Gostev » Fri Jun 15, 2018 12:05 pm

Tarqy wrote:As above an FLR restore of 41000 files transfers at 250 KB/s (this is for both overwrite and copy to).
Windows file copy from FLR mount point to the remote server and its transfers at between 15-30MB/s

These particular numbers sound very much like restore thought ESXi host over VIX vs. restore over network (SMB).
Gostev
Veeam Software
 
Posts: 22562
Liked: 2736 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Baar, Switzerland

Re: Very slow file level restore and problem with permission

Veeam Logoby cbrasga » Fri Aug 10, 2018 6:53 pm

Just performed a File Level Restore (Overwrite) of 25,000 small files (1GB total) via SAN Snapshot for a VM. It was only copying at a speed of 100-200KB was taking hours. Way too slow.

Please fix the native FLR restore speed for large number of files.
cbrasga
Influencer
 
Posts: 14
Liked: never
Joined: Sat Apr 27, 2013 2:09 am
Full Name: Cazi Brasga

Re: Very slow file level restore and problem with permission

Veeam Logoby foggy » Thu Aug 16, 2018 4:32 pm

Hi Cazi, please open a case with our technical support so our engineers could take a look at your environment and identify the actual reasons of why the restore took that long - otherwise we just cannot know what to fix. Thanks.
foggy
Veeam Software
 
Posts: 16488
Liked: 1320 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Previous

Return to Veeam Backup & Replication



Who is online

Users browsing this forum: No registered users and 31 guests