Comprehensive data protection for all workloads
Post Reply
ejenner
Veteran
Posts: 636
Liked: 100 times
Joined: Mar 23, 2018 4:43 pm
Full Name: EJ
Location: London
Contact:

guest file restore v.slow to open

Post by ejenner »

Hi guys,

Probably been seen before.

My most frequently requested restore location takes about 40 minutes to open the restore dialogue for a guest files restore. i.e. from when I select the restore point and press the 'finish' button it takes about 40 minutes to present me with a list of the restorable files.

It's a Windows Agent backup. Quite large. 35 restore points.

It seems to be a problem which gets worse as time passes. I've not reported it up to now as I felt some delay to open such a large backup was acceptable.. but as time moves on it is getting worse and 40 minutes is a bit excessive. Imagine if I got the wrong restore point and had to open a different restore point!

I'm sure there's a simple explanation.
DGrinev
Veteran
Posts: 1943
Liked: 247 times
Joined: Dec 01, 2016 3:49 pm
Full Name: Dmitry Grinev
Location: St.Petersburg
Contact:

Re: guest file restore v.slow to open

Post by DGrinev »

Hi,

Can you provide a bit more details about the environment?
I.e. how far the agent from the repository, network parameters such as bandwidth, the backup file size, etc.

Thanks!
foggy
Veeam Software
Posts: 21070
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: guest file restore v.slow to open

Post by foggy »

We're mostly interested in the servers (Veeam B&R backup server, console, repository/mount server) placement in relation to each other and where do you initiate the restore process? Also, does the actual restore takes considerable time or is performed decently?
ejenner
Veteran
Posts: 636
Liked: 100 times
Joined: Mar 23, 2018 4:43 pm
Full Name: EJ
Location: London
Contact:

Re: guest file restore v.slow to open

Post by ejenner »

The restore process completes at a reasonable speed. All other restore operations are reasonably quick to initialize (i.e. some are slower.. but not to the point where you'd think there was anything wrong)

B&R server is a DL380 G9 with 64GB. Repository and mount server is the same but with more RAM, 96GB.

I think the point of note here is that this job works differently to others when we attempt to restore. The fileserver actually has a few backups. This one we're discussing is by far the biggest... but others are also large but you can set up a restore in well under 5 minutes... compared to 40 minutes for this one.
foggy
Veeam Software
Posts: 21070
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: guest file restore v.slow to open

Post by foggy »

You didn't answer regarding servers location - the reason I'm asking is that for the purpose of browsing files during FLR the backup is mounted to the server from where the restore is initiated (either backup server itself or Veeam B&R console). If it is located remotely to the repository, this might cause the delay.
Mgamerz
Expert
Posts: 159
Liked: 28 times
Joined: Sep 29, 2017 8:07 pm
Contact:

Re: guest file restore v.slow to open

Post by Mgamerz »

I've found that it heavily depends on the amount of files in the original filesystem. Since Veeam is 'mounting' the backup to the filesystem, it is creating a bunch of file pointers to the backup file. On my client systems I can mount a backup typically in less than a minute, with some of the ones with bigger data sets in a couple minutes. My fileserver, which has tens of millions of files, it takes almost 40 minutes to mount a backup.

The backup chain length to the last full also has an impact too. Once my restores actually start (which can take quite some time) they cruise along pretty fast.
foggy
Veeam Software
Posts: 21070
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: guest file restore v.slow to open

Post by foggy »

Yes, those are also factors that affect FLR performance along with some other - e.g. compression, storage optimization settings (block size). However, the sub-optimal relative position of the involved servers is what typically causes issues, so the first thing to check.
ejenner
Veteran
Posts: 636
Liked: 100 times
Joined: Mar 23, 2018 4:43 pm
Full Name: EJ
Location: London
Contact:

Re: guest file restore v.slow to open

Post by ejenner »

Sorry, I didn't mention network or distances because we've got a very good backbone between sites.

I think what Mgamerz has said is most likely the explanation. Here's the properties for the folder in question:

Image
HannesK
Product Manager
Posts: 14316
Liked: 2890 times
Joined: Sep 01, 2014 11:46 am
Full Name: Hannes Kasparick
Location: Austria
Contact:

Re: guest file restore v.slow to open

Post by HannesK » 1 person likes this post

do you do "defragment and compact full" from time to time? With 10TB servers I have seen improvements from 45min to 2min.
Egor Yakovlev
Veeam Software
Posts: 2537
Liked: 683 times
Joined: Jun 14, 2013 9:30 am
Full Name: Egor Yakovlev
Location: Prague, Czech Republic
Contact:

Re: guest file restore v.slow to open

Post by Egor Yakovlev »

It is not that much about files count, but rather total volume size. I can mount 27M(26,803,432) files server backup for File Level Restore operations under 2 minutes. It is just 100GB in size, though.
40 minutes session initialization looks quite long to me, so I would also check:
- if antivirus exceptions are set, especially for for C:\VeeamFLR
- if FLR Session logs are clear of errors \ timeouts \ retries (C:\Program Data\Veeam\Backup\FLRSessions\Windows\)
/Cheers!
ejenner
Veteran
Posts: 636
Liked: 100 times
Joined: Mar 23, 2018 4:43 pm
Full Name: EJ
Location: London
Contact:

Re: guest file restore v.slow to open

Post by ejenner »

It's only this job affected. Other restore jobs perform as expected. So perhaps a "defragment and compact full" would be a good idea for getting things back on track.
ejenner
Veteran
Posts: 636
Liked: 100 times
Joined: Mar 23, 2018 4:43 pm
Full Name: EJ
Location: London
Contact:

Re: guest file restore v.slow to open

Post by ejenner » 2 people like this post

HannesK wrote: Feb 05, 2020 12:43 pm do you do "defragment and compact full" from time to time? With 10TB servers I have seen improvements from 45min to 2min.
This problem was resolved using the scheduled "defragment and compact full" option recommended by HannesK.
Post Reply

Who is online

Users browsing this forum: Google [Bot] and 78 guests