Comprehensive data protection for all workloads
xeonjackson
Novice
Posts: 4
Liked: never
Joined: Dec 02, 2016 4:47 pm
Contact:

Issues with Indexing Backups

Post by xeonjackson » May 01, 2017 1:36 pm

Hi all,

I opened a ticket with Veeam support, but I thought perhaps you all may also be able to offer assistance.

Here's the situation:

I am receiving this error: Failed to Index guest file system. VSSControl: Index Failed on two jobs backing up the same VM. I have five jobs that backup the different virtual drives/vmdk's of this VM. Three complete successfully with the indexing while two fail. In the each of the five backup jobs, only the child vmdks(drives) are being backed up, not the "C" "Windows/Administrative" drive. I could understand that the job was failing if the Windows vmdk wasn't present, but three of the five jobs backup and index their virtual drive vmdk without issue. Please let me know what is going on so I can rectify it.

Case # 02135002

Please help if you can.

foggy
Veeam Software
Posts: 18366
Liked: 1575 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Issues with Indexing Backups

Post by foggy » May 04, 2017 12:07 pm

System disk exclusion shouldn't affect guest file system indexing. Please continue working with your support engineer.

adruet
Influencer
Posts: 22
Liked: 6 times
Joined: Oct 31, 2012 2:28 pm
Full Name: Alex
Contact:

Re: Issues with Indexing Backups

Post by adruet » May 19, 2017 7:22 am

@xeonjackson are you running veeam backup and replication 9.5 update 2 ?

I just upgraded from 9.5 update 1 to update 2 and I have seen 23 warnings exactly like yours last night.

I am digging in the logs right now and will open a support case if necessary.

foggy
Veeam Software
Posts: 18366
Liked: 1575 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Issues with Indexing Backups

Post by foggy » May 19, 2017 12:57 pm

Hi Alex, I've checked the OP's case and it was closed after no response from the customer, so it does make sense to open your own case for investigation. Thanks.

adruet
Influencer
Posts: 22
Liked: 6 times
Joined: Oct 31, 2012 2:28 pm
Full Name: Alex
Contact:

Re: Issues with Indexing Backups

Post by adruet » May 19, 2017 1:43 pm 1 person likes this post

Hi Alexander, after some investigation I did open a case: 02161438.
Thanks for your feedback.

andriktr
Enthusiast
Posts: 41
Liked: 1 time
Joined: Mar 02, 2015 11:53 am
Full Name: Andrej
Contact:

Re: Issues with Indexing Backups

Post by andriktr » May 22, 2017 4:43 pm

Looks that we also have same issue after update 2 install. Many VM's have same warning: "Failed to index guest file system. VSSControl: Index failed"
Any news regarding this issue?

davecla
Enthusiast
Posts: 26
Liked: 4 times
Joined: Feb 03, 2016 9:40 pm
Full Name: Dave Clarke
Contact:

Re: Issues with Indexing Backups

Post by davecla » May 22, 2017 9:53 pm

Same here after update 2 applied
Just one server out of many though.

DaveWatkins
Expert
Posts: 349
Liked: 93 times
Joined: Dec 13, 2015 11:33 pm
Contact:

Re: Issues with Indexing Backups

Post by DaveWatkins » May 23, 2017 1:14 am

Just another me too here.

Installed Update 2 yesterday and overnight got 8 or so failed index warnings on jobs this morning. That's still a small fraction of our total VM's but markedly more warnings than I have ever seen otherwise.

Oddly, in our case it seems to mostly affect RDP servers

adruet
Influencer
Posts: 22
Liked: 6 times
Joined: Oct 31, 2012 2:28 pm
Full Name: Alex
Contact:

Re: Issues with Indexing Backups

Post by adruet » May 23, 2017 6:34 am

Veeam Support told me this is a new behavior because they now have a more robust logging engine which allows them to log what they didn't see before.

From a user side, the backups with the warning are ok, and we are able to restore.

I am still working with support to give them logs to work on the issue.

We do not have Remote Desktop hosts with the issue, but many different machines.

Nicodonald
Novice
Posts: 3
Liked: never
Joined: May 12, 2016 4:12 pm
Contact:

Re: Issues with Indexing Backups

Post by Nicodonald » May 23, 2017 7:05 am

Same here after update 2

foggy
Veeam Software
Posts: 18366
Liked: 1575 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Issues with Indexing Backups

Post by foggy » May 23, 2017 12:05 pm

For everybody who is seeing this behavior it is recommended to contact support, unless done already.

davecla
Enthusiast
Posts: 26
Liked: 4 times
Joined: Feb 03, 2016 9:40 pm
Full Name: Dave Clarke
Contact:

Re: Issues with Indexing Backups

Post by davecla » May 24, 2017 10:41 pm 1 person likes this post

I've logged a support job too #02167192 - still just the one server.
Even if it's just informational, unless all my job reports are green then my day starts badly.

JaySt
Service Provider
Posts: 175
Liked: 26 times
Joined: Jun 09, 2015 7:08 pm
Full Name: JaySt
Contact:

Re: Issues with Indexing Backups

Post by JaySt » May 26, 2017 7:57 pm

same here. However, not consistently on the same VM each job run.
Veeam Certified Engineer

davecla
Enthusiast
Posts: 26
Liked: 4 times
Joined: Feb 03, 2016 9:40 pm
Full Name: Dave Clarke
Contact:

Re: Issues with Indexing Backups

Post by davecla » May 29, 2017 6:15 am

Anyone had a decent answer from support yet?
I've got another server now with the same error message and the one that was failing before now completes ok. No changes to the environment.

Support have indicated it's a permission problem with the account being used to run the indexer. I'm very skeptical......

Nicodonald
Novice
Posts: 3
Liked: never
Joined: May 12, 2016 4:12 pm
Contact:

Re: Issues with Indexing Backups

Post by Nicodonald » May 29, 2017 11:22 am

Same here, a server didn't had the warning since update and now it fail to index, the reverse is true too, a server had the warning since update and now it's ok.

foggy
Veeam Software
Posts: 18366
Liked: 1575 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Issues with Indexing Backups

Post by foggy » May 29, 2017 3:05 pm

I've checked a couple of cases mentioned above and they are still under investigation. Please open your own cases to confirm the issue and get notified about available solutions.

foggy
Veeam Software
Posts: 18366
Liked: 1575 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Issues with Indexing Backups

Post by foggy » May 29, 2017 4:27 pm

Latest state from R&D: the issue is confirmed, hotfix for Veeam B&R v9.5 u2 (104602) is available through support and is planned to be included into one of the next updates. Thanks.

bucoops
Enthusiast
Posts: 47
Liked: 5 times
Joined: Aug 01, 2016 6:37 pm
Full Name: Richard
Contact:

Re: Issues with Indexing Backups

Post by bucoops » May 30, 2017 9:13 am

Hi All,

Another user with this issue. Just installed the hotfix and will see how that runs tonight. Our case ref is 02166440

davecla
Enthusiast
Posts: 26
Liked: 4 times
Joined: Feb 03, 2016 9:40 pm
Full Name: Dave Clarke
Contact:

Re: Issues with Indexing Backups

Post by davecla » May 30, 2017 8:34 pm

Hotfix applied here. One time run through the backup cycle completed without warnings or errors.

DaveWatkins
Expert
Posts: 349
Liked: 93 times
Joined: Dec 13, 2015 11:33 pm
Contact:

Re: Issues with Indexing Backups

Post by DaveWatkins » May 30, 2017 8:35 pm

Same here, fix looks good so far

bucoops
Enthusiast
Posts: 47
Liked: 5 times
Joined: Aug 01, 2016 6:37 pm
Full Name: Richard
Contact:

Re: Issues with Indexing Backups

Post by bucoops » May 30, 2017 11:52 pm

Agreed - my cycle just finished and no warnings/errors :)

Now to update the firmware on core switch 1 and then back to bed lol

adruet
Influencer
Posts: 22
Liked: 6 times
Joined: Oct 31, 2012 2:28 pm
Full Name: Alex
Contact:

Re: Issues with Indexing Backups

Post by adruet » Jun 01, 2017 6:32 am

Applied the patch too, and no more warnings !

KeiichiKun
Enthusiast
Posts: 62
Liked: 10 times
Joined: Jul 21, 2016 3:59 pm
Contact:

[MERGED] Guest file system indexing failed in network mode

Post by KeiichiKun » Sep 06, 2017 9:28 am

Hi all,
a backup job of a sql server vm ends with this warning: "Failed to index guest file system. VSSControl: Index failed"
Log has this entry:

Code: Select all

VSSControl: Index failed   at Veeam.Backup.VssProvider.CVssControl.Index(Guid jobId, String[] includeFolders, String[] excludeFolders, String outputDir)
at Veeam.Backup.Core.CViGuestDiskIndexer.Veeam.Backup.Core.IGuestDiskIndexer.Index()
at Veeam.Backup.Core.CViGuestCatIndexer.TryToIndex(Guid jobId, CCatIndex& catIndex, Boolean& isGuestGroupMembersAvailable)
vss::CVeeamIndexingProvider::NetTryCompleteIndex. Failed to complete guest file system indexing in network mode.
All our backup proxies are in automatic mode.
Why could network mode give this error? For a network problem? Should we create another proxy and force it to use another mode instead of automatic and check again?
Thanks!

DGrinev
Veeam Software
Posts: 1763
Liked: 224 times
Joined: Dec 01, 2016 3:49 pm
Full Name: Dmitry Grinev
Location: St.Petersburg
Contact:

Re: Guest file system indexing failed in network mode

Post by DGrinev » Sep 06, 2017 1:34 pm

Hi,

Please contact the support team and let them review the logs to find out the real cause of the issue.
Also, when you are posting a technical issue you should share a case id number or your message will be deleted in 24 hours by moderators according to the rules of the forum. Thanks!

KeiichiKun
Enthusiast
Posts: 62
Liked: 10 times
Joined: Jul 21, 2016 3:59 pm
Contact:

Re: Guest file system indexing failed in network mode

Post by KeiichiKun » Sep 06, 2017 2:35 pm

Sorry, #02303497

albertwt
Expert
Posts: 641
Liked: 20 times
Joined: Nov 05, 2009 12:24 pm
Location: Sydney, NSW
Contact:

Re: [MERGED] Guest file system indexing failed in network mo

Post by albertwt » Sep 22, 2017 1:12 am

KeiichiKun wrote:a backup job of a sql server vm ends with this warning: "Failed to index guest file system. VSSControl: Index failed"
Log has this entry:

Code: Select all

VSSControl: Index failed   at Veeam.Backup.VssProvider.CVssControl.Index(Guid jobId, String[] includeFolders, String[] excludeFolders, String outputDir)
at Veeam.Backup.Core.CViGuestDiskIndexer.Veeam.Backup.Core.IGuestDiskIndexer.Index()
at Veeam.Backup.Core.CViGuestCatIndexer.TryToIndex(Guid jobId, CCatIndex& catIndex, Boolean& isGuestGroupMembersAvailable)
vss::CVeeamIndexingProvider::NetTryCompleteIndex. Failed to complete guest file system indexing in network mode.
All our backup proxies are in automatic mode.
So how did you go with this issue ?
--
/* Veeam software enthusiast user & supporter ! */

KeiichiKun
Enthusiast
Posts: 62
Liked: 10 times
Joined: Jul 21, 2016 3:59 pm
Contact:

Re: Issues with Indexing Backups

Post by KeiichiKun » Sep 25, 2017 7:45 am

Hi,
apologies for late reply.
I've solved disabling indexing because file level restore is available even if file indexing is disabled.
I've tried to move shadow copies from C: to a dedicated volume Z: but I got another error "The shadow copies of volume C: were deleted because the shadow copy storage could not grow in time. Consider reducing the IO load on the system or choose a shadow copy storage volume that is not being shadow copied."
So I've choose drastic solution.

rdkennedy
Lurker
Posts: 1
Liked: never
Joined: Oct 10, 2017 6:27 pm
Contact:

Re: Issues with Indexing Backups

Post by rdkennedy » Oct 16, 2017 3:01 pm

Hello
Does hotfix 104602 only need to be applied to the Veeam server or does it need to be applied to the proxies as well?

Vitaliy S.
Product Manager
Posts: 23070
Liked: 1582 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: Issues with Indexing Backups

Post by Vitaliy S. » Oct 16, 2017 8:02 pm 1 person likes this post

Hotifx should be installed on the Veeam backup server. Thanks!

mtaggart
Enthusiast
Posts: 25
Liked: 2 times
Joined: Dec 21, 2012 2:32 pm
Full Name: Mike Taggart
Contact:

Re: Issues with Indexing Backups

Post by mtaggart » Feb 09, 2018 10:08 pm

We have this issue as well and we are on Update 3. We've opened a support case 02596079, but there's not been any resolution to it yet.

Help, anyone!?

Post Reply

Who is online

Users browsing this forum: Bing [Bot] and 23 guests