Comprehensive data protection for all workloads
xeonjackson
Novice
Posts: 4
Liked: never
Joined: Dec 02, 2016 4:47 pm
Contact:

Issues with Indexing Backups

Post by xeonjackson »

Hi all,

I opened a ticket with Veeam support, but I thought perhaps you all may also be able to offer assistance.

Here's the situation:

I am receiving this error: Failed to Index guest file system. VSSControl: Index Failed on two jobs backing up the same VM. I have five jobs that backup the different virtual drives/vmdk's of this VM. Three complete successfully with the indexing while two fail. In the each of the five backup jobs, only the child vmdks(drives) are being backed up, not the "C" "Windows/Administrative" drive. I could understand that the job was failing if the Windows vmdk wasn't present, but three of the five jobs backup and index their virtual drive vmdk without issue. Please let me know what is going on so I can rectify it.

Case # 02135002

Please help if you can.
foggy
Veeam Software
Posts: 21069
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Issues with Indexing Backups

Post by foggy »

System disk exclusion shouldn't affect guest file system indexing. Please continue working with your support engineer.
adruet
Influencer
Posts: 23
Liked: 7 times
Joined: Oct 31, 2012 2:28 pm
Full Name: Alex
Contact:

Re: Issues with Indexing Backups

Post by adruet »

@xeonjackson are you running veeam backup and replication 9.5 update 2 ?

I just upgraded from 9.5 update 1 to update 2 and I have seen 23 warnings exactly like yours last night.

I am digging in the logs right now and will open a support case if necessary.
foggy
Veeam Software
Posts: 21069
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Issues with Indexing Backups

Post by foggy »

Hi Alex, I've checked the OP's case and it was closed after no response from the customer, so it does make sense to open your own case for investigation. Thanks.
adruet
Influencer
Posts: 23
Liked: 7 times
Joined: Oct 31, 2012 2:28 pm
Full Name: Alex
Contact:

Re: Issues with Indexing Backups

Post by adruet » 1 person likes this post

Hi Alexander, after some investigation I did open a case: 02161438.
Thanks for your feedback.
andriktr
Enthusiast
Posts: 41
Liked: 1 time
Joined: Mar 02, 2015 11:53 am
Full Name: Andrej
Contact:

Re: Issues with Indexing Backups

Post by andriktr »

Looks that we also have same issue after update 2 install. Many VM's have same warning: "Failed to index guest file system. VSSControl: Index failed"
Any news regarding this issue?
davecla
Enthusiast
Posts: 26
Liked: 4 times
Joined: Feb 03, 2016 9:40 pm
Full Name: Dave Clarke
Contact:

Re: Issues with Indexing Backups

Post by davecla »

Same here after update 2 applied
Just one server out of many though.
DaveWatkins
Veteran
Posts: 370
Liked: 97 times
Joined: Dec 13, 2015 11:33 pm
Contact:

Re: Issues with Indexing Backups

Post by DaveWatkins »

Just another me too here.

Installed Update 2 yesterday and overnight got 8 or so failed index warnings on jobs this morning. That's still a small fraction of our total VM's but markedly more warnings than I have ever seen otherwise.

Oddly, in our case it seems to mostly affect RDP servers
adruet
Influencer
Posts: 23
Liked: 7 times
Joined: Oct 31, 2012 2:28 pm
Full Name: Alex
Contact:

Re: Issues with Indexing Backups

Post by adruet »

Veeam Support told me this is a new behavior because they now have a more robust logging engine which allows them to log what they didn't see before.

From a user side, the backups with the warning are ok, and we are able to restore.

I am still working with support to give them logs to work on the issue.

We do not have Remote Desktop hosts with the issue, but many different machines.
Nicodonald
Novice
Posts: 5
Liked: never
Joined: May 12, 2016 4:12 pm
Contact:

Re: Issues with Indexing Backups

Post by Nicodonald »

Same here after update 2
foggy
Veeam Software
Posts: 21069
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Issues with Indexing Backups

Post by foggy »

For everybody who is seeing this behavior it is recommended to contact support, unless done already.
davecla
Enthusiast
Posts: 26
Liked: 4 times
Joined: Feb 03, 2016 9:40 pm
Full Name: Dave Clarke
Contact:

Re: Issues with Indexing Backups

Post by davecla » 1 person likes this post

I've logged a support job too #02167192 - still just the one server.
Even if it's just informational, unless all my job reports are green then my day starts badly.
JaySt
Service Provider
Posts: 415
Liked: 75 times
Joined: Jun 09, 2015 7:08 pm
Full Name: JaySt
Contact:

Re: Issues with Indexing Backups

Post by JaySt »

same here. However, not consistently on the same VM each job run.
Veeam Certified Engineer
davecla
Enthusiast
Posts: 26
Liked: 4 times
Joined: Feb 03, 2016 9:40 pm
Full Name: Dave Clarke
Contact:

Re: Issues with Indexing Backups

Post by davecla »

Anyone had a decent answer from support yet?
I've got another server now with the same error message and the one that was failing before now completes ok. No changes to the environment.

Support have indicated it's a permission problem with the account being used to run the indexer. I'm very skeptical......
Nicodonald
Novice
Posts: 5
Liked: never
Joined: May 12, 2016 4:12 pm
Contact:

Re: Issues with Indexing Backups

Post by Nicodonald »

Same here, a server didn't had the warning since update and now it fail to index, the reverse is true too, a server had the warning since update and now it's ok.
foggy
Veeam Software
Posts: 21069
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Issues with Indexing Backups

Post by foggy »

I've checked a couple of cases mentioned above and they are still under investigation. Please open your own cases to confirm the issue and get notified about available solutions.
foggy
Veeam Software
Posts: 21069
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Issues with Indexing Backups

Post by foggy »

Latest state from R&D: the issue is confirmed, hotfix for Veeam B&R v9.5 u2 (104602) is available through support and is planned to be included into one of the next updates. Thanks.
bucoops
Enthusiast
Posts: 48
Liked: 5 times
Joined: Aug 01, 2016 6:37 pm
Full Name: Richard
Contact:

Re: Issues with Indexing Backups

Post by bucoops »

Hi All,

Another user with this issue. Just installed the hotfix and will see how that runs tonight. Our case ref is 02166440
davecla
Enthusiast
Posts: 26
Liked: 4 times
Joined: Feb 03, 2016 9:40 pm
Full Name: Dave Clarke
Contact:

Re: Issues with Indexing Backups

Post by davecla »

Hotfix applied here. One time run through the backup cycle completed without warnings or errors.
DaveWatkins
Veteran
Posts: 370
Liked: 97 times
Joined: Dec 13, 2015 11:33 pm
Contact:

Re: Issues with Indexing Backups

Post by DaveWatkins »

Same here, fix looks good so far
bucoops
Enthusiast
Posts: 48
Liked: 5 times
Joined: Aug 01, 2016 6:37 pm
Full Name: Richard
Contact:

Re: Issues with Indexing Backups

Post by bucoops »

Agreed - my cycle just finished and no warnings/errors :)

Now to update the firmware on core switch 1 and then back to bed lol
adruet
Influencer
Posts: 23
Liked: 7 times
Joined: Oct 31, 2012 2:28 pm
Full Name: Alex
Contact:

Re: Issues with Indexing Backups

Post by adruet »

Applied the patch too, and no more warnings !
KeiichiKun
Enthusiast
Posts: 97
Liked: 17 times
Joined: Jul 21, 2016 3:59 pm
Contact:

[MERGED] Guest file system indexing failed in network mode

Post by KeiichiKun »

Hi all,
a backup job of a sql server vm ends with this warning: "Failed to index guest file system. VSSControl: Index failed"
Log has this entry:

Code: Select all

VSSControl: Index failed   at Veeam.Backup.VssProvider.CVssControl.Index(Guid jobId, String[] includeFolders, String[] excludeFolders, String outputDir)
at Veeam.Backup.Core.CViGuestDiskIndexer.Veeam.Backup.Core.IGuestDiskIndexer.Index()
at Veeam.Backup.Core.CViGuestCatIndexer.TryToIndex(Guid jobId, CCatIndex& catIndex, Boolean& isGuestGroupMembersAvailable)
vss::CVeeamIndexingProvider::NetTryCompleteIndex. Failed to complete guest file system indexing in network mode.
All our backup proxies are in automatic mode.
Why could network mode give this error? For a network problem? Should we create another proxy and force it to use another mode instead of automatic and check again?
Thanks!
DGrinev
Veteran
Posts: 1943
Liked: 247 times
Joined: Dec 01, 2016 3:49 pm
Full Name: Dmitry Grinev
Location: St.Petersburg
Contact:

Re: Guest file system indexing failed in network mode

Post by DGrinev »

Hi,

Please contact the support team and let them review the logs to find out the real cause of the issue.
Also, when you are posting a technical issue you should share a case id number or your message will be deleted in 24 hours by moderators according to the rules of the forum. Thanks!
KeiichiKun
Enthusiast
Posts: 97
Liked: 17 times
Joined: Jul 21, 2016 3:59 pm
Contact:

Re: Guest file system indexing failed in network mode

Post by KeiichiKun »

Sorry, #02303497
albertwt
Veeam Legend
Posts: 879
Liked: 46 times
Joined: Nov 05, 2009 12:24 pm
Location: Sydney, NSW
Contact:

Re: [MERGED] Guest file system indexing failed in network mo

Post by albertwt »

KeiichiKun wrote:a backup job of a sql server vm ends with this warning: "Failed to index guest file system. VSSControl: Index failed"
Log has this entry:

Code: Select all

VSSControl: Index failed   at Veeam.Backup.VssProvider.CVssControl.Index(Guid jobId, String[] includeFolders, String[] excludeFolders, String outputDir)
at Veeam.Backup.Core.CViGuestDiskIndexer.Veeam.Backup.Core.IGuestDiskIndexer.Index()
at Veeam.Backup.Core.CViGuestCatIndexer.TryToIndex(Guid jobId, CCatIndex& catIndex, Boolean& isGuestGroupMembersAvailable)
vss::CVeeamIndexingProvider::NetTryCompleteIndex. Failed to complete guest file system indexing in network mode.
All our backup proxies are in automatic mode.
So how did you go with this issue ?
--
/* Veeam software enthusiast user & supporter ! */
KeiichiKun
Enthusiast
Posts: 97
Liked: 17 times
Joined: Jul 21, 2016 3:59 pm
Contact:

Re: Issues with Indexing Backups

Post by KeiichiKun »

Hi,
apologies for late reply.
I've solved disabling indexing because file level restore is available even if file indexing is disabled.
I've tried to move shadow copies from C: to a dedicated volume Z: but I got another error "The shadow copies of volume C: were deleted because the shadow copy storage could not grow in time. Consider reducing the IO load on the system or choose a shadow copy storage volume that is not being shadow copied."
So I've choose drastic solution.
rdkennedy
Lurker
Posts: 1
Liked: never
Joined: Oct 10, 2017 6:27 pm
Contact:

Re: Issues with Indexing Backups

Post by rdkennedy »

Hello
Does hotfix 104602 only need to be applied to the Veeam server or does it need to be applied to the proxies as well?
Vitaliy S.
VP, Product Management
Posts: 27055
Liked: 2710 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: Issues with Indexing Backups

Post by Vitaliy S. » 1 person likes this post

Hotifx should be installed on the Veeam backup server. Thanks!
mtaggart
Enthusiast
Posts: 25
Liked: 2 times
Joined: Dec 21, 2012 2:32 pm
Full Name: Mike Taggart
Contact:

Re: Issues with Indexing Backups

Post by mtaggart »

We have this issue as well and we are on Update 3. We've opened a support case 02596079, but there's not been any resolution to it yet.

Help, anyone!?
Post Reply

Who is online

Users browsing this forum: No registered users and 219 guests