Comprehensive data protection for all workloads
SyNtAxx
Expert
Posts: 149
Liked: 15 times
Joined: Jan 02, 2015 7:12 pm
Contact:

Veeam v9.5: Error: Full storage not found

Post by SyNtAxx »

Case # 01984571

I recently upgraded to version 9.5 from v9u2 and everything seemed to work fine after the fact except for one job failed with this error: Error: Full storage not found. I use SOBR for targets and what i noticed was the .vbm file seemed to be missing from one of the extents. Copying the .vbm into the extent did nothing as it was removed again once the job was retried. Running an active full on that Job created a new chain and job folder.

Fast forward to last night, eight (8) more jobs that all of the sudden fail and display the same error. The same symptoms appear to be present, missing .vbm in one of the SOBR extents. Something is afoot here and this time active full doesn't do the trick. I cant just simply create new jobs and let them rip, the issue is impacting ~25TB worth of vms and data and will clobber the back end array. We rotate fulls and schedules to keep everything happy.

What I also notice is that the job/data no longer appears under "Backups Disk" as if they job never existed but the data is clearly on the disk target. Rescanning the repositories does nothing to improve the problem.

Anybody else see this? I know it had been a known issue with previous releases and there was a hotfix or SQL fix for it.

Thanks.
Mike Resseler
Product Manager
Posts: 8044
Liked: 1263 times
Joined: Feb 08, 2013 3:08 pm
Full Name: Mike Resseler
Location: Belgium
Contact:

Re: Veeam v9.5: Error: Full storage not found

Post by Mike Resseler »

syntaxx,

I see you have created a case so that is good. Please let us know the outcome here also. And I hope this is resolved quickly :-)

Mike
SyNtAxx
Expert
Posts: 149
Liked: 15 times
Joined: Jan 02, 2015 7:12 pm
Contact:

Re: Veeam v9.5: Error: Full storage not found

Post by SyNtAxx »

Well, last night 97% of my jobs ran as fulls. .vbm files got nuked, even on jobs that had been recreated and run for 5 days. Something is really wrong. All my backups are MIA as far as veeam is concerned. All new chains, again.
Mike Resseler
Product Manager
Posts: 8044
Liked: 1263 times
Joined: Feb 08, 2013 3:08 pm
Full Name: Mike Resseler
Location: Belgium
Contact:

Re: Veeam v9.5: Error: Full storage not found

Post by Mike Resseler »

That is not good news. Is support still working on the case?
SyNtAxx
Expert
Posts: 149
Liked: 15 times
Joined: Jan 02, 2015 7:12 pm
Contact:

Re: Veeam v9.5: Error: Full storage not found

Post by SyNtAxx »

Hoping for escalation to tier 2/3 for development and resolve.

-Nick
ferrus
Veeam ProPartner
Posts: 299
Liked: 43 times
Joined: Dec 03, 2015 3:41 pm
Location: UK
Contact:

Re: Veeam v9.5: Error: Full storage not found

Post by ferrus »

Not sure if it's related to the problem above (the error is similar) - but I've had a recurring problem in both v9 and 9.5 - 'Full point not found'
Case #01970878

An Active Full resolved it, but the error has returned on other jobs.
Gostev
Chief Product Officer
Posts: 31460
Liked: 6648 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Veeam v9.5: Error: Full storage not found

Post by Gostev »

The fact of life is that the bug will not be escalated to R&D, investigated and fixed until you keep agreeing with your support engineer to just do an Active Full every time you have this issue.
layte
Lurker
Posts: 2
Liked: never
Joined: Mar 24, 2010 10:08 am
Contact:

Re: Veeam v9.5: Error: Full storage not found

Post by layte »

I had the exact same thing happen to every single one of my copy jobs after upgrading to 9.5

Veeam support were of little help and even tried to make out the jobs were disable for a number of days as the root of the issue. Not only were the jobs not disabled, why would them being disabled for a few days cause Veeam to trash them all and start again. In the end I had to create new storage repositories on the Data Domain and recreate all the copy jobs.

I am left being very disappointed in Veeam, and will be making some tough decisions when the support renewal is due.
foggy
Veeam Software
Posts: 21069
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Veeam v9.5: Error: Full storage not found

Post by foggy »

Have you provided this feedback to support management (there's an option for this right on the customer support portal)? Otherwise how would we be able to react.
ferrus
Veeam ProPartner
Posts: 299
Liked: 43 times
Joined: Dec 03, 2015 3:41 pm
Location: UK
Contact:

Re: Veeam v9.5: Error: Full storage not found

Post by ferrus »

OK, speaking personally, it's quite infrequent and for us, too easily remedied - to consider entering into a prolonged investigation with support.
That's why I just mentioned it here, to support what has already been posted above (the other poster's issues, seem more serious than our own).

However, the next time it happens - I can certainly put a call in, and request a deeper investigation.
applc
Influencer
Posts: 15
Liked: 2 times
Joined: Jun 01, 2010 3:48 pm
Full Name: Chris A
Contact:

Re: Veeam v9.5: Error: Full storage not found

Post by applc »

I had the exact same issue twice now. I have a brand new install of 9.5, just installed and configured over a week ago. This is a completely new green-field setup. It had been running great for several days. Then yesterday a job failed with Error: Full storage not found. Since we aren't using the system fully, I deleted the jobs, repositories, and all data. Then I recreated everything and now that job is running fine. Then today I had the exact same thing happen to another job. For now I am going to reactivate the backups on my old system, and call Veeam support tomorrow to troubleshoot further. In my case the backup disk data simply disappears. I rescan the repository and it completes saying 1 skipped. But no data appears. Since the storage is an Exagrid appliance, I can't easily view the file contents in the repository. We will see what support says.
applc
Influencer
Posts: 15
Liked: 2 times
Joined: Jun 01, 2010 3:48 pm
Full Name: Chris A
Contact:

Re: Veeam v9.5: Error: Full storage not found

Post by applc »

I opened a ticket with Veeam support. Case # 02007660. The Veeam engineer suspected it's possible the Exagrid unit may have changed the modified date on the .vbk file. But he admitted he wasn't entirely sure this was the cause. He asked for more logs, and left the ticket open. Nevertheless I will be working with Exagrid to investigate the possibility that it may have somehow modified the Veeam backup files. Moving forward, the Veeam engineer had me create a new job and start a whole new chain of backups for the failed job. He also showed me the original chain, and all the backup files, were still accessible if need be for restores.
hyvokar
Veteran
Posts: 406
Liked: 29 times
Joined: Nov 21, 2014 10:05 pm
Contact:

Re: Veeam v9.5: Error: Full storage not found

Post by hyvokar »

Hi,

Did anyone got this problem resolved? Run in to same error today with 9.5 update4.
Bed?! Beds for sleepy people! Lets get a kebab and go to a disco!
MS MCSA, MCITP, MCTS, MCP
VMWare VCP5-DCV
Veeam VMCE
foggy
Veeam Software
Posts: 21069
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Veeam v9.5: Error: Full storage not found

Post by foggy »

I've checked all the cases mentioned in this thread and all of them were closed after running active fulls. So no actual reason of the issue, plus they are from over 2 years ago and different releases. So, I recommend you to contact support for an investigation. Thanks!
hyvokar
Veteran
Posts: 406
Liked: 29 times
Joined: Nov 21, 2014 10:05 pm
Contact:

Re: Veeam v9.5: Error: Full storage not found

Post by hyvokar »

Did contact, but it really didnt take me anywhere.
I believe the problem was that I changed the storage type to per-vm backup chains, but cannot tell for sure since the gui didn't give me enough info about what was missing.
Bed?! Beds for sleepy people! Lets get a kebab and go to a disco!
MS MCSA, MCITP, MCTS, MCP
VMWare VCP5-DCV
Veeam VMCE
johnlong
Enthusiast
Posts: 74
Liked: 11 times
Joined: May 12, 2012 3:37 pm
Contact:

Re: Veeam v9.5: Error: Full storage not found

Post by johnlong »

Was this resolved?
foggy
Veeam Software
Posts: 21069
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Veeam v9.5: Error: Full storage not found

Post by foggy »

Nothing new in this regard, please contact technical support directly.
Ci2Group
Service Provider
Posts: 19
Liked: 2 times
Joined: Dec 20, 2016 3:16 pm
Contact:

Re: Veeam v9.5: Error: Full storage not found

Post by Ci2Group » 1 person likes this post

we have a similar issue after upgrade from 9.5b to 10. We are a service provider and a client is receiving this error. The data set is several TBs in size so an active full is less than desirable.
Active sev 1 ticket 04133261 . We are having issues with many of our clients with different errors but this error is now the error we get after upgrading .
atsrl
Service Provider
Posts: 77
Liked: 11 times
Joined: Jul 08, 2016 1:58 pm
Full Name: AT SRL
Contact:

Re: Veeam v9.5: Error: Full storage not found

Post by atsrl »

we a have a similar issue on a brand new v10 cloud connect environment. Active sev2 ticket 04225838.
Did you have any workaround?
foggy
Veeam Software
Posts: 21069
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Veeam v9.5: Error: Full storage not found

Post by foggy » 1 person likes this post

I've checked the latest case mentioned above and it was closed due to no response from the customer. Let's see if our engineers could track the issue down within your case.
RubinCompServ
Service Provider
Posts: 259
Liked: 65 times
Joined: Mar 16, 2015 4:00 pm
Full Name: David Rubin
Contact:

Re: Veeam v9.5: Error: Full storage not found

Post by RubinCompServ »

Has anyone had any success on this? One of our customers has started to experience this on their VCC jobs. As they currently are using 18.5 TB of their 20 TB quota, they don't have the luxury of running new Active Fulls (not to mention the required bandwidth). I've opened case #04473901 as a Sev 1.
PetrM
Veeam Software
Posts: 3229
Liked: 520 times
Joined: Aug 28, 2013 8:23 am
Full Name: Petr Makarov
Location: Prague, Czech Republic
Contact:

Re: Veeam v9.5: Error: Full storage not found

Post by PetrM »

Hi David,

Please continue to work with our support team as the error is generic and can have different root causes and workarounds depending on the specific case.

Thanks!
clovischalegre
Service Provider
Posts: 1
Liked: never
Joined: Sep 22, 2020 7:31 pm
Full Name: Clovis Chalegre
Contact:

Re: Veeam v9.5: Error: Full storage not found

Post by clovischalegre »

I have the same problem with B&R v10. Several days have passed and no solution in the ticket I opened. # 04693610
foggy
Veeam Software
Posts: 21069
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Veeam v9.5: Error: Full storage not found

Post by foggy » 1 person likes this post

Hi Clovis, the case is in Portuguese so I cannot make much sense of it ;) but I do see that our team is investigating the log files, so please allow them some time.
fojtp
Service Provider
Posts: 4
Liked: 2 times
Joined: May 10, 2021 8:07 am
Full Name: Pavel Fojt
Contact:

Re: Veeam v9.5: Error: Full storage not found

Post by fojtp »

this should help:
- disable affected backup job
- edit job + enable GFS, save job
- again edit job (without starting job) + disable GFS, save job
- start job
PetrM
Veeam Software
Posts: 3229
Liked: 520 times
Joined: Aug 28, 2013 8:23 am
Full Name: Petr Makarov
Location: Prague, Czech Republic
Contact:

Re: Veeam v9.5: Error: Full storage not found

Post by PetrM »

Hi Pavel,

Not sure it can help in every single case as the error "Full storage not found" is a generic one which means that a record about backup file that contains full point is not found at the level of our configuration database. The only correct way of working with the issue is to open a support case and let our engineers to investigate debug logs.

Thanks!
EcoboostPerformance
Enthusiast
Posts: 27
Liked: 2 times
Joined: May 05, 2020 5:50 pm
Full Name: Ryan
Contact:

Re: Veeam v9.5: Error: Full storage not found

Post by EcoboostPerformance »

This has been a persistent issue. For us on versions 11, & 11a. It causes backups to fail. I really hope this bug gets squashed.
Gostev
Chief Product Officer
Posts: 31460
Liked: 6648 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Veeam v9.5: Error: Full storage not found

Post by Gostev »

There are currently no known issues like that in V11, so most likely it's not a bug but rather some environment-specific condition.
EcoboostPerformance
Enthusiast
Posts: 27
Liked: 2 times
Joined: May 05, 2020 5:50 pm
Full Name: Ryan
Contact:

Re: Veeam v9.5: Error: Full storage not found

Post by EcoboostPerformance »

There may be no known issues but we have submitted 2 support issues with this on v11.
PetrM
Veeam Software
Posts: 3229
Liked: 520 times
Joined: Aug 28, 2013 8:23 am
Full Name: Petr Makarov
Location: Prague, Czech Republic
Contact:

Re: Veeam v9.5: Error: Full storage not found

Post by PetrM »

Hi Ryan,

Basically, the error can be thrown when the job cannot find a starting point of the incremental chain when the job validates backup chain structure in Veeam configuration database. The root cause can be different in every specific case so it must be investigated by our support team. You may share a support case ID with us so that we can check that the investigation moves into the right direction.

Thanks!
Post Reply

Who is online

Users browsing this forum: No registered users and 277 guests