File not found

Everything about backing up to tape

File not found

Veeam Logoby Schmoo » Thu Jul 28, 2016 9:35 pm

Technically a technical issue but it's just a simple question so I don't see the need to open a support case as warned above.

Backing up a simple directory to tape. Job ends with the warning "Volume D: have x problems. Details: File not found"

I understand from previous threads this is normally caused by Veeam doing file enumeration at the beginning of the job but the files weren't there when it got to the point of backing them up. I get that.

Simple question - where can I find a list of these files it didn't backup? That would increase my customer and my comfort level if I can just verify that the errors were generated because the files have been deleted/moved/whatever since the initial enumeration.

I've generated the log files and as we know, they are numerous and verbose. I just need to know which log file to look at and what error should I be searching for.

Thanks
Schmoo
Lurker
 
Posts: 2
Liked: never
Joined: Thu Jul 28, 2016 9:15 pm
Full Name: Craig Austin

Re: File not found

Veeam Logoby PTide » Fri Jul 29, 2016 10:43 am

Hi,

I just need to know which log file to look at and what error should I be searching for.
Try to search for "not found" string inside C:\ProgramData\Veeam\Backup\JobName\Job.JobName.TapeFilesBackup.log file on VBR server.

Thanks
PTide
Veeam Software
 
Posts: 3230
Liked: 269 times
Joined: Tue May 19, 2015 1:46 pm

Re: File not found

Veeam Logoby Schmoo » Fri Jul 29, 2016 5:02 pm

Thanks for the info. I've been looking in that file and can't find any "not found" entries. I've tried searching for other terms as well "error" and stuff like that.

Seems like if the program knows I have "14 problems" it would at least be able to tell me what they are!
Schmoo
Lurker
 
Posts: 2
Liked: never
Joined: Thu Jul 28, 2016 9:15 pm
Full Name: Craig Austin

Re: File not found

Veeam Logoby B.F. » Fri Sep 16, 2016 2:45 pm

I've experienced this as well. Any updates on how to identify the missing files.

Also, if Veeam is invoking Shadow Copy on the host which is being backed up, I don't understand how it can then miss any files. Is Veeam actually backing up the files based on the Shadow Copy?

Thanks!
B.F.
Expert
 
Posts: 131
Liked: 6 times
Joined: Tue Jan 28, 2014 5:41 pm

Re: File not found

Veeam Logoby Dima P. » Fri Sep 16, 2016 5:31 pm

Seems like if the program knows I have "14 problems" it would at least be able to tell me what they are!

Imagine you have 1000+ missing file names pushed to job session :wink:
Is Veeam actually backing up the files based on the Shadow Copy? Is Veeam actually backing up the files based on the Shadow Copy?

Yes, if you use VSS option in file to tape job. This error reflects that file added to the source for backup job was deleted (thus cannot be backed up)
Dima P.
Veeam Software
 
Posts: 6673
Liked: 477 times
Joined: Mon Feb 04, 2013 2:07 pm
Location: SPb
Full Name: Dmitry Popov

Re: File not found

Veeam Logoby B.F. » Mon Sep 19, 2016 3:28 pm

Seems like if the program knows I have "14 problems" it would at least be able to tell me what they are!

Imagine you have 1000+ missing file names pushed to job session :wink:


Imagine taking a vehicle to the shop to have work done. Upon picking up the vehicle, the repair receipt will then say "Found 14 problems. Cost is X" :wink:

Every backup I've done so far has this error / warning. If it doesn't tell us what files are omitted, why bother with the warning? What recourse do we have to try and correct this so that the reports aren't constantly yellow with warnings? Maybe instead of an error / warning, this could be informational stating "X files were omitted due to deletion" or something in that nature?

I'm probably sounding like a broken record from other posts but our production Backup Exec backing up the same data to tape does not throw any kind of error like this.

Yes, if you use VSS option in file to tape job. This error reflects that file added to the source for backup job was deleted (thus cannot be backed up)


Help me understand Veeam's process. In our job setup, I have it backup a server's E:\<folder> with a filemask of *.*. Does it then generate a list of specific files and folders from the filemask before starting the backup? If not, how else would it even know that a file is no longer there unless it has a reference point? If an unnamed file is part of the error / warning, will Veeam from that point on, always count that unnamed file in subsequent backups or just the current one?

Thanks much
B.F.
Expert
 
Posts: 131
Liked: 6 times
Joined: Tue Jan 28, 2014 5:41 pm

Re: File not found

Veeam Logoby B.F. » Wed Sep 21, 2016 2:53 pm

Update: Today's backup did not have any errors / warnings! So that answers the question if the errors are cumulative. It seemed like each day was adding more errors but this time it was green.

I just don't understand where it's getting the error / warning from. When VSS is being used and the backup is based off of the VSS snapshot, this warning should never come up.

So I did a test. I ran the tape backup and watched very closely the status of the job as it was happening while also monitoring VSS on the system being backed up. I think I see what's going on.

1. Veeam starts off building the file tree. This can take some time.

1a. I noticed that VSS was NOT invoked while the file tree was being built. This tells me it is generating the tree not based off of the VSS snapshot but from the actual file / folder structure of the system being backed up.

2. When the file tree is built in Veeam, then shortly after I see VSS invoked and the snapshot is taken.

3. Veeam then backs up files to tape.

If a file is deleted while the file tree is generated and after Veeam has already identified that file, it will not be in the VSS snapshot. Therefore, I can see this error being thrown.

If my assessment is true, would it be possible to rearrange the sequence a bit? First create the VSS snapshot, then build the file tree based off of the snapshot just taken?

Thanks!
B.F.
Expert
 
Posts: 131
Liked: 6 times
Joined: Tue Jan 28, 2014 5:41 pm

Re: File not found

Veeam Logoby simcomit » Wed Sep 28, 2016 2:09 pm

I 100% agree with this post, and have just run into the same issue trying to copy some files to tape.

1) As for the warning being virtually useless, I don't understand how you can claim this is a reliable backup software if it is hiding the details of the most important job it performs - making a copy of data from one media to another. How is this thing useful for anything if it keeps reporting files weren't transferred but doesn't tell you which ones? I want them ALL copied, and any that aren't I want to know exactly which ones so I can fix the process (no data should be able to be created and deleted without being backed up first). This should be a setting so those that don't want a list of 100's of files in the log can just get the generic "warning" as it does now, but for those of us that actually care if our data was backed up we should have the option of turning on the verbose info so the potential problem can be addressed (or a way to find said details by clicking on the warning).

2) If B.F.'s analysis of the VSS process is correct how is this a valid design? As I said in item #1 above, the whole purpose of this software is to reliably transfer specified data from one place to another. That means the second the job is started the source data needs to be "locked" in place until it can be copied. Why on earth would you take a file list first, then lock it, allowing this exact situation to occur? If you just fix this, the need for a full list of "deleted" files in item #1 would be irrelevant as it would never happen (because with a VSS lock even if the file is deleted after the backup started and built the file list it wouldn't actually be deleted until after the backup job released the VSS lock, hence the file would never miss the backup transfer and the warning wouldn't happen).
simcomit
Lurker
 
Posts: 1
Liked: never
Joined: Thu Mar 24, 2016 2:39 pm
Full Name: Jason Spencer

Re: File not found

Veeam Logoby busitech » Thu Nov 17, 2016 3:55 am

Sometimes, it doesn't even matter what files are missing, because they were deleted during the backup. This can happen when backing up files from a live Linux machine that has no concept of VSS - which can be especially problematic for Veeam when the backup is long. These jobs always end in Warning when in fact they were successful.

This specific case is one of a Linux machine sharing out a volume over AFP (netatalk) to Apple Macintiosh machines. There are changes to the Time Machine archives 24x7x365, as long as the machines are powered on. (The user receives an email, shortly thereafter, it is in the Time Machine backup on the file server. Awesome!)

I do not want to create a third copy of this data in the Veeam deduplicated store, because the backup volume is huge, and full of data that does not deduplicate at all.

The server is a VM, so I'd actually prefer to start a VM snapshot and copy the (full or incremental) backup of the volume straight to tape, but Veeam doesn't offer this option (it requires a disk copy first).

I would like to see an option to ignore missing files.
busitech
Lurker
 
Posts: 2
Liked: never
Joined: Tue Jan 26, 2016 3:40 am

Re: File not found

Veeam Logoby B.F. » Mon Nov 28, 2016 10:16 pm

Now that v9.5 has been released into the wild, does anyone know if this was addressed?

Thanks
B.F.
Expert
 
Posts: 131
Liked: 6 times
Joined: Tue Jan 28, 2014 5:41 pm

Re: File not found

Veeam Logoby Dima P. » Thu Dec 01, 2016 7:04 pm

Hi guys,

Same behavior remains in v9.5 We have this request on tack and noted this feature request for next versions. Meanwhile, detailed errors are displayed in the job log file – if required you can check the detailed output there.
Dima P.
Veeam Software
 
Posts: 6673
Liked: 477 times
Joined: Mon Feb 04, 2013 2:07 pm
Location: SPb
Full Name: Dmitry Popov


Return to Tape



Who is online

Users browsing this forum: No registered users and 2 guests