I/O device error / Cannot get file size - 9.5 Related?

Availability for the Always-On Enterprise

Re: I/O device error / Cannot get file size - 9.5 Related?

Veeam Logoby foggy » Wed May 31, 2017 3:52 pm

It didn't, as far as I know. Please contact support to get the hotfix.
foggy
Veeam Software
 
Posts: 16153
Liked: 1288 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: I/O device error / Cannot get file size - 9.5 Related?

Veeam Logoby P4Tr1ck » Tue Jun 20, 2017 5:51 am 2 people like this post

we've updated our B&R to 9.5 U2
we didn't get any more warnings since updating (one week ago)
P4Tr1ck
Novice
 
Posts: 5
Liked: 2 times
Joined: Thu Apr 27, 2017 6:09 am

Re: I/O device error / Cannot get file size - 9.5 Related?

Veeam Logoby pco » Wed Jul 26, 2017 3:54 pm

Hello,

Same behavior here, replication between 2 sites.
Multiple VMs, only 2 VMs got this issue.
Do you have an update or a suggested fix?

Thanks
pco
Novice
 
Posts: 6
Liked: 1 time
Joined: Thu Nov 03, 2011 11:10 am
Full Name: Philippe Combes

Re: I/O device error / Cannot get file size - 9.5 Related?

Veeam Logoby foggy » Wed Jul 26, 2017 6:13 pm

Hi Philippe, what Veeam B&R version are you at?
foggy
Veeam Software
 
Posts: 16153
Liked: 1288 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: I/O device error / Cannot get file size - 9.5 Related?

Veeam Logoby pco » Thu Jul 27, 2017 6:41 am

Hello,

Veeam backup and replication 9.5 update2 / 9.5.0.1038
pco
Novice
 
Posts: 6
Liked: 1 time
Joined: Thu Nov 03, 2011 11:10 am
Full Name: Philippe Combes

Re: I/O device error / Cannot get file size - 9.5 Related?

Veeam Logoby foggy » Mon Jul 31, 2017 4:45 pm

Please contact support for a closer look at whether the hotfix is applicable.
foggy
Veeam Software
 
Posts: 16153
Liked: 1288 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: I/O device error / Cannot get file size - 9.5 Related?

Veeam Logoby pco » Wed Aug 02, 2017 11:59 am 1 person likes this post

Hello,

Case opened 02261738 since Monday 31/07.

Regards
Philippe
pco
Novice
 
Posts: 6
Liked: 1 time
Joined: Thu Nov 03, 2011 11:10 am
Full Name: Philippe Combes

Re: I/O device error / Cannot get file size - 9.5 Related?

Veeam Logoby Jackf » Mon Oct 23, 2017 8:27 am

Hi,

I am experiencing exactly the same issue.

My Support ref is:-

Case # 02348457

Please Help!

I have built a brand new Repo server on 2016 and tried performing a new full backup however the issue still persists.
Jackf
Service Provider
 
Posts: 19
Liked: 4 times
Joined: Sun Mar 29, 2015 9:26 pm
Full Name: Jack Firth

Re: I/O device error / Cannot get file size - 9.5 Related?

Veeam Logoby BGA-Robert » Fri Mar 09, 2018 10:53 pm

I know this is a year old post, but we still see intermittent failures with "Cannot get file size".
I've sorta just gotten use to seeing them and knowing that they will succeed on retry. But this does need to be fixed.

Here's the whole error message from last night:
Code: Select all
3/8/2018 8:11:08 PM :: Error: The request could not be performed because of an I/O device error.
WINAPI: Cannot get file size. File: [Device '\\.\PhysicalDrive7'].
Failed to upload disk.
Agent failed to process method {DataTransfer.SyncDisk}.


I've opened a new ticket for this: 02661167
BGA-Robert
Service Provider
 
Posts: 38
Liked: 5 times
Joined: Wed Feb 03, 2016 5:06 pm
Full Name: Robert Wakefield

Re: I/O device error / Cannot get file size - 9.5 Related?

Veeam Logoby BGA-Robert » Wed Mar 21, 2018 12:57 am

Support hasn't been much help. I'm getting the impression that they haven't seen much of this issue. I may be getting the error randomly, but I do see it on a regular basis, maybe a few times a month. Surely support has some history. I've asked Zach a few times if there's any similar tickets, but he hasn't responded to that. I have been asked for logs and to test a job in network mode. Which doesn't seem like it would prove anything since the error is sooo random. Meaning if I put a job in network mode and it doesn't fail, it would not likely have failed anyhow. Frankly, this error first occurred the day after I installed 9.5 for the first time a year ago and is clearly a 9.5 bug. Support also mentioned it could be a resource issue where the VMware datastore is getting swamped. Even if that's true, Veeam should handle that better and AT LEAST report that. Not "cannot get file size"
BGA-Robert
Service Provider
 
Posts: 38
Liked: 5 times
Joined: Wed Feb 03, 2016 5:06 pm
Full Name: Robert Wakefield

Re: I/O device error / Cannot get file size - 9.5 Related?

Veeam Logoby sdunkin » Fri Apr 13, 2018 2:32 pm

I have been on 9.5 for a while with no issues. We did however just upgrade vmware from 5.5 to 6.5 and now for the first time I see this error. The vm having the error is actually the backup server, which is not the proxy - I have a another vm for that. We use Nimble storage. Since this is the first time I have ever seen this issue I was wondering if the issue I'm having is similar to these posts and if it ever went away for folks.
sdunkin
Lurker
 
Posts: 1
Liked: never
Joined: Fri Dec 02, 2016 4:47 pm
Full Name: Sherry Dunkin

Re: I/O device error / Cannot get file size - 9.5 Related?

Veeam Logoby BGA-Robert » Mon Apr 16, 2018 4:09 pm 1 person likes this post

I was escalated to Level II and this issue appears to be resolved.

Looking back at my notes from last time, I uninstalled and reinstalled the VMtools on the Veeam server, since VMware provides the SCSI controller driver. That Veeam server hasn't had the "cannot get file size error" since.

David in Level II looked thru the event logs of the Veeam server currently having these errors and found some matching errors in the System log:

Code: Select all
Log Name:      System
Source:        LSI_SAS
Date:          3/25/2018 4:05:01 PM
Event ID:      11
Task Category: None
Level:         Error
Keywords:      Classic
User:          N/A
Computer:      SVR-BACKUP-01.xxxxx.loc
Description:
The driver detected a controller error on \Device\RaidPort0.


Still sorta point to VMware as the culprit.

This time, we decided to switch to a different SCSI controller:
https://kb.vmware.com/s/article/1010398

So I migrated the Veeam server in question from the LSI_SAS SCSI controller to the Paravirtual SCSI controller. This is a resource definition in the VMware settings for the Veeam server. The switch is a little tricky as it's entirely possible to blue screen the server on startup due to a missing driver.

My feeling is that this issue was caused by a bug in VMware that Veeam started tripping with 9.5. The above solution is more of a work-around than a fix as we're simply side-stepping the bug by using a different driver.

FYI, I did test the Paravirtual driver on a couple of test boxes. The first one had no issues after installing using the above KB. The second instance was nothing but blue screens. On that instance, I finally manually downloaded the Paravirtual driver from the VMware tools download directly from VMware and just installed it. After both those experiences, I was able to get that driver into production with no problems.

The Paravirtual driver documentation does say that it's a more efficient driver (less CPU, more throughput). Considering the amount of data moved by the Veeam server, that could be a win too...
BGA-Robert
Service Provider
 
Posts: 38
Liked: 5 times
Joined: Wed Feb 03, 2016 5:06 pm
Full Name: Robert Wakefield

Previous

Return to Veeam Backup & Replication



Who is online

Users browsing this forum: Bing [Bot], cpfleger, cstaubli, Google [Bot] and 61 guests