Standalone backup agents for Linux, Mac, AIX & Solaris workloads on-premises or in the public cloud
Post Reply
vaeem
Novice
Posts: 9
Liked: never
Joined: Oct 26, 2019 10:13 pm

Backup fails on devices with eMMC storage

Post by vaeem »

Hello everyone,

ID 03832663

I'm a frequent user of veeam agent for windows and just started to deploy the veeam agent on two linux machines. Everything installed fine and after doing one more necessary step (https://helpcenter.veeam.com/docs/agent ... ccess.html) my user can run veeam.

I did all the onboarding things and created a new file based backup job with target to a local attached usb storage (tested with a usb2 stick and usb3 hd). The two devices I tested both have the OS on a eMMC storage. Veeam get's it right and starts even the backup (mmcblkX,..) but it always fails to complete the job. It looks like the maximum amount of data it reaches for backup is around 10GB (which is around 60% on one of the machines).

I tried many times but never suceded

Image

Both machines I tested run the amd64 version and using the deb packages provided by veeam. OS I tested is Debian 9 and Linux Mint 19.

Log with failing backup:

Code: Select all

22:44:35 Creating volume snapshot 00:00:02 ^
22:44:37 Starting full backup to Repository_1 │
22:44:38 Backed up mmcblk1boot1 4 MB at 5 MB/s 00:00:01 │
22:44:39 Backed up mmcblk1boot0 4 MB at 10.3 MB/s 00:00:01 │
22:44:40 [error] Backing up mmcblk1rpmb 00:00:00 │
22:44:47 [error] Failed to perform backup │
22:44:47 [error] Input/output error │
22:44:47 [error] POSIX: Failed to read data from the file [/dev/veeamimage2] │
22:44:47 [error] Failed to upload disk │
22:44:47 [error] Agent failed to process method {DataTransfer.SyncDisk} │
22:44:47 [error] Exception from server: Input/output error │
22:44:47 [error] POSIX: Failed to read data from the file [/dev/veeamimage2] │
22:44:47 [error] Unable to retrieve next block transmission command. Number of already processed blocks: [0]
Just in case my case ID 03832663
HannesK
Product Manager
Posts: 14287
Liked: 2877 times
Joined: Sep 01, 2014 11:46 am
Full Name: Hannes Kasparick
Location: Austria
Contact:

Re: Backup fails on devices with eMMC storage

Post by HannesK »

Hello,
and welcome to the forums.

In general, the Veeam Agent for Linux does not care about whether it is running on SSD, eMMC, spinning disk or whatever. So I would not focus on that.

As far as I see, there are no logs attached to the case. Support cannot help without logs. Please do also understand, that the forum does not replace support.

Best regards,
Hannes
vaeem
Novice
Posts: 9
Liked: never
Joined: Oct 26, 2019 10:13 pm

Re: Backup fails on devices with eMMC storage

Post by vaeem »

According to the User Guide, backups from USB and SD cards are not supported:

https://helpcenter.veeam.com/docs/agent ... filesystem

However, since eMMC is a slightly different format of memory cards, this will need a clarification from our development team.
HannesK
Product Manager
Posts: 14287
Liked: 2877 times
Joined: Sep 01, 2014 11:46 am
Full Name: Hannes Kasparick
Location: Austria
Contact:

Re: Backup fails on devices with eMMC storage

Post by HannesK »

good point, I will check that.
PTide
Product Manager
Posts: 6408
Liked: 724 times
Joined: May 19, 2015 1:46 pm
Contact:

Re: Backup fails on devices with eMMC storage

Post by PTide »

Hi, @vaeem
However, since eMMC is a slightly different format of memory cards, this will need a clarification from our development team.
Whose quote is that? AFAIK eMMC is not really different from any other multi-media card except for the fact that it is embedded. By the way, what is the file-system on that eMMC?

Are there any other storages on the machines? My guess is that the issue might related to a snapshot being located on the same eMMC which might cause the IO errors as some eMMCs operate in half-duplex mode, and that is something what our snapshot algorithm might have not taken into account.

It seems that the support case is missing logs, would you share them please? You can upload them to some sharing service and PM me the link.

Thanks!
HannesK
Product Manager
Posts: 14287
Liked: 2877 times
Joined: Sep 01, 2014 11:46 am
Full Name: Hannes Kasparick
Location: Austria
Contact:

Re: Backup fails on devices with eMMC storage

Post by HannesK »

I got response from QA: chances are very high that eMMC cannot work as they are very similar to SD cards.

But no 100% answer, because you did not upload log file to the case.
vaeem
Novice
Posts: 9
Liked: never
Joined: Oct 26, 2019 10:13 pm

Re: Backup fails on devices with eMMC storage

Post by vaeem »

I couldn't add my logs to the case because it was closed. You will find my log bundles in the case ID 03845661 now.

@P.Tide the file system on the emmc to backup is a ext4, no other storage. The backup target is a external usb (excluded from backup)
vaeem
Novice
Posts: 9
Liked: never
Joined: Oct 26, 2019 10:13 pm

Re: Backup fails on devices with eMMC storage

Post by vaeem »

Good news.

The error seams related to the device "/dev/mmcblk1rpmb" which is the "Replay Protected Memory Block (RPMB) subsystem" and not readable.

I good this very useful tip from the veeam support:
As a way to work this around I'd suggest trying to skip this partition.

To do so, please follow these steps:

1) Make sure no backup jobs are ruunning ion the agent
2) Stop the "veeamservice" service
3) Open /etc/veeam/veeam.ini, and add the "ignoreDevices= /dev/mmcblk1rpmb" at the end of the [backup] section of the file
4) Start the veeamservice and try to take a backup again.
PTide
Product Manager
Posts: 6408
Liked: 724 times
Joined: May 19, 2015 1:46 pm
Contact:

Re: Backup fails on devices with eMMC storage

Post by PTide »

Ok, I got ahold of the logs and passed it to our dev team, stay tuned.
Open /etc/veeam/veeam.ini, and add the "ignoreDevices= /dev/mmcblk1rpmb" at the end of the [backup] section of the file
This thing will make Veeam to skip the specified devices. That is, it will pretend that mmcblk1rpmb does not exist, which, I believe, is not exactly what you were looking for since it is your only storage.

Thanks!
l.scotti
Novice
Posts: 9
Liked: never
Joined: Feb 15, 2019 8:59 am
Full Name: Ludovic SCOTTI
Contact:

Re: Backup fails on devices with eMMC storage

Post by l.scotti »

Hello,

Does widlcard work with ignoreDevices ? eg: dev/mmc*

Regards,
Ludovic
PTide
Product Manager
Posts: 6408
Liked: 724 times
Joined: May 19, 2015 1:46 pm
Contact:

Re: Backup fails on devices with eMMC storage

Post by PTide »

Hi,

Yes, it should work. For example:

Code: Select all

[backup]
ignoreDevices=/dev/sda1;/dev/sda2;/dev/sda3;/dev/sdb*;/dev/nvme*
Post Reply

Who is online

Users browsing this forum: No registered users and 15 guests