Some backups fail, others succeed

[prewest]

Support Case ID : 01029939

Hi,

i`m getting some errors with endpoint, using the latest version
on some installations it fails with
Failed to backup [Data\Photoshop\MasterCollection_CS5_LS1 (2).dmg]
Error: Timed out to wait until the size of mount cache will be less than threshold Agent failed to process method {FileBackup.SyncDirs}.
or
Failed to backup [DATA\PRIVE\Boekhouding PC\Outlook Files\boekhouding@greenplanet.nl.pst]
Error: Timed out to wait until the size of mount cache will be less than threshold Agent failed to process method {FileBackup.SyncDirs}.

It seems to be happening random..
All the system`s I `m having problems with are the server versions, first error is from a SBS 2011 installation, the second from a Windows 2012.
Any ideas?

I`m backuping to a Backup/Replication Software server which points to several Linux Repositories.

[Mike Resseler]

Hmmm,

I haven't seen this one before... What are the sizes of those files and are it always the same files or does it happen randomly?

Also, please use the support system in the product and make a support case. Post the ID here and keep us informed

Thanks

Mike

[prewest]

Support Case ID : 01029939

I`ve just mailt the log files

[Mike Resseler]

Thanks!

[prewest]

I think I have found something, the memory and swap on my Linux node is running full to 100% when the agent is running..
when its reaches 100% other functions start to fail on the node..

What are the recommended specs for a Linux repository?
currently i`m using:
2GB Ram
2 VM CPU (2.6GHZ Xeon)
1TB Disk
per node.. Ubuntu 14.03 Server

[JaxIsland7575]

How many concurrent jobs do you have running to that Linux server at a time? Are they all scheduled and running at the same time?

[prewest]

Its random, most of the times 2 concurrent jobs are running.. but at night that might be like 10.
I`ve upped the RAM to 4GB, after running one job 5 hours, the agent has reached 1.3GB Ram usage.. thats one agent..
If I have 10 jobs at the same moment my repos. stops working when mem and swap are full..

[JaxIsland7575]

What is the concurrent task setting at? By default it is 4 concurrent tasks on the repository, have you tried lowering that and seeing if that performs better?

You can see This article for guidance too.

[Dima P.]

Agree with Ryan – try to set the option to two concurrent tasks instead and see how it goes. Additionally, what is set to be a gateway server for this repository?

[prewest]

Okay, changed the concurrent tasks to 2, server does not seem to be crashing anymore (2 agents use per agent 1.2GB Ram after a while what stays within the 4GB i`ve set)
But now and in the future, there will be a "waiting line" when I add more endpoint clients on that server.

the CIFS option that was proposed will not work because i`m using endpoint backup over the internet..
Is there another option to setup a static repository host on the internet for multiple (a number of 100 endpoint clients) without using that much RAM?

[JaxIsland7575]

Dima can correct me if I am wrong, but I believe the process to run the backup will require the resources regardless of where the repository lays. If you would want more concurrent tasks you would need to add RAM and CPU Cores.

[Dima P.]

Theoretically, if you have a chance to mount a shared folder (i.e. network location) via iSCSI or symlink( maybe like subfolder of the existing physical volume). Then use it as a destination and Endpoint will be utilizing its own hardware resources having zero influence on the repository.

[joeljerkin]

I receive the same error message after upgradering to lastest Veeam Endpoint Backup and changed the backup repository to a Backup & Replication repository (latest version, 8.0 patch 3)

Case logged but no answer yet: 01081780

Code: Select all

[quote]
                 :: Retry: 1 
2015-10-12 21:00:02 :: Preparing for backup 
2015-10-12 21:02:27 :: Required backup infrastructure resources have been assigned 
2015-10-12 21:02:34 :: Creating VSS snapshot 
2015-10-12 21:04:53 :: Calculating digests 
2015-10-12 21:07:23 :: DATA (D:) (3,4 TB) 553,8 GB read at 22 MB/s
2015-10-13 04:29:32 :: Failed to backup [<file>] 
2015-10-13 04:30:20 :: Finalizing 
2015-10-13 04:30:51 :: Error: Timed out to wait until the size of mount cache will be less than threshold Agent failed to process method {FileBackup.SyncDirs}.  
                    :: Processing finished with errors at 2015-10-13 04:31:02 
                    :: Retry: 2 
2015-10-13 04:41:19 :: Preparing for backup 
2015-10-13 04:43:23 :: Required backup infrastructure resources have been assigned 
2015-10-13 04:43:30 :: Creating VSS snapshot 
2015-10-13 04:45:34 :: Calculating digests 
2015-10-13 04:48:30 :: DATA (D:) (3,4 TB) 242,3 GB read at 22 MB/s
2015-10-13 08:03:18 :: Failed to backup [<file>] 
2015-10-13 08:06:12 :: Finalizing 
2015-10-13 08:06:41 :: Error: Timed out to wait until the size of mount cache will be less than threshold Agent failed to process method {FileBackup.SyncDirs}.  
                    :: Processing finished with errors at 2015-10-13 08:06:49 
                    :: Retry: 3 
2015-10-13 08:17:03 :: Preparing for backup 
2015-10-13 08:18:42 :: Required backup infrastructure resources have been assigned 
2015-10-13 08:18:48 :: Creating VSS snapshot 
2015-10-13 08:21:31 :: Calculating digests 
2015-10-13 08:23:33 :: DATA (D:) (3,4 TB) 553,8 GB read at 23 MB/s
2015-10-13 15:26:42 :: Failed to backup [<file>] 
2015-10-13 15:29:39 :: Finalizing 
2015-10-13 15:30:08 :: Error: Timed out to wait until the size of mount cache will be less than threshold Agent failed to process method {FileBackup.SyncDirs}.  
                    :: Processing finished with errors at 2015-10-13 15:30:17 
                    :: Retry: 4 
2015-10-13 15:40:33 :: Preparing for backup 
2015-10-13 15:42:20 :: Required backup infrastructure resources have been assigned 
2015-10-13 15:42:26 :: Creating VSS snapshot 
2015-10-13 15:45:20 :: Calculating digests 
2015-10-13 15:47:24 :: DATA (D:) (3,4 TB) 311,6 GB read at 23 MB/s
[/quote]

[Dima P.]

Joel,

Thanks – I’ve asked QA team to take a look.

[texmanro]

Hello

I have received this error:
Error: Timed out to wait for traffic control event. Agent failed to process method {FileBackup.SyncDirs}. Exception from server: Timed out to wait for traffic control event.

The scenario is like this:

- 1 file server (Server 2008 R2 Enterprise)with 18tb of data, 80 gb of RAM (needed to be backed uped) and Veeam Endpoint Backup Version 1.1.2.119
- 1 backup server (Server 2008 R2 Standard) with 21tb of free space, 5gb of RAM, GPT partition

They are connected thru LAN 1gbps speed.
The ~copy speed is 40mb/s

After 4-5 days i receive the error and the backup fails.

What is wrong?

[veremin]

Just to be sure - you get the said error while working with Veeam Backup and Replication, not Veeam Endpoint Backup? What's your case ID, by the way?

[texmanro]

it's Veeam Endpoint Backup Version 1.1.2.119.
It seams that i've posted in the wrong forum section. Sorry.
Can you please move it?

Thank you

[Vitaliy S.]

Can't see any resolution in the support cases mentioned in this thread. Can you please contact our technical team directly and submit all logs for investigation?

[Dima P.]

Mate,

Can I ask you to test this solution (limit the number of concurrent tasks to 2 instead of existing value)? Thanks

[Shall1569]

Anyone get anything back from the support team on this?

[Vitaliy S.]

Sam, it might be quicker to get a solution by contacting our technical team too.