-
- Influencer
- Posts: 19
- Liked: 1 time
- Joined: Sep 28, 2013 9:09 am
- Full Name: Neil Potter
- Contact:
Proxy Server maxed out on RAM usage
We have recently moved from a "traditional" offsite backup to a Veeam Proxy server, to using an Offsite Copy Job.
This works soooo much better for us now and a lot quicker, bar one issue.
We have one backup of 12 "standard" VM's (DC's, SQL Server, Web Server etc) which runs like a dream, but we also have a separate backup for our main 6Tb File Server.
When this copy job sicks in, the proxy seems to take all the available RAM, and makes the server pretty much unusable for anything else. To the point that our monitoring software is telling us that server is offline for the first half an hour of that job.
So the VM is a 6Tb VMware 5.5 VM (4 Drives,3 of which are spanned to create a single volume).
The Proxy server (Veeam 9.5) has 12Gb RAM, and 8 cores to chew with.
Do I need to up the RAM, or is there something quicker and less costly that I can do to stop the server croaking when this backup kicks in?
Thanks
This works soooo much better for us now and a lot quicker, bar one issue.
We have one backup of 12 "standard" VM's (DC's, SQL Server, Web Server etc) which runs like a dream, but we also have a separate backup for our main 6Tb File Server.
When this copy job sicks in, the proxy seems to take all the available RAM, and makes the server pretty much unusable for anything else. To the point that our monitoring software is telling us that server is offline for the first half an hour of that job.
So the VM is a 6Tb VMware 5.5 VM (4 Drives,3 of which are spanned to create a single volume).
The Proxy server (Veeam 9.5) has 12Gb RAM, and 8 cores to chew with.
Do I need to up the RAM, or is there something quicker and less costly that I can do to stop the server croaking when this backup kicks in?
Thanks
-
- VP, Product Management
- Posts: 27377
- Liked: 2800 times
- Joined: Mar 30, 2009 9:13 am
- Full Name: Vitaliy Safarov
- Contact:
Re: Proxy Server maxed out on RAM usage
Proxy server usually consumes CPU resources, but not RAM. What's your bottleneck stats for this job? What is the weakest component, proxy or target repository? How many jobs do you run at the same time using this proxy server?
-
- Influencer
- Posts: 19
- Liked: 1 time
- Joined: Sep 28, 2013 9:09 am
- Full Name: Neil Potter
- Contact:
Re: Proxy Server maxed out on RAM usage
Only ever one job at a time running.
The 12 x VM job runs up to 4 concurrent VM's and doesn't cause an issue.
The 1 x Large VM runs on it's own over a 100MB internet link over hardware VPN.
Stats from last few completed jobs are
Bottleneck tends to be network if there have been a lot of new files through the day, or Source if there are a lot of changes, I assume because of CBT?
Source bottle neck - Load Source 69% - Proxy 6% - Network 39% - Target 0%
Network bottleneck - Load Source 16% - Proxy 3% - Network 99% - Target 0%
For clarity, the proxy server is also the remote repo.
The RAM seems to maxed from when the job starts processing the info but I think it drops when files actually start to be transferred over. Its almost the first half an hour of the job when it's working out what needs to be transferred I think
The 12 x VM job runs up to 4 concurrent VM's and doesn't cause an issue.
The 1 x Large VM runs on it's own over a 100MB internet link over hardware VPN.
Stats from last few completed jobs are
Bottleneck tends to be network if there have been a lot of new files through the day, or Source if there are a lot of changes, I assume because of CBT?
Source bottle neck - Load Source 69% - Proxy 6% - Network 39% - Target 0%
Network bottleneck - Load Source 16% - Proxy 3% - Network 99% - Target 0%
For clarity, the proxy server is also the remote repo.
The RAM seems to maxed from when the job starts processing the info but I think it drops when files actually start to be transferred over. Its almost the first half an hour of the job when it's working out what needs to be transferred I think
-
- VP, Product Management
- Posts: 27377
- Liked: 2800 times
- Joined: Mar 30, 2009 9:13 am
- Full Name: Vitaliy Safarov
- Contact:
Re: Proxy Server maxed out on RAM usage
CBT is always used starting from the second run, so the stats should look more or less the same unless you're using different source datastore to retrieve VM data. In your case,if the more data you push the more it tends to be network bottleneck, then it could be indeed the expected behavior.neilpotter wrote:Bottleneck tends to be network if there have been a lot of new files through the day, or Source if there are a lot of changes, I assume because of CBT?
Try increasing the RAM configuration, and let us know if that improves the server uptime or not.neilpotter wrote:For clarity, the proxy server is also the remote repo.
The RAM seems to maxed from when the job starts processing the info but I think it drops when files actually start to be transferred over. Its almost the first half an hour of the job when it's working out what needs to be transferred I think
-
- Influencer
- Posts: 19
- Liked: 1 time
- Joined: Sep 28, 2013 9:09 am
- Full Name: Neil Potter
- Contact:
Re: Proxy Server maxed out on RAM usage
Ok, I will try that. Is there no way I can limit the amount of resource that Veeam can take instead?
-
- VP, Product Management
- Posts: 27377
- Liked: 2800 times
- Joined: Mar 30, 2009 9:13 am
- Full Name: Vitaliy Safarov
- Contact:
Re: Proxy Server maxed out on RAM usage
Limiting the resource usage will lower the processing rate. You might want to play with processes priority via Task Manager (just as a crazy idea), but you can limit concurrent tasks to 1 and check if you observe the same behavior or not.
-
- Influencer
- Posts: 19
- Liked: 1 time
- Joined: Sep 28, 2013 9:09 am
- Full Name: Neil Potter
- Contact:
Re: Proxy Server maxed out on RAM usage
Quick update. I took the ram in both the Veeam server, and the remote Proxy / Repo from 12Tb to 32Tb, and it's revolutionised everything. It all runs a lot better, and much faster now.
No more offline warnings etc.
Thanks
No more offline warnings etc.
Thanks
Who is online
Users browsing this forum: Bing [Bot], mbrzezinski and 21 guests