Active/Running reports

VMware specific discussions

Active/Running reports

Veeam Logoby tkeith » Tue Jun 09, 2015 10:02 pm 1 person likes this post

This may be a feature request but having a large environment i have to ask if there is a report or way to tell whats actively running without having to inspect each job? For example if i want to see a list of all proxies that are currently active and running across our jobs, if i need to do troubleshooting or maintenance.

Its challenging to go through 30 jobs trying to determine which proxies are currently in use...
tkeith
Service Provider
 
Posts: 10
Liked: 4 times
Joined: Fri Jan 09, 2015 4:49 pm
Full Name: Keith Thiessen

Re: Active/Running reports

Veeam Logoby Shestakov » Wed Jun 10, 2015 10:59 am 1 person likes this post

Hello Keith,
You can leverage Veeam One capabilities for that. In Veeam One Monitor you can observe recent proxies activities as well as statistical information and more.
Thanks!
Shestakov
Veeam Software
 
Posts: 4863
Liked: 396 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

Re: Active/Running reports

Veeam Logoby AMS » Wed Jun 10, 2015 7:35 pm 1 person likes this post

@Shestakov, while the report shows a history and "running tasks", it does not show real time proxy usage. Also, it requires you to click on each proxy individually to get the information. Lastly, there doesn't seem to be a way to see what proxy server is serving what job, what VMDK is being backed up, or which repository is currently being written to.
AMS
Veeam Software
 
Posts: 129
Liked: 30 times
Joined: Tue Mar 06, 2012 6:32 pm
Full Name: Ari Saperstein

Re: Active/Running reports

Veeam Logoby Shestakov » Thu Jun 11, 2015 10:28 am

Hello Ari!
You are correct, looks like the report about backup proxies will be helpful.
Do you want any other info about proxies to be shown?
Thank you for the feedback!
Shestakov
Veeam Software
 
Posts: 4863
Liked: 396 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

Re: Active/Running reports

Veeam Logoby Vitaliy S. » Thu Jun 11, 2015 12:49 pm

Hi Keith,

In a perfect world all proxy servers should be used, otherwise you're over-provisioning your Veeam backup infrastructure. Can you please clarify a bit your request? Do you run jobs on different schedule throughout the day?

@Ari, while I agree that this can be useful data, I do also believe that a report would not address this use case, cause by the time you build it, the entire information can change (for example, backup job has finished or backup proxy server became vacant for processing other jobs).

Thanks!
Vitaliy S.
Veeam Software
 
Posts: 19575
Liked: 1106 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov

Re: Active/Running reports

Veeam Logoby AMS » Thu Jun 11, 2015 3:12 pm

@ Vitaliy I have been discussing with with Keith working on other things so I am familiar with what he is looking for. We were less worried about a report. We were looking to get a view of some kind, to see which Proxy servers are active right now. During the backup, there are a large amount of jobs running on a large amount of Proxy servers. In fact, Veeam is balancing the load across the Proxies rather well. So imagine we have 30 Proxy servers, each capable of running 8 VMDK streams at a time. During the backup window 240 streams are running. So, we need to see in real time which Proxies are active. As the various jobs complete and streams finish, we need to see which proxies are still actively moving data. Also, as the day goes on and perhaps ad-hoc jobs, or development VM jobs are running, we need to see which proxies are active. It would be very helpful to be able to run a PowerShell script even that would show each proxy server, which VMDK it is backing up and which repository it is writing to.

We don't expect this to be available in VeeamOne as a report but rather as a powershell or in the VeeamOne Client perhaps as a monitor.

A VeeamOne report that would be useful is which proxy servers served which VMDK's and which jobs on a particular date to make troubleshooting easier.
AMS
Veeam Software
 
Posts: 129
Liked: 30 times
Joined: Tue Mar 06, 2012 6:32 pm
Full Name: Ari Saperstein

Re: Active/Running reports

Veeam Logoby Vitaliy S. » Fri Jun 19, 2015 12:38 pm

Ok, I think it should be possible to add some indication of all running proxy servers.
Vitaliy S.
Veeam Software
 
Posts: 19575
Liked: 1106 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov

Re: Active/Running reports

Veeam Logoby tsightler » Sun Jun 21, 2015 1:29 am 5 people like this post

AMS wrote:So, we need to see in real time which Proxies are active. As the various jobs complete and streams finish, we need to see which proxies are still actively moving data. Also, as the day goes on and perhaps ad-hoc jobs, or development VM jobs are running, we need to see which proxies are active. It would be very helpful to be able to run a PowerShell script even that would show each proxy server, which VMDK it is backing up and which repository it is writing to.

In the interim I created a script to do this, posted below for reference. It doesn't include repository, but I could certainly add that if it would be useful:
Code: Select all
# This script attempts to list all current active proxy tasks.
# Unfortunately the Veeam Powershell does not provide complete
# information via the task object model as those objects track only
# a single task for each VM even if the VM has multiple disk
# using different proxies.  Due to this limitation this script
# takes a different approach directly parsing the log entries
# of all actively running jobs and matching currently processing
# disks to proxies.  While this sounds crude, it appears to work
# well.
#
# Caveats:
#  - Doesn't currently take into account any use of proxies by
#    replication jobs (wouldn't be too hard to add)

asnp "VeeamPSSnapIn" -ErrorAction SilentlyContinue

# Get all proxies and create regexes for matching log entries
$proxies = Get-VBRViProxy
$proxies_regex = (‘(?i)(‘ + (($proxies.Name | ForEach {[regex]::escape($_)}) –join “|”) + ‘)’) -replace "\\\*", ".*"
$harddisk_regex = "(?i)(Hard disk\s+\d+)"

# Create empty array to hold results
$proxy_tasks = @()

# Get currently active backup sessions
$active_sessions = Get-VBRBackupSession | ?{$_.JobType -eq "Backup" -and $_.State -eq "Working"} | Sort JobName, Name
if (!$active_sessions) { Write-Host -ForegroundColor Red "No active backup sessions found!";Break }

foreach ($session in $active_sessions) {
    $tasks = $null = $session.GetTaskSessionsbyStatus("InProgress")  # Get all active tasks
    foreach ($task in $tasks) {
        $logs = $task.Logger.GetLog().UpdatedRecords # Get all logs for current task
        $proxy_logs = $null = $logs.Title | Select-String -Pattern $proxies_regex # Select all log lines that mention a proxy server
        $active_task_logs = $null = $logs | ?{$_.Status -eq "ENone"} # Select log entries that are in progress (exist but no completion status)
        foreach ($log_entry in $active_task_logs) {
            # If active log task includes "Hard disk XX" then its using a proxy, find the matching proxy log entry and grab the proxy name
            if ($log_entry.Title -match $harddisk_regex) {
                $harddisk = $matches[1]
                if (($proxy_logs | Select-String -Pattern $harddisk) -match $proxies_regex) {
                    # Insert collected info into an array
                    $proxy_tasks += New-Object -TypeName PSObject -Property (@{Proxy=$matches[1];Job=$session.JobName;VMname=$task.Name;Disk=$log_entry.Title;Progress=$log_entry.Description})
                }
            }
        }
    }
}
# Sort and convert array into a hash table
$proxy_tasks = $proxy_tasks | Sort-Object -Property Proxy,Job,VMname,Disk | Group-Object -Property Proxy -AsHashTable

# Output all of the collected information to the screen
foreach ($proxy in $proxies) {
    write-host -NoNewline -ForegroundColor green $proxy.Name "- Running:" $proxy_tasks.($proxy.Name).Count "of" $proxy.Options.MaxTasksCount "Tasks"
    if ($proxy_tasks.($proxy.Name).Count -eq 0) {write-host;write-host}
    $proxy_tasks.($proxy.Name) | Format-Table Job, VMname, Disk, Progress
}

Produces output that looks something like this:
Code: Select all
repo01.notyourdomain.com - Running: 4 of 4 Tasks
Job            VMname     Disk                               Progress                     
---            ------     ----                               --------                     
Proxy Test     orcl01     Hard disk 1 (40.0 GB)              6.1 GB read at 20 MB/s [CBT] 
Proxy Test     orcl01     Hard disk 2 (50.0 GB)              2.0 GB read at 12 MB/s [CBT] 
Proxy Test     vc02       Hard disk 1 (25.0 GB)              20.5 GB read at 66 MB/s [th...
Proxy Test     vc02       Hard disk 2 (100.0 GB)             27.5 GB read at 162 MB/s [CBT]


proxy01.notyourdomain.com - Running: 3 of 4 Tasks
Job            VMname     Disk                               Progress                     
---            ------     ----                               --------                     
Proxy Test     lnx02      Hard disk 2 (50.0 GB)              7.2 GB read at 28 MB/s [thr...
Proxy Test     lnx02      Hard disk 3 (40.0 GB)              13.6 GB read at 78 MB/s [CBT]
Test Servers   walrus01   Preparing backup proxy prox...                             
tsightler
Veeam Software
 
Posts: 4775
Liked: 1742 times
Joined: Fri Jun 05, 2009 12:57 pm
Full Name: Tom Sightler

Re: Active/Running reports

Veeam Logoby dellock6 » Mon Jun 22, 2015 4:28 pm

Lovely!!!!
Tom's the man, as usual :)
Luca Dell'Oca
EMEA Cloud Architect @ Veeam Software

@dellock6
http://www.virtualtothecore.com
vExpert 2011-2012-2013-2014-2015-2016
Veeam VMCE #1
dellock6
Veeam Software
 
Posts: 5055
Liked: 1336 times
Joined: Sun Jul 26, 2009 3:39 pm
Location: Varese, Italy
Full Name: Luca Dell'Oca

Re: Active/Running reports

Veeam Logoby lussierd16 » Mon Apr 18, 2016 7:48 pm

Tom this is great! Can you modify it to include the repo and copy jobs? This is very helpful.

Thanks!
lussierd16
Service Provider
 
Posts: 1
Liked: never
Joined: Mon Mar 14, 2016 2:48 pm
Full Name: Dustin Lussier

Re: Active/Running reports

Veeam Logoby AMS » Wed Apr 20, 2016 7:53 pm

Great script. But if this information is so readily available, why is this not a graphical view part of BnR or VeeamOne?
AMS
Veeam Software
 
Posts: 129
Liked: 30 times
Joined: Tue Mar 06, 2012 6:32 pm
Full Name: Ari Saperstein

Re: Active/Running reports

Veeam Logoby v.Eremin » Thu Apr 21, 2016 10:19 am

As far as I'm concerned, there have been plans to make this information available in Veeam ONE Monitor. At least similar requests have been already collected. Thanks.
v.Eremin
Veeam Software
 
Posts: 13296
Liked: 974 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

Re: Active/Running reports

Veeam Logoby Vitaliy S. » Thu Apr 21, 2016 10:29 am

And answering your question - because there were not many requests so far, thus the priority of this feature was lower compared to others. ;)
Vitaliy S.
Veeam Software
 
Posts: 19575
Liked: 1106 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov


Return to VMware vSphere



Who is online

Users browsing this forum: Bing [Bot] and 20 guests