Comprehensive data protection for all workloads
Post Reply
rawtaz
Expert
Posts: 100
Liked: 15 times
Joined: Jan 27, 2012 4:42 pm
Contact:

Ordering the list of chained jobs

Post by rawtaz »

When looking at the list of backup jobs, it would be useful if one could click some column header to have the jobs sorted/listed in the order which they would run in. Purely for the purpose of getting an overview.

For example if I have jobs A, B, C, and D and they are set to execute after each other in the order A, C, D, B, that's how I want to be able to list them.

As it is now one have to follow/track the "Name" and "Next run" columns which can be confusing with a bunch of jobs :)
veremin
Product Manager
Posts: 20284
Liked: 2258 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: Ordering the list of chained jobs

Post by veremin »

I believe it might be possible with Powershell.

I’ve already created a script that outputs in chronological order the name of the jobs that will be executed during the current day and also the time when these jobs will be run. If you modify it a little bit, I believe, you will be able to achieve your goals.

Thanks.
rawtaz
Expert
Posts: 100
Liked: 15 times
Joined: Jan 27, 2012 4:42 pm
Contact:

Re: Ordering the list of chained jobs

Post by rawtaz »

v.Eremin, I'm not sure why you merged my post with this thread, from what I can tell the initial post here is completely different from what I suggested. I am not talking about the historical timeline, I am only talking about the list of backup jobs in the "Backup & Replication" view, under Jobs -> Backup in the "menu tree" to the left. Powershell isn't relevant either, sorry :)

Please "unmerge" it if possible. Or shall I make a new thread?
veremin
Product Manager
Posts: 20284
Liked: 2258 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: Ordering the list of chained jobs

Post by veremin »

Even though it wasn't me who merged you, I split the discussion back into two separate topics, as you wanted to.
rawtaz
Expert
Posts: 100
Liked: 15 times
Joined: Jan 27, 2012 4:42 pm
Contact:

Re: Ordering the list of chained jobs

Post by rawtaz »

Oh, I'm very sorry for blaming you! Thought it was the one who answered it that merged. Thanks a lot!

EDIT: Can you tell me where "my" post/thread is? I'm not seeing it under "My posts". I mean the one you split back, so to speak.
foggy
Veeam Software
Posts: 21071
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Ordering the list of chained jobs

Post by foggy »

Actually, it was me and I still think that this feature request corresponds with the one discussed in the referred topic (listing jobs according to their chained runs can be a part of the mentioned historical view).

However, we can keep it separate if you wish. Thanks for the feedback!
rawtaz
Expert
Posts: 100
Liked: 15 times
Joined: Jan 27, 2012 4:42 pm
Contact:

Re: Ordering the list of chained jobs

Post by rawtaz »

Thanks foggy.

Just to clarify, to avoid any misunderstandings, here's a screenshot of where I am asking for this feature to be added:

Image

I honestly don't care about the/a history view, since in the history view you can already simply sort on the "Start time" column to see the order in which the jobs were run. But you can't do that here in the backup jobs "definition" list, and that's why I'm asking for it.

Being able to sort on the expected "start order" would make it easier to locate the jobs you want to edit or look at in this list (especially in bigger installations than this example one).

Thanks!
foggy
Veeam Software
Posts: 21071
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Ordering the list of chained jobs

Post by foggy »

rawtaz wrote:Being able to sort on the expected "start order" would make it easier to locate the jobs you want to edit or look at in this list (especially in bigger installations than this example one).
Yep, I fully understand what you are talking about. Makes sense.
yizhar
Service Provider
Posts: 181
Liked: 48 times
Joined: Sep 03, 2012 5:28 am
Full Name: Yizhar Hurwitz
Contact:

Re: Ordering the list of chained jobs

Post by yizhar »

Hi.

Regarding chained jobs in general, I'm using a different approach at all with very smaill and simple powershell script:
Community Forums • View topic - Veeam Backup Script to run multiple jobs in sequence
http://forums.veeam.com/viewtopic.php?f ... har#p63202

Using such script has some benefits:
I can get a daily single summary report of all job runs instead.
There is no dependency between jobs.
I manually start a single job from the GUI (for example b4 maintenance of specific VM), without running all other chained job.
I can add/remove jobs to the script without thinking or modifying other jobs.

However - I would still look for a feature in the product itself which might have in the future a "job group" option, which would allow us to better schedule and monitor jobs in sequence.

Yizhar
tsightler
VP, Product Management
Posts: 6012
Liked: 2843 times
Joined: Jun 05, 2009 12:57 pm
Full Name: Tom Sightler
Contact:

Re: Ordering the list of chained jobs

Post by tsightler » 1 person likes this post

yizhar wrote:However - I would still look for a feature in the product itself which might have in the future a "job group" option, which would allow us to better schedule and monitor jobs in sequence.
The product already technically allows this, well, at least partially. If you configure the proxy and/or repository to limit the number of parallel processes to 1 you can effectively start all of the jobs with 1 minute intervals and they will run in sequence. Perhaps it's not exactly what your looking for, but it's generally much easier than attempting to leverage linked jobs. I'm curious if you could describe the reasons for running jobs in sequence. Why not just put all of the VMs that need to be run in sequence in a single job since they can be ordered in the job? Is there some reason this doesn't work for you?
yizhar
Service Provider
Posts: 181
Liked: 48 times
Joined: Sep 03, 2012 5:28 am
Full Name: Yizhar Hurwitz
Contact:

Re: Ordering the list of chained jobs

Post by yizhar »

Hi.

Reasons for running several smaller jobs vs single big one:

* I prefer to have the backups in several separated folders vs one big VBK file.
I know that I get dedup per job only and it is fine with me because of other benefits of separated jobs.

* I'm dividing jobs to server types, such as:
SQL
DC
and also per customer (we run a mini cloud farm for few clients).
This allows me to start a specific job as needed out of the regular schedule, for example before maintenance of specific servers.
It also gives me more control over some options such as guest processing, restore point to keep, and even destination repository if I have several to play with.
I have the freedom to run a specific job on demand as needed, and also the option to run them all.

In regards to running jobs in sequence vs parallel processing:
Well I have a long backup window, and the backups are running quick (normally 2 hours daily incremental backup for all onsite jobs), so I don't have the need for parallel processing. I prefer not to saturate the production storage with multiple jobs even if it is capable for more.

* I like to get the simple daily bottom line report that I get from my powershell script and looks this:

Name State CreationTime EndTime Result
---- ----- ------------ ------- ------
JOB1 Stopped 6/1/2013 8:00:07 PM 6/1/2013 8:16:21 PM Success
JOB2 Stopped 6/1/2013 8:16:22 PM 6/1/2013 8:28:15 PM Success
JOB3 Stopped 6/1/2013 8:28:16 PM 6/1/2013 8:38:11 PM Success
etc...


FYI My setup is:
A new 3PAR 7200 with FC connections (just migrated last week from HP Lefthand P4300).
3 VMware hosts (HP DL360 G7/G8), esxi 5.1u1
1 physical backup server (Dell R610)
An IBM DS3300 ISCSI Storage for backup repository

Currently we have about 30 VMs to backup,
with a total of about 2000gb production data to backup daily.
As mentioned earlier it takes about 2 hours for daily jobs, using reverse incremental.
Some VMs have also offsite backup (regular Veeam job to remote repository).

Yizhar
tsightler
VP, Product Management
Posts: 6012
Liked: 2843 times
Joined: Jun 05, 2009 12:57 pm
Full Name: Tom Sightler
Contact:

Re: Ordering the list of chained jobs

Post by tsightler » 1 person likes this post

Thank you very much for the feedback, I can certainly understanding wanting the jobs split. Based on your description it seems like you could simply set the number of parallel processes on your repository to 1, and get sequential processing without needing to chain jobs at all, just allow the scheduler to queue up the jobs and run them in sequence. You'd still need some Powershell to get your single nightly report though so certainly your method works fine and is quite simple.
Post Reply

Who is online

Users browsing this forum: Camille Iaropoli, Google [Bot], ilyshar, tsightler and 159 guests