Maintain control of your Microsoft 365 data
Post Reply
dbr
Expert
Posts: 121
Liked: 16 times
Joined: Apr 06, 2017 9:48 am
Full Name: Daniel Brase
Contact:

Finding a more reliable way to select the corresponding team of a site

Post by dbr »

Hi all,

I have no case number because my topic isn't an issue but more asking for some thoughts I may have missed. We use VBO version 7.1.0.2031. When we started with VBO we created one job per workload pointing to separate repositories and I was aware, that we have to change that to a more granular handling when migrating more users and data to M365 in favor for data storage and processing load balancing. I’m aware of the best practices and techniques for load balancing. Because dynamic groups for load balancing was no option for me and load balancing for SharePoint/Teams is only available through custom scripting respectively using one of the scripts in custom Github repos or Veeam script repo (vb365-JobManager for instance). I created my own PowerShell VBO-JobManager handling SharePoint/Teams and user workloads (Exchange/ExchangeArchive/Onedrive) that dynamically adds and removes the corresponding workload objects based on the idea to split objects into 4 groups using the first character of the siteid (SharePoint) or officeid (all other workloads). That is working really well, except one thing: Currently it treats SharePoint and Teams completely independent. This works technically but ignores the best practices (to point the connected team for a site to the same repository). A site with a siteid starting with “0” would be added to a different job than the connected team with an officeid starting with “f”. Now to my question: Currently it is not possible to do a strong mapping by e.g. group object id, that have both the site and team have in common. Is there a better way to match site and corresponding team and put them in the same job than…
  • Match site and team the same way VB365-JobManager does (get alias of team group email address and compare it with site name or using displayname of team and name of site).
    • Even though I get only around 40, where the corresponding site cannot be matched. It isn’t sustainable/reliable enough for me.
    • Using parameter “-NotInJob”, report not matching teams and add them manually. Could be difficult when also removing not matching teams (due to deletion). I cannot separate keeping not matching but wanted teams and indeed not existing teams.
  • Make sure fields for comparison/connecting site and team are identical using a process with the help of additional scripts (e.g. “-NotInJob” parameter).
  • Using the “-NotInJob” Parameter to add all not matchable teams in a separate job and ignore best practices
  • Using the catch all job mentioned in the best practices
    • We don’t want that because of the downsides also mentioned in bp.
  • Leveraging additional scripts and app registration in M365.
    • No option because we don’t want to establish a parallel connection. My script is running without an addition service user exclusively leveraging Veeam capabilities.
This can also be considered as feature request: Have a common unique property between VBO team’s and site’s PowerShell objects. Adding the group id to both the site and team would be really helpful load balancing across different job and still following best practices: Keeping SharePoint and Teams backup data together.

I appreciate any discussion input or ideas. Thanks.
Daniel
Mildur
Product Manager
Posts: 10316
Liked: 2754 times
Joined: May 13, 2017 4:51 pm
Full Name: Fabian K.
Location: Switzerland
Contact:

Re: Finding a more reliable way to select the corresponding team of a site

Post by Mildur »

Hi Daniel

I recommend to wait for our upcoming version 8 and test backup performance with a single job for the entire tenant.
V8 will allow you to use a single job and a proxy pool which will write backups to a single repository.
Instead of creating 20 jobs, 20 proxies and 20 repositories, you will be able to create a single job with 1-* proxies and 1 repository.

Proxy pools will allow you to scale up and down as required.
- Need more processing power? Just add a new proxy server to the pool.
- Require less processing power? Remove one proxy from the pool

Let me know if that would solve your request already.

Best,
Fabian
Product Management Analyst @ Veeam Software
dbr
Expert
Posts: 121
Liked: 16 times
Joined: Apr 06, 2017 9:48 am
Full Name: Daniel Brase
Contact:

Re: Finding a more reliable way to select the corresponding team of a site

Post by dbr »

Hi Fabian,

thanks for your reply. Our main problem wasn't proxy load but managing large repositories. Thus, we needed to split up jobs so we can point jobs to different repositories (multiple local drives of a proxy). If I understand correctly a proxy pool will not help us, will it?
Mildur
Product Manager
Posts: 10316
Liked: 2754 times
Joined: May 13, 2017 4:51 pm
Full Name: Fabian K.
Location: Switzerland
Contact:

Re: Finding a more reliable way to select the corresponding team of a site

Post by Mildur »

Hi Daniel
different repositories (multiple local drives of a proxy)
Yes, proxy pool will not help you solve the issue. Because proxy pools will be available only for object storage repositories and not for local disk repositories based of jet databases.

If you have large amount of data to protect, you should consider a migration to object storage as repositories for Veeam Backup for Microsoft 365. You will get better stability and data reduction compared to jet database repositories. And with V8 you will get load balancing for job processing.
Adding the group id to both the site and team would be really helpful load balancing across different job and still following best practices: Keeping SharePoint and Teams backup data together.
Your request is noted. But chances are small for such a feature since object storage is the recommended storage type for VB365 and V8 will bring load balancing to the product.
Leveraging additional scripts and app registration in M365.
Maybe reconsider this option with an app registration and read only permission for your script. This would allow you to get all metadata from M365 directly.

Best,
Fabian
Product Management Analyst @ Veeam Software
dbr
Expert
Posts: 121
Liked: 16 times
Joined: Apr 06, 2017 9:48 am
Full Name: Daniel Brase
Contact:

Re: Finding a more reliable way to select the corresponding team of a site

Post by dbr »

Hi Fabian,

Ok. I will discuss the object storage option internally but I guess it would change our whole VBO backup design. Currently we virtualize our proxies and repository disks and backup them via VBR to leverage our off-site and immutable infrastructure as with every other vm we backup. I know there are immutable options for object storage but currently we want all data on premises. I will also consider the app registration option, although I don't like the additional dependency. Thanks a lot for your input.
Mildur
Product Manager
Posts: 10316
Liked: 2754 times
Joined: May 13, 2017 4:51 pm
Full Name: Fabian K.
Location: Switzerland
Contact:

Re: Finding a more reliable way to select the corresponding team of a site

Post by Mildur »

Hi Daniel

You're welcome. Let me know if you have additional questions.
I know there are immutable options for object storage but currently we want all data on premises.
Object storage appliances and solutions are available for on-premise. And our upcoming V8 will extend immutability to primary backup jobs.

Best,
Fabian
Product Management Analyst @ Veeam Software
Post Reply

Who is online

Users browsing this forum: No registered users and 62 guests