azure vm backup jobs are causing a lot of microsoft azure alerts

[vbaguy]

Case #07876454

Deployed vbaz appliance version 8 from vbr console, used all private settings, nothing public.
Also, currently have in vbaz console -> General -> Deployment mode set to private

Getting a lot of Microsoft Azure alerts in mail, stating public IPs deleted.

Set up a case with veeam and microsoft, both saying they see public IPs getting deleted, but neither see any public IPs.
We've already checked during the time backup job runs to see if any public IP got created, didn't see anything.

What public IPs and why are they getting deleted?

Am I missing anything?