Discussions related to using object storage as a backup target.
Post Reply
inayama
Influencer
Posts: 21
Liked: never
Joined: Dec 08, 2016 12:02 am
Full Name: Tadashi Inayama
Contact:

Network Throttling for Google Cloud Storage

Post by inayama »

Hello ,

I have set up a SOBR with Capacity Tier at Google Cloud Storage. Earlier this week, I was saturating our outbound internet connection from our data center. I tried setting up network throttling for Internet, but it ended up throttling everything even within our internal network because we own a Class B subnet.

I cannot use specific IP addresses because Google Cloud Storage uses transient IP addresses. If I can turn on network throttling for hostname storage.googleapis.com it might work.

nslookup for storage.googleapis.com comes up with:

Non-authoritative answer:
Name: storage.googleapis.com
Addresses: 2607:f8b0:4005:808::2010
2607:f8b0:4005:809::2010
2607:f8b0:4005:80a::2010
2607:f8b0:4005:805::2010
142.250.191.48
216.58.194.208
172.217.6.48
172.217.164.112
142.250.188.16
142.250.72.208
142.250.189.176
142.250.189.240

But Google told me that these IP addresses can change without any notice.

I have opened Case #05111395.

So in summary, I need to either (1) be able to throttle outbound traffic to storage.googleapis.com specifically or (2) exclude our Class B IP address block from Internet Rule.

I have disabled file move to Object Storage for now, so I need some help.

Thank you,
Tadashi
Mildur
Product Manager
Posts: 9848
Liked: 2607 times
Joined: May 13, 2017 4:51 pm
Full Name: Fabian K.
Location: Switzerland
Contact:

Re: Network Throttling for Google Cloud Storage

Post by Mildur » 1 person likes this post

Using fqdn for throttling rules is not possible at the moment.
If you need dynamic configuration for your case, try to use a script to fetch the official ip range list from google (or nslookup) and use the result to configure the throttling configuration. Run the script every few hours and you will always have the correct ip ranges included in the network traffic rules.

Official Google IP Ranges:
https://www.gstatic.com/ipranges/goog.json
https://www.gstatic.com/ipranges/goog.txt

Powershell Command to configure Throttling:
https://helpcenter.veeam.com/docs/backu ... ml?ver=110
Product Management Analyst @ Veeam Software
inayama
Influencer
Posts: 21
Liked: never
Joined: Dec 08, 2016 12:02 am
Full Name: Tadashi Inayama
Contact:

Re: Network Throttling for Google Cloud Storage

Post by inayama »

Hello Mildur,

Thank you for your suggestion. I will try it out.

But is there a way to exclude our Class B IP Address from the existing Internet Rule?

Thank you,
Tadashi
Mildur
Product Manager
Posts: 9848
Liked: 2607 times
Joined: May 13, 2017 4:51 pm
Full Name: Fabian K.
Location: Switzerland
Contact:

Re: Network Throttling for Google Cloud Storage

Post by Mildur » 1 person likes this post

Hi Tadashi
Your welcome.

The internet Rule should automatically exclude privat subnets:
- 10.0.0.0/8
- 172.16.0.0/12
- 192.168.0.0/16
Others cannot be excluded.

https://helpcenter.veeam.com/docs/backu ... ml?ver=110
Product Management Analyst @ Veeam Software
Post Reply

Who is online

Users browsing this forum: No registered users and 6 guests