I can ping the appliance from the actual network it is located on.
I actually found a thread posted by someone that seems to describe my issue perfectly:
Virtual Lab advanced routing brainteaser
Your reply right
here seems to be exactly what is happening, when i set the isolated network side ip address to an address other then my gateway IP i am able to ping it from other networks fine. Of course then the VMs that are brought up on the isolated side cannot find their default gateway

, if i log into the isolated VM and change its gateway to reflect the appliances isolated IP am able to access it from any network fine and everything works as expected.
So it seems like the appliance is confused by the production default gateway being the same as its isolated IP address?
Hopefully this makes sense? If it helps i can take screenshots of my virtual lab config.