Could you not restrict access to a local security group on the machine? Either the in-built Backup Operators group or a custom group created during installation? If the latter you could add the local Administrators group by default. This seems a fairly extensible means of allowing non-administrative users access to the control panel for scenarios where delegated access may be required.
Also you may want a user to be able to access the Control Panel for purposes other than modification of settings - for example to access and forward information about the backup status. If the user cannot access the control panel they cannot access and/or forward the reason of the failure.
Role-based granular access using local security groups for the win!