Steps to Reproduce
Log in as admin.
Set the glide.ui.advanced system property to true.
Click the gear icon next to the user avatar (the Settings icon) and select Notifications.
Click Create Channel or Create Personal Notification.
Note that there are two Save buttons.
Choose the duplicate button that you do not want to display and add the following record in the UI Action visibility related list:
View: Concourse Notification Preference
Related Problem: PRB1280868