If you click the arrow does it give you the option to delete it? I would do a "reset all settings". Probably a good idea anyway to run back through all the settings to get the iOS9 related ones set like you want. Of course wallpaper and wifi networks have to be set back up after you do this but all apps and data will stay intact.