Encountered this with Telegram on my iPhone 6s running iOS 9.0.1. Tried to dismiss the notification via the clear button, but it stayed in NC. Tried with a swipe on the notification itself, and tried using the x there, but same result. Fixed itself with a hard restart