Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.
My Messages notifications show up in the Notification window, i.e. not pop-ups, despite the app being closed. Also noticed that there are no badges on Messages in the dock.
 
Set these "notification" apps to start up at log in. Check the "Hide" box if you don't want to clutter up your screen with them.
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.