Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.
Go to Settings > Notifications > Calendar

Under "Alert Style" select the middle option, "Banners" and they will not come up as the old "Pop-up" style like in iOS4.
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.