I'm in this boat too. I have no doubt that Android has made huge strides in usability, but living with an OG Droid for two+ years burned me so badly on the platform that it would take a device-miracle to lure me back. I've been using a 4S for the past year or so and haven't had a single complaint (even Maps works fairly well for me).
iOS definitely has limitations and drawbacks but for someone who isn't a smartphone power user (I don't watch videos, don't play many games, don't try and use the phone as a mobile office, etc) it works beautifully. So many of the "advanced" features of Android are ones I would rarely use over what is available on iOS. Sure, you can download a song from one store and share it with friends via another (I'm just making this up, lol), but if I don't share songs/videos, that sort of functionality is meaningless. I'd much rather trade those features for simplicity, smoothness and reliability, but that's ME. I totally get why a lot of tech-fans are into Android... I do miss the ability to customize.
One must also consider the ecosystem and friend/family circles. My wife's entire family just went iOS, and my parents/siblings have done the same. Being able to iMessage or FaceTime would be really helpful, where switching to WP8 (or Android) makes me the odd-man-out. I'm the only tech-savvy person in my family so I have to take that into consideration as well... I'm not going to convince my family to adopt something like Android if they are comfortable with iOS. You can certainly mock Apple for "boring, idiot-proof" usability but it sells in droves to people who don't care that much about this stuff.