Should you? I don't know, but my experience is that I went from the first iPod touch, to iPhone 3G, to iPhone 4, to a Galaxy S3.
Honestly, couldn't be happier with this (unless you were to put an S4 in my hands), I'm amazed at how much more I am able to get out of my phone now. android 4.0 is the point where iOS and android OS seemed to hit parity, and with 4.1 then onto 4.2.2 IMO the Droid has pulled ahead. It's meant also that I barely touch my iPad now, I find it a little frustrating to use.
I was fairly invested into iOS software, I have hundreds of apps, very few movies and TV shows, no iBooks, all my music was DRM free after iTunes plus, I have two apple TV's and two airport express for music. My computer is a macbook pro. Yes the iphone integrates perfectly with all this, but droid can do it pretty well too. OTOH I never got into iCloud, my contacts, email, calendars were all google before the first iphone came along, so they just came with me, it would have been a lot harder to do if I was data invested there.
Right now I'm selling the iPad 3 for a nexus. My wife after seeing the difference traded her iPhone in for a Galaxy note 2.