That's not something you can delete... Go to Settings>General>Restrictions and make sure iTunes turned on to Allow or Disable Restrictions... That should do the trick.
Its possible if you drop it off the last page...kinda like a Spartan kick into the hole of oblivion.
I recognize I used the App store icon. I dont care.