OK, the S6 just came out, so of course its going to be higher speced. Its also the first phone to to utilize new technology, the CPU, flash memory, and ram are all built to new standards and are the first of their kind. So I don't know how some are expecting a phone that came out 8 months ago to also have that hardware. I'm sure the 6S at the end of the year will have an even more powerful processor along with faster ram and flash storage, as will the Note 5, Moto X, and Nexus.
There are only really 2 areas that apple is behind specs wise, screen resolution and amount of ram. But there is more to a screen than just resolution, overall the iPhone still has a great screen, and ram can be partially solved with software, and if you look at test done with other phones that came out around the same time, the iPhone still outperforms most with app switching.
And, like jamzer, I also have a Note 4, 6 plus, and S6. Though I would put the iPhone in second after the S6 in performance, but ahead of the Note 4.
I can't wait till the second half of this year, as it truely seems we're finally seeing a big jump in performance if the S6 is any indication. Can you imagine how insanely fast an iPhone or Nexus will be with the next gen SOC, RAM, and flash storage found in the S6? Plus an even more powerful Note with the awesome design of the S6?