I have the Note 2, and really like it. Had it almost a month now, running CM10.1 Nightly. I don't use the S-Pen as much as I thought I would. I think mainly because I never had a stylus phone before, I just forget it's there, and my brain not accustomed to using apps for it.
But the battery life is AMAZING on this phone, and large screen great for reading news sites, watching videos, doing e-mail, etc...The Note 2 really is a fantastic device.
But I will say @ 5.5" is borderline too large almost. Is difficult one hand texting, which I do a lot, and reaching for the notification bar at the top, requires super stretching of the fingers. But my old phone, and Wife's phone are the Galaxy Nexus and One X respectively, both @ 4.7" screen size, and they feel very tiny and way too small to me now. But the Note 2's 5.5" screen is almost too large, I get frustrated using it quickly just to send a little text or e-mail reply, so I think a size right in the middle around 5" would be the absolute perfect size. And the Galaxy S IV will be that size.