Whenever I have played with a Note in store or on my cousins, I have noticed lag in comparison to my iPhone. You may not experience it as I am sure you have fiddled with it to get it right, but its the one complaint I hear the most from Samsung owners so there is an issue there.
My note-3 definitly does have a lag..and things seem to "hang" or misbehave much more then on iPhone5s with the latest ios7 version.