I find that this distinction between usage patterns is generally at the root of the differences in phone preferences.
I love the SE purely on size. Between where I put it in my car, when I use it on top of a treadmill, when it slides into all the pockets on all my clothes so easily (even small ones) and so many dozens of other use cases, it just always fits the bill.
For what I do with my mobile "phone" - The small physical size is the #1 reason I love it.
This photo of Tim here?
This doesn't happen to me with my SE and I love that...
It's particularly relevant in warmer weather situations where I might have shorts or just less clothing on in general. It's always a cinch to find a spot for my SE.