I used to think like you, but noticed real difference in battery life by kicking apps out.Probably bad habits picked up over the years. I was at a birthday party last weekend, and I saw a girl who had the 14PM and she was constantly kicking apps out of memory. That triggers me so bad, lol. Just ignorance.
It's been demonstrated over the years that apps can use various tricks to wake themselves up in the background–through notifications for example (whether silent or visible).
There used to be an argument that kicking apps out of memory consumes more battery because the app has to load again, but everyone knows that iOS is aggressive with memory, meaning that a lot of apps get kicked anyway. If they are still in the app drawer, they can wake themselves up, but if they aren't, they shouldn't be able to.
The other thing is that iPhones are so fast nowadays that it probably doesn't consume that much energy to loads app again.
In any case, I think a lot of apps are playing dirty without Apple noticing or paying attention. If Apple provided an Activity monitor for iOS, people (at least power users) would be able to accurately monitor the usage of apps and make appropriate decisions.