Click on the icon, top LHS of screen & it's below recent items (5 down), or open Activity Monitor in other in app folder / spotlight it to highlight process & end it there.
You're on the right track.
There just is no such button for an individual app.
You have to click > Force Quit and then a list appears where you can select an individual app.