Their icon will have a cloud with a down arrow next to their name. If you touch the icon it says the app needs to be updated and you can "keep" or "delete".
103 applications here. I recently, with iOS 14, went through and decided to remove stuff I haven't touched in awhile, found a few games that no longer worked, etc - probably uninstalled some 20-30 applications.