I haven't seen a badge on the App Store in a while - probably before iOS 13. But I also have automatic App Updates turned on (Settings > App Store > (Automatic Updates) > App Updates [ON].
I still get the blue and orange dots next to apps on my home screen - blue to indicate that I have not opened an app since it was updated, and orange to indicate that the app is a TestFlight version.
Same here.