What you are experiencing is called "blooming" and is normal for Mini-LED displays.
Compared to the 2021 iPad Pro, it is much better on the new MacBooks. I have only seen it when viewing from an angle, as you said. On the iPad it's much more prominent, even when looking directly at the screen.
Maybe this will be an interesting read
Reports Suggest Mini-LED 'Blooming' Effect on New MacBook Pro Displays Not an Issue.