The only drawback I see when having dual SIM active is when having Facetime* calls over 4G or 5G while driving. As the iPhone has only one radio/modem, when it needs to roam to a new base station on your second SIM while having a Facetime call on the first SIM, you may see short glitches and drops of a split-second. Definitely annoying enough for me to turn Dual SIM off.
* = or any other kind of video call like Teams, Zoom, etc