As others have noted, it generally should not matter. The only advantage the HDMI port offers over TB4 is the support for 8K resolution or 144Hz refresh rate at 4K.
I have two displays with HDMI ports and I connect my 4K 165Hz MiniLED HDR display to the Studio's HDMI port and the other from one of the USB-C/TB4 ports as it is just a 4K 60Hz display.