You'll need to use at least one of the top Thunderbolt (TB) ports if those are LG UltraFine 4K displays with only one USB-C or TBv3 input.
The XDR consumes two DisplayPort streams to run. So once attached to a "Thunderbolt Bus" (as Apple calls them. Really a TB controller with two DisplayPort inputs attached to it), that bus is 'spent' in terms of any more video.
So you would have to go to a different TB bus. On the base model there is only one other possible one ( the ports on top) if require for a Thunderbolt display.
A display that takes HDMI could use one of the two HDMI ports on the 580X.