Thanks for your detailed guidance, it really helps a lot in making the right choice.Ahh, yes I chose wrong but it ended up working out with some modifications. I have the GIGABYTE GeForce RTX 3070 Ti Gaming OC 8G (https://www.amazon.com/dp/B097G7RBSZ?ref=ppx_yo2ov_dt_b_fed_asin_title), however it is slightly too long and does not fit with the MacPro fan module. I ended up buying a spare on eBay which I took apart - I essentially stripped the fan from the enclosure and then set it in place with some velcro tape. Additionally, the graphics card is a bit too tall and blocks the second 16x slot when installed in the bottom one. I ended up moving it up to the 2nd 16x slot so I could use an NVMe SSD adapter in the bottom one. With all that though I cannot fit any additional PCIe cards. Hope this is helpful and that you might be able to find a card that fits a bit better... but if you don't need much installed it likely won't matter.
As an Amazon Associate, MacRumors earns a commission from qualifying purchases made through links in this post.