There have been Xeon SKUs with integrated graphics before. I'm certain Intel could provide one with sufficient punch to drive the upcoming pro display. Don't hear this discussed much. Or, since there will be PCIe slots, there's room for a GPU on a mezzanine card somewhere in there.
The more I think about it, that's a very Apple solution. Baseline GPU options are Vega 56 and 64 (or equivalents) on a mezzanine card. Apple can customize it to do whatever trickery to handle video over TB3, enthusiasts can upgrade as new cards hit the market (and if not, who cares we have PCIe again).
Hmmm... coupled with my belief that they're really into this thermal core language... imagine the same thermal core. Your configuration options are (per side)
1. CPU
2. GPU
3. 2nd GPU or CPU
Only DIY would attempt upgrade of these core parts.
The rest of the chassis could house 4 full-sized Nvidia GPUs and still be reasonably small. So a mini Z? They must have something more in mind. Some high speed fabric to tie the core components together could be something. AMD was talking about bringing an open source NVLink competitor to market, but it's been a while...