Saying this, as a mid level power user, the requirements for multi CUDA cores and multi core processors for the limited amount of people, will most likely be satisfied in PC’s. I simply cannot believe Apple will stay with large desktop computers with the directions already shown.
The Cube / trash can will be the future Mac Pro.
There is a disconnect from reality fallacy there that PCI-e slots are primarily only useful for add-in-cards with discrete GPUs on them. That isn't it. There was a "what is in your slots" thread that existed during the 2014-2018 drought on Mac Pro progress that while a substantial fraction of folks had a "non boot screen" GPU installed in a Mac Pro 2009-2012 they also had :
1. Storage drives ( M.2 drives , 2.5" SSD drives )
2. Network cards (Although more 2-4 1GbE or 1-4 10GbE cards more so than one network socket 40 or 100 GbE card)
3. A bit of mix of above External direct or network attached storage.
4. Audio and/or Video capture cards ( sometimes more that 2-3 range )
If going to push huge data and computation out the "cloud" ( somewhere on the other side of Ethernet connection that is out of immediate sight ; not necessarily 100's - 1,000's of miles away. ) then having faster than Apple SOC network speeds makes a difference.
All really need is a aggregate bandwidth of the add-in-cards to be higher than Thunderbolt 3 (or 4 ... same upper limit) and basically taking a "bandwidth" hit to be on the outside.
Apple pretty much admitted in that April 2017 pow-wow on the Mac Pro revitalization that having one and only one internal drive was not cutting it for a substantial number of their Pro customers. The single 4-8TB SSD get rid of the need to have baseline HDD RAID for entry-midlevel users, but workload capacity and speed requirements were still outstripping single drives.
( the two SSD NAND modules in the iMac Pro and Mac Pro are just a single drive. They are no more "RAID" boosted than any other SSD were reads and writes are about the same speed. All SSDs internally use more than one NAND chip concurrently to hide the huge read/write disparity. Apple's modules are about larger than normal capacity on a small card more so than speed. Apple didn't need have to use super, ultra, bleeding edge density NAND modules to get to 4TB in 2017. They didn't again either in 2019 to move to 8TB. )
Some folks have 20TB active (low latency) data set working sizes and archival targets in the 100's of TB range. A single drive isn't going to cut it there for many, many , many years. Apple doesn't have magic pixie dust to tap dance around that kind of gap because it is primary driven down at the basic physics of implementation that Apple does not do. ( don't make NAND chips any more than they make EUV fabrication tools. )
The cube or retreat to the MP 2013 footprint restraints would a mistake. Apple has the flexibility to take the Mini into that zone. They already have a Mini.
Apple's M-series powered "half sized" Mac Pro doesn't have to support 6-8 PCI-e slots. But if it supports zero, then it will probably have substantive problems getting traction with what is left over of the Mac Pro user base. At least one or two slot support is likely necessary. Maybe those don't have "aux power" connector to drive a top end 3rd party GPU card, but a pretty good chance something will be there ( at least for the audio capture folks and local large scratch space crowd. )