It's also a specialised one. It's not necessarily an aspirational product that sells stuff lower in the range. Someone buying a Dell XPS laptop, for instance, isn't secretly lusting after (or possibly even aware of) the Precision 7865 tower.
True. But it does give them bragging rights which extends to the other M-series chips.
An RTX 4090 is barely affected by running on PCIe 3.0 vs 4.0, and doesn't even support 5.0. So calling PCIe 3.0 a bottleneck is overstating it a bit. Sure, you can get the same bandwidth with half the lanes on 4.0, but the MP 2019 has plenty of lanes.
Well, Apple seemed to feel it was necessary to build those dual-GPU MPX modules. If the Xeon had supported PCIe 4.0 it might not have been necessary. I'm just theorizing, of course!
How useful is TB routing in practice though? Don't most people just plug their monitor(s) into their graphics card?
Usually, yes, but if you're daisy-chaining stuff via TB4 it helps reduce cable clutter.
Using what? Where's the PCIe lanes on M1/2?
Aye, there's the rub. That's why either the SOC will need to have more of an onboard PCIe infrastructure, or hand that off to the motherboard chipset and have some sort of wide-bandwidth connection.
Apple tried this sort of thing with the Xserve. They like to add value with design, and stuff that goes in a server room doesn't give them much opportunity to shine in this regard. More to the point, would Apple be regularly iterating on server chips, with a published long-term roadmap? Or would they just lose interest after a few years? Would these chips have much relevance to their consumer products? That sort of ARM stuff is better left to Ampere.
You might be right, but I think Apple Silicon positions them a bit differently now. The old G3/G4 Xserve wasn't really of interest to anyone except existing MacOS users, and the current rackmount Mac Pro is definitely not cost-efficient for large hosting / data center operations.
General-purpose ARM chips may excel at average server tasks, but what the M-series has going for it is a lot of dedicated onboard GPU units, AV encode / decode hardware, and very low power requirements. Probably overkill for web servers, but very much of interest for any company that handles media uploads / capture, 3D rendering, cloud streaming, etc.
Also consider, if/when Apple comes out with its AR / VR consumer solution, they will want to support content creators and app developers with complementary hardware. Maybe this won't be sold, per se, but will run in Apple datacenters as a hosted solution. For instance, being able to do game streaming for the Apple TV platform, including smart TVs that run the Apple TV app.