1) Has anyone complained that they can't get their work done for of memory?
2) Which PCI cards do the actual users have that don't work in the MP's PCI slots?
3) Yes, these are good, But we do this with the network and use remote computers or the even more remote cloud. No one really wants to train networks on their normal desktop computer because it ties up the machine for days and weeks on end.
4) Yes, more is better but at some point, you offload your work to the cloud or the server room.
1) Yes, there are applications that need a lot of memory. Apple praised the Mac Pro's ability to install 1.5TB of RAM to load large sound libraries. Others: virtualisation, scientific computing, machine learning, etc.
2) Primarily GPU-based computing accelerators, but also other high-bandwidth-intensive add-in cards. Currently, if you add one high-speed RAID card to a Mac Pro 2023, there is no more bandwidth for any other card.
3) Apparently those who use multi-GPU configurations for machine learning disagree with you. The same is true for 3D rendering. Of course you can use external services, but it is also convenient to have a quick view of the 3D scene in realtime and to perform at least test renders. For these applications, Macs are currently non-existent - Macs are even dozens of times slower than PC workstations. It didn't have to be that way at all.
4) Workstation is your personal computer for work - the faster it is, the faster you will get the job done. A properly configured Workstastion PC can be many times more powerful than a Mac. This is the sad reality, unfortunately. Apple's processors are awesome for laptops and mini desktops, but when it comes to Workstations, they completely fail. I realise it's not a profitable market for Apple, but I think they should treat the Workstation market in a similar way to how car manufacturers treat F1. Or space technology development.
Graphics cards or compute cards (without video outputs), have internal bandwidths up to many times greater than the GPU in Apple Silicon and are connected to the system via PCIe5. Understand that it is not a question of whether it can be done, but whether Apple will find it profitable for them. It is very possible that Apple has reallocated all possible engineering resources to work on Vision Pro, as this product is now the most important. By doing so, they have sacrificed the Workstation market (hopefully temporarily).