It might surprise you, but that's exactly what GPU driver have been doing for decades and do today, with great success. Yes, GPU data synchronization is a complicated and channeling topic. But it's a solved problem.
Stop assuming that there is some weird magic to Apple's implementation that prevents it from using PCI-e for data transfers just like any other computer. On the memory organization level, there is little difference between an Intel SoC or an Apple SoC — it's just that the later is faster and smarter.