What about mac pro with MPX hidras? Where each hidra is something like a m4 ultra+ ? Energy efficient, silent, connected via something the 400 Gb range instead of just thundebolt. Will it beat nvidia? Probably not but it will be something that could reduce costs in the end.
Aye, people have mused about the possibility for different multi-chip solutions for the Mac Pro, including SOC-over-board. There are no rumors that I know of that Apple has anything like that planned, but you never know.
Oh, and btw, yes AI/ML is a vast field as mentioned. For a small company in CV we get very far on 4090s and similar and we mostly added a single h100 for the memory increase when working on large images. 4090s i än gamer rigs are silent. The h100 needs its own room. A mac studio would be lovely for experimenting and adding in as ”worker” if it just would fully support its hardware when used with torch or mlx.
Tbh, most smaller companies i worked with use gamer cards since long time. Both for AI and viz. Quadros and radeon pros seldom made sense even in visualization if you didn’t have some very nische need like stereo rendering on a cluster with sync needs.
who is training ML on a 4090 or 5090? unless it’s for fine tuning or for dev/test before moving it to cloud. As some one who uses both Nvidia workstation and a Mac, they compliment each other. Large unified memory is helpful to test and tweak before blowing up money on High end Nvidia GPUs in cloud. Nvidia could potentially increase memory on future 6090, but that would eat in to their data center revenue.
There’s economies of scale in it for Nvidia. Apple’s Mac Pro costs what it costs partially because it leans on the R&D efforts from the millions and millions of base processors that sell in iPads and laptops. They stand on those shoulders, and put a few more of those cores on the die. A completely separate parallel effort to make something that doesn’t build on that tech? The prices can only go up from here.
People are still “trained” to think that the capability of high end solutions shouldn’t be available across the entire line. The fact that your average user, with their single threaded tasks, wouldn’t perceive a significant difference, day-to-day, between a Mac Pro and a MacBook Air (due to the single threaded performance being so similar) still seems foreign and wrong to them. Apple has done with AMD/Intel will never be able to do and instead of marveling at that fact, some are pointing at Intel “Why can’t it be more like that?” It could, Apple could just do what AMD/Intel does and ship solutions with FAR more disabled cores than they do today.
To combine these posts together, this is one advantage Apple has over Nvidia in this space, at least when it comes to boutique-firm/prosumer hardware. Even Apple's base machines have decent if not good margins and they don't have "big iron" device profits to protect. Nvidia's gaming chips have much lower profit margins than their professional devices and they try to actively dissuade people from using the gaming chips for the professional purposes (e.g. in addition to lower VRAM, you'll note Blackwell 2 gaming chips have a lot lower matmul throughput than Blackwell 1 professional chips and of course no FP64 acceleration and this has been true for many Nvidia product lines even when the two share silicon). This isn't to say that Apple wouldn't want high margins on a hypothetical Mac Pro Hidra, of course they would, but Apple are in a position to build something that delivers many, though not all, of the performance features Nvidia offers at the high end (the most obvious example is VRAM capacity, but increase ray tracing/FP32/matmul compute performance and suddenly ...), more economically than Nvidia (currently, Nvidia and AMD likely see the writing on the wall here too and more SOCs are expected from both - even AMD is supposedly working on an ARM chip).
I think you can link 4 Mac Studios together, albeit only with TB5 bandwidth. I’s the only solution for fine tuning full models under probably $500k right now and works reasonably well for MoE if you only have a couple people doing the work.
Once Apple addresses their slow matrix GPU performance things are really going to get interesting. I’m going to be devastated if Mac Pro gets m3 because it means 2 years without those massive gains.
nvidia has a huge lead with their interconnect technologies, Apple really should put something special in the Mac Pro if they can swing it, and bring it to the next Studio.
My guess is their internal PCC servers will indeed have fancier interconnects if the rumors are anything to go on, but what Apple can (economically) put on the Mac Pro/Studio is a different matter.
Last edited: