Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

theorist9

macrumors 68040
May 28, 2015
3,880
3,059
Yes, that amount of RAM would indeed serve, but I doubt that I could afford it. :)

I would indeed always prefer to have modular RAM, as I will likely need multi-terabyte RAM configs in the future. I don't need top-of-the-line processing power, but I do need lots of RAM and lots of storage for my work.

- Alex
Yeah, modest processing needs combined with high RAM and storage needs are probably the worst value case for the Apple Silicon Macs.

Plus since you're using them as servers, you don't interact with the OS's GUI much anyways (certainly not as much as someone using it as a workstation), hence removing one of the main reasons for getting a MacOS box rather than a Linux box.
 
  • Like
Reactions: Ruftzooi

ajacocks

macrumors newbie
Jul 20, 2009
24
19
Middletown, MD, USA
Well, not really. I have used all the Mac OS based server management applications, in addition to tools like VMware Fusion, Parallels and UTM.

Additionally, I use Podman desktop for Mac. So, Mac desktops are actually quite good for engineering desktops. Also, the CAD that I use, Autodesk Fusion 360, runs very well on Apple Silicon.

So, were Apple to make a machine I could use again, which every top-of-the-line G4, G5, 2006-2010 Mac Pro and 2019 Mac Pro would fit. However, the 2019 Mac Pro is unbelievably expensive, or I would probably already have one.

I, along with a lot of other *nix developers and engineers, think that Mac OS provides the best front end for engineering and development work.

- Alex
 

theorist9

macrumors 68040
May 28, 2015
3,880
3,059
Well, not really. I have used all the Mac OS based server management applications, in addition to tools like VMware Fusion, Parallels and UTM.

Additionally, I use Podman desktop for Mac. So, Mac desktops are actually quite good for engineering desktops. Also, the CAD that I use, Autodesk Fusion 360, runs very well on Apple Silicon.

So, were Apple to make a machine I could use again, which every top-of-the-line G4, G5, 2006-2010 Mac Pro and 2019 Mac Pro would fit. However, the 2019 Mac Pro is unbelievably expensive, or I would probably already have one.

I, along with a lot of other *nix developers and engineers, think that Mac OS provides the best front end for engineering and development work.

- Alex
You're preaching to the choir when it comes to using Macs as workstations:
Macs are particularly popular among physical scientists like myself because they have a great UI, allow us to use our favorite programs for publishing papers and analyzing data, and also offer a native Unix interface for doing programming.
But that's not germane to our discussion, since we were talking about server use. And while you might prefer MacOS over Linux for server use, don't you find the OS has much less of an impact on your user experience when you are using it as a server than as a workstation?
 
Last edited:

ajacocks

macrumors newbie
Jul 20, 2009
24
19
Middletown, MD, USA
@theorist9 I'm not actually using Macs as servers, to be clear. I just replaced my test usage with a server, in this case, which is not my preference. I do indeed use Linux-based servers for all my server applications.

Anyway, as I said, I just with Apple would again make one high-end completely modular Mac, so that users could customize it to their particular use case. I very much like the path that Framework is taking, on the PC side, and would love to see that kind of modularity come to Apple.

I know that this is a forlorn hope. :)

- Alex
 

MRMSFC

macrumors 6502
Jul 6, 2023
371
381
@theorist9 I'm not actually using Macs as servers, to be clear. I just replaced my test usage with a server, in this case, which is not my preference. I do indeed use Linux-based servers for all my server applications.

Anyway, as I said, I just with Apple would again make one high-end completely modular Mac, so that users could customize it to their particular use case. I very much like the path that Framework is taking, on the PC side, and would love to see that kind of modularity come to Apple.

I know that this is a forlorn hope. :)

- Alex
So, hypothetically speaking, what would be your requirements for this dream Mac Pro?
 

leman

macrumors Core
Oct 14, 2008
19,520
19,669
Modularity. I really want an Apple Silicon version of the 2019 Mac Pro, or even better, the 2010 Mac Pro. As much upgradability as possible.

- Alex

So far it seems that your main concern is RAM. Would it suffice for you if, say, Apple introduced RAM expansion via PCIe?
 

theorist9

macrumors 68040
May 28, 2015
3,880
3,059
So far it seems that your main concern is RAM. Would it suffice for you if, say, Apple introduced RAM expansion via PCIe?
Based on my conversation with @ajacocks, it seems his main concern is not RAM upgradeability alone, but that plus its cost. Here's what he said when I asked if 512 GB (the amount Apple should be able to offer on the Ultra when it switches to LPDDR5x) would be sufficient:
Yes, that amount of RAM would indeed serve, but I doubt that I could afford it. :)

I would indeed always prefer to have modular RAM, as I will likely need multi-terabyte RAM configs in the future. I don't need top-of-the-line processing power, but I do need lots of RAM and lots of storage for my work.

- Alex
And knowing Apple, they may only offer RAM expansion on the MP if they could do it with Apple-exclusive modules for which they charge Apple-level prices, rather than allowing something like Samsung's PCIe 5.0-based CXL RAM:
After all, that's exactly what they did with the MP's upgradeable NAND--you have to buy the Apple-branded product, and pay Apple prices.

And even if they did collaborate with Sammy, I don't expect those CXL modules to have commodity RAM pricing.
 
Last edited:

crazy dave

macrumors 65816
Sep 9, 2010
1,450
1,221
Based on my conversation with @ajacocks, it seems his main concern not RAM upgradeability alone, but that plus its cost. Here's what he said when I asked if 512 GB (the amount Apple should be able to offer on the Ultra when it switches to LPDDR5x) would be sufficient:

And knowing Apple, they may only offer RAM expansion on the MP if they could do it with Apple-exclusive modules for which they charge Apple-level prices, rather than allowing something like Samsung's PCIe 5.0-based CXL RAM:
After all, that's exactly what they did with the MP's upgradeable NAND--you have to buy the Apple-branded product, and pay Apple prices.

Only if you buy from Apple - according to the thread about soldering your own SSDs, you can reliably buy the exact same SSD modules on the Chinese market. A quick scan seems to confirm this. They are good SSD modules, but they are just fundamentally SSD modules. One of the reasons Apple probably doesn't allow upgrades across its lineup, which lets be clear I think they should, is because the selling of raw SSD modules of the kind Apple uses would become a big business and there'd be nothing Apple could actually do. Again, apparently it's already a big business in China for soldering down extra iPhone memory. Now imagine if the ones on Macs weren't even soldered, you could just swap them a la the Mac Pro (and technically the Studio but I don't think the Studio will let you upgrade them). Macs may be a small percentage worldwide, but it's growing and everyone buying a Mac could upgrade easily then that would still be millions of people who could more cheaply get SSDs from third parties if Apple's prices remained too high. Restricting upgrades to the Mac Pro means most people won't even consider it and means it isn't really economical to start a business offering 3rd party SSD upgrade kits. Maybe we'll see it anyway, it wouldn't shock me, but ... it's certainly harder.

And even if they did collaborate with Sammy, I don't expect those CXL modules to have commodity RAM pricing.

While I don't know Apple will go down the CXL route, would be interesting - a good use of those PCIE lanes for sure, just don't know how it would play out otherwise, but if it was truly CXL, Apple couldn't really stop you from getting 3rd party solutions. They'd have to roll their own connection if they actually wanted to prevent you from getting standard CXL modules. Oddly, given the use case for CXL, I actually think this is one they wouldn't bother to stop people. CXL RAM is not want you want to use as day-to-day RAM or anything really latency sensitive or even for the GPU. It wouldn't be something that could replace the unified memory architecture. CXL memory has its uses of course, it could serve as an additional cache and perhaps for the purposes @ajacocks needs. But in that sense it would be no different than someone buying any kind of PCIe board that does a specific task to improve the Mac Pro's capabilities - e.g. Apple doesn't demand you only buy Apple branded PCIe Raid drives just because you could in theory use that instead of their storage. This feels more like than that than say Afterburner which of course was effectively moved into the SOC itself upon the introduction of Apple Silicon to the Macs.
 
Last edited:

leman

macrumors Core
Oct 14, 2008
19,520
19,669
Based on my conversation with @ajacocks, it seems his main concern is not RAM upgradeability alone, but that plus its cost.

Ah yes, that will probably remain a problem. If Apple does improve the modularity and capabilities of the Mac Pro, the price will go up, not down.

While I don't know Apple will go down the CXL route, would be interesting - a good use of those PCIE lanes for sure, just don't know how it would play out otherwise, but if it was truly CXL, Apple couldn't really stop you from getting 3rd party solutions. They'd have to roll their own connection if they actually wanted to prevent you from getting standard CXL modules. Oddly, given the use case for CXL, I actually think this is one they wouldn't bother to stop people. CXL RAM is not want you want to use as day-to-day RAM or anything really latency sensitive or even for the GPU. It wouldn't be something that could replace the unified memory architecture. CXL memory has its uses of course, it could serve as an additional cache and perhaps for the purposes @ajacocks needs. But in that sense it would be no different than someone buying any kind of PCIe board that does a specific task to improve the Mac Pro's capabilities - e.g. Apple doesn't demand you only buy Apple branded PCIe Raid drives just because you could in theory use that instead of their storage. This feels more like than that than say Afterburner which of course was effectively moved into the SOC itself upon the introduction of Apple Silicon to the Macs.

There is an interesting discussion about this very topic going on at https://www.realworldtech.com/ (worth a look if you have an interest in technology). I am not convinced that Apple will use CXL (they do not appear to be a consortium member), they could ship something sufficiently similar. There is some evidence that Apple might be planning to introduce a new model for chip scalability — transitioning from a direct UltraFusion connector to a dedicated silicon that hosts a routing network. This silicon could potentially integrate more PCI-e lanes and memory controllers, compensating for lack of capability in the base Max chip. My favored solution would be inclusion of regular DRAM sockets (e.g. with four or six memory channels) for expandability.

Regarding bandwidth, it would make sense for the expandable memory to work as a last RAM tier (and faster system LPDDR serving as cache). Memory access patterns show strong locality properties, this is why caches work. I think having a large expandable pool of RAM that's 4-5x slower than the local DRAM would be worth it for most applications. Especially the GPU. And it would be 100% compatible with unified memory.
 

crazy dave

macrumors 65816
Sep 9, 2010
1,450
1,221
There is an interesting discussion about this very topic going on at https://www.realworldtech.com/ (worth a look if you have an interest in technology). I am not convinced that Apple will use CXL (they do not appear to be a consortium member), they could ship something sufficiently similar.

I'm not convinced either, I just don't think this is an area where Apple would necessarily roll their own solution. They might but I could easily see them offering CXL compatibility unless there was some solution that fit their model better.

There is some evidence that Apple might be planning to introduce a new model for chip scalability — transitioning from a direct UltraFusion connector to a dedicated silicon that hosts a routing network. This silicon could potentially integrate more PCI-e lanes and memory controllers, compensating for lack of capability in the base Max chip. My favored solution would be inclusion of regular DRAM sockets (e.g. with four or six memory channels) for expandability.
That would be cool, I believe we were talking about it at the other place but I hadn't considered upgradeable RAM as a potential benefit. Of course with such a system you could also just buy regular DRAM to fill those slots. If the connector to add the DRAM sockets to the Mac Pro was optional then I could see that being expensive, but that's not quite the same thing and would still ultimately offer "3rd party" modularity.

Regarding bandwidth, it would make sense for the expandable memory to work as a last RAM tier (and faster system LPDDR serving as cache). Memory access patterns show strong locality properties, this is why caches work. I think having a large expandable pool of RAM that's 4-5x slower than the local DRAM would be worth it for most applications. Especially the GPU. And it would be 100% compatible with unified memory.

Sure this is what I was imagining though I'll admit I mistakenly used the word cache to describe the last RAM tier instead of the closer one. My point was that for those who really need bandwidth and latency, CXL isn't a straight up replacement for larger pools unified memory so Apple wouldn't necessarily feel threatened by users buying that capability from a 3rd party - I dunno maybe if the unified memory pool was large enough, say 192-256 GB ;), it would be fine. But going smaller at some point we know it isn't good enough or unified memory wouldn't provide much of a benefit over communicating over PCIe with a dGPU (i.e. Nvidia's Ada or even Hopper line of GPUs would provide no benefit relative to a 24GB 4090 and large DRAM pool but we know they do which is why Nvidia sells even Adas for thousands of dollars more than the 4090 and sticks large amounts of expensive HBM VRAM on their workstation chips, even those nv-linked with their own CPUs with large amounts of memory in a Grace-Hopper). So there still has to be a trade off there or at least a crossover point.


Ah yes, that will probably remain a problem. If Apple does improve the modularity and capabilities of the Mac Pro, the price will go up, not down.

Indeed, the solution above would require at least an Ultra if not an "Extreme" style SOC. For @ajacocks' purposes he would prefer this solution but on a lower-end, less expensive chip which even if Apple went down this road wouldn't be the case. Right now, the least expensive Mac Pro on offer, when they don't have any of this, is $7500 which I think is already beyond what he's looking for even if it otherwise had RAM/storage modularity.
 
Last edited:

ajacocks

macrumors newbie
Jul 20, 2009
24
19
Middletown, MD, USA
What I’d like is simply a modernized version of what was offered before:

1 or 2 socketed CPUs
lots of user-replaceable RAM
plenty of PCIe slots
multiple user-replaceable storage devices

See the HP Z-series high-end desktops, for a current equivalent. Or the Dell Precision high-end workstations. I’m willing to spend several thousand $ for the machine, but it needs to be expandable so that it can have a long service life.

My comment was that I know Apple could make such a machine, but they clearly don’t see the market being large enough for them to do so. I want the same kind of workstation that engineers and architects, visual effects creators, and other traditional workstation users do.

- Alex
 

bcortens

macrumors 65816
Aug 16, 2007
1,324
1,796
Canada
What I’d like is simply a modernized version of what was offered before:

1 or 2 socketed CPUs
lots of user-replaceable RAM
plenty of PCIe slots
multiple user-replaceable storage devices

See the HP Z-series high-end desktops, for a current equivalent. Or the Dell Precision high-end workstations. I’m willing to spend several thousand $ for the machine, but it needs to be expandable so that it can have a long service life.

My comment was that I know Apple could make such a machine, but they clearly don’t see the market being large enough for them to do so. I want the same kind of workstation that engineers and architects, visual effects creators, and other traditional workstation users do.

- Alex
This is unlikely because the tradeoffs aren't worth it to them.

The tradeoffs of having 2 sockets vs 1 is in the memory architecture - this would also fragment the platform, I really don't want them to fragment the high performance software architecture design platform. I want all Mac software to be written with unified memory in mind because it benefits all Macs that way.

User replaceable RAM - possible but might affect latency and to achieve the bandwidth Apple likes would require a LOT of memory channels (a single channel is about 64 GB/s so to get to 800 GB/s you would need 13 channel memory)

There are already plenty of PCI-e slots and for the things they are intended to be used for there is already plenty of bandwidth.

You can already add PCIe storage cards to the current AS Mac Pro
 

leman

macrumors Core
Oct 14, 2008
19,520
19,669
My comment was that I know Apple could make such a machine, but they clearly don’t see the market being large enough for them to do so. I want the same kind of workstation that engineers and architects, visual effects creators, and other traditional workstation users do.

- Alex

They could if they gave up on Apple Silicon and continued using x86 platform. I would think that many of the user groups you mention do benefit from Apple Silicon architecture. So yes, I agree with you that the market fragmentation and brand weakening are not worth it for Apple to go after this very small market.
 

crazy dave

macrumors 65816
Sep 9, 2010
1,450
1,221
What I’d like is simply a modernized version of what was offered before:

1 or 2 socketed CPUs
Remember these are SOCs now, not CPUs. A single socketed SOC is possible though unlikely. 2 SOCs, socketed or not, is incredibly unlikely. The design of Apple Silicon is fundamentally about unified memory and an SOC and even when Apple had 2 CPUs, they didn't support NUMA. That would likely be a no go with the requirements of AS an SOC (the memory and SLC have to fill not just a CPU but all the accelerators like GPU, NPU, etc ...). More likely than a socketed SOC would be a user replaceable motherboard and even that I don't think is hugely likely though they absolutely could offer that. Still not a bad idea.
lots of user-replaceable RAM
Possible but unlikely with too many tradeoffs. Again unified memory is fundamental to the AS design.
plenty of PCIe slots
They already have the physical slots on the AS Mac Pro, but they are using a PCIe switch for most of them. Thus, depending on your use case you can easily overwhelm the internal bandwidth and as such they need a processor with enough PCIe lanes to feed (most of or at least more of) them without relying on a switch. An "Extreme" processor bigger than the Ultra would fulfill your requirements here. Despite all the rumors to the contrary I fundamentally believe that if Apple intends to stay in this market they will offer such a SOC and more PCIe lanes off the SOC will return.
multiple user-replaceable storage devices
Good news, this part is already possible today! :) 1 out of 4! PCIe storage is quite available and in theory even the socketed SSDs are user upgradeable and 3rd parties could offer upgrade kits.
See the HP Z-series high-end desktops, for a current equivalent. Or the Dell Precision high-end workstations. I’m willing to spend several thousand $ for the machine, but it needs to be expandable so that it can have a long service life.

My comment was that I know Apple could make such a machine, but they clearly don’t see the market being large enough for them to do so. I want the same kind of workstation that engineers and architects, visual effects creators, and other traditional workstation users do.

- Alex
I would argue that the current Studio/Mac Pro offer a compelling device for all of those fields. Certainly Apple has made trade offs but just as there are disadvantages, there are also massive advantages to their approach. For one, having a massive pool of VRAM for workstation tasks is not something you can currently get in the PC space and that has big implications for all the workstation tasks mentioned. However, I'd be the first to agree that for Apple to really offer a compelling product in the Mac Pro tier, they need a larger SOC with more PCIe, a larger GPU (preferably with better matmul for AI), and more unified memory. The larger CPU from such a SOC would also be nice, but of course Apple's Ultra CPU is already damn good.
This is unlikely because the tradeoffs aren't worth it to them.

The tradeoffs of having 2 sockets vs 1 is in the memory architecture - this would also fragment the platform, I really don't want them to fragment the high performance software architecture design platform. I want all Mac software to be written with unified memory in mind because it benefits all Macs that way.
Indeed, that's why even adding CXL or a similar solution seems like a long shot. It is almost even contradictory to AS' design and could result in fragmentation. But even said that it's not impossible and there may be solutions. If Apple did do it, especially @leman's idea, then there might be ways to do it so the additional RAM tier would be transparent to the end user - i.e. the users don't worry about the location in memory and the OS simply handles it. Thus software wouldn't be written with this capability in mind for performance - except perhaps in the requirement that you have enough memory for the task.
User replaceable RAM - possible but might affect latency and to achieve the bandwidth Apple likes would require a LOT of memory channels (a single channel is about 64 GB/s so to get to 800 GB/s you would need 13 channel memory)

There are already plenty of PCI-e slots and for the things they are intended to be used for there is already plenty of bandwidth.

You can already add PCIe storage cards to the current AS Mac Pro

They could if they gave up on Apple Silicon and continued using x86 platform. I would think that many of the user groups you mention do benefit from Apple Silicon architecture. So yes, I agree with you that the market fragmentation and brand weakening are not worth it for Apple to go after this very small market.
In the time it took my to respond everyone else already covered it all.
 
Last edited:

theorist9

macrumors 68040
May 28, 2015
3,880
3,059
Only if you buy from Apple - according to the thread about soldering your own SSDs, you can reliably buy the exact same SSD modules on the Chinese market. A quick scan seems to confirm this. They are good SSD modules, but they are just fundamentally SSD modules. One of the reasons Apple probably doesn't allow upgrades across its lineup, which lets be clear I think they should, is because the selling of raw SSD modules of the kind Apple uses would become a big business and there'd be nothing Apple could actually do. Again, apparently it's already a big business in China for soldering down extra iPhone memory. Now imagine if the ones on Macs weren't even soldered, you could just swap them a la the Mac Pro (and technically the Studio but I don't think the Studio will let you upgrade them). Macs may be a small percentage worldwide, but it's growing and everyone buying a Mac could upgrade easily then that would still be millions of people who could more cheaply get SSDs from third parties if Apple's prices remained too high. Restricting upgrades to the Mac Pro means most people won't even consider it and means it isn't really economical to start a business offering 3rd party SSD upgrade kits. Maybe we'll see it anyway, it wouldn't shock me, but ... it's certainly harder.
I'm familiar with that thread, since I've made several posts there, e.g.:
This might be interesting to do for an older device that you own and would otherwise need to get rid of because you'd outgrown its storage. But if you just wanted to save money on a device you're buying now, it seems safer and more cost-effective to instead buy a used device with the storage you need from one generation ago.

For instance, a new M2 Mini with 16 GB RAM and a 2 TB SSD is currently $1,600. But I've seen sold listings on eBay for an M1 with those specs for $700. And when the M3 Mini comes out, similar deals will be available on the M2.
More broadly, you start by saying "Only if you buy from Apple", as if you were going to explain why you disagree with what I wrote about secondary RAM, but then get into a long digression about aftermarket SSD upgrades. So I'm afraid I'm not following what specific point you're trying to make about what I wrote.


Oddly, given the use case for CXL, I actually think this is one they wouldn't bother to stop people. CXL RAM is not want you want to use as day-to-day RAM or anything really latency sensitive or even for the GPU. It wouldn't be something that could replace the unified memory architecture. CXL memory has its uses of course, it could serve as an additional cache and perhaps for the purposes @ajacocks needs. But in that sense it would be no different than someone buying any kind of PCIe board that does a specific task to improve the Mac Pro's capabilities - e.g. Apple doesn't demand you only buy Apple branded PCIe Raid drives just because you could in theory use that instead of their storage. This feels more like than that than say Afterburner which of course was effectively moved into the SOC itself upon the introduction of Apple Silicon to the Macs.
1) I think CXL could be more useful than how you portray it. Consider someone that needs to do an operation on a block of data too large to fit in their primary RAM (whether than be UMA or traditional). Swapping to the secondary RAM would be much faster than swapping to the SSD. Indeed, if it didn't provide such a benefit, there would be no market for it, and Samsung wouldn't have spent the presumably substantial developent dollars on it.

2) If Apple offered secondary RAM, I'm sure they would want to stop people from using aftermarket solutions, since (unlike the case with PCIe storage) I imagine there would be significant development costs* incurred in modifying their UMA to accommodate secondary RAM, and they would want to recoup those.

*At the same time, I don't see anything about UMA that would preclude it. Currently, they have a mechanism to swap to the SSD when there's not enough RAM. With secondary RAM, they could do the same thing, just with an extra layer: They would swap to the secondary RAM instead of the SSD—and only swap to the SSD when the secondary RAM wasn't enough. Or even if this isn't how they would implement it (e.g., for some operations, it may be more efficient to have the most-frequently accessed data be resident in the primary RAM, and the remainder be in the secondary RAM, and give the CPU and GPU direct access to both, rather than having them accessed hierarchically), I don't think UMA would provide a particular barrier to implementing secondary RAM.
 
Last edited:

ajacocks

macrumors newbie
Jul 20, 2009
24
19
Middletown, MD, USA
I know the UMA argument very well, as I used SGI O2 workstations professionally, and own one now. The primary trade-off is limited memory size in exchange for performance. They are also, in modern form, unexpandable.

I’m also quite familiar with the SoC concept, and know the origin with microcontrollers.

The performance and size advantages are clear, but they are by nature unexpandable. That’s not great for my personal use-case, but it also creates ewaste, which is why I am such a strong believer in modular design, in servers, desktops and laptops.

- Alex
 

theorist9

macrumors 68040
May 28, 2015
3,880
3,059
I know the UMA argument very well, as I used SGI O2 workstations professionally, and own one now. The primary trade-off is limited memory size in exchange for performance. They are also, in modern form, unexpandable.

I’m also quite familiar with the SoC concept, and know the origin with microcontrollers.

The performance and size advantages are clear, but they are by nature unexpandable. That’s not great for my personal use-case, but it also creates ewaste, which is why I am such a strong believer in modular design, in servers, desktops and laptops.

- Alex
I think it's important to understand (not that you don't understand this, but it's worth saying explictly) that Apple went with UMA for two reasons: (1) The technical benefit it provides to its products; and (2) The financial benefit it provides to Apple.

Expanding on #2: As with storage, RAM upgrades are a big source of profit for the Mac division—this is obvious from the prices they charge. Thus Apple views UMA's non-expandabilty as a positive, since it forces all its Mac desktop customers to buy RAM only from Apple, and do so at the time of sale. Without UMA, Apple couldn't justify not offering expandable RAM in its desktops. Now it can.

Thus it's highly unlikely Apple would be willing to allow post-sale expansion (unless it can be purchased only from Apple). And hence it's highly unlikely Apple will ever again offer the inexpensively-expandable workstation you desire.
 
Last edited:
  • Like
Reactions: gusmula

crazy dave

macrumors 65816
Sep 9, 2010
1,450
1,221
I'm familiar with that thread, since I've made several posts there, e.g.:
I was referring to this thread:


But yes I am aware you are aware as you posted in the other thread on this subject. :) I was pointing out its relationship to what you wrote.

More broadly, you start by saying "Only if you buy from Apple", as if you were going to explain why you disagree with what I wrote about secondary RAM, but then get into a long digression about aftermarket SSD upgrades. So I'm afraid I'm not following what specific point you're trying to make about what I wrote.

Ah sorry if my response was confusing. I was responding specifically to the below:
After all, that's exactly what they did with the MP's upgradeable NAND--you have to buy the Apple-branded product, and pay Apple prices.
Sure Apple offers expensive upgrade kits but they don't block PCIe SSDs. If you've already bought the Mac Pro, you don't have to pay Apple prices if you don't want to and you still get internal storage. Further 3rd party upgrade kits for even Apple's slots could feasibly be made. It's just hard to make a compelling business case out of it as it only applies to the Mac Pro and the Mac Pro can already add as much storage as you want easily. You wrote that even Apple's MP upgradeable NAND supports the idea that they would ensure there would no 3rd party RAM if that was upgradeable and I argue that it shows the opposite.

1) I think CXL could be more useful than how you portray it, for someone that needs to do an operation on a block of data too large to fit in their primary RAM (whether than be UMA or traditional). Swapping to the secondary RAM would be much faster than swapping to the SSD. Indeed, if it didn't provide such a benefit, there would be no market for it, and Samsung wouldn't have spent the substantial developent dollars on it.
That's exactly how I think it'll be used. I'm just saying that's not a replacement for someone needing lots of UM - after all we already see solutions like Grace Hopper where huge amounts of on-chip VRAM are needed even though it offers cache coherent memory across an even faster bus than PCIe 5. Just as there is a market and use case for CXL there would still be a market for large pools of high bandwidth GPU memory. Perhaps I downplayed it too much, but that's what I was trying to say.

2) If Apple offered secondary RAM, I'm sure Apple would want to stop people from using aftermarket solutions, since (unlike the case with PCIe storage) I imagine there would be significant development costs incurred in modifying their UMA to accommodate secondary RAM, and they would want to recoup those.
So this all theoretical and seems a little silly to disagree about something that doesn't and may never exist for the Mac. But both solutions, CXL and RAM sticks, discussed here would ultimately be similar to PCIe storage. Basically there would be 3rd party solutions and I disagree that the costs would be large enough that Apple would block them unless Apple went and developed a completely novel and bespoke system and even then there would likely be a market for 3rd party solutions if that market were big enough.


*At the same time, I don't see anything about UMA that would preclude it. Currently, they have a mechanism to swap to the SSD when there's not enough RAM. With secondary RAM, they could do the same thing, just with an extra layer: They would swap to the secondary RAM instead of the SSD—and only swap to the SSD when the secondary RAM wasn't enough. Or even if this isn't how they would implement it (e.g., for some operations, it may be more efficient to have the most-frequently accessed data be resident in the primary RAM, and the remainder be in the secondary RAM, and give the CPU and GPU direct access to both, rather than having them accessed hierarchically), I don't think UMA would provide a particular barrier to implementing secondary RAM.

Very much agreed: it would have to function like super-swap so it would be transparent to the user and not fragment the user base which as @bcortens pointed out is a potential issue. At that point I agree I don't think it would be much of a challenge to add to UMA. But there may be wrinkles I'm not seeing.

I know the UMA argument very well, as I used SGI O2 workstations professionally, and own one now.
Now there's a blast from the past!

The primary trade-off is limited memory size in exchange for performance.
Ehhh ... only at the very highest end of memory size and even then technically Apple can and likely will increase RAM availability at the higher end. At most product tiers it's more of an exchange of cost vs performance. ;)

They are also, in modern form, unexpandable.

For RAM? Currently true and admittedly likely to continue to be true. Having said that CXL and other related solutions may ameliorate that in the future.

I’m also quite familiar with the SoC concept, and know the origin with microcontrollers.

The performance and size advantages are clear, but they are by nature unexpandable.

It depends. Beyond RAM, they are less modular in the since you cannot pair a low end CPU with a high end GPU (chiplets may help with this) or replace just a component of the SOC at a time (but would not help with this) but in terms of expandability, the ability to add more stuff on top, then in theory that's quite feasible for many common PCIe applications. Apple's PCIe lanes are limited but that's more a function of the laptop-focused design of the Max and the lack of an Extreme SOC. Those aren't intrinsic to the idea of using an SOC. In fact truthfully most of the industry is moving towards SOC design but they aren't necessarily losing dGPUs yet. You could even allow motherboard upgrades which would save the chassis and allow people to upgrade all the components at once - a higher one time price vs amortized over time, but functionally equivalent. Of course Apple doesn't do this, but there isn't any reason why they couldn't. Theoretically you could even offer a socketed SOC, Apple almost certainly wouldn't but in theory you could.

That’s not great for my personal use-case, but it also creates ewaste, which is why I am such a strong believer in modular design, in servers, desktops and laptops.

- Alex

I feel the e-waste argument is a little overblown unless you're simply referring to yourself and not wanting to add to the problem which is commendable rather than the market's behavior at large. I don't disagree that in the very tail end of the distribution of computer users a non-upgradeable chassis might have a shorter life, but the median/mean? All the market research points in the same direction that very little changes. Perhaps it shouldn't be that way but it is - though not all of it is for bad reasons: SSDs, modern RAM, and SOCs etc ... last longer than most people change computers and theoretically they, even on the used market, simply don't need upgrades over reasonable lifetimes for a lot of these devices. Obviously focusing on workstations is a little different but even then ...

As I said above, even with the SOC you could in theory offer upgrades like MB upgrades (and even more theoretically socketed SOCs) which would be functionally equivalent in this regard, just bigger individual jumps than smaller ones. Another unfortunate trend is that even in the PC space motherboards don't last as long as they used to (both in terms of their quality which has taken a rather disturbing hit in recent years and also AMD/Intel telling people that the new generation of CPU is backwards compatible with last generation's sockets is now a big deal and met with great elation as opposed to being expected). That's not an excuse not to do better of course.

Basically Apple could build the following kind of workstation:

chipset based SOC with UMA on a upgradeable motherboard
lots of PCIe lanes
CXL or related solution for a large pool of RAM which was transparent to the end user

that would recover 90+% of the modularity/upgradeability while retaining almost all of of the advantages of Apple Silicon. Sadly I'm not sure if Apple will ever build such a device, but a good first step would simply be getting an Extreme SOC!
 
Last edited:

theorist9

macrumors 68040
May 28, 2015
3,880
3,059
Sure Apple offers expensive upgrade kits but they don't block PCIe SSDs. If you've already bought the Mac Pro, you don't have to pay Apple prices if you don't want to and you still get internal storage. Further 3rd party upgrade kits for even Apple's slots could feasibly be made. It's just hard to make a compelling business case out of it as it only applies to the Mac Pro and the Mac Pro can already add as much storage as you want easily. You wrote that even Apple's MP upgradeable NAND supports the idea that they would ensure there would no 3rd party RAM if that was upgradeable and I argue that it shows the opposite.
My argument is that Apple will either block NAND & RAM upgrades, or allow only Apple-branded upgrades, whenever it can get away with doing so (i.e., without creating a PR nightmare), since those are a significant source of profit for them.

The PCIe storage on the MP falls into the category of "can't get away with blocking it", hence they offer it. After all, the only benefit you get from paying the extra $3,000 for the MP over the Studio Ultra is the PCIe slots, and PCIe storage is a standard part of that. Thus there's no way Apple could could get away with blocking customers from using their PCIe cards for storage, as that's a standard part of what PCIe slots allow.

By contrast, they can get away with blocking non-Apple upgrades on their internal NAND, since there is no equivalent "hard expectation" that will be upgradeable. Hence they do block that.

[I'm not saying there's no grumbling about them disallowing 3rd party upgradeability of the slotted NAND on the Studio and MP--there's lots of grumbling about it. But it's nothing like the uproar that would be created if they blocked the PCIe cards on the MP from accepting 3rd party storage solutions.]

Now that I've established this distinction, we can ask: What category would expandable RAM fall into? The answer is that it's clearly the latter, rather than the former. Thus if they offered it, it be would be exactly like internal NAND on the MP--they would block non-Apple-branded upgrades.

In summary, the way Apple does upgradeable NAND on the MP does indeed support the idea that they would block 3rd-party upgradeable RAM.
 
Last edited:

crazy dave

macrumors 65816
Sep 9, 2010
1,450
1,221
My argument is that Apple will either block NAND & RAM upgrades, or allow only Apple-branded upgrades, whenever it can get away with doing so (i.e., without creating a PR nightmare), since those are a significant source of profit for them.

The PCIe storage on the MP falls into the category of "can't get away with blocking it", hence they offer it. After all, the only benefit you get from paying the extra $3,000 for the MP over the Studio Ultra is the PCIe slots, and PCIe storage is a standard part of that. Thus there's no way Apple could could get away with blocking customers from using their PCIe cards for storage, as that's a standard part of what PCIe slots allow.

By contrast, they can get away with blocking non-Apple upgrades on their internal NAND, since there is no equivalent "hard expectation" that will be upgradeable. Hence they do block that.

[I'm not saying there's no grumbling about them disallowing 3rd party upgradeability of the slotted NAND on the Studio and MP--there's lots of grumbling about it. But it's nothing like the uproar that would be created if they blocked the PCIe cards on the MP from accepting 3rd party storage solutions.]

Now that I've established this distinction, we can ask: What category would expandable RAM fall into? The answer is that it's clearly the latter, rather than the former. Thus if they offered it, it be would be exactly like internal NAND on the MP--they would block non-Apple-branded upgrades.

In summary, the way Apple does upgradeable NAND on the MP does indeed support the idea that they would block 3rd-party upgradeable RAM.
I understand but I still disagree on both counts - i.e. both that Apple would necessarily block 3rd party RAM used as a swap/CXL on top of unified memory and that the way Apple NAND works supports your position that Apple would. Even though I think my arguments hold, I think we've run the course on this as they didn't convince you and I don't have any additional arguments to persuade you otherwise and likewise don't find your arguments persuasive either. We'll just have to agree to disagree. :)
 

theorist9

macrumors 68040
May 28, 2015
3,880
3,059
I understand but I still disagree on both counts - i.e. both that Apple would necessarily block 3rd party RAM used as a swap/CXL on top of unified memory and that the way Apple NAND works supports your position that Apple would. Even though I think my arguments hold, I think we've run the course on this as they didn't convince you and I don't have any additional arguments to persuade you otherwise and likewise don't find your arguments persuasive either. We'll just have to agree to disagree. :)
Actually, perhaps I could try one more round ;), by simplifying things:

It seems if you took your argument (that if Apple offered upgradeable RAM on the MP, they would allow 3rd party options), and applied it to the upgradeable NAND on the MP, you would conclude Apple would allow 3rd party options there. Yet they don't. I assert that invalidates your argument.

Can you explain precisely why upgradeable RAM on the MP represents a qualitatively different business case from upgradeable NAND on the MP, such that Apple would allow the former when they don't allow the latter? That's what I've not been able to find in your arguments.
 
Last edited:

JouniS

macrumors 6502a
Nov 22, 2020
638
399
The tradeoffs of having 2 sockets vs 1 is in the memory architecture - this would also fragment the platform, I really don't want them to fragment the high performance software architecture design platform. I want all Mac software to be written with unified memory in mind because it benefits all Macs that way.
I don't think that would change things that much. Apple Silicon Macs already feel like NUMA systems, even if it's hidden from the user. For example, look at these memory latency measurements I've made:

Working setiMac (i9-10910, 128 GiB)MBP (M2 Max, 96 GiB)
1 GiB94 ns117 ns
2 GiB96 ns123 ns
4 GiB108 ns123 ns
8 GiB134 ns129 ns
16 GiB164 ns143 ns
32 GiB182 ns201 ns
64 GiB191 ns365 ns

The exact numbers don't matter, as they are noisy. However, there is a huge increase in latency on M2 Max when the working set increases from 16 GiB (below 1/4 capacity) to 32 GiB (above 1/4), and again from 32 GiB (below 1/2) to 64 GiB (above 1/2). I'd expect that the effect would be even more significant with Ultra.
 

theorist9

macrumors 68040
May 28, 2015
3,880
3,059
I don't think that would change things that much. Apple Silicon Macs already feel like NUMA systems, even if it's hidden from the user. For example, look at these memory latency measurements I've made:

Working setiMac (i9-10910, 128 GiB)MBP (M2 Max, 96 GiB)
1 GiB94 ns117 ns
2 GiB96 ns123 ns
4 GiB108 ns123 ns
8 GiB134 ns129 ns
16 GiB164 ns143 ns
32 GiB182 ns201 ns
64 GiB191 ns365 ns

The exact numbers don't matter, as they are noisy. However, there is a huge increase in latency on M2 Max when the working set increases from 16 GiB (below 1/4 capacity) to 32 GiB (above 1/4), and again from 32 GiB (below 1/2) to 64 GiB (above 1/2). I'd expect that the effect would be even more significant with Ultra.
Have you seen this article, which includes measurements of both GPU and CPU DRAM latency (as well as bandwidth) in the M2 Pro? The article focuses on the GPU, but does include this statement about the CPU:

"M2 Pro’s CPU sees a 116.5 ns latency with a 1 GB test size using macOS’s default 16 KB page size."

That matches the 117 ns value you posted for 1 GiB.

 
Last edited:
  • Like
Reactions: Chuckeee

quarkysg

macrumors 65816
Oct 12, 2019
1,247
841
The exact numbers don't matter, as they are noisy. However, there is a huge increase in latency on M2 Max when the working set increases from 16 GiB (below 1/4 capacity) to 32 GiB (above 1/4), and again from 32 GiB (below 1/2) to 64 GiB (above 1/2). I'd expect that the effect would be even more significant with Ultra.
I'm not sure Apple wants to add NUMA support into macOS without much financial benefit. I would think latency would be an order of magnitude worst or more with multi-socket CPU as synchronisation will have to be done by the OS.
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.