Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

Xiao_Xi

macrumors 68000
Original poster
Oct 27, 2021
1,628
1,101
In his last video, Moore law's is dead, a reliable leaker about Intel and Amd, confirms that Apple is making its server chips for internal use, so he believes that Apple may enter the server market again.

How could those chips be? Same as Mac Pro chips? Does it make sense to Apple enter the server market again?
 

senttoschool

macrumors 68030
Nov 2, 2017
2,626
5,482
I don't know how reliable Moore's Law is Dead is. But it's almost a given that they're testing Apple Silicon internally for server use.

It's quite simple. If Apple ever wants users to be able to rent a 40/128 core Apple Silicon at a click of a button while sitting pretty in a coffee shop on a Macbook Air, they'll need server chips. There are probably plenty of other use cases too, including perhaps replacing AWS with their own internal servers for iCloud.


I think what's interesting is them losing some major talent to Nuvia, which was acquired by Qualcomm, because they didn't want to work on a server chip back in 2017 - 2019. This could come back to bite Apple because Qualcomm w/ Nuvia might be the only chance Windows PCs have at competing with Apple Silicon.
 
Last edited:
  • Like
Reactions: zakarhino

zakarhino

Contributor
Sep 13, 2014
2,611
6,963
I was about to make a thread on this then saw yours. This is huge, people were speculating about this a while ago as per the linked thread above but to get confirmation from MLID means it's probably happening. This thread should have way more traffic, this is one of the most interesting Apple news stories in a while.

For those that aren't aware, MLID is probably one of the most accurate/reputable news sources for upcoming info about what's going on in the chip world. If he says he can confirm Apple are working on server chips then he's almost certainly correct.

The question now is what will they be used for. Moving iCloud infrastructure in house to AS is probably a given, although that task will require a tremendous amount of resources, but will we see AS servers used for developer workflows? (Cloud compilation for large Xcode projects?) Or maybe something consumer facing like the ability to offload resource intensive tasks in a client side app to the cloud? Maybe a cloud gaming service is in the pipeline for AAA games?

I wonder if they'll actually end up selling these chips to third parties. There's a lot of money to be made in the cloud computing game. Will they sell just the chips/SOCs to third parties to run whatever software they want (Linux running on AS)? Or maybe they sell the SOCs + macOS Cloud/Server software to cloud compute companies like AWS as an entirely new option for backend work (kinda like how you can spin up Intel Mac Mini EC2 instances on AWS right now).

Again, this is one of the most exciting pieces of news to come out of Apple in years. Also kinda daunting in a weird way. Apple are seemingly going to triple down on building out all avenues of the Apple World ecosystem.
 

Xiao_Xi

macrumors 68000
Original poster
Oct 27, 2021
1,628
1,101
I wonder if they'll actually end up selling these chips to third parties. There's a lot of money to be made in the cloud computing game. Will they sell just the chips/SOCs to third parties to run whatever software they want (Linux running on AS)? Or maybe they sell the SOCs + macOS Cloud/Server software to cloud compute companies like AWS as an entirely new option for backend work (kinda like how you can spin up Intel Mac Mini EC2 instances on AWS right now).
Big cloud service providers design its chips servers. Could Apple's server chips better than AWS's Graviton or Google's TPU?

What could Apple offer different than other cloud service provider? cheaper MacOs for CI?
 

mr_roboto

macrumors 6502a
Sep 30, 2020
856
1,866
In his last video, Moore law's is dead, a reliable leaker about Intel and Amd, confirms that Apple is making its server chips for internal use, so he believes that Apple may enter the server market again.

How could those chips be? Same as Mac Pro chips? Does it make sense to Apple enter the server market again?
MLID is reliable? Don't think so.


He's just a clickbait youtube guy who spits out lots of guesses (often contradicting himself), hypes the hits, and pretends the misses never happened.
 

Jorbanead

macrumors 65816
Aug 31, 2018
1,209
1,438
It's quite simple. If Apple ever wants users to be able to rent a 40/128 core Apple Silicon at a click of a button
Who says Apple is interested in this though? And if they were, why couldn’t they just use the Mac Pro for this purpose?
 

jjcs

Cancelled
Oct 18, 2021
317
153
MLID is reliable? Don't think so.


He's just a clickbait youtube guy who spits out lots of guesses (often contradicting himself), hypes the hits, and pretends the misses never happened.

Moore's law isn't dead anyway. It spoke to increases in transistors not speed.
 

Boil

macrumors 68040
Oct 23, 2018
3,478
3,173
Stargate Command
Who says Apple is interested in this though? And if they were, why couldn’t they just use the Mac Pro for this purpose?

I would think server variants of the Quad Mn Max MCM would be blades on a custom backplane...

I have a years old post somewhere about a new Mac Pro Cube being exactly that...
 

deconstruct60

macrumors G5
Mar 10, 2009
12,493
4,053
In his last video, Moore law's is dead, a reliable leaker about Intel and Amd, confirms that Apple is making its server chips for internal use, so he believes that Apple may enter the server market again.

"Server" chips or Hyperscaler/Cloud chips?

Amazon is rolling out more Graviton2 (Neoverse0 nodes than x86_64 nodes. Baidu is working on an AMD Neoverse solution. Microsoft appears to be working on a Neoverse solution. Oracle's cloud has Ampere nodes . etc.
Who isn't a top end hyperscaler than doesn't have some ARM Neoverse /Ampere / etc ARM nodes in deployment at this point?


If Apple is building (or contracting semi-custom work ) cores for the back end of iCloud , email , photos , etc. (i.e., primarily all Linux workload now on x86_64 ) then Apple could have a hyperscaling chip of their own , but that would have nothing to do with macOS or retail sales at all. Aamazon isn't selling servers. They sell time on servers but not the servers themselves. Google, Facebook , Azure , etc.

So just because it is a hyperscale server chip wouldn't necessarily mean a retail product would fall out of that.

The Jade2c and Jade4C 20 / 40 core chips serving as "server" chips for XCode Cloud. Perhaps . But somewhat doubtful that is actually going to cut the "grade' as a server chip for general purpose (e.g., non macOS ) workloads that invovle substantive I/O throughtput. Apple probably isn't going to scale macOS past 64 cores ( a cap that it has now). There are zero 3d party GPGPU drivers. Again look at major cloud services vendors who don't offer any AI/ML backend coverage. Apple macOS cloud licensing model doesn't really support mass , multitenant servers either.

MacStadium/MacColoc runs 10's of thousands of Minis as servers. It is a "server business" but it isn't the same as what is being talked about in the vast majority of that video.


The bulk of that video is about AMD Bergamo ( 128 core AMD Epyc variant for Cloud/Hyperscalers) . Supposedly the AMD (or Intel) competitive intelligence for said that the competition was "Apple/ARM". If actually look at what Ampere is doing with



ampere-computing-cpu-roadmap-2021-augmented.jpg



They are moving to their own custom cores from baseline ARM Neoverse ones. That is mainly to do customer SoC for different Cloud/Hyperscalers. Those cores could run the current backend of iCloud, Apple email , etc. just fine at lower power than the x86_64.

The roadmaps for AMD and Intel for high end server cores TDP is just up, up and up. 500W ... 600W ( noted in the video). That is actually a problem for folks that need to do "carbon neutral" computing for various workloads. That is the problem that Bergamo is suppose to help solve. Zen4D cores ...toss the single threaded drag racing low perf/watt chase and go for more effective mutliple thread for specific workloads.

Bergamo is suppose to come in 2023 with 128 cores. Look at the chart above. Ampere is shipping 128 cores now. 2022 probably go to 5nm can crank the core count again. 2023 ... they are playing catch up.

Apple's 40 core , only supports boots macOS , no 3rd party GPU chip likely won't be the primary issue. Apple M1 sereis as development workstaiotns/laptops to deploy to ARM Neoverse N and V series


One of the chicken-egg thing with server ARM is that developer tool on same general platform. ( e.g., Xeon SP in HP z8 deployed to Xeon SP server ). Apple delivering more developer client systems to deploy from is a bigger threat than Apple flipping some semicustom on their own back end.

To do a minor tweak on Neoverse N2 or V2 Apple doesn't need a huge design team fork from their own fully custom work.





How could those chips be? Same as Mac Pro chips? Does it make sense to Apple enter the server market again?

At a big enough point it makes sense for a Hyperscaler /Cloud vendor to do their own server boards. They don't have to be fully custom but once at the point have internal hardware team to specific nodes , then can contract spec own tweaks to "Open Compute " designs to meet minor variations needs for server cluster designs.

For XCode Cloud yes. But those really don't have to be "servers" in classic sense. There is large macOS CI market done with Mac Mini and Mac Pros now. The Mac Pro 2019 has a "rack model" for the case but it isn't a classic hyperscale box. A "half sized" Mac Pro with much fewer slots would probably rack better at a higher density. So yeah they could do that but it isn't going to put AWS , Azure , or any major cloud services vendor out of business.



P.S. MLID seems to ramblie in and out of talking about consumer/gaming chip rumors and into some of the more esoteric stuff that Intel and AMD have coming in the server spaces . Often trying to maps the latter back down into products or at least cast them into "sizzle" for the enthousiant/gamer folks to consume as buzz.

About 18 mins into video he makes a comment about being "less worried AMD can compete with Intel in the server space". Generally He is still on the Intel takes back over in 2024-5 theme. More than a decent chance this "Apple server" thing is being thrown out there to get clicks. It is likley a HUGE tangent from the market that Bergamo (and Intel's and other ARM vendors ) are trying to cover as a market segment.
 
Last edited:
  • Like
Reactions: Xiao_Xi

deconstruct60

macrumors G5
Mar 10, 2009
12,493
4,053
here are probably plenty of other use cases too, including perhaps replacing AWS with their own internal servers for iCloud.

AWS bough pallets of Mac Minis to deploy.







It is more likely that Apple is out to "Sherlock" some of their "partners" here. Amazon , MacStadium , etc.


Apple has been doing a reduction on AWS (and other ) services

"... Apple hosts various iCloud components on Amazon Web Services, Microsoft Azure, and the Google Cloud Platform. ..."

https://9to5mac.com/2019/04/25/aws-halved-spending-apple-cloud/

But then has done new stuff like Private Relay with other providers (Cloudflare, etc ) .



Apple's "edge" footprint is so large ( and with video streaming biz ... even more bulky edge ) that winding back to "do it all inhouse" probably isn't practical.





I think what's interesting is them losing some major talent to Nuvia, which was acquired by Qualcomm, because they didn't want to work on a server chip back in 2017 - 2019. This could come back to bite Apple because Qualcomm w/ Nuvia might be the only chance Windows PCs have at competing with Apple Silicon.

Since that Bergamo "market competitors" Intel came from a couple of years ago. That "Apple/ARM" reference could also easily be a "Nuvia/ARM" reference since that is where Nuvia (ex Apple folks with an "Apple like" core) said they were going.
 
  • Like
Reactions: Pedro1223

4sallypat

macrumors 601
Sep 16, 2016
4,034
3,782
So Calif
In our organization, we use highly upgraded, maximum RAM CTO Minis for each of our locations just for caching servers & iOS user backups (16TB external TB3 storage on each Mini).

Should be interesting if the new AS Mini will be better....
 

TinyMito

macrumors 6502a
Nov 1, 2021
862
1,225
In his last video, Moore law's is dead, a reliable leaker about Intel and Amd, confirms that Apple is making its server chips for internal use, so he believes that Apple may enter the server market again.

How could those chips be? Same as Mac Pro chips? Does it make sense to Apple enter the server market again?

He's not reliable, one of our Discord proof all the BS fact-checking. I don't believe MLID, F that guy.
 

Xiao_Xi

macrumors 68000
Original poster
Oct 27, 2021
1,628
1,101
He's not reliable, one of our Discord proof all the BS fact-checking.
It seems MLID is not as reliable as I thought.

Out of curiosity, how accurate is MLID according to that fact-checking? Can you point out one egregious mistake of MLID? I want to check it for myself.
 

deconstruct60

macrumors G5
Mar 10, 2009
12,493
4,053
Out of curiosity, how accurate is MLID according to that fact-checking? Can you point out one egregious mistake of MLID? I want to check it for myself.

Kind of funny. In this thread’s referenced video, his Bergamo slide from over a year ago has extra chiplet’s on it . His scoop now is the chiplet’s have 16 cores on them . ( so chiplet count not particularly going up ) [ he sprinkles in lots of caveats the early stage stuff can change . So pragmatically not suppose to tag those misfires as being wrong later if don’t pan out ]

Tends to be better the closer to release get so harder to sort out who is “first” with info .
 

Xiao_Xi

macrumors 68000
Original poster
Oct 27, 2021
1,628
1,101
MLID uses three degrees of confidence (very high confidence, high confidence, and mostly confident) in his slides. So, I can expect that he misses more when he has less confidence in his info.

Anyway, for the sake of the conversation, let's pretend that MLID is correct and Apple is designing its server chips.

Does it make sense to have CPU, GPU and RAM in the same SOC for a server chip? From my limited knowledge, cloud computing requires a lot of flexibility. The requirements for a rendering farm are different to an Apache Cassandra cluster.
 
Last edited:

JouniS

macrumors 6502a
Nov 22, 2020
638
399
Does it make sense to have CPU, GPU and RAM in the same SOC for a server chip? From my limited knowledge, cloud computing requires a lot of flexibility. The requirements for a rendering farm are different to an Apache Cassandra cluster.
People don't like paying for features they don't need. As long as the price is competitive, the vendor can choose to ship more powerful hardware than necessary or provide different configurations for different purposes.

If we look at what AWS has to offer, there are a few key instance types:
  • General Purpose: Typically 4 GB of RAM per logical CPU core and no GPU at all. Configurations go up to 64-128 cores and 256-512 GB. A hypothetical 4x M1 Max would be competitive against a 64-core / 256 GB configuration.
  • Compute Optimized: Like General Purpose, but only 2 GB/core. The same 4x M1 Max would be competitive.
  • Memory Optimized: Low-end configurations start from 8 GB/core, but there are also 16 GB/core and 32 GB/core configurations with up to 64-128 logical CPU cores. The separate High Memory subcategory provides up to 448 cores and 24 TB of RAM. GPU is still unnecessary. Apple may be in trouble here with its tightly integrated unified memory approach.
  • Accelerated Computing: There are many different configurations with various GPUs and other accelerator chips. Typical systems come with 8 GPUs (such as Nvidia A100) connected to a 600 GB/s bus. A 4x M1 Max system might be competitive against 1-2 GPUs, so Apple really has to improve its offerings.
 
  • Like
Reactions: Xiao_Xi

Xiao_Xi

macrumors 68000
Original poster
Oct 27, 2021
1,628
1,101
If we look at what AWS has to offer, there are a few key instance types:
  • General Purpose: Typically 4 GB of RAM per logical CPU core and no GPU at all. Configurations go up to 64-128 cores and 256-512 GB. A hypothetical 4x M1 Max would be competitive against a 64-core / 256 GB configuration.
  • Compute Optimized: Like General Purpose, but only 2 GB/core. The same 4x M1 Max would be competitive.
  • Memory Optimized: Low-end configurations start from 8 GB/core, but there are also 16 GB/core and 32 GB/core configurations with up to 64-128 logical CPU cores. The separate High Memory subcategory provides up to 448 cores and 24 TB of RAM. GPU is still unnecessary. Apple may be in trouble here with its tightly integrated unified memory approach.
  • Accelerated Computing: There are many different configurations with various GPUs and other accelerator chips. Typical systems come with 8 GPUs (such as Nvidia A100) connected to a 600 GB/s bus. A 4x M1 Max system might be competitive against 1-2 GPUs, so Apple really has to improve its offerings.
Can we assume that Apple uses accelerated compute instances for training its ML models and memory-optimized instances for storing its databases?

If yes, it seems that Apple could have designed their server SOCs using a different solution than simply scaling M1 Max.
 

Joe Dohn

macrumors 6502a
Jul 6, 2020
840
748
Last time Apple got in the server market, they abandoned their product line without warning, which doesn't really make them seem reliable. They will need some effort to show credibility, since the server market cares more about continued support than raw performance.
 
  • Like
Reactions: AlumaMac

JMacHack

Suspended
Mar 16, 2017
1,965
2,424
I would be astonished if Apple made servers to sell to any enterprise. Apple is extremely single user focused, and typically doesn’t bother with enterprise at all, aside from bulk purchase deals or some such.

I could see them maybe making servers for their internal use.
 

deconstruct60

macrumors G5
Mar 10, 2009
12,493
4,053
Does it make sense to have CPU, GPU and RAM in the same SOC for a server chip? From my limited knowledge, cloud computing requires a lot of flexibility. The requirements for a rendering farm are different to an Apache Cassandra cluster.

Apple isn't required to in the slightest "have to" use their Mac chip design for their server chip design if the server isn't a Mac. If the severs aren't running macOS there is no real big upside to saddling their server CPU with the iOS optimized design in terms of "bring up" firmware support , server OS support, bi-section bandwidth support. etc.

That said, they could just "chop off" the GPU ( or scale it down to just one GPU core. Opposite of what have done with the M1 Pro/Max were GPU core scale up is prioritized). That really doesn't solve their server problem because what really are missing is more general I/O provisioning. Going to hook up 40GbE (or higher) headers/cards to what they have got now? Nope. Apple's 'war' on dGPUs is also pragmatically a 'war' on PCI-e bandwidth provisioning capabilities.

There are off-the-shelf starting points for a ARM server processor that doesn't have that 'war on PCI-e' presumption built into it from the start. Nor a 'war' on UEFI firmare. Nor a 'war' on the CXL standard.


If Apple's primary server role that are providing through cloud services is macOS application access to individuals/organizations as single instance at a time then they don't need all of that "lots of flexibility" for hyperscaler backbone provisioning , since macOS doesn't really provide the apps for that. "Random Joes" small scale website application server doesn't really need that.
 

deconstruct60

macrumors G5
Mar 10, 2009
12,493
4,053
MLID uses three degrees of confidence (very high confidence, high confidence, and mostly confident) in his slides. So, I can expect that he misses more when he has less confidence in his info.

MLID's bigger problem is similar to the problems that AdoredTV used to run into with reading the mass consumer market bias into what are leaks about more "big iron" , cloud , and server focused products.

AMD announced Bergamo today. It is. Zen 4C ( for cloud) not 4D. Can try to label that not a major mistake, but it is indicative in his substantially missing the point. It is the cloud targeted , ARM server products that AMD is primarily concerned with that this product addresses. XCode Cloud is not what AMD is freaked out about 3-4 years ago. Neither was MacStadium/MacColoc. Bergamo is a cloud specific product.

MLID is all hyped up about how the Bergamo chiplet can be mutated into a Raptor Lake (big.little ) killer. That wasn't the point. Pretty decent chance the "4C" cores will be configured different when weaved into a AMD APU/notebook role once get to TSMC N3 and Zen5 deployment.

Similar to AdoredTV missing ( over a year ago ) the CPU and GPU discrete dies being hooked via Infinity Fabric in daughterboard set ups and not one, 'normal" package .


P.S. And the just announced Milan-X will likely outcompete Apple's current stuff on technical computation application stuff. Milan-X coupled to MI200 class stuff probably doesn't give much up on "unifed memory" workloads. That's another problem for Apple is only a subset of the cloud services market they can do.
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.