Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.
Status
Not open for further replies.

Taz Mangus

macrumors 604
Mar 10, 2011
7,815
3,504
Fault how?
It has already been explained to you multiple times about the chess benchmark is not optimized for Apple Silicon and that means the benchmark is faulty when run on Apple Silicon. You need to prove that the benchmark is a valid measure when run on Apple Silicon. You have not provided any proof of your hypotheses. And the result of the benchmark is not proof if the code is not testing properly. A good software engineer would know this.
 

Leifi

macrumors regular
Nov 6, 2021
128
121
Well, we agree that Apple stuff is expensive...

But for all the rest you've written, how is Intel more open? Or how is your argument less sales-pitchy? misleading?

Intel provides a lot more detail on the hw, interfaces and low-level software, drivers, bios, etc. They are open to integrating with various vendors' GPUs, memory subsystems, and configurations. I think Apple is way more proprietary than Intel. Intel works a lot with different partners in an open way (they even work with Apple). Apple is open to no one else. Rather the opposite. Even try to stop 3rd parties to access hw and running different OS: es etc.. Very different stance than, for example, Intel and AMD.
 
  • Like
Reactions: Appletoni

Leifi

macrumors regular
Nov 6, 2021
128
121
It has already been explained to you multiple times about the chess benchmark is not optimized for Apple Silicon and that means the benchmark is faulty when run on Apple Silicon. You need to prove that the benchmark is a valid measure when run on Apple Silicon. You have not provided any proof of your hypotheses. And the result of the benchmark is not proof if the code is not testing properly. A good software engineer would know this.

I think you have missed the mark on benchmarking overall.. A benchmark is not "faulty" beacuse it is not specifically tweaked for a certain vendor..
 
  • Like
Reactions: Appletoni

Taz Mangus

macrumors 604
Mar 10, 2011
7,815
3,504
I think you have missed the mark on benchmarking overall.. A benchmark is not "faulty" beacuse it is not specifically tweaked for a certain vendor..
And you keeping proving the point that the chess benchmark is not optimized for Apple Silicon and that is why it runs so poorly on the Apple Silicon. Yes, let's get real. You think just simply recompiling the code is enough. It requires having knowledge of the target hardware and how best to utilize that in the code. Has anyone at StockFish ever used Apple Silicon and examined the source code to see what needs to be changed in order for the code to take advantage of said hardware? Since you seem to be the expert on this, you tell us as you are the one who needs to prove that the benchmark code is correct for Apple Silicon. Somehow, I think your response will be to deflect away from this question and not answer it.
 

Leifi

macrumors regular
Nov 6, 2021
128
121
as anyone at StockFish ever used Apple Silicon and examined the source code to see what needs to be changed in order for the code to take advantage of said hardware?
Yes, they have.. Are you able to follow find the other pages of this thread?
 
  • Like
Reactions: Appletoni

Taz Mangus

macrumors 604
Mar 10, 2011
7,815
3,504
Yes, they have.. Are you able to follow find the other pages of this thread?
You said that the code was compiled for ARM that is not the same thing as knowing how to take advantage of the Apple Silicon to test it properly. A benchmark is designed to test a given hardware to determine its performance. If the code is not utilizing the hardware properly then the results of that benchmark are wrong.
 

Leifi

macrumors regular
Nov 6, 2021
128
121
You said that the code was compiled for ARM that is not the same thing as knowing how to take advantage of the Apple Silicon to test it properly. A benchmark is designed to test a given hardware to determine its performance. If the code is not utilizing the hardware properly then the results of that benchmark are wrong.
Why do you claim the ARM tweaked code does not utilize the hw suffiently.. by just guessing?

Why don't you apply this reasoing to all benchmarks not just this..

How do you for example know geek-bench is fully optimized for the latest gen 11 Intel CPU?

Are you saying all benchmarks are irellevant, or just the one where your "pet" does poorly?

Let me ask you which benchmarks meets your criteria of beeing 100% optimized for each hw compared?
 
  • Like
Reactions: Appletoni

Taz Mangus

macrumors 604
Mar 10, 2011
7,815
3,504
Why do you claim the ARM tweaked code does not utilize the hw suffiently.. by just guessing?

Why don't you apply this reasoing to all benchmarks not just this..

How do you for example know geek-bench is fully optimized for the latest gen 11 Intel CPU?

Are you saying all benchmarks are irellevant, or just the one where your "pet" does poorly?

Let me ask you which benchmarks meets your criteria of beeing 100% optimized for each hw compared?
In others, you don’t know and have no clue if it is the case.
 

throAU

macrumors G3
Feb 13, 2012
9,204
7,356
Perth, Western Australia
Apple M1 Max hasn’t even tensor cores.
Look at RTX 3090 or RTX 4090 and how much they have.
Neither does AMD.

Neither 3090 nor 4090 are in a laptop. 4090 isn't even available for purchase yet. 3090 currently more expensive than an entire m1-pro machine.

3090 runs in 300-400 watts. M1 Pro is 60.

Nvidia doesn't have an afterburner on board.

?‍♂️
 
Last edited:
  • Like
Reactions: JMacHack

throAU

macrumors G3
Feb 13, 2012
9,204
7,356
Perth, Western Australia
But it is like 200%-300% performance diff... The performace diff i HUGE.. Bigger than what you could "solve" by tweaking pipelining SIMD etc..

Clearly you have never written a line of code in your life. Anyone who has done even a basic programming course knows that algorithm changes can be HUGE.

From entry level programming...


Hardware instructions can have massive impact

 

JimmyjamesEU

Suspended
Jun 28, 2018
397
426
Hi. Really interesting thread. I've been glued to it from the first page. Thanks to all those involved.

I've been wondering if it might be worthwhile performing some chess benchmarks on the M1 Pro/Max? It's obvious that these new chips are great performers on a wide variety of tasks. It'd be interesting to see some numbers for chess though. Once they get a chance to optimise these benchmarks for Apple Silicon, I think they'll do great.

Also, can anyone point me to some numbers for hashcat runs on the the M1 Max?
 
  • Like
Reactions: Appletoni

mr_roboto

macrumors 6502a
Sep 30, 2020
856
1,866
You would have a point if there was a small advantage between lets say a 5800 and a M1...

But it is like 200%-300% performance diff... The performace diff i HUGE.. Bigger than what you could "solve" by tweaking pipelining SIMD etc..
This right here is excellent evidence you've never done porting and optimization work. In fact, based on your presentation of yourself, I doubt you've ever written a single line of C or C++.

Please Keep in mind for reference, that the diff in these bencmarks is larger than ANY benchmarked diff between M1 and the latest M1 Max!! (only 40-70% jump) and those have even dubbled the high performance cores of the M1!!

Would you honestly argue that the M1 could be "optimized" to beat the M1 Max as well.. Of course not. this 4-copre (full speed) CPU cannot beat neither Apples 8-core versions, nor AMDs 8-core versions.. Its NOT a "coding" issue. lets get real.
Let's get really real: you're a troll who's not attempting an honest discussion. Reality constantly shifts in everything you write. Your only goal is to get a rise out of people. It's quite easy to see.

Like right here, you try to spin someone saying Stockfish could be much better optimized for M1 as if it's equivalent to claiming software could be optimized to make M1 perform better than M1 Max. That's a ridiculous leap, the OP didn't say anything like that, you know it, you just said this to provoke outrage.
 
  • Like
Reactions: Stratus Fear

Leifi

macrumors regular
Nov 6, 2021
128
121
Hi. Really interesting thread. I've been glued to it from the first page. Thanks to all those involved.

I've been wondering if it might be worthwhile performing some chess benchmarks on the M1 Pro/Max? It's obvious that these new chips are great performers on a wide variety of tasks. It'd be interesting to see some numbers for chess though. Once they get a chance to optimise these benchmarks for Apple Silicon, I think they'll do great.

Also, can anyone point me to some numbers for hashcat runs on the the M1 Max?

Thats great.. Reality is always more interesting than wishful thinking from fanboys...

You can download the best chess engines on github... (can be compiled with homebrew)..

https://github.com/official-stockfish/Stockfish (stockfish)
https://github.com/LeelaChessZero/lc0 (Leela Zero, a spin of project with the origins from Googles Alpha Zero)

A very good page with lots of ready made compiles and stuff for Apple silicon is..

Preliminary results are quite dissapointing for the M1 Max as well.. But try for yourself... You can compare with other platforms... Especailly Leela should perform much better on M1 Max with OpenCL due to the beefier GPU parts.
Leela.jpg
 
  • Like
Reactions: Appletoni

bcortens

macrumors 65816
Aug 16, 2007
1,324
1,796
Canada
That’s the one I found too, but the GitHub page does not reference an ARM macOS version. The arm code looks like it was last updated 4 years ago.
This is why no one takes your open bench results all that seriously and why your dislike of propriety code makes little sense.
Paid code gets updated, it gets optimization, rare and obscure code with minimal effort in the Mac branches does not make a great counter example.
 

JimmyjamesEU

Suspended
Jun 28, 2018
397
426
Thats great.. Reality is always more interesting than wishful thinking from fanboys...

You can download the best chess engines on github... (can be compiled with homebrew)..

https://github.com/official-stockfish/Stockfish (stockfish)
https://github.com/LeelaChessZero/lc0 (Leela Zero, a spin of project with the origins from Googles Alpha Zero)

A very good page with lots of ready made compiles and stuff for Apple silicon is..

The benchmark will need a great deal of work to be anything more than a novelty .. But try for yourself... You can compare with other platforms... Especailly Leela should perform much better on M1 Max with OpenCL due to the beefier GPU parts.
View attachment 1920990
Hey, thanks so much for your reply. It's a fascinating area to investigate.

Broadly, I think we're in agreement that the M1 looks amazing and as soon as devs start taking advantage of it, performance will be great. I'm not sure I'd go quite as far as you in saying Intel and AMD have a great deal to worry about though. I think they'll be just fine.

I'd be grateful for any links to quality chess benchmarks though. I'm having a hard time finding any.
 
  • Like
Reactions: Appletoni
Status
Not open for further replies.
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.