Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

mr_roboto

macrumors 6502a
Sep 30, 2020
856
1,866
For a compute-bound job, I just want it to run faster. As promised by Apple.
A few more watts won't matter.
Where did Apple specifically promise that this one weird bad benchmark would run faster?

And yes, I am willing to claim that it's a very bad benchmark. It's an extremely narrow part of Perl, and unlikely to predict performance in other tasks - probably not even common regex-based loads. You can easily find benchmark suite results which prove that the M1 Max is lots faster than the 2018 i9 MBP, both single and multithreaded.

 
  • Like
Reactions: Tagbert

chars1ub0w

macrumors regular
Original poster
Jun 5, 2017
147
67
Here, there and over there
Where did Apple specifically promise that this one weird bad benchmark would run faster?

And yes, I am willing to claim that it's a very bad benchmark. It's an extremely narrow part of Perl
You should know regex is a core feature of Perl. You classify it as "bad" because it doesn't conform to Apple's claims (see Apple's diagram). I showed an independent regex engine, that of Python, also doesn't show that the M1 is superior.

313304546_10222411945915203_8817960430141939236_n.jpg
 

raknor

macrumors regular
Sep 11, 2020
136
150
You should know regex is a core feature of Perl. You classify it as "bad" because it doesn't conform to Apple's claims (see Apple's diagram). I showed an independent regex engine, that of Python, also doesn't show that the M1 is superior.

View attachment 2103661
No.. You haven't proven any such thing. There are countless reviews and benchmarks proving Apple's claims.

It's not even up for debate.
 

chars1ub0w

macrumors regular
Original poster
Jun 5, 2017
147
67
Here, there and over there
Bottom line is if the battery is dry the notebook is a dead weight. While the raw performance is comparative the efficacy is not and that's where Apple Silicon excels.
While true, compute heavy operations are usually run with the A/C adapter in. At least, when I'm running bigger jobs, I make sure I'm always plugged either on the Intel in my office or the M1 Max at home.
 

chars1ub0w

macrumors regular
Original poster
Jun 5, 2017
147
67
Here, there and over there
No.. You haven't proven any such thing. There are countless reviews and benchmarks proving Apple's claims.
And I've observed plenty of times when I've noticed my M1 Max is not faster than my Intel MBP despite Apple's claims. So I tested a bunch of code, and yes there are plenty of such cases. You can run my Perl and Python code to confirm. Sure there are plenty of times when I've noticed the M1 Max is faster, e.g. at detecting objects in Photoshop etc.
 
  • Haha
Reactions: PauloSera

Hippocrates

macrumors member
Jun 12, 2012
95
33
Well, it's not just Perl. Let's look at the same regex matching using Python. Again, I give a one-liner that anyone can run from the Terminal. There is a small gap, but again the M1 Max isn't much different from a 4 year-old 2018 Intel Core i9 (i9-8950HK).
View attachment 2102888

I did a quick test with my 2017 MBP Core i7 and the results are similar to the above:
n=5: 0.042
n=10: 0.044
n=15: 0.044
n=20: 0.095
n=25: 1.667
n=30: 51.977
n=35: didn't test

this test probably has an artificial performance ceiling at rather low CPU requirement, unless i9 is also not better than the 2-years older i7.
 

raknor

macrumors regular
Sep 11, 2020
136
150
And I've observed plenty of times when I've noticed my M1 Max is not faster than my Intel MBP despite Apple's claims. So I tested a bunch of code, and yes there are plenty of such cases. You can run my Perl and Python code to confirm. Sure there are plenty of times when I've noticed the M1 Max is faster, e.g. at detecting objects in Photoshop etc.
Again your annecdotal feelings and some random scripting examples are not comprehensive evidence of the claims you are making.

Sites like anandtech have run industry standard benchmarks like SPEC etc and have proven Apple's claims.

I strongly suspect the code you are running will run the same on any modern CPU and not show a difference because the code itself is the problem and not the CPU itself.
 
Last edited:

raknor

macrumors regular
Sep 11, 2020
136
150
I ran this perl script on 3 machines.

2013 Core i7 15" MBP
2019 Core i9 16" MBP Intel Core i9-9880H
2021 M1 MAX 16" MBP

With n= 25

2013 Core i7 15" MBP = 4.7 sec
2019 Core i9 16" MBP = 3.75 sec
2021 M1 MAX 16" MBP = 2.7 sec

With n =30
2019 Core i9 16" MBP = 2 mins 1 sec
2021 M1 MAX 16" MBP = 1 mins 32 sec

So you can see the M1 Max is faster.. however the interesting thing is in power consumption.

n=30 run

Core i9 32-35W Core Power

M1 Max 4.6 W Core power

This is a really silly test.. even then the OP's conclusion is grossly incorrect. It is very clear the M1 is faster and consumes a whopping 6x less power.

Once the i9 gets heat soaked the n=25 runs end up being 4 secs.. the M1 Max consistently does 2.6 - 2.7 seconds with no slow downs.
 
Last edited:

leman

macrumors Core
Oct 14, 2008
19,521
19,675
Well, it's not just Perl. Let's look at the same regex matching using Python. Again, I give a one-liner that anyone can run from the Terminal. There is a small gap, but again the M1 Max isn't much different from a 4 year-old 2018 Intel Core i9 (i9-8950HK).

And here is the same regex performance using R's built in regex engine. Didn't run it on the i9. This is just to make clear that you are measuring pathological performance.


regex.jpg


The R code was

C-like:
dumb_regex_bench <- function(n) {
  s <- paste0(rep("a", n), collapse = "")
  r <- sprintf("(a?){%s}a{%s}", n, n)
  grepl(r, s)
}
 
  • Like
Reactions: PauloSera

mr_roboto

macrumors 6502a
Sep 30, 2020
856
1,866
You should know regex is a core feature of Perl. You classify it as "bad" because it doesn't conform to Apple's claims (see Apple's diagram). I showed an independent regex engine, that of Python, also doesn't show that the M1 is superior.
You should know that benchmarking just one feature of Perl, a language with a very high feature count, is a terrible benchmark. Even if that feature is a very important Perl feature (which of course regexes are, nobody disputes that), you're being far too narrow. Especially when you then proceed to make sweeping generalizations based on this result.

Hell, I wouldn't trust your test to accurately predict general regex performance. It's a weird regex to care about even if literally all you use a computer for is to plow through data sets with regex.

If you actually are an academic, you know full well you are being the exact opposite of rigorous in your approach to finding out whether M1 is faster than your i9, and in your responses to criticism. I think you're just here to troll.
 
Last edited:

leman

macrumors Core
Oct 14, 2008
19,521
19,675
You should know regex is a core feature of Perl. You classify it as "bad" because it doesn't conform to Apple's claims (see Apple's diagram). I showed an independent regex engine, that of Python, also doesn't show that the M1 is superior.

But you are not measuring the performance of the perl regex engine. You are just measuring its behaviour on a single pathological case where the regex engine breaks down. Again, this is like evaluating performance of different cars by drawing them in mud. This is not a useful comparison.

If you want to measure the performance of perl regex on different architectures, why not take a complex non-pathological regex that will use many of the perl features, for example this one, and run it on a corpus of several thousands or million of email addresses.

P.S. I will even make it easy for you, here are some sample email addresses I randomly generated, along with a complex regex to match them
 

Attachments

  • email-data.zip
    1.1 MB · Views: 61
Last edited:
  • Like
Reactions: pdoherty

leman

macrumors Core
Oct 14, 2008
19,521
19,675
Hell, I wouldn't trust your test to accurately predict general regex performance. It's a weird regex to care about even if literally all you use a computer for is to plow through data sets with regex.

Of course it won't predict general regex performance. This regex is a prime example of how not to write regexes. What's the point in benchmarking a regex that no sane person will ever use? The only utility is for the regex engine developer, to identify pathological cases and fix them.
 

sam_dean

Suspended
Sep 9, 2022
1,262
1,091
I ran this perl script on 3 machines.

2013 Core i7 15" MBP
2019 Core i9 16" MBP Intel Core i9-9880H
2021 M1 MAX 16" MBP

With n= 25

2013 Core i7 15" MBP = 4.7 sec
2019 Core i9 16" MBP = 3.75 sec
2021 M1 MAX 16" MBP = 2.7 sec

With n =30
2019 Core i9 16" MBP = 2 mins 1 sec
2021 M1 MAX 16" MBP = 1 mins 32 sec

So you can see the M1 Max is faster.. however the interesting thing is in power consumption.

n=30 run

Core i9 32-35W Core Power

M1 Max 4.6 W Core power

This is a really silly test.. even then the OP's conclusion is grossly incorrect. It is very clear the M1 is faster and consumes a whopping 6x less power.

Once the i9 gets heat soaked the n=25 runs end up being 4 secs.. the M1 Max consistently does 2.6 - 2.7 seconds with no slow downs.
In addition I'd keep the Intel Mac if I want a free winter heater.
 
  • Haha
Reactions: Queen6

MayaUser

macrumors 68040
Nov 22, 2021
3,177
7,196
So i guess this topic one user vs all comes to an end..That user thinks different, the non Apple's logic way
 

maflynn

macrumors Haswell
May 3, 2009
73,682
43,740
Consider

- performance per watt
- power consumption
- battery life
- thermals
I think that ideal is over sold. True for laptops that are on battery that sort of performance is awesome and its one of the best features that I enjoy on my mac, BUT when doing hard core, or intensive work, most everyone is doing that while plugged in.

As a for instance, the performance per watt is really meaningless when you're using an iMac/Mini/Studio. The more important metric is performance,
 
  • Like
Reactions: pdoherty

sam_dean

Suspended
Sep 9, 2022
1,262
1,091
I think that ideal is over sold. True for laptops that are on battery that sort of performance is awesome and its one of the best features that I enjoy on my mac, BUT when doing hard core, or intensive work, most everyone is doing that while plugged in.

As a for instance, the performance per watt is really meaningless when you're using an iMac/Mini/Studio. The more important metric is performance,
In places where the kWh is 2x what you're used to and median household income is 2x less than what you make then power consumption is a concern whether it be desktop or laptop.

Some of use use our Macs 12hrs/day for 3,650 days in these places.

Not to mention our carbon footprint using 14nm Intel chips?
 
Last edited:

sam_dean

Suspended
Sep 9, 2022
1,262
1,091
If you're not sufficiently impressed by Apple Silicon's performance, please watch this!
And remember, Apple wasn't even the chip business 15 years ago.

iPhone made it possible. If Apple stuck to Macs as their main profit driver then they'd be a die shrink or 2 behind Intel until now.
 
Last edited:

maflynn

macrumors Haswell
May 3, 2009
73,682
43,740
In places where the kWh is 2x what you're used to and median household income is 2x less than what you make then power
I concede your point. I looked at the cost of electricity in the EU and the cost difference between 2020 and 2022 is horrifically high and I can see it being a major incentive having a laptop sipping electricity.
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.