Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

Beautyspin

macrumors 65816
Dec 14, 2012
1,010
1,174
“Advantages that will differentiate us”: models running on-device? Either way, I hope it to be smart enough.
Pixel 8 has Gemini Nano1 and Pixel 8 Pro and Galaxy S24 has Gemini Nano 2 that runs completely on device. They seem to be getting the job done okay right now. However, Apple's chips are supposed to be beefier so it all depends on how Apple is leveraging it.
 

Beautyspin

macrumors 65816
Dec 14, 2012
1,010
1,174
Anyone else fatigued by new AI news? I'm just sick of the existential dread that I feel every time it makes an advancement, which is daily, and I become more and more obsolete as a worker and provider for my family. The creeping anxiety is real. I only have two hopes at the moment: The power requirements are quickly spiraling out of control which will somewhat limit this (and probably work in Apple's favor) and companies will still need people to work jobs so they can pay for things. No jobs = no economy.
If Apple's generative AI comes without subscription, then I would be interested to experiment with it. Who knows, it may give me alternative income stream (long shot). If it is going to be behind some payment wall, I would rather go with something else rather than get further locked in. :)
 

Beautyspin

macrumors 65816
Dec 14, 2012
1,010
1,174
Im in the same boat. I use a decent amount of Apple products, but it’s to the point I’m going to go back to huawei products before too long. No longer sold in the US, but that’s what the internet is for. Camera with Leica is superior, the displays are superior, etc.
I held out for a long time and have recently jumped into the Apple ecosystem. I can't go back so quickly. I will have to give it some more time, I guess. :)
 
  • Like
Reactions: delsoul

Beautyspin

macrumors 65816
Dec 14, 2012
1,010
1,174
The only advantage they have is full control over the hardware and software stack, over 2 billion devices in active use, and mindshare like no other company on earth. Apple is in big trouble IMO. :D
While the number "2 billion" does look huge, will AI come to all those devices or only the latest? If it comes only for the latest and that too for the Pro devices, then the share would be about the same as Galaxy and Pixel devices.
 

dumastudetto

macrumors 603
Aug 28, 2013
5,156
7,504
Los Angeles, USA
While the number "2 billion" does look huge, will AI come to all those devices or only the latest? If it comes only for the latest and that too for the Pro devices, then the share would be about the same as Galaxy and Pixel devices.

I think on-device will need latest and greatest Apple tech, but I expect Apple will offer a cloud-based offering for older devices - albeit, attracting a monthly subscription fee.
 
  • Like
Reactions: FriendlyMackle

deckard72

macrumors newbie
Feb 29, 2016
1
0


During today's earnings call covering the second fiscal quarter of 2024, Apple CEO Tim Cook again spoke about Apple's work on generative AI. He said that Apple has "advantages" that will "differentiate" the company in the era of AI, and some "very exciting things" will be shared with customers in the near future.

Apple-Silicon-AI-Optimized-Feature-Siri-1.jpg


Rumors have suggested that Apple's first AI features are designed to run on-device rather than contacting a cloud service, which would make Apple's AI much more private and secure than an online AI option. Apple's plan to have generative AI available on-device will require significant CPU and GPU power, and Apple is planning to focus on AI with the upcoming M4 chip.

We could see the M4 chip as soon as next week in new iPad Pro models, with Bloomberg's Mark Gurman indicating last weekend that there is a chance Apple will unveil the chip in the iPad Pro models.

Article Link: Tim Cook on Generative AI: 'We Have Advantages That Will Differentiate Us'
Today Siri can tell me the time ! Imagine if it is a car ? Shame
 

ric22

macrumors 68020
Mar 8, 2022
2,038
1,945
Do you really think that current Siri is what Tim is talking about when he says “AI”? I have slightly higher aspirations. 😊
😅 I don't think current Siri is as good as it gets, obviously. It's horrendous- that's my very point. If they cannot get something comparatively simple right, what hope do that have with any other AI? We should have about 1% faith in them pulling this off based on their Siri track record.
 

Tagbert

macrumors 603
Jun 22, 2011
5,664
6,633
Seattle
😅 I don't think current Siri is as good as it gets, obviously. It's horrendous- that's my very point. If they cannot get something comparatively simple right, what hope do that have with any other AI? We should have about 1% faith in them pulling this off based on their Siri track record.
Siri was tech that came when they bought Nuance. According to subsequent sources, the code is a hopeless interconnected knot that is very difficult to modify. Apple seems to have put improvements on the back burner. All of their other AI work has been in other areas in recent years. Now there is new technology that would completely change how Siri works and by all rumors that is what Apple is planning.
 
  • Like
Reactions: ric22

Dredd67

macrumors member
Sep 20, 2012
91
308
I'm running local LLMs on my 15 Pro Max.
llama 3 8B, Mistral 7B, Gemma... (using the Private LLM app on ios). It works like a breeze, and I'm getting very good results, and everything's local, uncensored (dolphin versions)...

Now if you do the same, with some neet Apple rebranding and repackaging to smooth out the experience, then it will be mission accomplished.

In any case, if you've got a 15 Pro max you can already do it.
 
  • Like
Reactions: Tagbert

JimmyHook

macrumors 6502a
Apr 7, 2015
952
1,789
Most generative AI platforms are toys at best. Insane error rates, hallucinations, and just plain terrible responses plague these toys. I hope Apple genuinely does have something more powerful and private than the garbage being passed off as AI today.
 

Macalicious2011

macrumors 68000
May 15, 2011
1,754
1,783
London
On device computation will only be an upside if the performance matches LLM services in the cloud. Phone can run quantized LLM models but they are not on par with 7-8b parameter models.

Another route for Apple is a hybrid model. Power some inference on device and the other in the cloud that users seamlessly pay for through their iCloud subscription. :apple::cool:
 
  • Like
Reactions: Tagbert

ric22

macrumors 68020
Mar 8, 2022
2,038
1,945
Siri was tech that came when they bought Nuance. According to subsequent sources, the code is a hopeless interconnected knot that is very difficult to modify. Apple seems to have put improvements on the back burner. All of their other AI work has been in other areas in recent years. Now there is new technology that would completely change how Siri works and by all rumors that is what Apple is planning.
Let's hope that is right. It remains a disgrace they didn't fix/replace Siri many years ago. They should have been embarrassed about it.
 

Motorola68000

macrumors 6502
Sep 12, 2022
300
272
And no doubt all achieved with a large increase in RAM requirements to work efficiently, leaving those 8Gb baser users with a degraded performance on what would then appear to be a misnamed Pro device.
 
  • Like
Reactions: ric22

redcarlsen

macrumors regular
May 22, 2014
112
192
Apple wanted to be the leader but invested in the wrong things as well as neglected the next big thing. Now it's playing the follower.

As an Apple user I hope for my own sake that Apple catches up and much more. But I am resentful that Apple has wasted so much of our time and let us down again and again.

Apple has not messed up enough to make me leave yet and I'm heavily invested in their products and ecosystem. So although there is much bitterness I am still rooting for Apple for my own benefit.
Investing in “AI” will probably pay off just as well as the Apple Car and Vision Pro.
Lol
Face it, tech and all this nonsense is not the future, nor will it improve humanity.
 
  • Like
Reactions: gusmula and cardfan

redcarlsen

macrumors regular
May 22, 2014
112
192
And no doubt all achieved with a large increase in RAM requirements to work efficiently, leaving those 8Gb baser users with a degraded performance on what would then appear to be a misnamed Pro device.
Classic Apple move. Also they’ll probably decrease battery size to make room for all the new stupid processing units, a slimmer chassis, and more pronounced wobble-corner… I mean camera bump.
 

Pezimak

macrumors 68030
May 1, 2021
2,999
3,298
Yes, thanks to the next gen advancements of AI, Siri will now OPEN the Webpage for you instead of just presenting it as a result for your query… ! 🤣
 

macabrumorsab

macrumors member
Sep 5, 2017
35
36
No that is usually commentators on forums like this that attribute claims like that to Apple. Apple generally just talks about what they have done without talking about others and people interpret that as them claiming to be first.
This is not true. In the last iPhone keynote they mentioned so often industry-first it was just embarrassing
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.