Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.
Just imagining virtual assistant Tim Cook:
Question: 'Siri, find me a recipe for banana bread'
Response: 'Today, we have a recipe for raspberry pie we know you are going to love'
Or it might launch maps and give directions to Cuba... 'fun times ahead' no doubt..
 
I hope they don’t phase out the Siri Brand (not technology, that can go away). It’s already too iconic and infamous to be deleted, so i think they should just adopt brand new, useful and reliable technology and call it Siri. I believe a complete overhaul it’s more impressive than a brand new product.
Cue rebrand as 'Siri Max' to come...
 
  • Like
Reactions: swiftapplefan
Despite Apple having a reputation of being late to the party... they also have a reputation for redefining spaces in tech...

So I think when they do release this... you can be pretty certain they will make a good effort and get most of it right... plus their Neural Engine hardware is amongst the best.

Plus, I trust them on privacy way more than Google.
Siri sucks. It's laughably bad compared to Alexa and Google. Why? The privacy thing. The more information these "assistants" have, the better they work, which makes perfect sense. Apple has painted themselves into a corner when it comes to privacy, the result being that their assistant will always be brain-dead compared to others.

Whatever Apple does with AI, it will likely be underwhelming and limited, just like Siri.
 
Yes, but the problem is in the ways it can fail. One good example id a failure is to ask for a biogrphy of George Washington's youngest grandchild Sara. The AI will give a brief summary even though we know GW never have any children. I think someone also got a summary of Beethoven's 11th Symphony too. These famous errors are likey fixed by now but there could be MANY more waiting to happen. ... Perhaps I could ask GPT-Siri why you stopped killing and eating small children.

The trouble is there is no way to put a custom fix on every possible future problem and it i VERY hard to stop these AIs from doing what they are asked to do. The solution Apple is looking for is to build a version of GPT does NOT hold information itself, but looks up information and then summarizes it. So it would never find information that did not exist.

It gets harder. What if we ask Siri about how the election was "stolen" from Trump? There is fake information out on the web that a search can find but how is Siri to know it is fake? How to stop GTP-Siri from giving credible summaries about the Flat Earth, Space Aliens, stolen elections, and the sighting of Elvis Presley? It is a hard problem that the others don't car too much about.
Absolutely and good example. There is no inherent 'confirm validity of what is being stated' in LLMs - false history, poisonous recipes, non-existent court cases, etc.

Of course there's work being done on this but LLMs themselves are quite 'large' with billions of hyper parameters, and not insignificant resources. Yes, there are several smaller implementations, which are effectively pre-trained reduced hyper-param models more focused in a specific area/less general. 'Training' is not really a real-time thing on LLMs, although 'prompt refinement' can be. There are ways to 'fine-tune' versus the enormous effort of training from scratch (e.g. ingest the internet).

Without some type of significant breakthrough, the data collection loop might well turn into for 'updates to 'SiriGPT' with OS releases, or quarterly backend updates using the aggregate user data for additional fine-tuning.

I don't work for them, but you can play around with 'real LLMs' using H2) Studio if anyone's interested..to get a better feel for what LLMs really are and how they are typically 'fine-tuned' etc.
 
I'm sure Apple's priorities is running models directly on devices. They may be well ahead of competition in that metric. Often Apple is just not in the same race as everyone else. There is a lot of room to optimize models to make smaller models work as well as large ones. The race to create ever larger models like everyone else might not be in Apple's interest.
 
As usual, fashionably late to the party. Only hope is that it's not based on Siri.
Apple's lag with releasing the new tech (OLED iPad/Mac, USB-C on the phone, periscope lens and now ChatGPT) on average is climbing fast and might be approaching 5-7 years.
 
The industry is moving quickly, but the latest research suggests that small models (13 or even 7B) can outperform large models when trained on a narrow input. So it is possible that Apple will end up with a mixture of small experts doing a variety of tasks on-device. This will both perform well and preserve privacy because everything is done on device.
I don't disagree with a second that they can do well. What I'm saying si that they can't possibly have the breadth of input of one that use a wider knowledge base as a starting point?
 
It took Siri 10 years to able make a screen recording. Imagine what it will do with this new AI after 10 years.
 
  • Haha
Reactions: wegster
We want??? surely you're speaking for yourself, not "We"
Come on, think outside the box. The number of people that use, let's say Google and other usual suspects for research or just general info has a significant effect on your life whether you like it or not.
It massively increases the amount of 'input' you receive whether that input is good/bad, or welcome/unwelcome.
I can have privacy and ALSO a full life becasue other are willing to give up theirs.

It's like a fight for your rights. People that sit at home because they can't be bothered or are in fact too restricted in time, money or other resource benefit from those that do the hard work.

Those people you might see on YouTube 'flexing their rights' are often the ones that ensure yours don't get trampled on even though you may not be interested in what they're doing.
 
"as the company considers how to use and process personal data in a way that aligns with its commitment to customer privacy" -
This means that Apple needs to figure out how only it can use the customer data and monetize while denying the same to competitors (all others).
 
Apple spent too much on developing the useless Vision Pro when the hype of the VR/AR is already gone. Siri is only good at setting a timer. A businessman can't lead a technology company. Period. He doesn't even know AI is the most important thing to focus on...

Oh, how wrong you are.

Today might be VR/AR, but tomorrow will be true Spatial Computing, with no headset required. Technology evolves, and needs to start somewhere. You can't jump to the end of the race.
 
  • Like
Reactions: Tagbert and wegster
I'm sure Apple's priorities is running models directly on devices. They may be well ahead of competition in that metric. Often Apple is just not in the same race as everyone else. There is a lot of room to optimize models to make smaller models work as well as large ones. The race to create ever larger models like everyone else might not be in Apple's interest.
When you search for the hardware requirements for running ChatGPT models, you come across different estimates including the ones like this: "The largest model, GPT-3 “175B,” requires 600 GB of RAM and a specialized GPU with 250 GB of VRAM.".

For iPhone to be able to run a ChatGPT model, it would need to be foldable (10 times?) and cost (based on Apple upgrade strategies) a few million dollars.
 
Despite Apple having a reputation of being late to the party... they also have a reputation for redefining spaces in tech...

So I think when they do release this... you can be pretty certain they will make a good effort and get most of it right... plus their Neural Engine hardware is amongst the best.

Plus, I trust them on privacy way more than Google.
You must be kidding.
 
I don't disagree with a second that they can do well. What I'm saying si that they can't possibly have the breadth of input of one that use a wider knowledge base as a starting point?
It's early, and the research is still evolving, but yes: it seems that you can get small models that can understand a broad input and produce high quality narrow output. You might also have a "coordinator" that is trained on picking the right small model given an input. All of the leading edge papers that I've seen are showing this approach to be very, very effective.
 
  • Like
Reactions: wegster
For Apple building a generative AI feels a bit like Apple trying to compete with Google Maps with their very own Apple Maps. Despite their efforts Google Maps is and probably always will be light years ahead.
Untrue. The only advantage Google Maps has, at least here in the US, is that Google's point of interest database is a lot better. Navigation, Apple Maps is better designed and has much better voice prompts and graphics. Routing and traffic info is constantly updated thanks to millions of iPhone out there on the road.
 
  • Like
Reactions: Tagbert
Yes, but the problem is in the ways it can fail. One good example id a failure is to ask for a biogrphy of George Washington's youngest grandchild Sara. The AI will give a brief summary even though we know GW never have any children. I think someone also got a summary of Beethoven's 11th Symphony too. These famous errors are likey fixed by now but there could be MANY more waiting to happen. ... Perhaps I could ask GPT-Siri why you stopped killing and eating small children.

The trouble is there is no way to put a custom fix on every possible future problem and it i VERY hard to stop these AIs from doing what they are asked to do. The solution Apple is looking for is to build a version of GPT does NOT hold information itself, but looks up information and then summarizes it. So it would never find information that did not exist.

It gets harder. What if we ask Siri about how the election was "stolen" from Trump? There is fake information out on the web that a search can find but how is Siri to know it is fake? How to stop GTP-Siri from giving credible summaries about the Flat Earth, Space Aliens, stolen elections, and the sighting of Elvis Presley? It is a hard problem that the others don't car too much about.
LLM models improve very fast. Your particular example is incorrect. Out of curiosity I just asked ChatGPT the following question: "Tell me about the biography of George Washington's youngest grandchild Sara". And the answer was:

I’m sorry for the confusion, but there seems to be a misunderstanding. George Washington, the first president of the United States, did not have any biological children of his own1. However, he was a stepfather to Martha Washington’s two younger children from her previous marriage: John Parke Custis and Martha Parke Custis1.
John Parke Custis had four children: Elizabeth Parke Custis, Martha Parke Custis, Eleanor Parke Custis, and George Washington Parke Custis2. There is no record of a grandchild named Sara in the historical data available. If you have any other questions or need information on a different topic, feel free to ask!


But I am sure SiriGPT will get confused.
 
Untrue. The only advantage Google Maps has, at least here in the US, is that Google's point of interest database is a lot better. Navigation, Apple Maps is better designed and has much better voice prompts and graphics. Routing and traffic info is constantly updated thanks to millions of iPhone out there on the road.
POI is at least half of the map app functionality (location, work hours, how busy, reviews etc). Opinions about the voice prompts and graphics are very subjective. Out of those millions of iPhone users on the road, how many use Google Maps? Google have access to their data in addition to the data of Android users (about 50% in US?) and Apple has access only to iPhone data.
 
  • Like
Reactions: zinacef
As usual, fashionably late to the party. Only hope is that it's not based on Siri.
How could it be based on Siri even if Apple wanted to?

Siri has nothing to do with AI, as all of its content is human curated.
 
Apple spent too much on developing the useless Vision Pro when the hype of the VR/AR is already gone. Siri is only good at setting a timer. A businessman can't lead a technology company. Period. He doesn't even know AI is the most important thing to focus on...

I genuinly envy the conviction with which you assume your opinions are the definitive truth
 
  • Like
Reactions: wegster
Having AI baked into the OS in a meaningful way would be a game changer, but it feels like we are still far away from that
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.