Photos Memories AI Results

[Feenician]

So I'm surprised how little discussion I've seen on this feature so I thought I'd post a thread to get people's impressions. I'm quite impressed. I have 750+ photos and the AI has done a pretty good job pulling things out where they're the main focus of a picture.

Hits: it has successfully pulled out things like "cat" (with a couple of exceptions I'll note), "sports field", "tree", "palm tree", "woodlands", "waterways", "car" (even managing to separate sedan, suv etc.)

Misses: There are a few odd misses I've noticed. I was typing "po" for ""pool" (which the AI did very well with btw) and I noticed there was a classification for "pooches". These were actually both cat pics, though both had been recently shaved in a "Lion cut" style so perhaps were mistaken for poodles.
A couple of odd things too that I can sort of see the logic if I squint. Like I have a pic of some jerky in a white wrapper which is identified as ice cream. I guess if you squint it looks like vanilla with chocolate topping.
The other "crime" is incompleteness. An odd shaped pool left out, an unusual dragster car not identified etc.

All in all shaping up well for a first pass I think.

Post your best/worst/funniest matches.

 

[macrescue911]

So I'm surprised how little discussion I've seen on this feature so I thought I'd post a thread to get people's impressions. I'm quite impressed. I have 750+ photos and the AI has done a pretty good job pulling things out where they're the main focus of a picture.

Hits: it has successfully pulled out things like "cat" (with a couple of exceptions I'll note), "sports field", "tree", "palm tree", "woodlands", "waterways", "car" (even managing to separate sedan, suv etc.)

Misses: There are a few odd misses I've noticed. I was typing "po" for ""pool" (which the AI did very well with btw) and I noticed there was a classification for "pooches". These were actually both cat pics, though both had been recently shaved in a "Lion cut" style so perhaps were mistaken for poodles.
A couple of odd things too that I can sort of see the logic if I squint. Like I have a pic of some jerky in a white wrapper which is identified as ice cream. I guess if you squint it looks like vanilla with chocolate topping.
The other "crime" is incompleteness. An odd shaped pool left out, an unusual dragster car not identified etc.

All in all shaping up well for a first pass I think.

Post your best/worst/funniest matches.

Thanks Feenician for these observations. That is indeed very interesting.
Unfortunately, I'm not a developer and can't test by myself.
I was wondering if the face detection syncs in anyway with the faces that are already detected in the Photos app on the mac? If you match any faces in iOS, are they available on the mac?
Also, is there any functionality in the iOS app to view additional information of the pictures (Date, Time, Comments, EXIF...)?

 

[Polaroid]

Apple thinks my dog is a tie.

 

[deadworlds]

So I'm surprised how little discussion I've seen on this feature so I thought I'd post a thread to get people's impressions. I'm quite impressed. I have 750+ photos and the AI has done a pretty good job pulling things out where they're the main focus of a picture.

Hits: it has successfully pulled out things like "cat" (with a couple of exceptions I'll note), "sports field", "tree", "palm tree", "woodlands", "waterways", "car" (even managing to separate sedan, suv etc.)

Misses: There are a few odd misses I've noticed. I was typing "po" for ""pool" (which the AI did very well with btw) and I noticed there was a classification for "pooches". These were actually both cat pics, though both had been recently shaved in a "Lion cut" style so perhaps were mistaken for poodles.
A couple of odd things too that I can sort of see the logic if I squint. Like I have a pic of some jerky in a white wrapper which is identified as ice cream. I guess if you squint it looks like vanilla with chocolate topping.
The other "crime" is incompleteness. An odd shaped pool left out, an unusual dragster car not identified etc.

All in all shaping up well for a first pass I think.

Post your best/worst/funniest matches.

This is a feature I had completely forgotten about. After reading your post I went ahead and did some quick searched. Over all I am impressed, it was able to pick out bowling picture, beaches, trees, and even fish. Something that was interesting and sort of funny, when the search field is selected and nothing is entered it gives suggested searches at the bottom. One of the categories was called "Show me photos of Barbara Streisand", which then took me to photos of my anemone.

 

[Superhai]

One of the categories was called "Show me photos of Barbara Streisand", which then took me to photos of my anemone.

I smell future unintentional categorization controversies in the future.

 

[dannyyankou]

Wow, it created a movie from my family's trip to San Juan and I'm extremely impressed. I imagine this feature will be very popular and Apple will market it a lot.

 

[deadworlds]

Wow, it created a movie from my family's trip to San Juan and I'm extremely impressed. I imagine this feature will be very popular and Apple will market it a lot.

I have been very impressed by the memory feature. I rediscovered some photos of a trip I took to LA a few years ago. When watching this feature on the keynote I was uninterested, but watching it being done with my own photos really made a difference. I think this a great idea and a great way to also share a short video of your trips with family and friends. All without the need to manually edit them in iMovie.

 

[dannyyankou]

I love how it mixes in videos also. It adds a nice touch.

 

[Hugo Frade]

Hi! Can anyone tell me or check if faces in photos sync between idevices and macs?
Thank you

 

[Superhai]

I tried it on the macOS app and it just failed after some time, but on the iOS app it found no memories, but that is understandable as I have just a few pictures there.

 

[Feenician]

Thanks Feenician for these observations. That is indeed very interesting.
Unfortunately, I'm not a developer and can't test by myself.
I was wondering if the face detection syncs in anyway with the faces that are already detected in the Photos app on the mac? If you match any faces in iOS, are they available on the mac?
Also, is there any functionality in the iOS app to view additional information of the pictures (Date, Time, Comments, EXIF...)?

On the faces piece, yep, it seems to have imported that metadata from OS X photos right off the bat - I guess it was in iCloud all along. It also has further opportunities to add and refine it right on iOS.

The metadata piece is more complex. It definitely has date and you can search on that and view it, along with (basic) geo information. Metadata (i used camera model to test) doesn't seem searchable - not yet at least.

Hi! Can anyone tell me or check if faces in photos sync between idevices and macs?
Thank you

Seems to. At least in the Mac -> iOS direction. I'll test the other direction but I guess it may require an update to macOS/Photos.

Apple thinks my dog is a tie.

lol it definitely has a few false reads. All AI photo recognition does but it could stand some improvement and I hope we see that over the coming betas

I do have mixed feelings about the "all on device" processing and the seeming lack of ways to train it and say "no, that's not a cat, that's my tie/dog/ferret" as I'm not sure how Apple will be able to improve the model if they aren't crowdsourcing the data, Google style. Of course that permissiveness with your private info to the cloud has it's own trade-offs which I think many here understand. Let's not start the usual holy war.

Concerns aside 't's pretty impressive just how smart it is now. It's a great start and a nifty feature. Cautiously optimistic

 

[Hugo Frade]

Seems to. At least in the Mac -> iOS direction. I'll test the other direction but I guess it may require an update to macOS/Photos.

Thank you I know that with iOS 9 if I search a face it would show me the photos with that query. It's nice to hear that now they do the full job and show them in an album

 

[macrescue911]

On the faces piece, yep, it seems to have imported that metadata from OS X photos right off the bat - I guess it was in iCloud all along. It also has further opportunities to add and refine it right on iOS.

The metadata piece is more complex. It definitely has date and you can search on that and view it, along with (basic) geo information. Metadata (i used camera model to test) doesn't seem searchable - not yet at least.



Seems to. At least in the Mac -> iOS direction. I'll test the other direction but I guess it may require an update to macOS/Photos.


lol it definitely has a few false reads. All AI photo recognition does but it could stand some improvement and I hope we see that over the coming betas

I do have mixed feelings about the "all on device" processing and the seeming lack of ways to train it and say "no, that's not a cat, that's my tie/dog/ferret" as I'm not sure how Apple will be able to improve the model if they aren't crowdsourcing the data, Google style. Of course that permissiveness with your private info to the cloud has it's own trade-offs which I think many here understand. Let's not start the usual holy war.

Concerns aside 't's pretty impressive just how smart it is now. It's a great start and a nifty feature. Cautiously optimistic

Thanks for your response! Is there the possibility to manually edit/delete any recognized items?

 

[Feenician]

Thanks for your response! Is there the possibility to manually edit/delete any recognized items?

I don't see any way to update any metadata, other than faces by the usual mechanism. Metadata isn't directly exposed for the most part and I doubt it will be. Probably still looking at 3rd party apps for the nitty gritty stuff

 

[Paco II]

Can anyone comment how it compares to Google Photos?

 

[schlaufox]

I'm having a lot of trouble getting anywhere with the facial recognition. The progress bar for the creation of the People albums gets stuck very early on, and the phone heats up a lot. Anyone else experiencing this?

 

[irishv]

I don't see any way to update any metadata, other than faces by the usual mechanism. Metadata isn't directly exposed for the most part and I doubt it will be. Probably still looking at 3rd party apps for the nitty gritty stuff

That's unfortunate. I still cannot understand how Apple hasn't given us the ability to caption and keyword photos in iOS. That should have been available for the first iPad. Looks like Photos will still fail as a DAM, which is a shame given the advantages of having your full library on all devices.

 

[AustinIllini]

Can anyone comment how it compares to Google Photos?

It's theoretically more private.

That being said, it's still a matter of the "airplane question". If I get on an airplane and disable all radios, does the recognition still work?

Does it affect battery life? What about photos in the cloud?

 

[Paco II]

Actually referring to how good the AI is in 'knowing' what's in a photo and making that searchable.

It's theoretically more private.

That being said, it's still a matter of the "airplane question". If I get on an airplane and disable all radios, does the recognition still work?

Does it affect battery life? What about photos in the cloud?

 

[AustinIllini]

Actually referring to how good the AI is in 'knowing' what's in a photo and making that searchable.

I know. I was just suggesting another important question. The reality is, it's likely the same, but the mechanism is hugely important here.

 

[Feenician]

I really thought there'd be more discussion on this. People must have all sorts of photos that'd be interesting to see if and how they're classified by Apple's AI.

Instead I guess it'll be 30 page whinge threads crying about an extra swipe in a dev beta

 

[vertsix]

AI?

Don't you mean...

A D V A N C E D
C O M P U T E R
V I S I O N ?

 

[shk718]

This is a feature I had completely forgotten about. After reading your post I went ahead and did some quick searched. Over all I am impressed, it was able to pick out bowling picture, beaches, trees, and even fish. Something that was interesting and sort of funny, when the search field is selected and nothing is entered it gives suggested searches at the bottom. One of the categories was called "Show me photos of Barbara Streisand", which then took me to photos of my anemone.

I'm sure Barbara would love that - LOL!!!!!
[doublepost=1466529261][/doublepost]I just downloaded google photos to my iphone 6s to see how well it does with recognition - it makes a ton of mistakes - it grouped some vegas pictures together with Greece and labeled it Paradise, missed a ton of pictures from other areas. The facial recognition was pretty good - but again - made mistakes. And, I'm not going to mention what it thinks a birthday is - maybe it's confusing it with birthday suite. I'm sure when OS 10 goes mainstream we're gonna hear all kinds of complaints and the google fanatics will come to this sight and say how much better a job google does - well I can see for myself it has flaws as I'm sure apples version will as well.
[doublepost=1466530024][/doublepost]

I don't see any way to update any metadata, other than faces by the usual mechanism. Metadata isn't directly exposed for the most part and I doubt it will be. Probably still looking at 3rd party apps for the nitty gritty stuff

I don't see a way to edit the metadata in google photos for iphone either - this will be very important - they also need a way to segregate any porn we may have from non porn albums. I'm getting some scandalous results!!!

 

[Feenician]

I'm sure when OS 10 goes mainstream we're gonna hear all kinds of complaints and the google fanatics will come to this sight and say how much better a job google does - well I can see for myself it has flaws as I'm sure apples version will as well.

Yes we will and it'll be based on the usual sound reasoning like "Google identified this one photo and Apple didn't!! Apple sucks!! Tim Cook. Steve Jobs. Scott Forstall etc etc."

 

[GreyOS]

Photos created a category 'dinosaur' for a photo of a dinosaur costume I made for a party a couple years ago. Well done Apple.