iOS 17 Can Automatically Block Unsolicited Nude Photos With 'Sensitive Content Warnings'

[MacRumors]

Apple in iOS 17 is adding a new feature to iOS that is designed to automatically block incoming messages and files that may have sensitive content like nudity.

Opt-in blurring can be applied to sensitive images sent in Messages, AirDrop, Contact Posters for the Phone app, FaceTime messages, and third-party apps. The feature will prevent adult iPhone users from being subjected to unwanted imagery. All nudity will be blocked, but can be viewed by tapping the "Show" button.

Sensitive Content Warnings work like the Communication Safety functionality that Apple added for children, with all detection done on device so Apple does not see the content that's being shared. Sensitive Content Warnings are an expansion of the Communication Safety options that Apple introduced for children last year.

Communication Safety detects and blocks nude images before children can view them, and with iOS 17, this too will expand to encompass AirDrop, the systemwide photo picker, FaceTime messages, and third-party apps.

Article Link: iOS 17 Can Automatically Block Unsolicited Nude Photos With 'Sensitive Content Warnings'

 

[jonnyb098]

Built in weenie detector? Wonder how they trained that AI….

 

[haleyp]

Does this mean apple will be analysing everything we see? This would make this like the child porn detection feature, where the main takeaway was that all photos would be analysed via a third party.

 

[JCCL]

Does this mean apple is already analysing everything we're seeing?

Yes? How else do you think the also identify the faces of your family and friends, and now even your dogs?

 

[Brad7]

Built in weenie detector? Wonder how they trained that AI….

Hot dog or not hot dog?

 

[SFjohn]

It’s totally on device and most importantly Opt-In, I’m OK with all that. 🤷

 

[Brad7]

Does this mean apple will be analysing everything we see?

That is a good question. Depends on whether it happens on-device or not.

 

[TheYayAreaLiving 🎗️]

Who wants to try it? I'm too afraid to try this feature and toggle it on.

 

[dubvulture]

Does no one actually read an article before commenting?

 

[sza]

Why would I want to opt-in this?

 

[wallinbl]

Does this mean apple will be analysing everything we see? This would make this like the child porn detection feature, where the main takeaway was that all photos would be analysed via a third party.

That is not at all how these algorithms work. They're not very complicated and can run on the device. There are intro level Coursera courses that have code examples that do this to a limited extent. It's not terribly difficult to extend to this kind of detection, and it's purely from the device examining the image locally for patterns.

If it were doing something like automatically identifying any person, ever, they'd need the cloud just for the pattern database. But, for "looks like a wang", that's a very small set of patterns that can be stored locally easily.

 

[TheYayAreaLiving 🎗️]

Does no one actually read an article before commenting?

I let Siri read the article for me. It works like magic in iOS 17.

 

[jz0309]

That is a good question. Depends on whether it happens on-device or not.

Opt-in blurring can be applied to sensitive images sent in Messages, AirDrop, Contact Posters for the Phone app, FaceTime messages, and third-party apps. The feature will prevent adult iPhone users from being subjected to unwanted imagery. All nudity will be blocked, but can be viewed by tapping the "Show" button.

Sensitive Content Warnings work like the Communication Safety functionality that Apple added for children, with all detection done on device so Apple does not see the content that's being shared. Sensitive Content Warnings are an expansion of the Communication Safety options that Apple introduced for children last year.

I bolded the text from the article for you ...

 

[fel10]

I don’t think it would be able to recognize my flat ass

 

[Brad7]

Who wants to try it? I'm too afraid to try this feature and toggle it on.

View attachment 2214787

Where is that located? It looks different from this:

 

[ethanwa79]

Does this mean apple will be analysing everything we see? This would make this like the child porn detection feature, where the main takeaway was that all photos would be analysed via a third party.

Read the article. It’s all done on-device, most likely with a ML (machine learning) model that’s been pre-trained by Apple.

 

[mknelson]

Why would I want to opt-in this?

You might not, but any woman who has received unsolicited nudes might be more than happy to opt-in.

 

[Graphikos]

Does no one actually read an article before commenting?

I don't even actually read your comment before replying.

 

[steve09090]

Does this mean apple will be analysing everything we see? This would make this like the child porn detection feature, where the main takeaway was that all photos would be analysed via a third party.

(Edited because everyone has said the same thing)
The old Child Porn detector was also on device, and it never analysed the Images. It analysed the hash for the image for identical hashes known to be child porn, provided to them. It only alerted the appropriate authority when a match occurred, as a source for investigation. No images left the device for searching. I still can’t see what the issue was.

 

[dubvulture]

I let Siri read the article for me. It works like magic in iOS 17.

View attachment 2214789

And you don't even have to say Hey anymore! What will we do with all that extra time? 😁

 

[TheYayAreaLiving 🎗️]

Where is that located? It looks different from this:

It is Under Settings > Privacy & Security > Sensitive Content Warning.

 

[SFjohn]

That is a good question. Depends on whether it happens on-device or not.

It’s on-device. 👍🏻

 

[redbeard331]

Who wants to try it? I'm too afraid to try this feature and toggle it on.

View attachment 2214787

I wanna try it but I’m afraid someone will send me pics of an eggplant. 🙈

 

[nwcs]

Simple machine learning feature. Most likely based on some existing models but downgraded for the 16 bit ML on the devices.

 

[coolfactor]

Does this mean apple will be analysing everything we see? This would make this like the child porn detection feature, where the main takeaway was that all photos would be analysed via a third party.

The involvement of a 3rd-party was not in the analysis of the content, but as a source of "hashes" that represent questionable content. If anyone believed that Apple was going to pass content over to a 3rd-party for analysis, that was *never* going to happen. The analysis was *always* happening on-device. They stated that clearly.

As per this article...

...all detection done on device [sic] so Apple does not see the content...

Analysis is done "on-device". Read that again ... "on-device". Are people not reading the article? The editor should have emphasized this important piece of info.