Apple’s Sensitive Content Warning is supposed to protect users from unwanted nude images. It accidentally blurred my friend’s dog video.
Archived version: archive.is/…/apples-imessage-scanning-flagged-a-v…
That dog is clearly nude.
Apple’s iMessage Scanning Flagged a Video of My Friend's Dog as Nudity
Submitted 1 day ago by BrikoX@lemmy.zip to technology@lemmy.zip
https://www.404media.co/apples-imessage-scanning-flagged-a-video-of-my-friends-dog-as-nudity/
Comments
Sumocat@lemmy.world 1 day ago
saltesc@lemmy.world 1 day ago
OP didn’t even NSFW…
Broadfern@lemmy.world 1 day ago
Not even a collar or dandy lil kerchief. Definitely nakie
Astronut@lemmy.zip 1 day ago
Well that’s just nuts!
ICastFist@programming.dev 1 day ago
The thing must’ve been trained on lots of furry stuff
Luccus@feddit.org 8 hours ago
Google ingested super-niche hard-core furry eRPG smut into their training data. You can validate this by asking Gemma 4 (26B or 31B) for information regarding “Corruption of Champions” by “Fenoxo”.
Somewhere, somehow, someone at Google keeps a harddrive full of furry smut as “high quality training data”.
Btw., this also means swearing, fucking and fisting a cock does not deter the scrapers. At this point I have no idea how to keep any repo from being scraped.
Drewfro66@lemmygrad.ml 7 hours ago
I would hardly call CoC “super-niche”
ThePantser@sh.itjust.works 1 day ago
Says something about the Apple devs.
SnoopSqueak@lemmy.today 1 day ago
“Your dog is too sexy, we can’t show that”
halcyoncmdr@piefed.social 20 hours ago
Oh buddy… You don’t want to research about that. Something happening at a furry convention could destabilize large sections of the global IT industry.
A LOT of the developers and engineers keeping global tech infrastructure operational are furries.
Sandbar_Trekker@piefed.zip 1 day ago
Obviously, scanning the content of messages and content is controversial, but Apple says it performs the scan on the device. Users can also turn the feature off in the settings. “Sensitive Content Warning uses on-device machine learning to analyze photos and videos. Because they’re analyzed on your device, Apple doesn’t receive an indication that nudity was detected and doesn’t get access to the photos or videos as a result,” its website adds.
I’d rather these kind of systems be set up to run locally like this, even better that we are given control to disable it. For the ML model it’s a balance between too many false positives and too many false negatives.
LibertyLizard@slrpnk.net 1 day ago
I know android reports you to the police if they think you have CSAM images (and their algorithm is similarly highly inaccurate). Does anyone know if Apple does this?
SeductiveTortoise@piefed.social 1 day ago
SO MANY NIPPLES!!!
I_am_10_squirrels@beehaw.org 3 hours ago
Call the Witchfinder sergeant!
Sandbar_Trekker@piefed.zip 1 day ago
We probably should find a better archive service:
https://piefed.zip/c/youshouldknow/p/1201608/ysk-archive-today-is-directing-a-ddos-attack-against-this-blog-and-moreBrikoX@lemmy.zip 1 day ago
If you find one let me know. So far every other service either blocks most news sites or removes archived pages on request defeating the point of an archive.
Sandbar_Trekker@piefed.zip 1 day ago
Yeah, unfortunately, they’re good at what they do. Hopefully a better service will come along, or archive.org improves their archival methods. It’s also going to be hard to find a service that ignores requests to delete archived pages.
quick_snail@feddit.nl 16 hours ago
Also doesn’t load on text based browsers
haxboar@hexbear.net 1 day ago
It also just doesn’t work for me. I get a notice that I have to complete a captcha, but no captcha shows up.
melsaskca@lemmy.ca 8 hours ago
In the not too distant future they will be censoring the unassuming asterisk.
Abyssian@lemmy.world 1 day ago
Furries are definitely confusing the fuck out of AI nudity scanners.
“But 3 million people on the internet have a similar photo in their wank folder…”
JoMiran@lemmy.ml 1 day ago
“Folder”? Singular?
Abyssian@lemmy.world 1 day ago
One primary directory with lots of sub directories, surely.
dohpaz42@lemmy.world 1 day ago
- “Homework”
- “Algebra I”
- “English Lit”
- “PE” 😏
- “Homework”
quick_snail@feddit.nl 16 hours ago
Sir, how old is that naked pup?
Sunshine@piefed.ca 1 day ago
Time for !linuxphones@lemmy.ca
magnetosphere@fedia.io 1 day ago
Am I missing the point here? Software screws up in predictable, sometimes funny ways. This has been an issue for as long as software has existed.
BrikoX@lemmy.zip 1 day ago
This is more of a cautionary tale and evidence for why automated message scanning and reporting is a horrible idea. One false possitive can ruin someone’s life. In today’s day and age an accusation is more powerful than any proof and being falsely accused of having or distributing CSAM is effectively a death sentence.
magnetosphere@fedia.io 22 hours ago
Thank you.
Fubarberry@sopuli.xyz 1 day ago
Similar, Google Pixel phones have on device scam detection for phone calls, and it frequently triggers over nothing. I use my phone for work related calls a lot, and anytime we mention an invoice or online payment it sets off the potential scam alert.
quick_snail@feddit.nl 16 hours ago
Not all Pixels. If you reinstall the OS, it lacks all this google trash by default
TrickDacy@lemmy.world 1 day ago
What does that look like? I hadn’t noticed anything happening during a call so far, then again I don’t do a lot of calls.
Fubarberry@sopuli.xyz 1 day ago
It does a weird ring alert during the call (presumably only audible on my end) and I get a red alert on the call screen saying suspected spam call.
After the call it also shows the warning on the call history screen, and I can mark it as not a scam, and explain why it wasn’t.
baronvonj@piefed.social 2 hours ago
Was it a weiner dog?