Microsoft PhotoDNA scanning problem
95 points
5 hours ago
| 13 comments
| elevenforum.com
| HN
giancarlostoro
4 hours ago
[-]
> Microsoft wanted me to confirm my age, that I was a "real person" along with identity. So Microsoft somehow reached out to the police department, based on my address information in my Microsoft accounts, with a check of some kind. I had to go to the local police department to verify who I was and my age. The police department told me it was odd. They are just following up on Microsoft complaint. This happened a few or so years ago. Microsoft confirmed my identity then. However, the Microsoft account profile photo issue still exists today.

You what now???

reply
MisterTea
4 hours ago
[-]
> The police department told me it was odd. They are just following up on Microsoft complaint.

Since when does your local police department respond to a "Microsoft complaint?"

reply
john_strinlai
3 hours ago
[-]
they dont. and microsoft doesnt contact local police. this post is dubious.

if its CSAM related (which is implied via photodna involvement), microsoft does not contact local police. they contact NCMEC (or the appropriate equivalent), who then coordinates the law enforcement response.

if it isnt CSAM, microsoft does not contact local police to aid with support, because that would be ridiculous to coordinate over a billion accounts across tens of thousands of police departments around the world. and police forces would obviously not tolerate acting as microsoft support personnel.

there has to be a substantial amount of missing context, or this story is (partially? fully?) fabricated, or the user is mistaken/wasnt talking to microsoft.

reply
giancarlostoro
4 hours ago
[-]
That's what I'm saying! That is WILD.
reply
MisterTea
4 hours ago
[-]
PD - Hello Police department MS - Hello officer, this is Microsoft. We're calling to report a user trying to access their system unlawfully...
reply
the_snooze
4 hours ago
[-]
That sounds like straight up scammer behavior. "Yes, this is Microsoft calling. We need to confirm your info with the local authorities."
reply
selcuka
3 hours ago
[-]
> That sounds like straight up scammer behavior. "

Microsoft reached out to the police department, then the person went to the local police department to verify who they were. I don't see how this could be a scam.

reply
thunfischbrot
46 minutes ago
[-]
Then again: how does the local police department verify they are indeed talking to Microsoft?

It’s been done before: https://krebsonsecurity.com/2022/03/hackers-gaining-power-of...

reply
beeflet
4 hours ago
[-]
Home Depot™ Presents the Police!®
reply
Forgeties79
4 hours ago
[-]
Subway™ Eat Fresh and Freeze, Scumbag!®
reply
dwroberts
17 minutes ago
[-]
Blocking the account because the image was used by another account that had been suspended etc. sounds more like the specific image had been flagged as offensive while in use by that account, rather than it having anything to do with them establishing a relationship between the actual accounts

(If they established connections between accounts by using images, surely they would block vast swathes of people using generic harmless images you can find online)

reply
mzajc
4 hours ago
[-]
> Microsoft's PhotoDNA scanning is not just in OneDrive, through the Microsoft's eco-system. Basically, if you are using your Microsoft account to sign in to Windows 11, PhotoDNA scans your entire computer. This information came directly from Microsoft Support.

This sounds like a horrible privacy violation. Is it true? What do they do if they find a match?

reply
Modified3019
1 hour ago
[-]
The general consensus from I saw from discussions years ago was that scanning of your local files was not something that happened (which would be detectable and eventually discovered and called out by someone). Doing so would also require the dll which contains how photodna works, which Microsoft does/did not want out in the wild and requires an NDA to use. Secretly exfiltrating your files for scanning would get Microsoft in legal trouble.

Incidentally, how it works is clever and interesting imo, though defeatable if you know how it works: https://www.hackerfactor.com/blog/index.php?%2Farchives%2F93...

The obvious alternative of course, is openly and aggressively getting users to agree to uploading their files to Microsoft’s computers (OneDrive), which are scanned.

However in the age of machine learning, copilot and the like, I would not be surprised if local scans start becoming a thing, since offering classification of objects in photos is a perfectly reasonable thing to offer from Microsoft’s point of view, and of course CSAM detection can come along with that.

reply
duskwuff
35 minutes ago
[-]
An alleged implementation of PhotoDNA was posted to GitHub a few weeks ago:

https://github.com/ArcaneNibble/open-alleged-photodna/

reply
snailmailman
48 minutes ago
[-]
I’m surprised that such scanning isn’t built into windows defender, the enabled-by-default tool already designed to scan all your files.

But yeah, they also just super aggressively try to trick you into sending all your files to onedrive.

reply
bawolff
4 hours ago
[-]
According to the post, they called the police (!)
reply
john_strinlai
4 hours ago
[-]
the police part makes me really question what is going on here and the validity of this report.

if you get multiple child sexual abuse material (CSAM) matches, the police will be knocking on (down) your door. microsoft isnt going to nicely ask you to go down the the police station. they dont even contact local police, they forward the information to the appropriate national entity (e.g. NCMEC) who coordinates the law enforcement response.

and if it isnt CSAM related, microsoft is not going to be contacting your local police, period.

something isnt adding up here. i suspect this post is ragebait.

reply
seszett
31 minutes ago
[-]
> and if it isnt CSAM related, microsoft is not going to be contacting your local police, period.

Why would they not? I once had a problem with material uploaded on a file sharing system hosted on Hetzner. I received an email about it from Hetzner, but I was on holiday and I didn't check my email so after 48 hours or so the local police (French gendarmerie) came to my address and politely asked for my server logs.

Luckily I had forgotten to update my billing address on my Hetzner account, so it was my parents address and I was on holidays at my parents.

reply
bawolff
4 hours ago
[-]
Wait, reading between the lines it thinks his face is CSAM?

I guess its a hash collision, but that is pretty crazy. Sounds like the plot to a scifi dystopia.

reply
Retr0id
4 hours ago
[-]
The perceptual hashes used for this kind of thing are, necessarily, much more susceptible to collisions than cryptographic hashes - so it's not out of the question at all.
reply
vessenes
4 hours ago
[-]
That's my guess as well. Could be a collision, or it might be he's in a corpus. Or he's been RATed and is not talking to Microsoft at all. I wasn't aware they required face pics to provide service.
reply
loloquwowndueo
4 hours ago
[-]
No, TFA says the picture was associated to an old account that got flagged - presumably anything linked to that account, picture included, is now cursed.
reply
bawolff
4 hours ago
[-]
TFA also says the police were involved. It seems unlikely MS would call the police just for a flagged account, or that if they did, the police would care.
reply
isodev
4 hours ago
[-]
> dystopia

Coming soon to every AI enabled product near you

reply
Retr0id
4 hours ago
[-]
This is why I regularly reset my face.
reply
wormius
3 hours ago
[-]
Philip K Dick enters the chat...

Through A Scanner Darkly, indeed.

reply
selcuka
3 hours ago
[-]
If that doesn't work, they'll fingerprint your thoughts.

Oh well, Philip K Dick enters the chat again. With Solar Lottery this time.

reply
batch12
4 hours ago
[-]
Is it a specific picture of the face or any picture of it?
reply
BobbyTables2
2 hours ago
[-]
Does this mean a Windows PC associated with a Microsoft account will scan images accessible on mapped file shares?
reply
loloquwowndueo
4 hours ago
[-]
> I just do not know what to about it any longer. Each time I create a new Microsoft account

There’s your problem. Don’t create a Microsoft account? Why would you need one anyway? To use windows? Why? Get Linux or switch to Mac.

reply
rincebrain
4 hours ago
[-]
"My picture gets a call to the police if I use it at my day job" is a hell of a sentence, for example.
reply
seemaze
4 hours ago
[-]
Ooph, what midlevel SWE at MS did he rub the wrong way..?
reply
donkeylazy456
4 hours ago
[-]
So... microsoft thinks he is too hot for them.
reply
Uberzi
4 hours ago
[-]
For your information, PhotoDNA is a CSAM related tool. I do not think that comment is appropriate.
reply
ltbarcly3
4 hours ago
[-]
Why does he keep using that picture?
reply
bombcar
4 hours ago
[-]
The whole point of PhotoDNA (CSAM scanner) is that it can detect variations of photos without them being identical and without having CSAM to directly compare it to.
reply
xeromal
4 hours ago
[-]
It's his face
reply
shrinks99
4 hours ago
[-]
"Why should I change? He's the one who sucks!"
reply
SV_BubbleTime
2 hours ago
[-]
That no talent ass-clown.
reply
9991
4 hours ago
[-]
Wrong question. Why does he continue to do business with a company who clearly doesn't want him?
reply
jrflowers
4 hours ago
[-]
>I had at least 12 Microsoft accounts immediately closed

What?

reply
inetknght
4 hours ago
[-]
What what?

I take it you're not one of the many people who've had a dozen different services over the years get bought up by Microsoft, then forcefully migrated to multiple Microsoft Accounts, and then lose access to all of them?

reply
cocodill
47 minutes ago
[-]
Maybe try it with a different image the 12th time?
reply