upvote
Typically they do report people to the police as well. But once the image is uploaded, they have as much info as they're getting probably. Hosting it for months until police get an indictment doesn't really do any good and just perpetrates these images' spread. I think criminals already know that most mainstream image hosts try to detect CSAM, whether they delete it immediately or not.
reply
Obviously there's all flavors of coordination with law enforcement to do exactly what you're talking about when it's appropriate.
reply
It also pushes big players (like FB or Apple) to add e2e encryption in their services so they can avoid being blamed for "knowing" that someone was planning an act of violence.

AI unfortunately currently can't be e2e encrypted at scale, so the the big players are forced to use surveillance to protect their legal butts from being sued.

Imagine if the government (USPS) decided they need to open and read every single letter or package you send or receive, for /safety/.

reply
> AI unfortunately currently can't be e2e encrypted at scale

It can actually, there are even inference providers that offer this. It isn't strictly E2EE but running a published image on attested hardware is the next best thing. The customer can inspect the image and the hardware manufacturer attests that this is the image that the inference provider is actually running.

That said the latest generation of attested hardware is quite vulnerable (see https://tee.fail/) so you're still taking the provider at their word that they haven't intentionally compromised their own machines.

reply
> Imagine if the government (USPS) decided they need to open and read every single letter or package you send or receive, for /safety/.

Of interest for those who might not know, the USPS does this for _metadata_ today.

The US Postal Service photographs every single article of mail it processes in the US through a program called Mail Isolation Control and Tracking[0]. It was created post-2001 anthrax scare, and is widely shared across LEOs.

But unlike most LEO intercept systems, you can actually /benefit/ from this one and get your own lens into their data feed.[1]

Modern problems, modern solutions, etc.

[0]: https://en.wikipedia.org/wiki/Mail_Isolation_Control_and_Tra...

[1]: https://www.usps.com/manage/informed-delivery.htm

reply