Another complicating factor is that it really blows to have humans look at stuff like that, so everyone would rather use automated classifiers; and if you assume good faith and share too much info with the affected parties, this will be exploited by the bad guys to gain insights into how the system works and how to circumvent it.
I don't think there's an elegant solution to this, other than "don't allow tech companies to get so big that they can afford not to care about individual customers".
On the contrary, that's an incredibly elegant solution.
I don’t think this is something that can be solved by more surveillance though.
Most abuse (i think something like 80%? Not sure but it was a big number) happens within the family and between minors (minors abusing minors)
Changing how easy or hard it is to distribute or generate CSAM will help exactly nothing here even if that’s the goal.
AI unfortunately currently can't be e2e encrypted at scale, so the the big players are forced to use surveillance to protect their legal butts from being sued.
Imagine if the government (USPS) decided they need to open and read every single letter or package you send or receive, for /safety/.
It can actually, there are even inference providers that offer this. It isn't strictly E2EE but running a published image on attested hardware is the next best thing. The customer can inspect the image and the hardware manufacturer attests that this is the image that the inference provider is actually running.
That said the latest generation of attested hardware is quite vulnerable (see https://tee.fail/) so you're still taking the provider at their word that they haven't intentionally compromised their own machines.
Of interest for those who might not know, the USPS does this for _metadata_ today.
The US Postal Service photographs every single article of mail it processes in the US through a program called Mail Isolation Control and Tracking[0]. It was created post-2001 anthrax scare, and is widely shared across LEOs.
But unlike most LEO intercept systems, you can actually /benefit/ from this one and get your own lens into their data feed.[1]
Modern problems, modern solutions, etc.
[0]: https://en.wikipedia.org/wiki/Mail_Isolation_Control_and_Tra...
Basically, keeping children from being miserably. Poverty isn't the only source of the exploitation of children but it's huge one and how little any anti-CSM crusaders care about this reveals a lot imo about their lack of sincerity.
But in our society, even in a much better society than this, bad things are going to happen at scale. At a certain point, you have abandon the "we'll do anything to stop this terrible thing, no matter how much what you do hurts people otherwise, no matter how ineffective what you do is, you must do your thing since it can be done".
> What is appropriate to what age?
Pretty much everything. You can talk to children about sex without issues.
> Who should do it?
A person the child can trust, can be a teacher or parent for example
> How much should it be driven by children's questions and how much regardless?
If they have questions answer them.
> Should all children by taught the same things at the same age?
Yea I don’t see why not
> Should it be purely biological or do you teach them values at the same time?
Both
In veil of ignorance Rawlsian style you teach them enough where if you were in their position you wouldn't feel slighted by the adults setting you up for the world at large.
But this agenda is also ultimately about the power of those pushing it rather than just its goals, of course.
I think virtually every person and company does care. In fact I think its exceedingly obvious.
Even if OpenAI, Facebook, etc dont care be cause they are evil, they do care because pf liability.
None of this even excludes the possibility that CSAM controls are co-opted for power sometimes. Which is why it’s absurd to suggest these companies don’t care - you can concede that point and still argue its being co opted.
To actually care about something is not the same as doing arbitrary actions due to financial reasons. That's caring about money, and nothing else.
What do you think? Do you think Facebook, OpenAI, etc. are fine with child porn on their platforms save for liability? A liability which of course exists because virtually everyone agrees that it's a real problem and not just an excuse to grab power.
The fact that they did not previously have proper procedures in place for something like this is not proof that they don’t care. They are one of the fastest growing companies of all time, it’s hard to get disparate parts of an organization aligned on something. Their organization has more than doubled in size in the last nine months.
Are there any resources or tools you'd recommend here for me to setup? It's already going through cloudflare, and I'm actually in the process of shifting my transform service from Supabase to a hosted container there, so I've got my images routing through there anyways (but storage on Supabase still instead of R2 for now).
I've so far managed to resist using OpenAI and similar for anything, except having played around with duck.ai a little bit. I'd only want to use local models, preferably models that I trained myself. "Open weight" seems like perverse terminology, like "open binary" for closed source software.
That doesn’t really follow from your experience.
OpenAI could care about child sexual abuse and not respond to your appeal, even wrongfully.
Frankly I am not interested in retaining an OpenAI account anymore so the only reason we appealed was to try to get more information, not to restore the account.
At the very least, they could provide us with an NCMEC case number so we can proactively work with the NCMEC to track the content down, but it appears their main motivation is not "strengthening the fight against child sexual abuse" but rather "reducing OpenAI's liability in the fight against child sexual abuse".
Duck roll…
So basically, table stakes for running a user-submitted-content site will be to pay for your own GPU node/cluster and manage your own inference stack (running a worse model than you could use in the cloud). Otherwise you're at the mercy of opaque and kafkaesque (by necessity) service termination without warning for CSAM (real or hallucinated), and subsequent refusal to communicate about anything related to it.
[1] either by queuing all posts for classification before showing them publically, or just best-effort after-the-fact detection of spam or abuse, and upon detection they're moved to a spam queue.
Or just use one of the many third party inference providers that markets an image classification endpoint intended for user generated content.
The fact that people have autonomous agents making these kinds of decisions is still mind-boggling to me. Maybe I'm stuck in the past. But could this agent have been racking up things of dollars in charges because of this decision GP didn't even know about?
stay away, use deepseek and stuff
I used to view shit there a lot sometime in the mid-2000s.
How much patience would you have for some entity maybe "accidentally" processing something that (apparently) looks like child porn against your policies?
Is this really the world you want?