upvote
I guess CSAM detection will remain hard as the training data raises so many ethical concerns.

I wonder if there's a way in which we can forward-hash sensitive material like CSAM and train a classifier that only consumes the 'hashed' version of the material for training and detection.

reply
Very naive approach but wouldn't training a model on a few specific buckets like "someone is naked", "image is explicit" and "there is a child" in the picture, would do the job without having to train explicitely on CSAM? If the model returns both a high probability of "there is a child" and a high probability of any other bucket than this image is classified as CSAM. It'd be high recall,low precision but one would be on a rather safe side.
reply
This is already done, there's hashed indexes of known CSAM and you can apply vector steering to the latent space to shift detections to trigger on CSAM material. You can also use two detectors for age estimation and a separate one for nudity and use them in combination.
reply
I believe this is how many CSAM classifiers work. There isn't a simple legal avenue to host CSAM for classifier training, for good reason.
reply
Weird, with it being from the UAE I'd expect it to detect any woman with an exposed ankle as porn.
reply
Have you been to the UAE? Sure t the beach there re women in burkinis and more, but also women in two piece bikinis.
reply
There's a big difference between international jersetters partying in Dubai and locals.

The jersetters are basically exempted from the strict laws because they bring in money.

Alcohol is illegal there, homosexuality is, even unmarried sex is.

I certainly will never visit there even if they choose not to apply those laws to me as a visitor.

reply
What a strange Islamophobic comment to make. You should probably go out a little more.
reply
Afghanistan.
reply
it is amusing that a model from a country that has banned porn would ever be developed. Wouldn't there be hurdles for them to access "data" at every stage?

(I know they must have used a VPN for training but it does seem like an added hoop. OFC the UAE's block is also not particularly thorough.)

You'd assume such models would do better in a laissez-faire nsfw environment than in a walled garden of relatively-less sin.

reply
It's for research purposes :wink: :wink:
reply
There are plenty western CSAM detection models
reply
Can you suggest a good one?
reply
It's a story as old as time so I'm frankly less amused by it. The old school censors always saw every "data" that was taboo under the sun prior to censoring it for public consumption.
reply