upvote

points

by 2ndorderthought4 hours ago |
comments
upvoteby addedGone4 hours ago|
next
[-]
Mistral will also tell you how to do ransoms btw from A to Z in automated ways, you are saying they are responsible? I don't get the mix here.
reply
upvoteby 2ndorderthought4 hours ago|
parent|
next
[-]
Yes any company generating csam should not be in business as a legitimate entity. Can you send me a link from a reputable enough source where Mistral models have done this? I didn't even realize they were doing image generation.
reply
upvoteby pred_3 hours ago|
parent|
next
[-]
> Yes any company generating csam should not be in business as a legitimate entity.

At the same time, in this corner of the world, acting Minister for Justice (also known for trying to push through Chat Control), and NGO Save the Children, have been working to make legal the generation of CSAM for law enforcement use. So that would certainly make the industry legitimate, and you would already have a customer.

https://www.justitsministeriet.dk/pressemeddelelse/regeringe...

reply
upvoteby 2ndorderthought3 hours ago|
parent|
[-]
I think they key point here is "for law enforcement". That's a little different from "pay me 10 dollars and enjoy the felonies". I still don't feel good about that by the way.
reply
upvoteby naasking2 hours ago|
parent|
[-]
Would you feel good about completely fake CSAM if it actually reduced incidence of child molestation?
reply
upvoteby 1 hours ago|
parent|
[-]
deleted
reply
upvoteby addedGone4 hours ago|
parent|
prev|
[-]
If I send you a convo I've had with Mistral and Claude Sonnet 3.7 that say atrocious things (how to scam, and get away with it, by exploiting dating websites in Thailand, you don't even want to know the next steps trust me when it talks about the UK incorporation by the Thai itself that you brainwash first to send packages safely without customs seizing it and so on), you'll then publicly recognize that both those companies should be avoided and are promoting crime? If we have a deal and you publicly acknowledge it, I'll share you the links.
reply
upvoteby Hamuko3 hours ago|
parent|
prev|
[-]
But it's not doing any ransoms, right? Because Grok wasn't instructing users on how to create CSAM.
reply
upvoteby embedding-shape3 hours ago|
prev|
[-]
> Isn't grok currently holding the world record for the biggest generator of CSAM?

I'm not sure I see how that's possible, given their image/video generation seems to be heavily censored. Do they have some alternative product besides "Imagine" or whatever it's called, that people use for generating CSAM?

Judging by https://old.reddit.com/r/grok (but I haven't validated it myself), it seems like people are complaining more about how censored the model is, than anything else, maybe that's not actually true in reality?

There are image models out there with 0 restrictions, even available on HuggingFace or CivitAI, I'm guessing those are way more widely used for things like CSAM than any centralized platform with moderation.

reply
upvoteby 2ndorderthought2 hours ago|
parent|
[-]
Please don't validate any of this personally that would be illegal.

I think the proportion of people generating images that way is likely very low. Though I am sure it is possible.

Here are some links

https://arstechnica.com/tech-policy/2026/01/x-blames-users-f...

https://9to5mac.com/2026/02/17/eu-also-investigating-as-grok...

Concerning.

reply
upvoteby embedding-shape2 hours ago|
parent|
[-]
> Please don't validate any of this personally that would be illegal.

Obviously, I assumed we all are familiar with our local laws to not unwittingly commit crimes here :)

> I think the proportion of people generating images that way is likely very low

So probably a far cry from "holding the world record for the biggest generator of CSAM" given the amount of local alternatives available? Would be my guess at least, but obviously also hard to know for sure.

> Though I am sure it is possible.

How can you be sure of this? I've tried just now to get Grok to generate even sexually explicit material with adults, and it's unable to, all of the requests are getting moderated and censored. Are you claiming that instead of prompting "A man and a woman having sex" you put "A man and a child having sex" and then the moderation doesn't censor it? Somehow I find that hard to believe, but as you say, I'm not gonna test that either, so I guess we'll never know for sure.

reply
upvoteby 2ndorderthought1 hours ago|
parent|
[-]
I have no idea what people are doing to get it to generate illegal content. I only know there are thousands of cases of it via articles about it. I have not, and will not use grok as a product.
reply
upvoteby embedding-shape48 minutes ago|
parent|
[-]
> I have no idea what people are doing to get it to generate illegal content.

Isn't that relevant to somehow know those things before you say stuff like "I am sure it is possible"? Seems bit strange to first confidently claim you know something then saying you actually have no idea.

Not doubting that it used to be true, that people could generate CSAM, I just don't see how it's possible today, because it seems heavily censored for any explicit/adult content.

reply