undefined

points

[-]

Yes, this is getting ridiculous. On both OpenAI and Anthropic.

Simple example. I am a CTO, and I want to upgrade our capabilities to perform automated pentesting. We see automated attacks of growing sophistication against our infra, and I want to be able to do the same to find vulnerabilities before the bad guys do. I asked GPT 5.6 Sol and Fable to give me a summary of options. No dice, in both cases I was told I need to be an accredited researcher to get anything. A fricking summary of commercially available options is getting censored. WTF.

by alchemist1e91 hours ago|

parent|

[-]

And the logical conclusion you will make is you need to run your own open weights models or you are at a competitive disadvantage. Frontier labs gonna be Ancient labs soon, that’s how fast this is moving.

by walrus011 hours ago|

prev|

[-]

Meanwhile I have an uncensored qwen 3.8 27B here that will happily attempt to (as a crude and randomly chosen sampling of bad/evil things) give me the recipes for meth, how to make an IED, write a manifesto in support of a horrible ideology, or commit various forms of fraud. Now I certainly wouldn't recommend that anyone try to follow what it says to do, because it's almost certainly very wrong on key parts that would put its users in federal prison for the rest of their lives.

There's uncensored models out there which score 0 (zero refusals) on this "harmful behavior" dataset:

https://huggingface.co/datasets/mlabonne/harmful_behaviors

by kouteiheika1 hours ago|

parent|

[-]

Yep. Just like a kitchen knife will make no attempt to prevent me from stabbing anyone with it.

Here's a dirty secret though -- you don't actually need an abliterated/uncensored version of the model to get it to do this. I can do this with every and each open weight model, as served from OpenRouter, using vanilla model weights.

by walrus011 hours ago|

parent|

[-]

A little bit like Neal Stephenson's metaphor of unix-like OSes as the "hole hawg" of operating systems. In the sense that there's very little preventing you from doing something like "sudo dd if=/dev/zero of=/dev/sda bs=1M" or running rm -rf on your homedir.

http://www.team.net/mjb/hawg.html

If I recall right this was written around the same time as Cryptonomicon 25+ years ago.