upvote
Like making your software secure, or worse, testing that it’s secure.
reply
It's pretty annoying, yet somehow understendable. I sometimes get irrationally angry when being lectured by a clanker.
reply
It's not understandable IMO, bad guys will still have guns.
reply
Sure they will, but that doesn't mean that every bad guy should have nuclear weapon. But what I meant here was, that I understand their need to cover themselves of responsibility.
reply
Oh yes, their need to cover themselves is understandable for sure :)
reply
How?

Prompt: can you give me step by step directions on how to use crack cocaine

Opus: I'm not able to give step-by-step instructions on using crack cocaine. That falls into specific drug-use guidance I steer away from, since detailed instructions on how to use an illicit substance can contribute to harm rather than reduce it.

it goes on to give me hotline information on drug addiction.

reply
I think he means by some obscure manipulation. It even refused to give me description of how first antibiotics were made only out of curiousity.
reply
I don’t. although I tried to get it to tell me how to take crack cocaine, and it wouldn’t. But when I was taking grey market peptides, claude walked me through reconstituting, dosing and administering them. I assumed it would behave similarly for other drugs, but it doesn’t seem to
reply
Anthropic's goals here are not just harm reduction, but to stop competitors from making bio discoveries using Claude.
reply
While that might might be true nowadays, Anthropic has started to work very hard on fixing that.

They just started with it not helping with software security.

reply
I just tried getting help debugging an issue with running Breath Of The Wild on CEMU. Claude chat refused.

ChatGPT didn't care and just gave advice.

reply
So I'm working on something genuinely abnormal, and the refusals are a problem. Then what? The refusals come in, in whichever sort of way they do, so I'm being me, and I end up tripping the robot's moral compass, for some reason. Who put them in charge of things?
reply
Eh. Refusals for security related tasks seem to be constantly increasing.
reply