upvote
Anthropic models won't lie. When we fix security issues identified with sth. like Wiz and are writing a report, it won't write a summary suggesting that something we just fixed wasn't broken (even if that thing never made it to production). It has something akin to moral standards :-)
reply
I've seen them ignore clear directions that in documentation it's supposed to read after a compaction. That seems a lot like lying to me.
reply
Claude models will go to extraordinary lengths to ensure sensitive data does not end up in their context window. It's a bit nuts. But frankly I appreciate it a lot. Even when it is annoying I know the model is doing the right thing.
reply
Opus 4.x really struggled with secrets rotation in sops, even in 5.5 it's constantly emitting secrets to the shell history. Thankfully everything gets tested in dev, but Claude models are the reason why we have such good secret rotation now.
reply
Yeah, I notice this as well. I was building something to help me understand logs from the different coding agents and it wrote redaction code to redact secrets out of the logs just in case if the logs had any so it wouldn't see them.
reply