I find Fable 5 still lacking in library design. But I guess there is no accounting for taste…
You can generalize from them to "science".
That said, the open source models are not bad and I'm looking forward to more tools and products built on top of them. Code review, security review, etc.
Anthropic needs to change how it treats users though. I'm increasingly put off by Dario, the rug pulling, the lies, and the attempts to regulate open weights. I'm going to bail if this doesn't change. There's plenty enough that's good enough, and those things are hackable and extensible.
If Fable isn't available at subscription price via third party harnesses soon, I'm also going to bail.
"Safeguards and automatic fallbacks (beta): Fable 5.1’s biology and cybersecurity classifiers block fewer benign requests and now permit vulnerability finding in source code. Blocked requests return an error and are not charged to you. On the Messages API, opt in to fall back to another model so users get a response instead of an error. We recommend Opus 5 for biology and Opus 4.8 for cybersecurity. In Managed Agents, fallback is built in."
[1] https://devforth.io/agents-for-code/?sortby=monthly-value And I can confirm the numbers, I subscribe to both and watch the numbers
They are if you follow Tibo on the resets.
Fable easily trips its safe guards. You can be 95% complete with the plan for it to trip and then lose it all. Anything is better than nothing.
Maybe it depends on the type of work you do, because for me it almost never happens.
>> You can be 95% complete with the plan for it to trip and then lose it all.
That's... not what happens though. The session will either seamlessly downgrade to another model mid-session, or it will stop with an alert and you can just re-prompt it. It will still have access to the context.
Making a web app secure is literally just finding and patching vulnerabilities, instead of finding and exploiting them. You could have the AI "try to make this app secure", find what it patches, and use it for exploits, and the AI can't know if that's what you're trying to do or not. I don't know how you can get around this. I get around it by not using Anthropic products, at present.
It probably doesn't help that I'm using frameworkless PHP - I imagine a lot triggers could be avoided if I was using a framework where secure features were baked in.
Maybe Dario should have just "donated" $1M to Trump's inauguration fund like Altman, Meta, Amazon, Microsoft, Tim Cook, Elon, and Google. There's a reason they are the odd man out with this current Administration.
They may have been unfairly targeted by the US government, but they are doing more damage to themselves without government help as well.
Their 20$ tier currently isn't serving their best model, and they insulted their users by putting out an ill tested opus 5.0, which is the worst experience ive personally had using a model in probably 2 years(obviously adjusting for expectations at the time of release).
People were very skeptical about how much investment most companies put into hardware/data centers two years ago, and anthropic was more conservative than OpenAI here, so it's potentially hurting them now.
(Opus is a separate story: it does seem to have improved in coding in my experience, most weirdness seems to be its human communication)