I've noticed also that 5.6-Sol is more concise with output than Fable (and let's not talk about Opus, which is even more wordy).
FWIW, we use ChatGPT for our primary model and use Claude to do the reviews. This works better than ChatGPT doing it's own review even with a clean session/context.
I've done this tens of times between these two models and it works great in my experience. Sol initial back and forth with me. Commit. Let Grok review. Sol fix. Only then do I start reading the code.
You should be doing this for every solution.
Even Fable reviewing itself will find issues, unproven assertions, etc. Same for Codex models. A review loop is critical.
Like, the quality of the anthropic models is fine, but they’re so incredibly slow. Claude reads files one at a time while codes dispatches tool calls three or four a time.
Company empathy does exist, just look at how easy or hard it is to reach a company when you have a problem. How do they try to solve it for you? Is it a brick wall, for example Google when you have a problem. People quite often like dealing with small businesses because they can reach a singular human and have them as an interface to the problems they face now and in the future.
Agentic loops and the models underneath them can have a simulacra of empathy too. Not every model just blindly agrees with users, and some have a much better depth in picking up context clues that the user on the other end is having a hard time. Businesses just typically aren't running more expensive and fragile systems like that though.
For example, health insurance providers are renowned for not being empathetic. Charities are the opposite. Sometimes companies even build it into their identity, e.g. Cards Against Humanity.
As for AI, I haven't seen a strong difference in empathy but it's definitely true that the big AI companies at least try to make their models moral and empathetic. Even if it mostly ends up just being annoying.
I think that AI has an insane level of upside, it’s just that the greedy dumbfuck billionaires are getting their greedy little grubby paws involved. If left to researchers I think the sky is the limit, but unfortunately thy need assets, so there isn’t a clean solution to that.
Ideally, we could somehow separate AI from funding from malicious entities like billionaires, but right now that doesn’t seem possible. Hopefully in the future researchers with genuinely good intentions can have far more direct control than dumbass greedy old fucks, but we’ll just have to see.
I think the future can be bright in theory but we’ll have to see, making insanely powerful open-source models is the direct way to get around the billionaires so I think that’s our only option. Make open-source ASI you can run on a consumer computer.
I believe the reason we have not seen a Fable-level model from OpenAI yet is because doing so would box them in on costs just as harshly as it has boxed in Anthropic. They are letting Anthropic make this mistake.
If you can train a larger model then you can distill smaller models from it. You don't need to necessarily serve the larger model publicly. Distillation is much more effective when you have unrestricted access to the original model.
It's funny how people make these alignment comments while ignoring how misaligned the leadership at these companies are right form the get go and they just play mental gymnastics to deflect those facts when confronted with them.