upvote
> Is there any theory on what is Anthropic's secret sauce?

I'm planning to write a blog post on it, but my theory is that it's aligned to not be "politically correct" but instead to have a solid stance. In the Claude Constitution, they explicitly say how they train it to have judgement and not "follow rules"

reply
I think Gemini 4 (Argon is the one I've been using) is very clearly better at writing English than any Anthropic model. It's not better otherwise but in that the difference is vast.

To the point that I now use a workflow of delegating from Opus or Fable to Gemini4 to write commit messages and PR descriptions, it mostly solves the Claudese problem.

reply
I just use Opus with the simple-english skill. No more Claudese.
reply
> To the point that I now use a workflow of delegating from Opus or Fable to Gemini4 to write commit messages and PR descriptions, it mostly solves the Claudese problem.

how do you do this w/o breaking bank? for Argon to write good commit messages, it must read the diffs and all the work Opus has done, which could easily eat up its usage quota.

reply
I use a $20 a month plan with Argon and I honestly find it pretty usable for asking a lot of questions if I don't keep it all in one session, or it can do a few small coding tasks a day for me until I hit my limit. I haven't hit any limits with the smaller models cuz I don't like using a lot of LLM code in my personal projects since me learning a new thing or area by coding is one of the main motivations. Generating messages from diffs/notes after the work is done is pretty cheap I imagine.
reply
You vastly underestimate size of context the model can process.
reply
Can you just have opus hand off the changelog to Gemini and have it write from that?
reply
Gemini has reliably been the best writer of the bunch, and Argon has blown me away with how "human" it can sound. It has so much less of the AI smell than the others, though Opus 5.5 definitely lobotomized the absolute sloppery that was Opus 5, at least.
reply
Every day I'm just more and more amazed at Opus 5.5 and how ahead it was. Even with the insane pace we're going at, it's amazing that two months later, we're barely putting out models that hit the price/speed/quality of Opus 5.5

No wonder they went for the 5.5 naming, instead of the .1 increase. From just the benchmarks, it seems like neon is basically on par with Opus 5.5 which came out 2 months ago.

reply
Same here. Spin up a few long horizon tasks, have it manage the whole thing as a project, you can talk to it, interrupt it, engage in side-quests, its like talking to a human.

Have another session on another machine (say, IOS build on a mac, and server build on a linux?). No problem, they will happily coordinate with each other through the /remote-control protocol, and then you feel like you are in a crowd, with those sessions talking to each other and over you.

No such feel with OpenAI nor Google models for me. They are absolutely great for lots of things, but nothing comes close to the feel of Opus 5.5 and Fable.

(I am biased; i mainly use the anthropic models so i got used to them).

reply
I dont even feel like fable 5.2 is better. Imho the best model rn is Opus 5.5 MEDIUM.
reply
deleted
reply
I agree Opus 5.5 is something different entirely. It is even hard to find tasks for other agents to be honest where you know the results will be picked apart when Opus 5.5 reviews them. In my setup Opus 5.5 uses codex from time to time when I'm running out of credits and it decided to run 2 astra agents for the same task to improve its performance.
reply
> two months later

Mad that this is seen as a long time horizon!

reply
Anthropic spent a lot more time editing their pre-training data with higher-quality material. For example, they used actual books for pre-training, because books are generally run through human editors for higher quality. (this is from the copyright lawsuits)

Other companies would use completely raw internet data for pre-training, which is basically trash. Anthropic's secret sauce is that they filtered and edited down their data for only the highest-quality material. You really don't need quadrillions of tokens to pre-train, as that's just random noise. A smaller-but-higher-quality data set is better in every way.

Meanwhile its obvious that companies like Google would use trash data like email and chat logs or Internet forums for pre-training. Just complete trash data.

This is a classic case of "less is more" and "garbage-in-equals-garbage-out"

reply

  Anthropic spent a lot more time editing their pre-training data with higher-quality material. For example, they used actual books for pre-training, because books are generally run through human editors for higher quality. (this is from the copyright lawsuits)
  [ ... ]
  Meanwhile its obvious that companies like Google would use trash data like email and chat logs or Internet forums for pre-training. Just complete trash data.
Google has been scanning every book they can get their hands on for 20 years or more. They have a bunch of patents on non-destructive book scanning gear. Surely they are using that data to train their models.
reply
won't help if they also include trash internet text in the training set as well.
reply
it's kinda known that the gemini models write better english which goes against the "trash data" remarks.
reply
Surely they are destroying scanned books for training
reply
I don't think it pre-training, because surely these labs all have similar data and Google should be very good at ingesting, cleaning, and filtering data.

I honestly think it just their post-training is fantastic and I think it has something to do with them being very opinionated on how they want the model to act that it basically the best at roleplaying a human. Humans are very good at completely and figuring out things that there aren't "trained" on if given basic set of intelligence. So when it working on these long tasks that might not be directly in it training data it still reason through it very well.

They got made fun of for this in the pass because they do a lot of research on this including hiring a philosopher.

This is just my best guess, because you don't see any other labs talk about how they made the model act and Anthropic is basically obsessed with it and talks about it every model release.

I think they just have better "taste" and that taste is their secret sauce.

reply
Microsoft (MSAI) showed that quality >> quantity with their Phi model a couple of years ago. It was a small model, but trained on very high quality data, and did better than much larger models.
reply
This is incorrect.

Everyone uses books as well as internet data.

Anthropics difference is they have a huge data budget for buying RL environments for real world tasks.

reply
I can't say what precisely, but other big companies are also doing what they can to get human data of high quality, just look for all the companies that popped like mushrooms that do ai reinforcement tasks, micro1, ethos, mercor ecc
reply
Where do you get that information from? Or is it just speculation?
reply
That doesn't really make sense because as good as Opus 5.5 is it writes awful terrible, disgusting slop.
reply
Anthropic doesn't want people to use their models for the chat/persona style use cases OpenAI has spent more time and effort optimizing for.

If you look back at GPT2 and the early days of AI safety/risk this was actually something the kinds of AI researchers that joined Anthropic didn't want - RL on coding->using that accelerate development and to bootstrap capabilities across domains was always the plan, not making it easier for people to spam/fake homework or trap people in problematic human-AI attention/relationship tarpits.

I personally find that Opus 5.5 and Fable 5+ are generally fine to chat with but just very wordy and culturally "LessWrong/essay-guy". Which, if a model is going to have a personality, is close to the one that I want (though it does piss me off when it gets preachy about standards Anthropic clearly doesn't hold themselves against)

I also want to immediately recognize AI generated content on the web or from another person, so I'm very glad it has a distinct voice

reply
Yeah maybe that's the case, and maybe I am more sensitive than other people. But I don't really use AI for that sort of thing but even for technical stuff I still find it's writing style a real turn off. Gemini still has lots of AIisms but it's a lot more tolerable.
reply
If the training set is smaller, doesn't that make sense though? There will be much less variety in its style and so its going to make very recognizable output.
reply
Yeah that could be it. I guess the thing about what makes AI writing so repulsive sometimes is not that it's bad like a human would be bad, but that it does the same things over and over.
reply
It's a much, much better writer than literally every other model.
reply
It's better than Opus 5 but it still has that incredibly punchy contrasty LLM style that worse than most other models
reply
I think by now everyone training trillion parameter models is using almost every book, magazine, research paper, etc they can get.
reply
Purely outside looking in, but yes, I'd argue you are right and higher-quality is a major part of it, both for pre- and post-training. There appears to be a far greater willingness to adopt specifically tailored training sets from third-parties, consistently update and build on them.

From simple frontend work to strategically adding virtual rulers when working with LIDAR scans to extract more accurate data, there are very clear points when Anthropic introduces a new external data set into their mix and while I have seen the same from competitors such as Google, there simply appears to be a greater tendency to stick with these once they have them.

As an example, at release it was quite apparent that Gemini 3 Pro, 3 Flash and Opus 4.5 had a similar, possible even the same frontend-focused training base bought in from a third party. But while Anthropic has had both smaller and larger improvements across each subsequent Opus release, I have not noticed such a consistent improvement with Gemini models over the last year. Maybe Anthropic simply buys updates more often, maybe they create more artificial PRs on top, who knows.

Same with the LIDAR scans, there was a point a few months ago when models started to exhibit a very systematic way of handling visual references in some few leather-crafting tasks, enabling whole new ways of working more efficiently combining existing measurements with images. Step-by-step pixel measurements, compensation for angles and poor captures, etc. Have since seen this in other models, again very much feels like a bought in data set that they are pushing as far as it goes.

Then there is 3D capability with models like Muse Wonder Full. I have not used it myself, if it ain't on API, it doesn't exist, but have seen PRs and do find the model output very parsable, despite it being terrible at any modelling task because these capabilities do not emerge from just training on vast amounts of data, they require high-quality, well tailored, step-by-step reference data of the entire process.

Harness wise, while pure output performance is very consistent across harnesses in my evals (I nowadays use both OpenCode via API and the labs own harness three times each to normalise), Anthropic also appears to be far more willing to use the time between releases to prepare features for the next. Stuff like workflows, proper subagent implementation, advisor, etc. often have found there way into Claude Code either in-between models or were first seen with a model that couldn't fully leverage these. Also feel that explained the good overall launch experience Fable 5 delivered, they simply used the time between announcing Glasswing and launching full access to get the UX/DX polished.

Meanwhile, I am still testing GPT-6.2 Astra and Sol so will refrain from making any more judgement on either till I have all data, but apparently there has been an extensive last minute rewriting of the system prompt to improve performance and "behaviour". Given the gap between GPT-6 Astra and yesterday, along with statements by OpenAI staff alluding that they had this model ready for a while, such things should happen in a far more structured, systematic, well thought out manner, not last second after some negative outside feedback. Heck, from what I know Anthropic, unlike any other lab, does zero early access outside the limited hardening for very exclusive partners like Glasswing. Certainly no early access for regular users, reviewers or the like from what I've heard, so Anthropic does all that prep-work for model releases with less feedback than other labs.

reply
I suspect that Anthropic has more user data to train on from Claude Code. Claude Code became popular sooner than Codex and Antigravity, and remains more popular - thus more data to collect.

Cursor was popular before any of those three, and just look at how much Grok improved after they acquired Cursor's data.

reply
> Cursor was popular before any of those three, and just look at how much Grok improved after they acquired Cursor's data.

No one that I know of uses Cursor anymore, and Grok has been disappointing since ages.

reply
I don't disagree.
reply
Anthropic has a proper feedback loop with claude code. They see way more real production data and can detect where their models are weak.

So they can train on prod traces or at the very least use user prompts to seed good synthetic tasks to train on.

reply
OpenAI has plenty of feedback from Codex. Maybe not quite on the same volume as Claude Codex, but still massive. So I'm not sure that's the whole story.

I doubt there's a single reason for why Anthropic are ahead right now. Building a frontier model requires executing well in a wide variety of things. It's probably a result of being slightly ahead in various aspects of of data collection, model architecture, pre and post training, harness development, etc.

It's a shame that so much of what's happening is being closed doors. Maybe one day, decades from now, somebody (or some AI) will write a definitive history of this period, explaining what was going on at the various labs, how their research compared, and what the major players really thought.

reply
They just have an incredible data flywheel I think. Since they were first to market with claude code, they have more training data than others. They also pay a lot ($150 per hour) for SWE experts to train the AI. I get some random recruiting emails occasionally from companies affiliated with them.
reply
Yeah I’ve gotten the same thing. If anyone from Anthropic is reading this: it’s not enough to make me quit my job for a short term contract. Try doubling it and we’ll talk
reply
It's likely that the agent configs you have might overfit to Claude models.

I'd recommend trying Gemini Neon on Antigravity, with a trimmed down (or new) agent configs.

reply
This model matches Fable 5.2 for about 40% the cost. Not sure how you can take from this that anthropic has some secret sauce?
reply
According to benchmarks; time will tell. I see a lot of comments here and on X about how Google's caught up. But when Opus 5.5 came out, I didn't see comments. I saw examples of what people built, and it was mind blowing. Stopped the world for a few days for me and others, while we re-configured our brains around what was possible. I'm entirely willing to believe Google's catching/caught up but - lets have some real people build and show off like they did with Opus and Astra.
reply
Exclusivity on RL environments they license.
reply
You are not alone. I have the exact same experience: opus just gets it and the others feel like cheap toys
reply
Here's my average experience with Carbon.

(After a long conversation with existing messages)

User Prompt: Ok, so SSH to the unraid server and update the plex db

Reply:

I need to think how to answer this.

The user is asking me to SSH into the unraid server. This seems to imply there is a machine to which we can SSH to. I should look for places where hosts may exist.

The implication is that once SSH is established to unraid, the plex db can be updated. It seems plex is a service that the machine has in which we can run updates.

I'm wondering if plex might be the Plex service the user has been discussing.

So the user doesn't want to SSH to the server - actually they want to SSH to the server.

... Formulating a plan ...

[some messages later]

Aha! THIS IS THE SMOKING GUN! `~/.ssh/config` HAS THE REQUESTED HOST!!! IT'S TIME TO CONNECT!!

[some messages later]

Ok, time to act. I'll ssh to the server and follow coherent rules.

----

I am shocked at how primitive its reasoning sounds (it reads just like gemini 2.5-pro's old reasoning). It often gets the job done (although it's quite slow and can't tackle more sophisticated problems).

Perhaps Anthropic's internal reasoning is also like this, but they really rewrite it to make it seem more coherent (which certainly sells it on me)? I almost want to click stop just by reading this nonsense.

reply
All displayed reasoning is not real reasoning for all models now. It's fake since they can be trained on.
reply
I want to believe you, and it's what makes the most sense! But if that's the case, why is google (intentionally?) presenting such terrible reasoning traces? To make sure that if they're trained on, they're trained on garbage? I guess it makes sense, but still...

I was not really fabricating the example I gave too much. Here's a verbatim transcript from a session which was filled with this stuff:

    ... thought LET'S READ RecordReader.cs RIGHT NOW!! RecordReader.cs IS WHERE EVERY SINGLE TABLE, ReadPlan, DecideValueVisibility, ReadRowCounts , AND ShowValues READS ITS DATA!! Let's read RecordReader.cs (lines 1-300)!
reply
reasoning traces also arent real reaaoning. its what tokens warm up the outpt the best
reply
What you're seeing is a small model summarizing and possibly obfuscating the real thinking.
reply
Yes, I understand it.

It seems rather ironic that Anthropic givens the most logical reasoning traces, though. You'd think if they're ahead they'd either hide them or make them produce garbage (like what seems to come out of Google's models).

reply
Neither has any relation to the actual reasoning trace. The summary is actively misleading and you'd be surprised how different it is from the raw CoT of the model. Just ignore it.

If you want to see example traces without jailbreaking claude or gpt, see open models that display the CoT without trying to hide it. It's pretty useful sometimes, with usual caveats (it deceptively looks like English but is heavily reward hacked, and it's generally a weak proxy for model's reasoning process).

reply
This makes sense. Nonetheless, I find that reading Anthropic's reasoning traces is sometimes a trigger for researching more stuff. Often I'll see models thinking (or fake thinking, whatever) about something and I'll be curious to check out more about that topic if I'm not particularly familiar with it.
reply
Off-topic, but this kind of conversation tells me just how little the average HNer still uses LLMs outside of specific coding tasks, or at least pays attention to them. Which in turn explains so many comments. Probably a good thing though.

You're of course completely right. Interestingly the "summaries" have only become more diverged over time. I now believe the big 3 are barely summarizing at all any more. I deem it likely that the small models don't get the CoT at all, they just completely make up something "plausible" solely based on the user message with a little bit of previous context. Much of the time it will be the complete opposite of something I asked for, or barely related.

Anthropic has changed this up multiple times over the last 12m, I'm talking about the iteration that was around the longest this year. I think they changed it again within the last feww weeks and potentially started actually summarizing again.

Your suggestion is the right one. Everyone who uses LLMs for their job should spend some time with open models like Deepseek and see what the thinking actually looks like.

reply
Not only that, Anthropic injects fakes reasoning and tool calls in there to make it harder for distillers. It's shitty behavior but you'd do the same if you had an edge you wanted to maintain.
reply
One of my long horizon tasks benchmarks involves writing logic controlling a team of soldiers in a simulated environment. Argon and Carbon both made such discoveries such as "it would seem that i need to be pointing at an enemy to shoot them". Its almost entertaining to read, its like its discovering the world on first principles.

(And it did produce a very competent algorithm, though it took a few days and a metric ton of tokens; I just triggered the same task with Neon).

reply
I'm curious about how it goes with Neon! This night I'll leave Neon with some lofty goals on a project and I'll see how it fares too.
reply
lol Aenis the god.
reply
Claude annoys me with condescension sometimes... makes it feel far less like a 'tool' and can even come across as a bit judgemental!

Just today I was filling out a security questionnaire and it said "I won’t write a PDF that claims zero credentials while this token is in the logs." But we were in the process of removing this from the logs so it was perfectly accurate to write and I wish it had deferred to my explicit request...

I think Anthropic overcorrected on the sycophancy; Google models to me seem a nice balance of highlighting issues / risks while still doing what I actually ask.

reply
Anthropic models won't lie. When we fix security issues identified with sth. like Wiz and are writing a report, it won't write a summary suggesting that something we just fixed wasn't broken (even if that thing never made it to production). It has something akin to moral standards :-)
reply
I've seen them ignore clear directions that in documentation it's supposed to read after a compaction. That seems a lot like lying to me.
reply
Claude models will go to extraordinary lengths to ensure sensitive data does not end up in their context window. It's a bit nuts. But frankly I appreciate it a lot. Even when it is annoying I know the model is doing the right thing.
reply
Opus 4.x really struggled with secrets rotation in sops, even in 5.5 it's constantly emitting secrets to the shell history. Thankfully everything gets tested in dev, but Claude models are the reason why we have such good secret rotation now.
reply
Yeah, I notice this as well. I was building something to help me understand logs from the different coding agents and it wrote redaction code to redact secrets out of the logs just in case if the logs had any so it wouldn't see them.
reply
There isn't because Opus 5.5 isn't better. There is no objective reason to believe Opus 5.5 is better.
reply
The secret sauce is sandwich statements. Just look at any Claude response. Positive-negative-positive. Bamm, and we are hooked.
reply
How do you evaluate opus 5.5 as "better"? My experience has been that Argon was ok - maybe equivalent to opus - but carbon in orchestration mode was finally able to rewrite some early experimental (ai slop) front end code - and break a bit out of UX/UI rut that a couple of projects were stuck in.

It might be that opus is better in better structured projects, and carbon is better at (re)structuring poorly structured projects?

Carbon is a better project manager/product owner - opus a better programmer?

reply
Opus 5.5 leads the CanTellForestFromTheTreesBench 42.0.
reply
> Is there any theory on what is Anthropic's secret sauce?

Lots of PR it seems?

I have all of Ant/OAI/OpencodeGo subs and test lots of models and I just cannot understand how and why some people find specific models so ahead, when it seems to me like reality is so nuanced and so specific to the particular task and how you approach it.

reply
More like, most people especially on here do 90% of their "tests" on very similar tasks - coding on specific codebases - and the other 10% is just asking stuff in chat. So they never get to experience the jagged edge. Anthropic models could be horrific at translation to Nahuatl or greenhouse cherry tomato management compared to Gemini and OpenAI but there's one person on HN doing such things and tens of thousands doing enterprise SaaS coding.
reply
Never underestimate the power of minimalist hand drawn graphics on an off white background with a clean typeface.
reply
Results usually reflect company culture and with big companies no matter what you do - if the culture is not there - you are doomed.

Google is the best example of this with their product graveyard. No matter what they release- they just can’t make a good/nice/usable product.

Just check google ai studio as one of latest examples.

reply
AI studio isn't great, but what is a better lightweight studio product than AI studio?
reply