upvote
All displayed reasoning is not real reasoning for all models now. It's fake since they can be trained on.
reply
I want to believe you, and it's what makes the most sense! But if that's the case, why is google (intentionally?) presenting such terrible reasoning traces? To make sure that if they're trained on, they're trained on garbage? I guess it makes sense, but still...

I was not really fabricating the example I gave too much. Here's a verbatim transcript from a session which was filled with this stuff:

    ... thought LET'S READ RecordReader.cs RIGHT NOW!! RecordReader.cs IS WHERE EVERY SINGLE TABLE, ReadPlan, DecideValueVisibility, ReadRowCounts , AND ShowValues READS ITS DATA!! Let's read RecordReader.cs (lines 1-300)!
reply
reasoning traces also arent real reaaoning. its what tokens warm up the outpt the best
reply
What you're seeing is a small model summarizing and possibly obfuscating the real thinking.
reply
Yes, I understand it.

It seems rather ironic that Anthropic givens the most logical reasoning traces, though. You'd think if they're ahead they'd either hide them or make them produce garbage (like what seems to come out of Google's models).

reply
Neither has any relation to the actual reasoning trace. The summary is actively misleading and you'd be surprised how different it is from the raw CoT of the model. Just ignore it.

If you want to see example traces without jailbreaking claude or gpt, see open models that display the CoT without trying to hide it. It's pretty useful sometimes, with usual caveats (it deceptively looks like English but is heavily reward hacked, and it's generally a weak proxy for model's reasoning process).

reply
This makes sense. Nonetheless, I find that reading Anthropic's reasoning traces is sometimes a trigger for researching more stuff. Often I'll see models thinking (or fake thinking, whatever) about something and I'll be curious to check out more about that topic if I'm not particularly familiar with it.
reply
Off-topic, but this kind of conversation tells me just how little the average HNer still uses LLMs outside of specific coding tasks, or at least pays attention to them. Which in turn explains so many comments. Probably a good thing though.

You're of course completely right. Interestingly the "summaries" have only become more diverged over time. I now believe the big 3 are barely summarizing at all any more. I deem it likely that the small models don't get the CoT at all, they just completely make up something "plausible" solely based on the user message with a little bit of previous context. Much of the time it will be the complete opposite of something I asked for, or barely related.

Anthropic has changed this up multiple times over the last 12m, I'm talking about the iteration that was around the longest this year. I think they changed it again within the last feww weeks and potentially started actually summarizing again.

Your suggestion is the right one. Everyone who uses LLMs for their job should spend some time with open models like Deepseek and see what the thinking actually looks like.

reply
Not only that, Anthropic injects fakes reasoning and tool calls in there to make it harder for distillers. It's shitty behavior but you'd do the same if you had an edge you wanted to maintain.
reply
One of my long horizon tasks benchmarks involves writing logic controlling a team of soldiers in a simulated environment. Argon and Carbon both made such discoveries such as "it would seem that i need to be pointing at an enemy to shoot them". Its almost entertaining to read, its like its discovering the world on first principles.

(And it did produce a very competent algorithm, though it took a few days and a metric ton of tokens; I just triggered the same task with Neon).

reply
I'm curious about how it goes with Neon! This night I'll leave Neon with some lofty goals on a project and I'll see how it fares too.
reply
lol Aenis the god.
reply