What I found the most interesting, and unfortunately not at all surprising, is that the reasoning of the LLMs frequently contained much more useful information than the actual answers, because the answers were censored.

You don’t even get _any_ logits with closed models for years now.

I can’t fault them too much, as logit based distillation is extremely effective.

Very useful for making smaller models out of bigger open weight models.

Dario is a cunning business man that won't hesitate to say whatever the fuck he needs to get the US government to exercise some regulatory capture to favor anthropic.