> every technique under the sun to understand and improve their models, including raw weights.
replyWhat does this even mean?
That's like saying the moon landing wasn't impressive because the US were in a space race with the soviets.
replyOf course they try train their models on these techniques. Finding success is still news.
replyWhy?
replyHow is this different from other things LLMs are trained to manipulate?
We aren't fully at AGI yet, even though it's starting to get damn close. So every new capability is in some sense unexpected.
replyIf it's new it's news.
replyWhy would they train the models they release with this though?
reply