There is one level that these training data give examples of specific static reasoning chains.
replyGiven exposure to enough reasoning chains, with training data that is designed around adversarial reasoning and teaching models to reason, these types of training data might be key to teaching models to reason beyond what they could gather from static data.
> these types of training data might be key to teaching models to reason beyond what they could gather from static data.
replyI was under impression that every time LLMs try to be truly novel and they need to assume things in the area where they didn't have enough data points that there were trained on, results are not good, has that changed?
If LLMs were already good at it, the AI labs wouldn't be paying this insane amount of money for people to generate training data to teach them.
replydeleted
reply