Yes I'd heard the labs (Anthropic mostly) speaking about LLMs training LLMs, so I wanted to make things a little more concrete and test it out myself! Essentially you are correct though, my framework allows the agent access to compute, but also the agent itself is being trained to become better at training models with that compute.
replyi remeber reading in one of the release blog posts that that version was the "first that codex helped train"
replyYes exactly, and also there is auto-research by Karpathy, Fable-5 on parameter golf etc which point to the direction of highly-assisted / autonomous AI training as the future. Wild.
replyI guess more important than LLMs training LLMs (which is mostly the same code over and over) is LLMs cleaning and curating training data.
replyVery good point. Sifting through noisy data and creating curated datasets could be of great value. Perhaps worth a project by itself!
replyNot sure how much of it was marketing but M2.7 supposedly trained itself
replyVery cool! Thank you
reply