upvote
Right. So we had enough information to train LLMs but not the technology to build it.

So the initial models arent just distilled from information. We’ve always had the information.

reply
Yes, but not the secret of distillation.
reply