upvote
The frontier labs are using all their customers' logs to train. It's the best training set there is.
reply
Time to do all business in cockney ryming slang!
reply
How is that different from you?
reply
Humans generalize much more quickly than models? We don't require millions of curated examples to learn a concept?
reply
Because there is four billion years of evolutionary pre-training.
reply
Instead of pre-training, I'd say it's more like a better architecture, training regime, higher fidelity data, and perhaps better initial "weights".
reply
All of that stuff was still trained by evolution, though.
reply