upvote
Humans generalize much more quickly than models? We don't require millions of curated examples to learn a concept?
reply
Because there is four billion years of evolutionary pre-training.
reply
Instead of pre-training, I'd say it's more like a better architecture, training regime, higher fidelity data, and perhaps better initial "weights".
reply
All of that stuff was still trained by evolution, though.
reply