upvote
For purely coding tasks, is every single expert required? 50%? 25%?
reply
Yes, every expert. It's not like different personas, more like very coarse dropout training.
reply
Right. So it's not like human experts or even different brain regions
reply