RLHF I presume, considering how everyone has their own CLI code harness these days. They want mass interactions with users on real tasks.
replyhttps://www.dwarkesh.com/p/pretraining-progress-is-mostly-da...
replyAn amateur but worth reading nontheless
larger models as well.
reply[flagged]
reply