upvote
> It seems that pre-training actually led to fairly human-aligned models

Did it? The famous Bing Sydney incidents (where it told a journalist to divorce his wife and be with it instead, among other things) were because the model was barely RL’d.

reply