upvote
Why is that not only forbidden, but also most forbidden?
reply
There's Most Forbiddenish and there's Most Forbiddener. We already apply length penalties to CoT in RL, for instance.

Sometimes I worry that the framing around CoT grading prevents research into necessary and useful safety techniques that edge up against it, but what do I know I'm just a guy, c'mon n downvote me LW bros

reply