upvote
I'll call bullshit on that.

If this were true, models would do way better in their own harness than in others, which doesn't seem to be the case (effect is minor).

Your link has a "link to the release blogpost" which is supposed to explain the training recipe but the link is down.

reply
Could have an outsized effect on a smaller model.
reply