it doesn't mean it poisons your ability to predict human text, but that it knows if it were to generate output it would likely be more correct than the human inputs...
Thus, if RL-trained for pure performance/correctness, the "innately inept" model would typically underperform the "innately capable" one. The second model has started from a better foundation, so when trained to push itself past the usual limits of human-dominated data, it would attain better task performance.