There's a lot of RL that goes into this, you're not just training on bad code. Python is one of the programming languages that LLMs consistently perform best at.