GitHub is to agents what StackOverflow was to developers back in the day (in a meme kinda way).

More seriously, I'm curious if you checked on the licensing of said codebases, were they permissive or strong copyleft?

I think a lot is memory really. For fun you can try pointing just about any model against the older kaggle challenges and it’ll come up with more or less the winning solution from memory. It’s here where you see a Gemma 27b perform about the same as opus 5.5

It's the same for CTF challenges. Many get 'solved' because a writup was found and steps were followed.