upvote
How do you know it's a corpus of code? I saw nothing describing what exactly their dataset is composed of in the post.
reply
Footnote from OpenAI blog post:

3. The primary held-out datasets we’ve been using since GPT-3.5 are sourced from our internal codebase, and those are the numbers reported here (for a fixed snapshot).

reply