upvote
I work at OpenAI and I made the plots. Gemini 4 Carbon was omitted when we couldn’t find public data, usually cost. No intent to hide anything.

If we missed anything, feel free to point me to it and we can add it.

reply
So all the plots are based off public data? You don't run the models internally yourselves?

(Again speaking only for myself)

reply
they are probably trying to authenticate their phone number to access agy
reply
Yeah it feels shady how Carbon was selectively plotted (or not), unlike Opus/Fable
reply
Probably still waiting for it to finish reasoning on the benchmark. Should be ready in a week or two.
reply
Two posibilities. 1. They couldn't figure out how to actually use those Google models.

2. They launched the benchmark days ago and Gemini is still rereading the file with tasks.

reply