My partner runs an internal computational mechanics benchmark that hasn’t tracked progress with model advancements (flat/no progress since early 2026) until suddenly saturating from argon and carbon. My take is that it’s due to spatial reasoning (most of the challenges are programming that require a lot of shape rotation type thinking), but we don’t know just yet why Gemini is doing so much better.
Carbon is the first "better than meh" model form Google in more than half a year. It's been out for less than a week. How can you consider it "steady"? Their subscription and even the API has been terribly unstable throughout the past few days, so I'm having really trouble believing any of this.
Ok, you're either a troll or you objectively don't know what you're talking about. Google should be ashamed they even released 3.8 Flash. They published models with such high frequency and always made a huge jump on benchmarks. Then they were caught, when a new version of AA came out and their numbers dropped like a stone.