I played around with Le Chonk on a toy project and it was ... very okay. Felt like a throwback to the Opus 4 era. It committed when I had told it not to, and it spent a lot of time arguing with itself going in circles.

I feel like the gap between Opus and Grok is about the same as the gap between Grok and Mistral. I didn't revert its code or anything, but I also didn't refill the initial OpenRouter budget when it ran out.

At the same time, I guess Opus 4 level is pretty good for a Western open weights model. 2027 is going to be amazing.