upvote
Hy3 DeepSWE - 28%

GPT5.4 xhigh DeepSWE - 52%

A lot of contaminated benchmarks in the blog post about Hy3, needs real testing though I have a distinct feeling it's benchmaxxed like a lot of Chinese models.

reply
I think you’ve got the models wrong…gpt-5.4? I doubt there is any open source mode matching it. Maybe in a year
reply
Yeah I meant gpt-5.4-mini, but GLM 5.2 is pretty close to gpt-5.4 base, and much better than it when it comes to design stuff.
reply
GLM 5.2 already matches GPT-5.4 easily.
reply