Becnhmarks are a pox on LLMs.
replyYou can use this model for about 5 seconds and realize its reasoning is in a league well above any Qwen model, but instead people assume benchmarks that are openly getting used for training are still relevant.
They really are. Benchmaxxing is real… but also the Qwen 3.5 series of models are still very impressive. I’m looking forward to trying out Gemma
replyDefinitely have to use each model for your use case personally, many models can train to perform better on these tests but that might not transfer to your use case.
reply