From my rough recollection, all 3 of the past updates all had the effects of decreasing the score of open weight models.
replyOne was rushed and same-day updated as GLM 5.3 (iirc) got added; of course its main change to rankings was lower GLM scores.
Such releases often show weaknesses if the intelligence index, because the models that are ranked jointly do not have the same percieved level of quality.
replySo instead of the narrative of benchmaxing, in truth it's benchminimizing of competitors by the U.S. oligarchy?
replysmall (700b) open-weights models are great at coding and tool calling but lack world knowledge. because the parameter difference is so huge T to B, of course they also are not as intelligent.
replythis is i think the difference in this new analysis.
doesnt mean deepseek is bad or useless.
Fun fact: By changing the weights of the input you can change the output as you want.
reply