What's funnier is that after cherry picking models for comparison, they further cherry picked Inking for size comparison instead of better and smaller Beam 1.0
replyThe bar chart also shows Nemotron 3 Ultra instead of smaller and better Nemotron 3.5 Super.
We've always been at war with eurasia.
replySeriously though, it's just easier to pretend that China doesn't exist when they're stomping us this badly.
I think it's because the primary users of this model won't even look at "those other open weight models" as options. This is the right chart to present to those who would consider this model. (e.g. US Gov't agencies, chip design industry, etc etc)
replyRight? These are not likely to be meaningful points of comparison to anyone but the authors.
replyMaybe Palantir will use it or something. There probably is a market for US models but I don't know how large it will be.
replyUS Gov won't let Chinese models be hosted on any internal infra, not even supposed to use them for local AI. So there is absolutely a market for US-made or non-Chinese models there.
replyDo you have a source for this? Genuinely curious, I've seen reports online of MIC contractors already using it extensively on-prem. In fact, one of the issues they bring up is how there is no official guidance right now, so no one really knows what to do.
replyBecause Chinese models heavily rely on distillation and regularly behave strangely in public benchmarks (where they score much better than in private evaluations), even if many world class researchers are Chinese. It's difficult to quantify to what extend labs like Moonshot would be competitive if they could not distill from OpenAI, now that Anthropic mostly blocks it
replyhttps://www.theinformation.com/articles/openais-astra-model-...
It would also be pretty difficult to quantify to what extent labs like Anthropic would be competitive if they could not distill from human knowledge.
replyDo those other models usually mention all the competition? I haven't noticed
reply