The number of active parameters is vastly different. Deepseek CEO hinted that he estimates it as an order of magnitude difference in one of his recent interviews.
reply> Seems to benchmark
yes, but in human usage the differences show up
Would you happen to have a link to that interview? Sounds like an interesting read.
replyIt's related to this: https://news.ycombinator.com/item?id=49052912
replyIt was posted to HN a few days back
reply1. https://news.ycombinator.com/item?id=49019012 (original chinese)
2. https://news.ycombinator.com/item?id=49052912 (translated english [pdf])