upvote
Also DeepSeek R1 was announced 1.5 years ago with ~0.7T parameters, which was a huge model back then.
reply
And DeepSeek has been making huge progress on efficiency, and publishing about, so they came with a 1.6T model that is both fast and cheap to run.
reply