i hope groq wins if they start doing such things with consumer.
replyIs this the chatjimmy asic approach with a bigger model?
replyNo, the asic could only ever run one model/set of weights, no updates possible, ever. These are general purpose processors that can have their models updated. But the chips are enormous, with a substantial amount of on-die memory alongside the execution units, for a relatively insane amount of memory bandwidth.
replyI thought from what I read about the Taalas approach, the model architecture and overall size couldn't be changed, but model weight values could be updated after for further tuning.
replyNot as flexible as Cerebras though. And I'd love for someone who knows more to clue me in to the truth.