With LLMs this fast, you could imagine using them as any old function in programs.
replyYou could always have. Assuming you have an API or a local model.
replyWhich was always the killer assumption, and this changes little.
Even if this first generation is not useful, the learning and architecture decisions in this generation will be. You really can't think of any value to having a chip which can run LLMs at high speed and locally for 1/10 of the energy budget and (presumably) significantly lower cost than a GPU?
replyIf you look at any development in computing, ASICs are the next step. It seems almost inevitable. Yes, it will always trail behind state of the art. But value will come quickly in a few generations.