Depends on cost IMO - if I could buy a Kimi K2.5 chip for a couple of hundred dollars today I would probably do it.
replydeleted
replyI mean if it was small enough to fit in an iPhone why not? Every year you would fabricate the new chip with the best model. They do it already with the camera pipeline chips.
replySounds like just the sort of thing FGPA's were made for.
replyThe $$$ would probably make my eyes bleed tho.
Current FPGAs would have terrible performance. We need some new architecture combining ASIC LLM perf and sparse reconfiguration support maybe.
replyWouldn't it be the opposite of freezing weights?
reply