Why would you need the LLM to be running on the device itself? Wouldn't it be more efficient for the intelligence to be more centralized? Maybe in one central computer per home, or (probably even more desirable for corporations) for the devices to phone home to a centralized server at the service provider in the cloud somewhere.
replyOh of course thats certainly also gonna happen. But i believe there its still useful to have local dedicated AI with low latency. For example regulators that need constant adjustments. Also in cameras local AI could be extremely useful. Same for audio processing and other sensor processing. Cloud solutions wont work in those cases.
replyWhy do you need an LLM to read a sensor? This is truly AI pilled delusion.
reply