upvote
And you think Google, one of the biggest cloud providers, Microsoft, etc. are going to be onboard with local LLMs? I don't think so
reply
Not sure about Google, but these Nvidia RTX Spark machines are specifically a Microsoft+Nvidia partnership. Microsoft is actually pushing hard on Windows security primitives for agents & local AI. At BUILD this year they used the phrase "unmetered local intelligence" more times than I can count.

From their blog about the RTX Spark surface ultra

> purpose-built to develop and run up to 1 trillion-parameter frontier AI models locally

Google may not want it, but Microsoft has a ton of lobbying power, and being primarily an enterprise software and services company, they know local AI is important for their own customers, and will also be important to sustain the PC OEMs that are threatened by a move toward thin client like devices.

reply
Not forgetting Apple!
reply
They'll do local LLMs you have to pay for. Best of both worlds: your LLM processing power will be locked behind a subscription.

You'll be coerced into a subscription to unlock the processing power you already have, and it'll only be usable by official Microsoft, etc implementations.

They get your money, get to control you, and best of all, they don't have to run it themselves in their data centers

reply
Google knows they will happen and even ships it with chrome.
reply
Google ships a local LLM with chrome browser nowadays. Don't they also provide the weights for the LLM built into iOS and MacOS?
reply