upvote
But you cannot train an open weight model by yourself, and maybe there could some distributed training net ran by thousand of volunteers around the world in the future, but until we get there we will still be tied to BigCo (American, Chinese or wherever in the world) decisions.
reply
You would need institutions to do this? What do we have besides global megacorps with the resources for this? Universities perhaps training models for their local catchment?
reply
This is exactly why I believe LLMs are fundamentally divergent from the trajectory of internet service path we have been on. It allows us to create space and disconnection from an otherwise tethered experience.
reply
It is possible that models are only the byproduct of what frontier labs are doing. In other words, what you call AI is just a log, a trace of what the real AI, for which only frontier labs have access to, did.
reply
> You can't host the internet on your machine, or download a "Google" or "Meta" but you can download a local model.

You can very much host websites on your machine (not the whole internet, but then again you can’t host the most powerful models either) and you can very much download a Wikipedia or Internet Archive.

But most people never will. This idea that everyone will soon be using local models while frolicking happily in the fields is a pipe dream. Besides, local or not, these models can already be harmful in ways the internet took decades to approach.

reply
A local model has more data than Wikipedia and the Internet Archive is way too large to download on a consumer machine.

A local model works even if the Internet is perfectly firewalled or straight-up down. However, you still need electricity and eventually replacement parts, so in an apocalypse may not work either.

reply
A local model has more data than Wikipedia and the Internet Archive is way too large to download on a consumer machine.

A local model works even if the Internet is perfectly firewalled or straight-up down. However, you still need electricity and eventually replacement parts, so in an apocalypse may not work either.

reply
It’s already fairly realistic to get 2022 era frontier models running on prosumer hardware, which is pretty good for freedom.
reply