upvote
Can you use an LLM to teach you how to build a gun or use it to design a gun for you build? Can an LLM be used to generate images of young people for older perverts? If yes, then it's not very hard to make the argument that you need to be licensed in order to run an LLM on your local machine. Why wouldn't you want to be licensed? Are you against protecting children and public safety? Many students die from gun violence every year and massive amounts of minors are taken advantage of by human filth. Why would you be against protecting the most vulnerable in our society?

It will look good for politicians who pass legislation to "protect" the vulnerable. Potentially improving the chances of another term due to the marketing benefits of pushing such a law through. I think you are mistaken believing that this may never happen.

reply
In the US, attaching legislation like that to firearms instructions would doom its success. It sounds like a great idea to ratfuck a potential bill. No Republican would be able to pass a bill that bans local agents from helping citizens exercise their 2nd Amendment rights.

The politics are probably different in other countries. We're still seeing Chat Control efforts in the EU.

reply
https://xkcd.com/504/

> I think the crypto community took the wrong side in that fight. We should have lobbied to keep it counted as weaponry.

> Why?

> Once they get complacent, we break out the second amendment.

reply
Yeah. I suspect parent either is very optimistic or does not know how restricted current batch of language models are already or does not recognize that, while it may some time to completely neuter, they do have time.

It seems that powers that be learned something from the world wide web deployment.

reply
You seem to be so sure, but lobbying in the US can do incredible (and stupid) things. Look at the 3d printing control laws that are being passed in NY
reply
And this is exactly my point, the OEMs have more lobbying power and leverage. Anthropic might be valuated at whatever amount, but they're a new player and their only product is a piece of software - which others like Google, OpenAI, etc also have (not identical but similar enough).

EDIT: FYI https://ibb.co/nMYP34Rr

reply
And you think Google, one of the biggest cloud providers, Microsoft, etc. are going to be onboard with local LLMs? I don't think so
reply
Not sure about Google, but these Nvidia RTX Spark machines are specifically a Microsoft+Nvidia partnership. Microsoft is actually pushing hard on Windows security primitives for agents & local AI. At BUILD this year they used the phrase "unmetered local intelligence" more times than I can count.

From their blog about the RTX Spark surface ultra

> purpose-built to develop and run up to 1 trillion-parameter frontier AI models locally

Google may not want it, but Microsoft has a ton of lobbying power, and being primarily an enterprise software and services company, they know local AI is important for their own customers, and will also be important to sustain the PC OEMs that are threatened by a move toward thin client like devices.

reply
Not forgetting Apple!
reply
They'll do local LLMs you have to pay for. Best of both worlds: your LLM processing power will be locked behind a subscription.

You'll be coerced into a subscription to unlock the processing power you already have, and it'll only be usable by official Microsoft, etc implementations.

They get your money, get to control you, and best of all, they don't have to run it themselves in their data centers

reply
Google knows they will happen and even ships it with chrome.
reply
Google ships a local LLM with chrome browser nowadays. Don't they also provide the weights for the LLM built into iOS and MacOS?
reply
It's not just NY. California, Colorado, Washington, they are trying to pull this bullshit in a whole bunch of states.
reply
> 3d printing control laws that are being passed in NY

The "don't print guns" laws? What lobby would that be? I actually agree that the US is very vulnerable to lobbying and that 3d printing restrictions are dumb, but I have no idea how you connected the two.

reply
> The "don't print guns" laws? What lobby would that be?

Gun control lobbying groups are pushing for these laws.

https://www.everytown.org/solutions/stop-spread-of-3d-printe...

reply
Wow, that is some breathtaking stupidity. Almost literally breathtaking. Who is funding these people?
reply
The “install software that phones home to [government db] to check if the tube shape you want to print on the tool you bought and own is different enough from another tube that’s been used in a gun” laws?

Laws that don’t meaningfully impact alleged 3d printing of guns because you can’t 3d print the metal parts of a gun that are needed to actually do gun things, on the vast majority of devices these laws would restrict.

reply
Did you read beyond the first sentence? This reply makes no sense if you read the whole comment.
reply
Yeah fair, I did when I was halfway through and decided to get my piece out anyway. These laws are stupid at best
reply
There’s a combined $3T+ of capital which is at least in some position to benefit from local AI ban. Don’t underestimate this
reply
There's a lot of capital that stands to gain from banning local AI, but there's also a lot that wins either way, or only wins if local AI sticks around.

Apple is paying for their cloud AI, but they can make customers buy devices for local AI. There's all the PC and Android handset makers (ASUS, HP, countless Chinese brands, etc.) who only really stand to gain from selling hardware to customers. Not to mention that Nvidia/AMD/Intel would all happily take a cut on both halves of the ecosystem.

reply
If big biz wants it, it'll only run signed blob models and prolly send telemetry.
reply
Point is.. if I want to run equivalent of GNU model with zero blobs or other corporate silliness, I should be able to.
reply
And Adobe! I've always figured their heart can't really be in the business of running a cloud platform that has to decide what people can and can't edit.

Blackmagic Design too.

They are all desperate for Windows to run well on a chip with unified VRAM.

reply
Well, we could expect anything from Adobe. An LLM subscription on top of the regular Adobe subscription sounds like the sort of thing they would do.

Do your local filters run slow? Does your movie render have no sass? Then sign-up for AaaS!

reply
They effectively do have a generative AI plan on top of regular Creative Cloud. Generative credits auto-top-up I think?

But it must be an epic pain for them to maintain when they are really a software company, and AI tools really should be able to do most of their work locally. Affinity has some local model support for example.

I am sure they are going to have to maintain cloud support for those features for a long time, but it's all a much easier sell if you can also run it locally.

reply
I think you are assuming those companies won't sign on to be on a list of "authorized model operators", while letting it become illegal for you to run deepseek yourself.
reply
Don't doubt it. Situation is fluid. Anything could happen.
reply
Its just so much easier to be a rebel for an imaginary cause then any of the real ones.
reply
The entire point is to stop it from needing to be a cause in the first place.

Trying to establish the right to run models locally while we still can makes more sense than waiting to see if they do try, then organizing too late.

reply
deleted
reply
deleted
reply
Isn't the RTX Spark from every OEM just nvidia throwing a bone to their decade long partners after nvidia crashed the regular PC market?
reply
it would be so easy to rent GPUs in europe and use unbannable encryption (tor,i2p if needed) to get inference from them. that remaining as an option makes banning local AI pointless. if all else fails I'm sure china will be able to sell to NK some GPUs and we can get inference from them lmao
reply
> Laws restricting the use of local AI/LLMs are not going to happen

Are you sure? There are already laws against what you can do at home with very basic (pun) fundamentals of reality like chemistry.

Someone simply searching for "How to assassinate Trump" could get arrested for a thought crime. Hell this comment alone likely set off a few flags.

Imagine someone running an AI at home and asking it for planning a hit on someone. Cue same media fearmongering wave as with 3D printed guns and woohoo now it's mandatory for operating systems to watch your screen and all your keystrokes.

Fuck I probably gave some of the control freaks in power some ideas there :(

reply