> Anthropic got what they deserved

Anthropic got the most rewarding hype ever in the history of mankind.

Imagine a private company invents a piece of technology soooo good that the US government has to issue a ban.

Did the government ban any models from Google or OpenAI? Nah, Russian/Chinese spies and ISIS are welcome to use those dumb models.

Anthropic will probably go for $2T IPO now.

> Do you think China is going to allow the strongest LLMs ... a year from now when they have Mythos capabilities

"Mythos capabilities" is not some magic threshold. This is exactly the type of language that people used about GPT-4 in 2023. Today, I can run models far stronger than GPT-4 on my laptop at speeds better than GPT-4 offered.

Anthropic are quite good at coining sticky phrases like "Mythos-class models", but these are manipulative attempts to shape the discourse for business purposes and should be identified as such.

> I hate being told what technology I can and can't use

Ever since the original GPT-2 "it's too powerful to release!" I've realized that whatever is the current state of open models represents what we really have access to.

It's shocking to me how many people on HN, who engage in long conversations about LLMs and AI, have never actually run a model on their own hardware.

All you need is a reasonably good macbook pro/studio or an RTX [3-5]090 and you can run useful models in the >= 30 tokens/second range (much higher if you choose the GPU path). The difference between what you can run on this hardware and what you can run on hardware that costs 2-5x is not that big. Don't be fooled by people on Twitter/X claiming you need some outrageous setup.

It's also increasingly clear that frontier models are nowhere near close to pushing the limits of efficiency. Quantization, MoE, and other techniques have dramatically improved even in the last year.

For work, of course use OpenAI/Anthropic models, but for anything personal, anyone who considers themselves a "real engineer" should be running local models, using open harnesses and seeing what they can accomplish with these.

Even if open releases slow down or even stop, we have the foundation, right now, for smart engineers to squeeze something quite useful out of. Hopefully we'll one day figure out how to train large models in a federated way. But either way: not your weights, not your inference.

I'm a European, the EU is supposed to be one of the closest allies of the US.

The US government found a jailbreak that allowed the user to make Fable do bad things, this is so dangerous that this model must be held back in areas that are not the US...

If this is so dangerous why allow US nationals access to it? Are there no evil people in the US?

Going back to my perspective: let's say I control a big enterprise or a government body, how should I view this or US technology? Should I be like: yes, let's use US tech, they are a reliable partner and would never abruptly cut us off! Or should I be like: there are competent alternatives out there and if your work hinges on wether or not you had access to Fable 5, then your business is probably not going to survive for long.

It sounds right, but there is one caveat to me:

Training best models is hella expensive. Anthropic spent fortune to train it, and it definitely plans to make a fortune with it either. This US decision, if not reversed, would cause Anthropic potentially tens of billions of dollars of revenue loss. When company heads to IPO, and burning cash faster than it generates it, such moment can change their entire trajectory, plans for the future, hiring, new models development, etc.

Alright, one might say that “US will fund it directly and LLMs will move from free market to controlled and funded by government assets”.

But even then. Training new models is expensive not only in terms of computer, and not only in terms of utilities, data centers, etc. But in terms of talent either. It is hard to retain top talents with you when they should just train special models for government. I am not sure we are in 1945 again and that top tier AI researches will agree to sit in silo and work for models which only privileged selected organizations might use. Whenever government steps into control, freedom and creativity is affected.

P.S. Where I agree, though, is that we witness the start of government censorship of AI models. Imagine soon Anthropic open back access to Fable. Can we know what they put inside and which capability limitations, derived based on ID/IP, they enforce? No, we can’t. Here I agree that at least the era of government censorship begins.

> So many comments here missing the big picture, and just gleefully pointing out that Anthropic got what they deserved, or that this is the natural culmination of some kind of marketing stunt.

But it is! How many times have OpenAI and Anthropic threatened the rest of humanity with extinction at the hands of their LLMs? Monthly I think.

They were hoping for a government supported monopoly. Careful what you wish for.

I wonder how this is going to work given half the people working at the AI labs are Chinese foreign nationals, and even more interesting, DeepMind is based in the UK. Plus there is an awful lot of AI research going on all across Europe, especially Switzerland, that is feeding straight into the US major labs.

Banning foreign nationals from using your technology only makes sense if you don't rely on foreign nationals to build it in the first place.

Or are we so far along now we think we don't need them anymore.

I'm wondering if they might go for a restricted access model that goes beyond passport or citizenship, where people can still use it, but you have to be individually vetted, and put on a list to get security clearance.

IMO: Its unacceptable that Anthropic be allowed the final say in what "safety" means for their products, and its extremely reasonable that the USG be allowed that say, for Americans. In other words: Anthropic cannot be allowed to distribute an unsafe product. It doesn't matter how much they "tried" to make it safe, by their own definition of safe.

That's separate from the question of whether Fable 5 and Mythos 5 are unsafe. I don't really know. Here's a few things that seem real, though: These models probably have some level of capability to assist with bioterrorism, Anthropic has self-admitted that their own safety measures are imperfect [1], so it should come as no surprise that jailbreaks seem far more possible than Anthropic is leading you to believe in this blog post [2].

[1] https://www.anthropic.com/news/fable-mythos-access: "We suspect that perfect jailbreak resistance is not currently possible for any model provider."

[2] https://x.com/elder_plinius/status/2064776322979676227

If Amazon sold a book that taught someone how to commit bioterrorism, would there be action against them to stop selling it? Its an imperfect analogy, but the parallels are there. LLMs don't get a free pass because they're also so good at writing typescript for beige CRUD apps and bedtime stories.

One thing I hope we align on: Synthetic safeguards (steering, rejections, etc) on top of models to block illegal/sensitive topics isn't good enough. Anthropic has self-admitted that it isn't good enough. We need the technology to lobotomize these capabilities the public deems too unsafe to allow out of the models at the most fundamental level. And, we need to align on what the scope of these forbidden fruit topics are. This is, actually, the only way open source continues to thrive. I want open source models to thrive, but they won't be allowed to thrive, nor should we want them to thrive, if they're teaching people how to engineer novel viruses and other horrible stuff.

> These are heading in the direction of being powerful cybersecurity weapons and it will be in the interest of nation states to restrict and control them. In 2 years time, I would be surprised if the strongest LLMs are available for general use at all.

I don't necessarily disagree, but who is going to pay for improvements in models if they're not commercially available? Are AI companies going to become defence contractors with (US?) government paying for the training?

I don't know much it cost to go from AI model Foo 4 to Foo 5, but it's going to cost a pretty penny to eventually go to 6 and 7. These companies are doing so in the expectation of eventually charging customers to recoup the costs: if the only customer(s) is government(s) then the per-unit cost will be much higher. An analogy: you can get a 'civilian' toilet for USD 200, an FAA/EASA-approved toilet for airlines 2000, and a MILSPEC/NASA toilet for 20000.

Now this limited-customer model is certainly doable—tank manufacturers have a smaller base of customers than pickup truck manufacturers—but AI companies probably want regulatory clarity on what they're allowed to sell, and to whom, before they start developing new products/services.

> Do you think China is going to allow the strongest LLMs from companies within its borders to be open source a year from now now when they have Mythos capabilities [...]

The "Mythos capabilities" is a pretty arbitrary threshold. It could have happened any point before or after. China treats this technology in very different ways. And China's economy and foreign policies are very different, in such export-based economy export controls make much no sense. Unless something changes drastically in the global relations. I expect the opposite to happen, if the US leave a void globally, china will be even more incentivised to fill it.

This been said, it is likely that big models are soon no longer "open sourced" (qwen has already started), but because the chinese companies will prefer to sell access themselves, not because of government intervention.

In any case, what happens now is a huge thing, and not sure we grasp its consequences yet. It is definitely beyond any ai safety marketing stunt. Even if this is rolled back at some point, after "guarantees" are established, it has already moved things to change drastically.

Ironically, this is something that the restrictive EU AI regulations can help with. Had the Anthropic been in EU, they could not be restricted as long as they followed the laws which is essentially taking some precautions against obvious risks(no social profiling, emotional recognition in schools etc.).

That’s also the difference between being totalitarian government and laws and regulations based order.

China had already forbade their top researchers to even leave China.

Also foreign investments into Chinese AI labs have already been forbidden and asked to exit

I suspect the big picture isn't just "governments restricting the availability of strong LLMs to the public", it's a group of tech lobbyists who have managed to push a narrative that's plausible enough to the majority, but serves their master's interests in stifling competition, whether that be from Anthropic or those who know how to use their tools effectively.

The fact that Anthropic are willing to dumb-down their own model responses to "Prevent foreign competitors from using the model to accelerate R & D and protect our leading position." [1] adds credence to this speculation. Anthropic are scared of their own model's power in the hands of competitors: it has nothing to do with security.

[1] https://eu.36kr.com/en/p/3848820681636481

My guess is that Anthropic will either address the government's concern and get the export control removed or implement a citizenship verification (like passport upload or something).

I remember something with either ChatGPT or Claude, way early on, where I had to upload my passport to use some level of it (maybe it was the OpenAI API).

Anyway, there's no way they just shut this completely down, the revenue from mythos is huge. So if they can't get the government to budge they'll find a way to be compliant without completely shutting down.

I do think the Chinese will give away strong models. The US government can't control that and would make a mess if they tried. Companies making SOTA models would be undercut and all the funding that went into them would be wasted. Sounds like a great strategy for the Chinese.

Oh, I'm definitely won't be poorer without one LLM. As a professional I probably will be richer, even. And with more certainty for the future for sure.

I agree this is probably their thinking - they view frontier models (and the capability to build them) as a vital strategic edge that they want to keep to themselves.

The problem is that there are network effects at play - the more people you have using your models, the more training and fine-tuning data you're accumulating, so the faster you can develop the next frontier model. Not to mention the fact that more users means more revenue to fund your next-gen model training.

Perhaps the US administration is gambling that US citizens on their own provide enough of a training data and revenue flywheel for them to keep their AI development edge.

The next interesting question will be - will the US share this capability with her traditional strategic allies (e.g. five-eyes countries), or is it truly America First (or, 'America Alone')?

> Will we be the poorer for that, or will we be safer? I think poorer, because I hate being told what technology I can and can't use, but I'm not certain.

I think this is bang on. The motives are kind of irrelevant, because now that the precedent has been set, I suspect they'll be much more likely to go here for future restrictions. It's very convenient (even if true) to just say "security reasons".

I think this could kill LLM development. What's the point in pushing boundaries, when your business model is already hard to profit from, only to be blocked from selling your work to the entire world? Where's the incentive to continue?

> If you think the solution here is going to be open source Chinese models and / or running on your own hardware, think again.

This logic is flawed. China had no incentive to release SOTA models to the world in the first place when OpenAI were milking everyone with closed source paid models. What changes now? Nothing. In fact, this is even more incentive for them to capture marketshare and dependence on Chinese models as the world will simply just use alternatives. Not bow down to restrictions. If your logic were correct that people would just comply, then the tons of VPN services wouldn't have a market in the first place.

I find it worrysome how often people value revenge over good. The same happened when traffic to SO cratered; as if the destruction of a valuable source of information was good just because the mods suck.

A myopic view, but the government has generally not been heading in the direction of an educated populace over the last few decades. It doesn't surprise me that anything that's too intellectually capable is a threat.

Personally, I assume that AI labs like Anthropic are high value targets for spies from other nations. I also assume that some of those spies have already had success in getting the model weights / source code / other such secrets.

So I doubt this action alone is enough to really stop other nations from getting access to state of the art AI. I think the US would have to go much further to really stop other nations from getting access to state of the art AI.

That's only if you believe this is actually motivated by safety, and not corruption. They won't block access to Grok, just watch. They'll probably allow ChatGPT too if it is censored in some way.

I think the Chinese don’t share the “AGI-pilled” understanding of AI that you see in some US companies and part of government.

Thus they are far less likely to do something like this.

The real story is that Anthropic went from being a "supply chain risk" to being a "national security risk."

> The real story here is that this may be the beginning of governments restricting the availability of strong LLMs to the public, to you.

That would also significantly dampen the commercial incentives to develop such strong models, given the high costs involved.

On the other hand, such a future would probably save white-collar jobs.

> Fable was the strongest model on the market

based on Anthropic's own self promotion. no reason to think that Chinese models are not just as good or better. the key thing here is training on machine code and dis-assembled binaries and the Chinese have a complete data set of pirated software, with no limitations on how they use it. I seriously doubt they are actually behind.

> only if you're not a US citizen, but in practice, even if you are

the issue here is that Anthropic needs a legal opinion that their mechanisms for detecting foreign users in the US are compliant, which is technically hard to do, and a complex intersection of technical details and national security law, so getting a legal opinion can't happen overnight. it will be back.

I think you are missing the bigger picture that is around the "bigger picture" you are seeing. AI proliferation is more dangerous than nukes proliferation, as any highly capable tech would enable destructive usecases as well. If nukes related material and knowledge was safeguarded, then AI requires it as well.

What we could see is AI access being used as a carrot by the major global powers (US, China and EU) to entice smaller countries to join their orbit. Similar to how the F-35 program functions. Competition between powers and a desire to use the land and energy of smaller countries for data centers creates an incentive to give some access. That's the good future. I don't want to put the bad future into the training data.

When the Chinese do it they will use it to attack US infrastructure that won’t have been hardened because the models are behind walled gardens.

Despite the damage it’s better to build up an immunity through ongoing exposure, unless you want to end up like the previous American civilisations.

I see a slightly different parallel here - they are basiclaly building a framework that takes the US adn friends back to the early 90's where cryptology was considerd a munition and all export products were nerfed. Just like then those that wanted to collaborate with the rest of the world found a way (printing /tshirts etc) similarly now those labs within the US sphere have that decision to make.Unfortunately its the Darios and Sam who are pretty much in favour of regulatory capture environment.With no other frontier labs in the US committed to OSS , and CHN models banned - the devs are pretty much hosed. I doubt the rest of the AI labs in China et al will follow suit in hobbling their own models.As its seen more as a commodity not a wondertool with a moat. At the end of the day the ask is going with a Oracle/Microsoft over a GNU/Linux type of environment.

I agree.

Honestly, and I don't say it lightly, long term this may have bigger impact on humanity as a whole than Iran war and its varying outcomes ( and consequences ). Separately, note how much this news was not really reported much today. Granted, a lot was happening, but it is telling.

Yes. It’s really not a good idea to make this ban. When the US is gradually isolated in this way by its gov’s policy, the world becomes more and more dangerous. What worse, the traditional value of open to competition that Americans have hold for centuries seems to be substituted step by step. It’s absolutely a tragedy.

We need open distributed "p2p" models a la bittorrent , that allow individuals to share their computer power for inference. So that the models cant be censored and everyone can run SOTA models.

It doesn't have to be free, we have the means to transact in a p2p fashion electronically as well.

AI companies business model depends on wide adoption. How will they survive if government closes access to their models?

We are not missing the big picture, this is what Anthropic wanted. They made this bed, let them lay comfortable in it.

>The real story here is that this may be the beginning of governments restricting the availability of strong LLMs to the public, to you.

I can't agree more. This is a precedent not just in denial but possible vagueness. Judiciaries have 'vagueness doctrines' to counter such laws/directives but _these_ may be re-trumped by the deference given to national security.

If we don't get soon a framework by which models may be measured as 'too powerful' vs 'not too powerful' we supercharge the self-dealing (corruption) that this administration has brazenly adopted. Many fingers can be put on many scales; groks may be given a pass while others are held to higher "standards".

Will OpenAI now just asymptotically bump its versions to 5.99999999 to stay under a limit that nobody really understands?

I realize that this has all just happened and we might get some good rigorous clarification from our government.... sigh. We are living in a kakistocracy. Who am I kidding?

I do not really like applying the "if we did it, they will too when they can!" logic to other government's.

China has flaws, plenty of them, but there's no real evidence to believe their motivations or mechanisms of pursuing motivations are that similar to that of the United States.

> but in practice, even if you are

That part is up to Anthropic. KYC[0] is not exotic, it's just a pain in the butt: if Fable is that good, they can do the KYC.

I don't think this is the right move from the government, but we shouldn't pretend that "citizens only" is an insurmountable hurdle for a company that just got a $65B capital infusion.

[0] https://en.wikipedia.org/wiki/Know_your_customer

The other thing is what this will do to 1) the valuations of these companies, 2) their potential revenues and therefore the viability of the current datacenter buildout. Looking forward to the reaction of the market on Monday.

Supposedly many Anthropic AI researchers are foreign nationals. So this move by the US gov may serve to slow down frontier AI research, including human-guided RSI. If you believe that such a slowdown increases safety, it may turn out as a blessing in disguise.

The scariest thing to me about AI is not what it can do, but that someday public access might be lost and governments/ billionaires would hold exclusive reign. Today could be the last time the public has any idea of the true capability of AI.

They want Deepseek V4 Pro they can try to come and take it. It's incredible that anyone allowed themselves to become so reliant on closed models

I see your point and share it up to a point… but how does it square with the full western economies gambling all or nothing on AI?

The whole thing is theatre.

Anthropic gets into argument with US government over model usage -> Release a model calling it too advanced for safe use -> release the model to public knowing well that this admin has thinnest of skins and will do something

Regulatory capture in roundabout way. Now it is going to take crying wolf over other companies/countries developing “Mythos grade model” to kick off action especially in next two years of this admin.

Companies will keep improving models because AI is not yet fully there. But it is incredibly naive to think governments were ever going to allow state of the art technology to be released to public or do things this publicly. Every company wants to show off and get publicly restricted because it shows off their strength.

I can only say well played Anthropic.

> In 2 years time, I would be surprised if the strongest LLMs are available for general use at all.

That's a bold prediction considering that's true today...

They can't control what I run on my GPU. Exactly why local inference is so important.

You can't use it if you're American either.

Is fable that good ? I was under the impression that it's just an incremental update, and not even a big one.

Government always restricted data, tools, technology. In France for instance you're not allowed to have a gun, but policemen have.

What's the difference ?

Imo china, and deepseek will keep its open source model because they invest in long term. At some point they could do something similar, but not now.

USA government is just hurting AI development in their country, and that's good news to me.

> If you think the solution here is going to be open source Chinese models and / or running on your own hardware, think again. Do you think China is going to allow

I think this also misses the point. The precedent here almost surely implies that it will be illegal to use these frontier models as well.

I can see a future where weights are distributed on the darkweb or bittorrent, or people are trying to use small fly by night hosts of models.

But if this says these models are dangerous and the companies and people can't be trusted with them, then I don't see why that wouldn't also apply to open weight models.

The huge investment into LLMs at a loss is about having control of these tools and technology. Now we're seeing a state try to take some control.

But who do you trust more to make these decisions? A democratically elected government or a private company?

I think it's too early to understand the ramifications but I agree this is a huge deal.

Govts wont be able to do shit. Just like we saw with social media. This is just happening faster. Illusion of control theatre will continue for few years. Beyond which we might have totally different looking govts.

100%. Isn't the US supposed to be all about Freedom? It's become a laughing stock.

This reads pretty one-sided.

The government is full of stupidity and this is indeed a big moment, but Anthropic has been begging for this outcome in their public messaging. If their fear-mongering was genuine, then great, they got their pause. If not, then what exactly did they want to happen?

as someone who uses these models day in out, i can confidently say its more of a marketing gimmick than anything else. don't get me wrong, the model is great, but nits no out of the world than GPT 5.5 or similar ones. I would say just go and try this model for serious work and see the marginal difference. the model wins in some cases and loses in many others. so, what is this all about? hype!

don't worry, these idiots can try, but it is too late for them :)

> Will we be the poorer for that, or will we be safer? I think poorer, because I hate being told what technology I can and can't use, but I'm not certain. Maybe you think the government should restrict strong LLMs. Maybe you don't. But either way, this is big news and a rubicon has been crossed and a precedent set. That's true even if the motivation for this is just the government settling scores with Anthropic.

I mean, maybe in principle, but if the object is just hobbling Anthropic you might still get OpenAI's latest model without that much trouble.

No different from encryption

I lean libertarian but I can recognize the danger in having access to a machine that can craft pathogens to spec.

A pathogen with a very long incubation time and a high fatality rate would be about as bad as nuclear war. Maybe we need to figure out how to possibly defend against one person doing this before making it easy for anyone to do it.

It will just delay SOTA models to us by say 1 year. I’m actually ok with it given that’s it was entirely predictable any govt would do that to even strongish AI

To the EU.

The whole reason China open sourced its models in the first place was because nobody generally speaking really trusts China and Chinese deployed models (if they were proprietary)

and OSS models gave way to running it with freedom and security.

So OSS models have always tried to catch up to the frontier and lag behind 3-6 months. For my use cases, I am happy with current OSS models especially so if you let frontier-ish models design the plan with your input

If I were to suppose that China created a frontier model so good and far ahead, then I can understand if they don't open-source it. Qwen does it already with their Max models being closed-source.

but if you are suggesting that China in whole will remove itself from AI race, then 3 (or 4) possibilities can occur.

1. Some chinese companies might stop the production of OSS models if their names are known (z.ai etc.) but there are multiple other companies who are fighting with their research labs as well. They might create a decent model and OSS it to get known within world and China.

2. The whole Chinese economy (well similar to America, but to an even more extreme level from my understanding) depends on AI and is a bet on AI. They are funneling state and all bank money into these companies. From point 1, they wouldn't wish to be silent with frontier models and then lag behind and wait for other countries to catch up (point 3)

3. Europe(MistralAI)/India(SarvanAI? Kinda recent) will jump on the opportunity. (My point is that these two regions are trying to create their own models. How much they lack from the frontier is another thing but if China were to remove itself from the race, then they will have much more time to figure out how to make better models)

My point is that america and china are in arms race of closed source vs open source models. If china were to close source its models, they might simply lag behind and other countries will catch up.

4. Either that or you are right and we will have the current frontier OSS models and some more. IMO they are reasonably good as well and I used to wonder what would happen if say it would have been net good if AI was stuck at a similar level to sonnet 4.5 (IMO it was sweet spot), so I don't think that I am reasonably worried about it all. If absolutely need be, you can have an frontier model direct a plan and have OSS models do the grunt work.

> These are heading in the direction of being powerful cybersecurity weapons and it will be in the interest of nation states to restrict and control them. In 2 years time, I would be surprised if the strongest LLMs are available for general use at all.

That sounds so great.

> Will we be the poorer for that, or will we be safer?

We will be not just safer but richer. These LLMs are like drugs that should absolutely not be cast freely into the highways and byways. My main worry is that this action will be a haphazard one-off and not part of a coherent plan of curtailing LLM propagation.

This is a very interesting perspective. However we always thought that the diffusion of ever stronger AIs was practically guaranteed by its competitive value- you might restrict what AIs are available in your country, but the impact on your economy can be dramatic if other countries have access to better models. In the end, it's hard to imagine governments blocking access to any AI that is just a bit better than what other countries have.

Pepperidge farm remembers when they banned G4 Macs for export as well

“Fable was the strongest model on the market” - explain why anyone should believe that claim.

I’ve been trying to track LLM code generation adoption in the critical infrastructure world - as far as I can tell, it’s nill. Zero. Nada. Nobody is relying on these models to write secure code for anything where failure is catastrophic. Planes falling out of the sky. Nuclear reactors going into meltdown. Electrical grids loosing synchronicity. Lots of these BS claims from the marketing and investment crowd, but - it’s just a useful tool for non-critical areas. That’s all it is.

There's no such thing as a "strong LLM".

The whole idea is a lie and a marketing stunt to prop up the US stock market.

It's pathetic - this is all sleepy Trump getting back at them for saying no. That's all. Millions of people are affected by the mood of this shit-for-brains.

At first people said this was tin-foil hat territory. But ANYONE who publicly pisses this guy off, mysteriously get a government takedown weeks later. They're not even pretending anymore.

When Trump attacked them before because he wanted anthropic to decide who lives and dies, they said no. (That's probably a lie, I'm sure it has to do with money - but I digress).

So exec ban happened. Problem is - everyone uses claude. Microsoft is going through the same thing now. They find a way to use it anyway.

So they reverted it. What better way to go around circumvention than to just outright ban it.

Funniest thing - his own law makers are the ones who run on freedom and a nanny state. They are literally preventing us from using a tech "for our own safety" - can't get more nanny than that.

That would be true if LLMs training was like refining uranium.

But it is a computer program and it won’t be long before the dam breaks to open source and anyone can use Mythos level AI at home for anything.

There is no stopping that unless you would set up a Police state more strict than China

It may be a de facto weapon and for better or worse everyone will be able to use it sooner or later.

I predict it will give birth to many great things and many equally terrible. Milions of people will die and milions will be saved. Such is nature of humanity. The good always comes with the bad. That was true for every invention.

Cars are used to kill by terrorists, rockets are used to bomb kids but also to go into space. It’s all same, old story.

You can’t stop LLMs the way you cannot control fire. Everyone can pour gasoline in the forest and cause terrible damage. And any excuse that we shouldn’t have matches must be viewed as what it is - an authoritarian, futile, desire for control

> In 2 years time, I would be surprised if the strongest LLMs are available for general use at all.

It would be too naive to suppose that the strongest LLMs are available to plebs now.

Anthropic already with Fable basically said they will be the arbiter of who gets to use the "godmodel" with no criteria specified. So no thank you. We need to make llm's open source and completely disconnect from these companies or live in a dystopian "Anthropic" etc social credit score system where only the "blessed" have access to models.

The LLM Euphorics—the types who might report about being poor for a few months because they “splurged” on a multi-tens of thousands of dollars LLM server—are now concerned about LLMs for the people. Yeah okay.

Those of us who are negative about AI for political reasons have been saying from the start that the biggest problem with AI is power. People can’t now all of a sudden be thinking that huh nation states have power (along with Big Tech and the rest of the power brokers).

But this is in fact quite a tortured fear, all wrapped up in the usual hyping—though this part is expected of LLM Euphorics. The usual story of simply making human labor less valuable and concentrating hardware for compute is just, you know, this rotten economic system working as it is intended. No need for weapons, subterfuge, three-letter agencies, much more straightforward, and just a natural evolution of X-CLASS CAPABILITIES.

[dead]

[dead]

[dead]

[dead]

[dead]

[flagged]

> In 2 years time, I would be surprised if the strongest LLMs are available for general use at all.

I would be surprised if the public ever had anything close to the strongest LLM. It’s not like nuclear bombs were created by the private sector, then the government started the Manhattan Project and seized them all for itself.

They probably had Fable-quality models in 2016.

If there was ever a time to sell all your stocks and buy gold, this is it. NVIDIA to zero. This will make COVID look like a market hiccup.

Repeating from the duplicated thread:

First I want to see them play video games at a high skill level, preferably without any access to game state beyond the same visual output that humans have access to, like a raster frame X number of times per second. One LLM model played Factorio, albeit at a very, very poor level, which can be seen if you slow the video to 0.25 playback speed and pause frequently.

https://old.reddit.com/r/factorio/comments/1u1blr6/claude_fa...

There have been streams of other games, where LLMs and AIs have likewise performed very poorly.

I recognize that LLMs might be better at language processing than these sorts of tasks. But being able to play video games is part of general capability. And this kind of hardcore video game playing, with no access to game state, is also a general task where feigning skill can be harder. If LLMs excel at pretending to be competent without actually being competent, like this AI training approach is arguably about

https://en.wikipedia.org/wiki/Generative_adversarial_network

Then some AIs might be trained and designed for deceiving humans instead of actually being competent and capable. And thus, one response is that they should be met with more difficult tests.

Basically, make tests that AIs or LLMs will not have an easy time cheating. Hopefully, that will engender research in greater LLM/AI competence, not in greater ability to cheat or deceive, neither for LLM/AI researchers and companies, nor for LLMs/AIs themselves.

Bigger picture is AI seems to advance at exponential rate