upvote
I think it might have accelerated things but on a much more basic level, there seems to be no real moat in synthesizing the world’s knowledge into LLMs.
reply
There's no question that training leading LLMs requires some serious expertise and know-how, but surely already having advanced LLMs/agents must be helping tremendously not only for software engineers but also for those working on LLMs themselves.
reply
I think one could describe LLM optimization as "hard but not a moat". Years ago, optimizing neural nets was described "graduate student descent" - it's tricky but throw enough conventionally smart people at it and it will happen. It's like tuning a hot rod and finding a reproducible bug in a large code base. It's hard and there are tricks but not absolute hurdles, no problems waiting for a conceptual breakthrough (and at today's scales, are there any problems waiting for an Einstein to solve? That's an open (AI) question).
reply
I also think we're seeing the sigmoid approaching.
reply
I want that to be true (assuming you mean specifically the second half of the sigmoid) just to give me room to adapt to the changes we've already seen; but I've seen comments saying things are slowing down since around when GPT-4 came out.
reply
What is really going on: all the AI labs are doing panicked model releases (and panicked training of new ones) because Qwen4 is rumored to come out end of October and is rumored to be very nice. Question is: is it another "Deepseek-moment" nice? Or just nice?

Btw: with Qwen4 I mean the next large Qwen model that is based on the Qwen4 architecture (Qwen 3.8 flash next was "almost" based on the new arch but obviously was a small model)

reply
It doesn’t matter.

What matters more is if firm’s start using a bundle of American and Chinese models and when they find their feet - how large is the market for frontier?

Frontier has to displace labour one for one at some point or it’s over.

reply
I wondered if there would be a Qwen 4 or we would go straight to 5, re: tetraphobia, but perhaps it's more like an uno reverse card in this case

https://en.wikipedia.org/wiki/Tetraphobia

reply
DeepSeek being Chinese also has 4 so I don't think it's a big deal for model makers.
reply
GLM moved through their 4-series without consequence

I wonder if the next DS models will also graduate to 5.x, I think I saw they are training up a 10T model, and just raised $12B too

reply
I'm pretty sure the point of Qwen3.8-Flash-Next was to get the open source engines to integrate the qwen4 architecture.

The fact that it basically broke open the local model supremacy was just a nice side effect.

I'm running: https://github.com/peonist-ai/halogen-server with a quant4, PLE offloaded, and it's resident VRAM is 36GB at 265k context.

Shave 10 more GB off and the TAM openai and anthropic are targeting is a lost cause. Local models are what 90% of people will need.

If the world governments can get a handle on the memory cartel, then there's no more moat for most normal humans.

reply
Awesome 3.8 next runs great on my Framework Desktop so I'm loving more local models.
reply
I have similar hardware - what specific version of the 3.8 Next model are you running and how many tokens/s are you seeing? 3.6 35B A3B gets about 68t/s for me so I've been sticking with that model for the mean time.
reply
The thing with 3.8 next is that it uses a variant of ngrams. Part of the network is replaced by a lookup table you can store on a fast ssd.

In practice, you will be able to run models a bit bigger than 35B.

https://unsloth.ai/docs/models/qwen3.8-next

reply
https://github.com/peonist-ai/halogen-server is beating the pants off of anything I've tried.

38GB of vram resident. more tk/s, more prefill.

reply
I think the moat is going to be compute. So far compute needed to push the frontier is still extremely cheap so the capital can afford to spread its bets. But when further improvement is going to cost in trillions, capital will have to pick a winner and bet only on him. It won't be a matter of finding the best bet, it will be a matter of survival.

This will cause the picked winner to get massively ahead with sheer compute alone used both for training and inference dedicated to recursive self improvement.

reply
I guess all predictions age like milk, but here's one:

There's a law of diminishing returns at play here, and doubling the energy cost of training to wring 2% more performance out of the technology isn't going to be very useful, because most of the problems it is capable of solving will be solvable with the previous-gen 98%-as-good model.

("there's a law of diminishing returns at play here" is an article of faith. But then, so is the belief that these models will keep getting better).

reply
As soon as you can demonstrate decent financial returns (ie. the AI can run a company better than humans can), suddenly it makes sense to put a lot more $$$ in even if returns are diminishing - since whoever runs companies the best gets control of a big chunk of the world economy.
reply
“ ie. the AI can run a company better than humans can”

lol You can always tell who has never ran a business before with comments like this

reply
I understood their point, if we truly get AGI then no reason to think AI would be worse than a human.
reply
AGI with people skills?
reply
[flagged]
reply
You are literally an AI spambot account, that's the hilarious irony here.
reply
Well yes that's the worry isn't it? That people will soon all be unemployed? Just because it sounds farfetched doesn't mean you should stick your head in the sand, seeing the pace of development these days, that is "reasoning properly" and it just seems you are trying to block out what seems inconvenient to hear.
reply
[flagged]
reply
If that works... why not just jump straight to a planned economy run by LLM? Skip the whole messy "free market" thing altogether?

(I don't think it will work).

reply
What do you have against multi-agent reinforcement learning systems and why do you think they are not AI?
reply
londons_explore is arguing for a winner-takes-all scenario, with an early advantage locking everyone and everything else out.
reply
Surely there is a point where algorithmic improvements will be more cost effective than buying more hardware.
reply
If you're actually applying LLMs, all of the things around the LLM that adapt it to coding, for example, that enable it to use existing validation tools for code, and enable it to diagnose and fix tool chain issues that aren't directly coding problems, are what makes the difference between a model that that scores a little higher on a coding benchmark and a model that's useful in a particular code base on a particular platform.

Are there any use cases that have enabled one customer of a frontier LLM to outperform a competitor using a different frontier LLM? Or is this why we are seeing confected points of comparison like solving challenge problems in mathematics?

reply
deleted
reply
I'm afraid it might be the other way around. RSI might pick all of the low hanging fruit soon. There must be a physical limit of how much intelligence you can squeeze out of some amount of parameters and compute.

There are going to still be worthwhile improvements but they are going to be more like not how to make transformers 10x cheaper but how to make next training run cost 9 trillions instead of 10 with a very particular optimization designed at the cost of hundreds of millions for this one specific run.

reply
I think we’re no where near a physical information theoretic limit.
reply
The hardware also is, so there ought to be a whole lot more room for improvement.
reply
It is just occurring to me that “RSI” expands to recursive self improvement. Thought people were talking about repetitive stress injuries; either in regards to programmers writing too much code/not having to write code anymore, or the frontier AI companies and their tendency to applaud themselves.
reply
[flagged]
reply
But the old models still exist at trivial marginal cost. The frontier models would need to dominate every price point to really take all and so far they haven't been.
reply
Don't worry, AI boosters will be in here soon denigrating anyone that uses anything but the latest and greatest models as irrelevant.
reply
Not just compute but energy. Most of Europe has no access to the cost effective power generation needed
reply
Build Nuclear, Build Thorium the Chinese are building whatever they can. They’re not locked in by special interest. Is that because they have lots of engineers on the job in government?
reply
Training location is flexible. Iceland?
reply
Europe has lots of zero-cost windows for electricity, and areas with cheap prices. The real issue is access to oil and gas.
reply
Maybe for training big models one can wait for times when the wind is blowing.
reply
There are worse ideas.

I could imagine a belt of data centres around the equator, that hand off their computational loads as the sun sets. Good scifi-esque premise.

reply
That does not really sound practical to let datacenters costing billions idle half the time.
reply
France is actually pretty cheap in Europe. About 15% more than average USA electric prices (but I know that varies a lot across the states so still likely much more than the cheaper areas)
reply
My spend on DeepSeek is not much and I regularly top up my balance every month as my support for all the good work DeepSeek is doing for the open science.
reply
DeepSeek, and other Chinese models, are heavily subsidised by the Chinese government. The reason they release the AI models is economic warfare against US, not because of charity or kindness. It's great for us consumers, but the goal is not to help humanity or open-source.
reply
Framing it that way hides all the levers used to tilt the playing field for US companies, no?

The government that removed restrictions on how private companies can access capital after a certain scale (the JOBS Act), that removed the need for private companies to report as if they were a public company after a shareholder threshold was crossed, superpowering the access of wealthy private investors to get in earlier in a growing company while at the same blocking the public from participating in funding growing enterprises at an earlier stage (since it required companies to IPO much earlier to access capital) which allowed retail investors to also reap the rewards on funding them early when they grew to become behemoths (like Amazon, Meta/Facebook, Google, etc.).

It's not fair in either place, the USA has its own model of unfairness, China has a completely different one. The difference is that in the USA the government allows private investors to become more powerful than the State (outside of the monopoly of violence) while plunging the rest of society into increasingly more precarious lives while in China the State is the power and its legitimacy only exists while the population feel they have a better life.

reply
IMO the selective enforcement of regulatory requirements should be added to the list. Observing from the outside, I have a hard time believing that e.g. musks gas powered data centers really follow all the environmental laws, for example, or that the authorities really see no grounds for indictment if Altmans company hacks hundreds of third parties, or that there's really no one at the SEC having a problem with Anthropics fear mongering prior to the IPO.
reply
In a list describing how the USA system works, sure: selective enforcement is there.

As a differentiator from the Chinese system, not so much. For two otherwise equal companies, the one that says things against the party line will experience selective enforcement too.

reply
Except that in China, the people who do that will disappear.

The propaganda of trying to make US and China government appear the same is making people dumber. and is one of the most heavily used tools in China’s online propaganda arsenal.

reply
>The propaganda of trying to make US and China government appear the same [...] is one of the most heavily used tools in China’s online propaganda arsenal.

The government could do some very easy things to remove this tool from China's toolbelt. Like you know, prosecuting rich people when they've earned it.

reply
No. They would need to kidnap rich and poor people and their families regardless of "earning" it. Then they. will start to get closer.
reply
he's not really "framing" it that way. that's just simply exactly what it is.
reply
If you think about it, the US labs are heavily subsidised too. Not only they receive billions in state funding, the administration is also prepared to engage in trade wars to help them.

I think the Chinese government is backing their labs by less direct means. For example cheap electricity and investing in chip manufacturers such as Huawei and cxmt.

Deepseek specifically, is known to operate with minimal resources. The entire company has around 160 employees and every model they release must break even within ten months.

reply
SpaceX has been awarded roughly $22 billion to nearly $30 billion in cumulative public federal contracts, the $280 billion CHIP act, and who knows how much the CIA + NSA are spending.
reply
Awarded that for doing work, though, not to clone someone else's work and release it for less money.
reply
I think this is different for different labs. Some innovate while others copy.

Same goes for US labs, not everyone are as innovative as google deepmind:

https://www.forbes.com/sites/antoniopequenoiv/2026/04/30/elo...

reply
> not to clone someone else's work

Ironically your comment will be cloned and used for training.

reply
Whose work on KV-cache reduction did Deepskeep clone? Please be specific.
reply
> Awarded that for doing work, though

Yes, just that. Being a huge supporter of the regime - at a time running a department - surely has nothing to do with it.

reply
> not to clone someone else's work and release it for less money.

... You're saying this about _deepseek_?

reply
You see why there are so many conspiracy theories about US landing on the moon, one is left wondering how is it possible that a countries of such retards did something like that
reply
I'm pretty sure, the training/fine tune through Claude/OpenAi would not be possible without the army/China's hacking teams (and legal protection). So it's more than just a cheap electricity.

Supporting deepseek is just like supporting the Chinese army, no need for that. Though it goes both ways, OpenAi subscription just lowers the cost of the US army as well.

reply
Sorry, are you saying that it's a subsidy that it's legal for them to distill other models, or what? It's not even clear that there's any kind of protection for models in Western countries. Why would they be worried about the legality of distillation? And what does the army have to do with distilling models? Like you're saying it's a subsidy that China protects their borders from invasion by the US?

It's not a subsidy for the Chinese to say they're going to ignore our IP laws. It's a subsidy for us to say we're going to make them and try to push them on the world. It's literally granting a monopoly by legal force. It's very obviously not aligned with the interests of the American people, while China releasing things in the open is.

reply
Same with the US legal system protecting Anthropic from copyright laws from all the books and other stuff used for pretraining...
reply
[flagged]
reply
China also has a very "rational" approach to dissidents, Tibetan activists, Uyghurs, Hong Kong pro-democracy activists, and Taiwan.
reply
In the US, it’s only a matter of time before El Presidente decides to take away those reservations from the Indians and sell them off and the same goes for Camp Pendleton in Taco’s favorite American state.
reply
>Supporting deepseek is just like supporting the Chinese army

Good, where do I sign up? At least they aren't exploding little children and generating chaos in the oil market.

https://www.business-humanrights.org/en/latest-news/anthropi...

reply
I want you to come here and apologize in public when Xi starts bombing Taiwan like he's promising.
reply
I want the current president who has lost his mind to apologize to two California cities.
reply
As bad as casualties get in a future war like that, it's still very likely to be a symmetric war where the main targets are military infrastructure. No systematic annihilation of universities, hospitals, religious sites, journalists and health workers like certain genocidal regimes backed by the tech oligarchies have been doing.

https://www.ohchr.org/en/press-releases/2025/06/israeli-atta...

https://www.unesco.org/en/articles/unesco-presents-assessmen...

I want you to publicly say that this turtle biologist and this journalist are Hamas: https://www.theguardian.com/world/2026/jun/20/mona-khalil-tu... https://www.theguardian.com/world/2026/apr/23/lebanon-journa...

reply
When one player tries to monopolize AI tech and market by all means, others are those who don't want to be hooked to a foreign will in the future. I think this is the reason in doing open research, and it's likely positive for all of us.
reply
> I think the Chinese government is backing their labs by less direct means.

It may be that the effect of the backing in both places is essentially equal but this statement is strange. The Chinese government invests directly in Deepseek[1]. Notice the article, in addition to saying the CCP is investing, says Tencent is also a major backer. CCP owns a golden share of Tencent.

[1]https://www.cnbc.com/2026/10/06/deepseek-funding-round.html

reply
Ok, but Trump stated that the US is in active talks to take over parts of both OpenAI and Anthropic, too: https://www.cnbc.com/2026/06/05/trump-open-ai-altman-stake.h...
reply
I'm not arguing about a comparison here. I'm trying to correct a misconception about China that I see a lot from Western perspectives.

Everything a Chinese company does has the explicit backing of the CCP, at least ideologically and usually financially in some fashion. While DeepSeek may not be the CCP, it couldn't exist if it was expressing any kind of ideology that wasn't inline with them and, in this case, is explicitly funded by them.

A Chinese company has no freedom to say Taiwan is a country the way someone in the US could suggest California succeed from the nation.

Any public message you hear coming out of China has the implicit approval of the Chinese government.

reply
I would like to point out that a lawsuit is currently live about the us govt forcing US tech companies to retaliate against us citizen criticizing the govt’s policy.
reply
Well, there was one happy audience in Nebraska with the blessing of El Presidente that was happy if two California cities get the shaft.
reply
> Everything a Chinese company does has the explicit backing of the CCP, at least ideologically and usually financially in some fashion.

If you're not arguing about comparison then don't state this as if it's any different from the US. Because you make it sound that way. Or do you think that if tomorrow OpenAI came out vocally supporting the DSA - that suddenly they wouldn't see lots of barriers rise up out of nowhere?

Come on now. That's fairy tale land.

reply
[dead]
reply
Well, they are helping 17% of the world's population, and the US is currently actively engaged in trade wars and economic warfare or explicitly attempting to leverage it's hegemony against its long term alliea for short term gain.

There is as much to criticize about American hyper scalers and AI labs and the lack of interest in helping humanity or contributing to open source, but that might not be as popular an opinions on this site.

reply
Only 17%? I'd say driving down the price of AI helps at least 95% of the world's population. It certainly helps me.
reply
I assume 17% is roughly the percentage of people that use LLMs globally (the numbers vary between 15 and 20 percent).
reply
Amazingly low, given potential impact. Where is this use concentrated? Who has the best data on use right now.
reply
17% is the approximate population of Earth in China. I was using a simple example as a counter to the anglocentric view the parent poster was expressing by trying to paint China as a villain.
reply
> Well, they are helping 17% of the world's population,

Any open weights model that Chinese companies are releasing for free are allowing everyone in the world to have access to high quality realizations of these tools without the risk of the US regime arbitrarily cutting you off.

Also, it's funny how all the neoliberal mantras of how free market drives progress through competition stops when it's a US company that's being challenged.

reply
I suppose in some sense preventing nuclear holocaust is a short term gain...
reply
What nuclear holocaust has the only country to use a nuclear weapon against a target prevented?

Do you think the world is closer to or more distant from large scale global conflict today than it was 10 years ago, or even 3 years ago?

reply
Iran has expressed a willingness/eagerness to nuke Israel and the US. That outcome would be less than ideal
reply
> Iran has expressed a willingness/eagerness to nuke Israel and the US.

Source? The last Supreme Leader of Iran issued a fatwa against nukes, way before he and his extended family where bombed in their home in a failed attempt at a decapitation strike.

reply
> The reason they release the AI models is economic warfare against US

The story is so much more complicated than that, to the point that this economic warfare theory is basically a meme.

Chinese models are open because they don’t have a choice. “When you trail the frontier, openness maximizes reputation per unit of capability. The moment you lead, you close.” [0]

[0] https://earnedintuition.substack.com/p/involution-without-ex...

reply
They do have a choice, as evidenced by all the times when the other option gets picked. The article you link tries to acknowledge ByteDance's Doubao and Alibaba's Qwen Max as exceptions, but forgets about Baidu's Ernie and iFlytek's Spark, which are also closed-weight. There's simply no consensus yet on which strategy is better, so different companies end up making different bets.
reply
That’s because Baidu sells model access and iFlytek sells integrated products. Also both have released open models, just older ones. They just close their latest ones because they got the reputation they needed out of them and have transitioned to a product. Notice that both of these explain the motivation without resorting to unfalsifiable claims about "economic warfare".
reply
Huh, when XHToken released a model named Spark, I assumed it was just a name collision, since iFlytek appears nowhere in the documentation. But on iFlytek's model marketplace, it's listed as their self-developed model: https://maas.xfyun.cn/modelSquare So they actually released an open model quite recently! Thanks for letting me know.
reply
So is American models. They are subsidised heavily but still can't provide cheaper access. Their fault is to assume all countries can afford them.
reply
By whom?
reply
If you want a direct example of the US subsidising a major AI lab, we can use Microsoft's investment in OpenAI. Microsoft has the largest ownership stake - 27%.

Microsoft did not pay with money - it paid (mostly) with Azure cloud computing credits. MSOFT is then able to write this off as a loss against tax.

It is generally far more tax-efficient in the US to write a loss in this way than it is to write a loss for a cash investment.

In this case, I believe the difference was ultimately highly significant. When including MSOFT eventually writing-off the deprecating Azure hardware it had used to buy the OpenAI equity, the result was MSOFT's tax reduction being either close-to or exceeding the actual cash value of MSOFT's investment in OpenAI - IIRC.

These examples represent taxes that the US chooses not to collect - the US could choose to make investments like these less tax-efficient. Instead, by making them extremely tax-efficient, the US subsidises the transaction hugely.

reply
This is a joke right?

Even ignoring monetary subsidies, there are the non-monetary ones: not being sued into oblivious by the government for their countless hacks of other companies and countries, the slaps on the wrist for massive piracy, the waving of environmental (and other) regulations in order to allow their data centres to be built an operated.

reply
> Even ignoring monetary subsidies

That's what I'm asking - which monetary subsidies?

> not being sued into oblivious by the government for their countless hacks of other companies and countries

That isn't normally how enforcement works, and it hasn't been very long since they disclosed those breaches. If the victims want to pursue legal action, they can, and they still may!

> the slaps on the wrist for massive piracy

So judges and juries are involved in the subsidization conspiracy, too?

> the waving of environmental (and other) regulations in order to allow their data centres to be built an operated

Sure, though if you think this isn't happening in China too, I have a bridge to sell you.

reply
CHIPS act, OBBA, defense, AI upskill grants.

That's just the ones i know off the top of my head in the US. Those programs account for more than 60 billion in committed spend.

reply
The original comments is "DeepSeek, and other Chinese models, are heavily subsidised by the Chinese government"

> That's what I'm asking - which monetary subsidies?

I am listing for you the non-monetary subsidies, which are just as real and equally important.

> not being sued into oblivious by the government for their countless hacks of other companies and countries

If it was one of the Chinese labs doing this hacking, the government would be stepping in. If it was European labs they'd be stepping in. If it was you or I the government would be stepping in. That is a massive subsidy (they don't have to worry about the same legal fees and exposure) and being allowed to continue doing business is in fact priceless.

> So judges and juries are involved in the subsidization conspiracy, too?

There is no conspiracy. They are objectively operating by a different set of rules than you or I could operate in this market.

> Sure, though if you think this isn't happening in China too, I have a bridge to sell you.

I never said it wasn't, I'm saying that it's happening here and it's a very real subsidy.

reply
> equally important

They really aren't. Nothing in the development of these systems, absolutely nothing, is as important as money. Stop these silly false equivalences.

reply
These are not silly equivalences.

All the major labs would be dead in the water if the government acted on the things I mentioned. If they treated the labs the way they would have treated us for all those hacks. Or if they enforced pollution measures (or god forbid ban on-prem turbines because of the climate damage). Or rule that training on data is not fair use, or that ingesting GPL3 code and then turning that into weights counts as a derivative work. Or. Or. Or.

Those are all just as important as cash.

reply
Nah, nothing here is a special advantage of US firms.

The hacks are pretty bland as long as there is no mens rea and the hacked victims do not want to press charges. This isn't a "subsidy", it's just our normal legal process at work.

The pollution question is winding its way through court systems and getting a lot of pushback. I wouldn't call this a subsidy, just a slow bureaucracy. And at any rate this isn't special to the US; certainly China's environmental policy is far more lenient.

With the training data, again there's nothing specific to US corporations here. Anyone can use that dataset. It's just how our legal system works. You might not like it, but it's the accepted law right now. This doesn't meet any reasonable definition of "subsidy".

On the other hand, shoveling billions of dollars of taxpayer funds into corporations is by definition a subsidy. Full stop.

reply
Investors, but also the government in allowing these companies to siphon electricity away passing the increased cost to the consumers
reply
>Investors, but also the government in allowing these companies to siphon electricity away passing the increased cost to the consumers

Not arbitrarily banning companies from buying a product from a supplier doesn't meet my definition of the term "subsidy".

reply
Fair enough, but it sure meets the definition of 'helpful intervention'.
reply
>Fair enough, but it sure meets the definition of 'helpful intervention'.

I don't see how. Anyone can buy electricity without any intervention from the government. An intervention is an action that changes what would happen by default.

reply
By investors. OpenAI and Anthropic are not profitable (Anthropic is profitable if you allow them to invent what profitability means).
reply
I heard someone calling the key metric in Anthropic financial reports EBBT: Earnings Before Bad Things[1] :-)

[1] Where "Bad Things" would be the typical interest, taxes, depreciation, amortisation plus the Anthropic specific employee compensation, LLM training (you know, for the LLM lab), revenue sharing agreements (which is a form of paying for infrastructure), etc.

reply
A recent YouTube video by Patrick Boyle said the same thing. They are only profitable if you ignore all the costs that make them unprofitable such as paying employees and developing A models.
reply
That's not how gross margin works.

For LLMs, marginal cost is just electricity

reply
I made a statement about whether Anthropic was profitable I don't understand your reply.

Assuming you meant to reply to me and not someone else are you saying under GAAP accounting standards Anthropic is a profitable business because under GAAP accounting their only expense is electricity?

(I see what happened you skimmed the conversation and didn't follow what was being discussed.)

reply
There's also things like training costs, spend on AI data centres and GPUs, R&D, sales and marketing, etc. See e.g. https://www.reuters.com/business/finance/anthropics-ipo-pros....
reply
Those are not marginal cost or unit economics
reply
If the "fixed costs" kill you unit economics won't save you. Scare quotes because true fixed costs generally have a long shelf life. Right now AI models die every 6-9 months.
reply
1. And that marginal cost is large, much larger than the marginal cost of serving a Google Search query

2. The marginal cost is electricity until the hardware overflows. So it's continuous for electricity and a step function for hardware capacity.

Plus you don't address the core point. Frontier AI is capital intensive. A lot more capital intensive than regular software. The existing clouds supporting the entire internet (!!!!) were built for a fraction of the cost of AI infrastructure, and there isn't even an end in sight to this continuous hardware investment.

Let alone hardware refresh cycles.

AI is basically investment into roads.

Software used to be a magical place, closer to selling music albums but even better.

AI is a much worse business margin wise than regular software.

reply
Investment is not a subsidy. Words still have meanings. Nobody in this thread has successfully answered the question: subsidized by whom?

Non-punishment is also not a subsidy; again, words have meanings. Let's use the correct words.

reply
Indirect subsidies are an accepted economic concept and well studied. The posts you replied to are obviously talking about indirect subsidies and dismissing them because they didn't say "indirect" everywhere is just sophism.
reply
But some investments are subsidized (tax liabilities) among all the other things.
reply
The government, specifically Trump's government and the current money circle in AI inflating American company stocks. In addition to all that American models do not share their papers like Deepseek and Qwen do. So you can literally say Chinese models are doing it for charity at this point.
reply
Of course you can say that, but you literally cannot be serious if you do!
reply
Can you say a US company donating to a non-profit and writing off taxes on the basis of it is donating to charity?

Would you say you could be serious in stating this?

reply
Sure, but I couldn't say that a US company writing about some work they did in paper form is charity. At least not seriously! If it were charity, Google might be the most charitable company of all time, since their researchers published "Attention Is All You Need." But it is not.
reply
Google has published a lot of open source software and a lot of research papers: I do believe they used to be very charitable even if they are less so today.

They have other issues as well, but among other things, I'd classify them as somewhat charitable too.

reply
Oh I am serious!
reply
The US regime, which includes the ruling class: the US VCs and megacorps are just as much of an extension of the US regime. They're incredibly intertwined.
reply
Capitalistic exploitation against the working classes.
reply
> DeepSeek, and other Chinese models, are heavily subsidised by the Chinese government.

DeepSeek is basically a research lab founded by a hedge fund guy, more than anything else.

reply
> The reason they release the AI models is economic warfare against US, not because of charity or kindness

There are many other reasons Chinese companies releasing models open-source or open-weight makes strategic sense.

A really easy-to-understand example is a company who has a near-monopoly on "serving video content" releasing a video model openly.

If you can be relatively certain that video content created by a model (which you have trained, using data from your own platform) will be ultimately served on your own platform, thus generating revenue from watch-hours, it makes sense to make those models as widely-available as possible.

It's also a net-positive if people use your public research to build better video models, because - again - you are reasonably certain that the even-better content those new models produce will be watched on your platform.

The alternative would making models harder to access and learn from (broadly, the current western model). Many would argue that Google, in choosing to not optimise its video generation models for "availability", is directly causing less content to be uploaded to YouTube. This is the trade-off.

I don't know much about DeepSeek's financing specifically, which obviously doesn't release video models - so I don't know how directly this analogy runs, or who directly benefits from the extremely evident rising tide that the public release of DeepSeek's research creates. However, this does not negate the broader rising-tide effect of the scientific method.

It's certainly also true that it's geopolitically beneficial to be able to undercut American labs' models. If I ran a global superpower, I would probably want my country to be technologically competitive too.

But Chinese companies are already serving a huge volume of customers in a complex, existing marketplace, before even thinking about the US market, and it's overly simplistic to assume that their entire strategy revolves around economic warfare directed specifically at the US. It's more nuanced than that.

This is, of course, without even getting into opening the can-of-worms around whether US economic policy also results in the US state functionally subsidising technological innovation, how comparable that is to China's model, etc.

reply
Interestingly if Google did release readily available video models then they'd likely be dealing with an order of magnitude of scale in the same way GitHub has had to.

Causing less content to be uploaded, when you are clearly the gorilla in the room, looks to be a wise strategy not a trade off.

reply
I'm not sure "subsidised" is the right word. If a government funds research and the results are released openly, that's just publicly funded research. It's how a lot of science works in the US and Europe too.
reply
The open-weight models are a great boon to all American companies other than a handfull of Mega Corps in the A.I business. Care to explain how this is "economic warfare against the U.S"
reply
Do you not see the risk inherit in sourcing everything from a antagonist?
reply
Yes, hence why I'm happy there's competition so we're not stuck with US tech. After all, you've proven to be very unreliable allies to us.
reply
Yes we see that in all other countries trying to avoid dependence on the US for everything. What we don’t see is competition with other countries having anything to do with warfare.
reply
Same goes for the US companies as well. Current US administration wants US to win the AI race at any cost and China is the only competitor left in the race. Winners always write the history or in this case the future of humanity
reply
Economic warfare against the US? I mean maybe against specific US companies and stakeholders but on the whole it seems like it's good for the US economy as well as the rest of the world, kind of like supplying free electricity would be
reply
And OpenAI and Anthropic are just in for the love of the game? Our of sheer desire to help humanity?
reply
Obviously not but they employ American researchers and aren't beholden to the CCP
reply
It's one of these rare cases where intention is not what is the most important - the net benefit for consumers and companies outside of the USA is indisputable.
reply
Which is the best kind of reason.

It is great for everyone except for a few people who want power over everyone else, and the fact it is not charity of kindness makes it more sustainable, because charity and kindness is quick to go when big money and politics is involved.

I want more warfare like this. Building stuff instead of destroying stuff.

reply
Not sure why so many people will vehemently refuse this idea. I won’t say it’s 100% true but it would be foolish to dismiss it. China is very much an adversary to America and has made it pretty clear they want to be a dominant leader of not the new world leader. Not here to evaluate what is good or bad. Keep in mind historically China has aggressively fostered industry (not unlike the west) but sometimes even more aggressively.
reply
Americans need to travel to China. The Chinese have zero issues with us. They quite like Americans. This is such a weird propagandist take. Idk if you remember but both country's leaders just had a slumber party for 3 days in DC. This is not what enemies do.

Not even our leaders say China is an enemy, ita mostly businessmen who are scared of competition and trying to regulate chinese out of their markets so they can make more money milking us.

reply
I have been to China many times. The citizens and visiting the country has nothing to do with global politics. Your take is just as propagandist as any other. China is not unlike the US and China has also made it subtly clear their desire to be a dominant global force. I am not marking judgement on it but don’t be a fool thinking that China is not some level of threat. This is how these discussions become weird. I don’t think China is going to blow up the US and I think it’s often a weird talking point by some US politicians but I also don’t think they are a peaceful actor but folks like you will suggest I am repeating propaganda. No, just pointing out that if you look at their language and actions they are an actor to pay attention to. Just because leaders meet means nothing.
reply
[flagged]
reply
The same is true of the Iranian people. There's sometimes a difference between the government and their own citizens.
reply
deleted
reply
Your just saying it’s beating america at its own game and crying fowl.
reply
When did I cry fowl? I am simply saying that the truth is probably somewhere in the middle.
reply
They are also releasing the weights so I am more inclined to think they are better than most.
reply
Well, US models are economic warfare too, of course.
reply
> The reason they release the AI models is economic warfare against US, not because of charity or kindness. It's great for us consumers, but the goal is not to help humanity or open-source.

You put it like US has a goal of help humanity or open-source

reply
What about cheap solar panels and electric cars, is that economic warfare too?

To say that US model providers have a close relationship with their government would be putting it mildly.

reply
That would have been a scathing criticism if anyone believed any of the American companies have the goal of helping humanity or open-source.

Notwithstanding that Chinese publishing methods actually does help both humanity and open-source.

reply
It just so happens that helping open source is the result. Image how far behind we’d (the hackers, not the moneymen) be as a sharing community be without them.
reply
At least DeepSeek didn't build its models on government subsidies. It came out of a quantitative hedge fund, so funding was never really an issue for them.
reply
Whatever their reason, I'm glad they do it. This tech shouldn't be monopolised by a handful of closed, profit-seeking corporations.
reply
And likewise, it shouldn't be monopolized by the CCP
reply
What do you think your comment is refuting!!? Chinese are publishing their research publicly and opening their models! How on Earth would they monopolize anything?? Such nonsense. If and when they start copying the Americans and closing everything down, you can say stuff like that. Until then, ffs stop this nonsense.
reply
So you’re telling me warfare doesn’t having to be blowing up schools and children, skyrocketing prices, crippling sanctions, and all that shit? Can I sign up for more of this warfare.
reply
If your belief is accurate, we should expect China to short the IPOs of Anthropic and OpenAI and release better frontier models immediately after their IPOs.

Does anyone think that likely? I have no clue or bias.

reply
I don't think that's likely because my understanding is that Chinese people in mainland China have a tricky time shorting American stocks due to Chinese capital controls.
reply
Economic warfare against the US is charity and kindness to a sizable portion of the world's population, especially when the US uses it's global hegemony as warfare against them. Neither system is perfect, but lets not be disingenuous.
reply
deleted
reply
Precisely. It's similar to their practice of aluminum dumping to depress US aluminum prices, which causes our aluminum mines and mills to close.
reply
Claude, and other American models, are heavily subsidized by investors (and the United States government).
reply
If the means of achieving their goal are sometimes mistaken for charity and kindness... are they the good guys?
reply
To be completely fair, write this kind of paragraph for every AI category. Would love to see your take.
reply
I like when bad intentions produce good results, I'm tired of seeing the opposite in practice.
reply
At some point though _the purpose of a system is what it does_, regardless of their intent.
reply
How do you know? You’re not speaking for the Chinese government, are you?
reply
> DeepSeek, and other Chinese models, are heavily subsidised by the Chinese government.

Yes, because everything China does is against the US. That's all they think about day and night. God forbid they want to corner the global market or have a genuine business case. How dare they provide options for those who can't afford a measly $200 a month? How can we let Chinese labs publish research for free for the whole world so that they can benefit? The nerve! To think they can use soft power instead of military might! I mean, Anthropic and OpenAI are the last bastions of human kindness and charity. Right?

Right?

reply
Poe's Law applies here.
reply
I’m neither in the camp of Chinese or the Americans(collective West) in general..

As a neutral party, this characterization is crazy.

As if the AI companies - Claude and OpenAI are guardians of freedom and humanity and very charitable to the global society without any self interests… “Chinese models are subsidized by the Chinese Government, therefore they’re inherently bad for humanity” is a highly propagandist argument. The politics of US vs China may be whatever it is in reality.. You have one company releasing their models for cheap, actually open sourcing their trained weights, and publishing details of their optimizations and learnings for others to use. The other camp actively “aligning” their models, nerfing their capabilities, hyping their swarm activities from poor sandboxes, and trying their best to lock users into their harnesses and walled platforms. They are subsidized by the capitalist VCs who are essentially waiting for their payouts..

At some point, one has to see things for what they are and evaluate their own reasoning..

I’m happy to stay provider agnostic, try all models and cheer any useful progress as open as possible.

reply
> are heavily subsidised by the Chinese government

We hear this about literally every industry the Chinese excel in - that it's only because the government subsidizes them that they succeed. For chip manufacturing, for batteries, for EVs, for solar, for AI. I don't see how the chinese government can afford to subsidize all of these industries and still have them contribute to the GDP.

reply
> DeepSeek, and other Chinese models, are heavily subsidised by the Chinese government.

So were Amazon and Uber by the US, which have now established monopolies across the globe. To the countries suffering from those, there's zero difference with China doing it to solar. Actually there is, at least solar got them cheap renewable energy in return. This would never have happened in the US because big oil interests would make it take decades. That's the reality.

You need to spend 10 years outside the US, deprogram, and then go back.

reply
> DeepSeek, and other Chinese models, are heavily subsidised by the Chinese government.

US companies are burning colossal piles of cash in ways that makes it unclear if it qualifies as dumping, not to mention their deep ties with the country's regime.

Claiming that companies from a country have ties to the regime and burn through cash is a very miopic accusation.

reply
I wish US was rich enough to subsidise development of open source science and useful open AI models. I wouldn't mind US waging this kind of wconomic warefare against China or everyone else on the world.

Charity and kindness is not a motivation, it's an outcome of what you do.

reply
Meanwhile, American AI models are heavily subsidized by stock market speculation. Ultimately, the subsidies from both countries are flowing out of the pockets of individuals.
reply
That's an interesting definition of subsidized. I don't thing I've ever heard it used like that before.
reply
US is basically doing economic warfare and bullying against everyone else ATM :)
reply
What if economic warfare against the US does help humanity?

Why are we assuming a strong US is necessarily good? As a European, I have seen plenty of evidence against that stance lately.

I understand that Americans might prefer a strong US. But conflating them with humanity is a leap that I don't think one can make without any backing.

reply
What evidence is that? Please share.
reply
A conspiracy to make the US look bad by being better at producing all the goods and services the world needs at a reasonable price. Have they no shame?
reply
What's wrong with governments subsidizing scientific work?

You think extremely US-centric. China has a different economic model than US and your rules for a specific kind of Capitalism may not apply to them. You assume a country of 1.4 Billion people is obsessed with a couple of foreign AI companies. What if they don't care.

reply
> but the goal is not to help humanity or open-source

Ok, but so what? That's what happening so far. Even a repressive totalitarian government I wouldn't wish on my worst enemy does some good sometimes.

If the Chinese cheap/open models rise up and destroy us, thats on us for giving them access to the tools to do so.

reply
Not really this is an X algo conspiracy. Up until recently the Chinese government wasn't even that invested in these companies. We're talking very very small grants compared to training costs.

Its very xenophobic of you to say China has zero intention of helping humanity, and just wants to "wage economic warfare".

Last time I checked, it was ourselves (USA) waging economic warfare on 2/3rds of the world.

I dont get this cope people have where people have this idea that its impossible for a Chinese company (that make billions of dollars) to have done something by their own merit, but instead its always some Chinese Communist Party conspiracy where the main goal is to destroy America.

Lay off twitter for a bit.

reply
>Up until recently the Chinese government wasn't even that invested in these companies

>Last time I checked, it was ourselves (USA) waging economic warefare on 2/3rds of the world.

Up until recently the USA Wasn't waging economic "warefare" on 2/3rds of the world

reply
The USA has been using financial sanctions, aka, financial warfare on anyone it's deemed an enemy for going on 4 decades.
reply
China has been owning and controlling key companies in its industry for going on 6 decades.
reply
Every country does this. Do you think the US government doesnt fund, regulate and control key companies?

China is not a threat to you, or anyone in the West.

reply
deleted
reply
[flagged]
reply
Why the anti China propaganda from you? The United States is doing the same thing here and making American multi-billionaires even wealthier. The greed of American AI, GPU and memory and storage corporations is a black hole on availability to humans around the World. The result is a massive financial bubble promoted by the American Government to the detriment of our citizens. The USA has an AI ponzy scheme shuffling the same money between data center owners (Oracle & X), Nvidia and memory & storage vendors.
reply
They're trying to pull digitally what they already pulled physically. The reason we can't manufacture a grill brush for a reasonable price is the result of years of Americans choosing the cheapest price. We gave up our manufacture base. They want us to give up our labs.
reply
Deindustrializing a country is not something consumers can achieve. It starts at the top level, with politicians who construct a financial system where it's more profitable to speculate than to build or invest in real businesses.
reply
Except they are open with the tech which is easy to replicate. All new models lowering cache prices is the result of DeepSeek's publications.
reply
US economy is driven on quarter to quarter short-sightedness of stock gamblers and CEOs that have to secure their bonuses and perks.

Its them who chose to outsource heavily, not US consumers.

There are no victims here however, both benefited from the arrangement. The consumers and capitalists.

reply
> The reason we can't manufacture a grill brush for a reasonable price is the result of years of Americans choosing the cheapest price.

No, it's the result of US leadership letting this happen. This is clear since China themselves would not let this happen. US leadership did nothing because they were best friends with the people who did it, and did not care one bit about their population.

reply
Architectural/algorithmic tweaks do advance the efficiency frontier nicely. But raw intelligence mostly comes from data (not just its sheer quantity, but also how it's curated & cleansed) and the scaling law. The know-how about data curation doesn't seem to get published much, even among the open-weight labs, though.
reply
This. Even in the efficiency frontier, it is a lot of data curation that actually makes many of those tweaks actually work at scale in practice.
reply
I'm not sure I like this framing - so much of AI research has been academic, in the open, building on others people's work. Much less comp sci generally, math & philosophy, etc. The idea that rich companies can just build stuff in secret because they have resources is a fantasy.
reply
So boring to see conversations moved over to Chinese models when that’s not even what we’re talking about here. This is about Mistral.
reply
Europeans are irrelevant these days, surpassed by China, S Korea, Japan, Hong Kong, Singapore, etc. Europe is coasting on former glory and now has regulated itself to death and vacationed its advantages away.
reply
Evidently not given that this model is on the open source frontier.
reply
cost is higher than Chinese models that are better
reply
Also, the field moves fast, but slower than people do. Researchers and engineers switch companies every year or two, and the know-how walks out the door with them.
reply
How it should be. Knowledge should not be copyrighted. The world will be a better place with such information democratized
reply
There would be a lot of competition even without DeepSeek. Workers can freely exfiltrate trade secrets without noncompetes in California.
reply
Proprietary competition, yes.
reply
>instruction manuals in paper form

So the most common way to publish manuals?

reply
In research paper form.
reply
I think the mean 'paper' in the scientific journal meaning; these are unfortunately often extremely bad 'instruction manuals'.
reply
Maybe 30 years ago
reply