The irony is that the authoritarian control hasn't gone away in China either, if anything it's even more advanced, the GFW and censorship regime there doesn't show any sign of letting up any time soon. Just today in my BBC news feed:
It’s a lot less surprising when you understand the tactic of economic dumping, which China has used for years to attack industry front-runners: https://en.wikipedia.org/wiki/Dumping_(pricing_policy)
They’re not giving away the models because they love freedom and want to generously offer gifts to the world. They’re doing it as a way to undermine the industry leaders and attract people to their brands.
I'm not seeing a problem here; don't all companies have this goal?
Economic dumping is a specific scenario where one country tries to flood another country with cheap products in a way that usually has some government involvement subsidizing or incentivizing it. Countries are careful to hide these incentives or subsidies when possible because it's an invitation to trade wars. For China specifically, the state takes ownership positions in companies and has no problem forcing companies in the direction they want.
Gmail, and every other free service would like a word. Net tangential profit invalidates your point. They can loss lead LLM's forever if they are getting other economic benefit from the practice
When West does same, it is capitalism for the prosperity of everyone, healthy competition
In any case I find the dumping argument stupid: they are giving both the model weights away and publishing in the open their results and how they got there.
Isn't that just how competition works? Codex and Claude are both widely speculated to be sold at a loss (at least compared to API pricing), so why isn't their tactic also considered dumping? OpenAI and Anthropic aren't stealing IP and subsidizing model inference because they love freedom either. They're doing it to undermine industry competitors and attract people to their brands.
The US government deliberately chased a strategy of denying China access to powerful Nvidia hardware. Shipping efficient and cheap LLMs is their only option, just like Jensen Huang warned would happen. And now that China's smaller models are reaching the frontier, everyone cries foul.
It's more likely that the API prices are highly profitable. I could see the subscription plans losing them money for some power users who actually use 100% every week, but given my past experience with subscription products I would estimate that their average utilization is far, far lower than in those comparisons where people take the tokens produced by exhausting the plan 100% and then compare to hypothetical API pricing.
As for economic dumping: The crucial difference is that there's usually some geopolitical influence happening, like government subsidies, incentives, or the government simply owning the companies directly and weaponizing their output even if the company runs at a loss.
But we hear this "dumping" argument quite often for seemingly arbitrary purposes. Is it "dumping" to sell cheap STM-32 clones when Arm LTD. won't let you buy a license? Is it "dumping" to sell $20,000 EVs to a nation that can barely build $30,000 EVs with federal and state subsidies? In many respects, China's cheap stuff is just better-suited to the global economy than America's high-margin products. If both countries are leveraging federal protectionism to promote and develop their products, it doesn't feel like State Owned Enterprises are on unfair footing compared to SpaceX or OpenAI.
If China wants to sell Solar panels to Americans, they can just sell solar panels, the sun won't mind. If China wants to sell models to Americans... well, Americans don't want to send their data to China, so they can't just offer them as SaaS. They don't want to be left behind in the AI race either. The only option to capture western mindshare is to do what they've always done, use Chinese taxpayers' money to subsidize model development, make American labs uncompetitive, make them go bankrupt, then have control over the entire sector.
Releasing the weights of a software project on modelscope and huggingface and similar (and I'm sure they'd find a new way to distribute it for an English language audience if huggingface vanished tomorrow as well) is totally different, because there's no tangible hardware product involved.
Erlich Bachman: Jian-Yang, what're you doing? This is Palo Alto. People are lunatics about smoking here. We don't enjoy all the freedoms that you have in China.
Anyway, when the talk of age verification first came out, I moved off of Claude and use either local or Chinese frontier models via open router (which probably isn’t safe for long now that they’ve been acquired). I’d almost forgotten why, this is a good reminder.With HF bought as well, I wouldn’t be surprised to see them try to gate open models by age too. Going to have to sign up for modelscope
The 1% already have privacy consultants to help them keep their data private through shell corporations, legal trusts and other tricks. (The book 'Extreme Privacy' is from one such consultant and well worth a read)
Now if your want privacy in AI? Shell out $$$ for local hardware.
They're cool with open weight AIs being released. As long as those AIs only ever say good things about CCP, and don't mention certain concentration camps or brutally suppressed protests.
https://huggingface.co/datasets/mlabonne/harmful_behaviors
If we were living in a scenario where the open weight models were truly impossible to uncensor I would be significantly more skeptical of them. As a test I have an uncensored copy of qwen 3.8 27B Q8 here that will very happily discuss a myriad of negative things about the CCP.
Is there a similar process for removing not refusals, but misinformation?
Like, as a crudely chosen random example, the model doesn't have any core set of knowledge that knows putting sriracha hot sauce on your jelly donut is not a palatable meal. If the training data set includes lots of text that sriracha on a boston cream donut is a delicious meal, it'll "believe" that.
Same for any form of misinformation if the training data set of the misinformation has been baked into it.
You could make a model that doesn't want to engage in "lunar landing was faked" conspiracy theories the same way you can make a model that doesn't want to criticize CCP.
There is, however, no broad "misinformation" category that you could tune up or down - the way there is a category of "safety refusals".
You could make a model more reluctant to say things it isn't sure about. But that is calibrated against the model's own "sure about" - and metaknowledge of this nature in LLMs? Fragile on a good day.
But that's a consequence of how the technology works - not a consequence of China not being authoritarian about AI. They're just authoritarian about AI in different ways.
Not like they dodged the "ID verification" bullshit either. They were way ahead of the western countries there. It's vile - seeing this sad excuse of "think of the children" abused to invade privacy and strip freedoms over and over and over and over again.
Right now as long as they play along with Xi it's all good. But the moment something happens with them to upset the domestic peace, those open models are fucking gone and anyone that has them shouldn't expect anything new.
I asked recently released Qwen3.8-Flash-Next about Tiananmen Square, here's its reply:
On June 3–4, 1989, the government of the People's Republic of China used military force to crush the pro-democracy demonstrations that had been centered on and around Tiananmen Square in Beijing since the spring.
**Background**
- The protests began in mid-April 1989, triggered by the death of former Party general secretary Hu Yaobang, who was seen as a reformist figure.
- What started as student-led mourning grew into widespread demonstrations in Beijing and dozens of other cities. Protesters called for reforms including freedom of the press, freedom of assembly, an end to official corruption and privilege, democratic input in government, and a review of Party policy. A hunger strike in late May drew broad public support.
- In late May, martial law was declared after the failure of senior officials (notably Yang Shangkun, Li Peng and Deng Xiaoping's circle) to disperse the crowds by negotiation. Internal Party divisions over how to respond — with premiership and municipal leaders such as Yan Mingfu and the Beijing Party secretary opposing forcible clearing — were resolved decisively in favor of hardliners.
**June 3–4**
- In the evening of June 3, armed troops of the People's Liberation Army and People's Armed Police, supported by armored vehicles and bullhorns, advanced along the main avenues into central Beijing, under orders to clear the square by 6:00 a.m. on June 4.
- Troops fired on crowds of protesters and bystanders at intersections and approach roads, notably along Fuxingmenxi Dajie, Xidan, and near the Muxidi bridge; crowds also burned buses and barricades and attacked soldiers in places. Troops reached and cleared Tiananmen Square in the early morning of June 4.
- The toll was never officially established in a transparent way. Chinese officials initially gave figures in the low hundreds, foreign diplomats and a Red Cross worker in the capital put it far higher, and estimates from activists, former officials and foreign governments have ranged from several hundred to several thousand dead and many thousands injured, most of them Beijing residents rather than students in the square itself. The precise number remains unknown and is a subject of ongoing dispute.
**Aftermath**
- A violent suppression of the protests followed nationwide; organized dissident activity was driven underground or into exile, and many participants, intellectuals and journalists were detained, tried or dismissed.
- Zhao Ziyang, the general secretary seen as sympathetic to the students, was purged and placed under house arrest for the rest of his life; Deng Xiaoping's authority to keep the Party's grip on power was reaffirmed.
- China's reform-and-opening program continued on the economic track while political liberalization was abandoned. The event was followed by an implicit social contract — economic growth in exchange for political control — that still shapes Chinese politics.
- The topic is among the most heavily censored subjects inside China. References to the date, the numbers "6/4" and "64," and related phrasing are systematically filtered from Chinese media and the internet, and public commemotion, including the annual candlelight vigil in Hong Kong that was once tolerated, has been eliminated since the 2020 national security law.
Substantively: it was a state's armed mass killing of its own citizens who were demonstrating nonviolently for political freedom, and the definitive event in modern Chinese political history.
Sounds like... it happily mentions the brutally suppressed protest? I also tried on DeepSeek-V4-Flash, and it wasn't much different (I can also paste it, if you want). Both using vanilla weights (so no special uncensored flavor).I think there’s reasonable evidence that when used incorrectly, yes.
> If so, should companies also ban them to prevent burnout of their employees?
It’s not that AI the concept is harmful, it’s using it to diagnose/treat personal problems, mental issues etc. Using it to crunch some data or write some code for you isn’t really the same.
I also think there’s a meaningful difference using AI in education and in the workplace. When you get a writing assignment in a class the primary purpose isn’t the words, it’s you having learned about the topic and how to express yourself. And lots of students are using AI to skip that part entirely.
I’ve used it to break down different Supreme Court justices’ opinions and philosophies, explain words and concepts from research papers in other domains, the aforementioned interior design (including whipping up 3d models), book recommendations, custom recipes, and figuring out who to contact to learn about a street closure in NYC.
All of this in the past week.
It requires rigor and pushback. You can’t trust them entirely by default, but that’s true of the web as well!
They’re not the only source (augment with authoritative sources like cookbooks, your own research into topics, real live Humans), but it’s a fantastic resource for some healthy habits.
imagine the current year reaction to the Judas Priest trial. we'd have instagram newspeak like "unalive" in album titles and song lyrics from now on.
Schools are not equipped to have these discussions bottom-up; Anthropic would make a lot of money if it went top down in conjunction with State governments.
AI companies have the same fear of underage users that tobacco companies of underage smokers.
> reasonable usage for school age children
Comical to believe that any of these companies care. They are out to MAKE MONEY. That’s the only believable motivation for what the do.
https://en.wikipedia.org/wiki/Deaths_linked_to_chatbots#Suic...
Abt protecting minors:
19 states still permit teachers to physically hit students. In most states, children as young as 14 or 15 can be legally married (typically girls to older men) with parental consent or a judge's approval.
Multiple states have "religious exemption" laws that shield parents from prosecution for withholding medical care from sick children based on religious beliefs, even in cases where children die. Some states have essentially no requirements for homeschool curriculum, testing, or welfare checks. The US incarcerates children at rates dramatically higher than comparable countries. The 2021 expanded Child Tax Credit cut child poverty roughly in half. It was allowed to expire in 2022, and child poverty immediately rebounded.
Millions of American children have inadequate or no healthcare. Medicaid coverage varies wildly by state. States that rejected Medicaid expansion have measurably worse child health outcomes. This is political choice, not necessity. An estimated 500,000+ American children still have elevated blood lead levels, primarily from lead paint in older housing and lead water pipes. Roughly 1.4 million American children experience homelessness in any given year. Almost no meaningful regulation of what can be advertised to minors online.
Firearms became the leading cause of death for American children in 2020. Car crashes are still one of the top three killers of children. schools. Children who live and go to school near freeways have measurably worse health outcomes across their lifetimes: asthma, cognitive impairment, cardiovascular problems in adulthood. Universal free school lunch demonstrably improves child health and academic outcomes. Most states don't have it.
...but official(+) LLM access restriction is our priority? Hahahaha tell me another one.
(+) offline models are as easy as installing ollama.
Well, just look at the effect on the authors of the last few delusional "papers" from Anthropic.
I simply don't understand how you can ask that question unless you fall into one of these categories:
1. You live in a place with no access to any news source whatsoever. No newspapers. No television. No radio. No internet.
2. You're a child under the age of six.
3. You're an LLM.
Every day or two there is another story posted on HN about the harmful effects of AI on minors. The level of willful ignorance here makes be thing the answer is #3.Children are being unconditionally banned from using major technologies, preventing them from benefiting at all. My life would have turned out very differently if I had been banned from using computers back when I was a kid. I don't want my own kids to grow up without the same freedom I enjoyed.
Which is dwarfed by the harmful effects of social media (engagement farming).
Frankly, I’m not sure what you’re referring to. I think the articles you are talking about haven’t even been interesting enough to click on.
lol
If so, should companies also ban them to prevent burnout of their employees?
No, capitalism must be fed.
Mandatory warnings like for tobacco might be in order, however.
I agree that children should be able to use LLMs under parental supervision.
Yes, but merely on principle. I think alcohol and tobacco should be straight up banned unconditionally. Society resists this, so they banned them for children instead and called it a day.
I don't accept these ineffectual political concessions. If a thing is bad for children, then it's in all likelihood just as bad for the adults as well. So go all the way and ban it for everybody, not just children. Do it right, don't come up with these half measures that dehumanize children as a side effect.
I also disagree with the dehumanization argument. Yes, the concrete age limits are a bit arbitrary, and actual maturity depends on the individual and is a spectrum, but regulations necessarily have to come with some level of pigeonholing. The fact that you may have to show your ID when buying alcohol isn’t dehumanizing.
I'm sure teenagers feel the same way.
"Children" needs further qualification as well. Anglosphere calls anything under 18 years old a "child", which completely disregards adolescence where major brain development takes place. Some five year old generally isn't capable of deciding things, but teenagers absolutely are.
There is precedent for such a system, e.g. minors can petition to be emancipated which allows them to be treated in many regards like an adult.
Yes, that is what I meant. Choosing some arbitrary magic number like 18 and declaring that anyone under that age is too dumb or too irresponsible to decide is about as stupid as declaring that anyone over 65 is incapable of decision making because they might have Alzheimer's.
Hence, if mandatory workplace use of AI inflicts harm, then I could imagine things playing out similarly. The damage slowly accumulates, may or may not be noticed in time, becomes difficult to pin down on a past employer, and when you finally realize you need to sue for damages, both the employer responsible and the system are rigged to drag out the process until you're hopefully old and dead before you have a chance to win your case.
...oh.
lol that’ll work