It's only a proof that it's possible with 18+ years of training.
Those are much more specialized models with pretty mediocre tokens per second.
I think China is thinking more about the application layer on top of models as going to matter more than the models themselves, so they don't need to gatekeep the models as much.
If China could work at the frontier, I don’t know, I kind of think they would still be dumping a lot of resources into exploring the value side since they have that culture already in place.
https://old.reddit.com/r/Anthropic/comments/1snorbg/the_bigg...
I don't know enough about distillation to understand how much this hinders/slows the process, but it sounds at least superficially plausible.
Honestly, I think its quite possible that models will be retrained with gaps in their knowledge. e.g. a coding model for commercial use probably doesn't need to have deep knowledge of biology, and training on biological sciences probably doesn't help those evals much.
Honestly, I'd welcome such an approach.
That's zero ex oh (the letter) five
> LLMs strongly prefer word-level tokens, and word substitutions follow semantic similarity and not the more human auditory similarity.
Is this an elaborate joke or your full-word misspelling of writing is both agreeing with your statement (word substitutions) and contradicting it (not semantic but only pronunciation similarity)
? Claude, ChatGPT, etc are heinously expensive for tiny benefits lmao. Local + efficient is clearly the future
Unfortunately local inference is inefficient, 100s of times more inefficient than cloud. When you answer one request at a time you still have to fetch all active weights into compute units, once every token. When you run a batch of 300, you load it once and compute 300 at a time.
Compared to cloud, local inference is less flexible. You can't scale up 5x or 20x, can't have spikes, and pay for it no matter if you use it or not. But usage factor is very low, like 5%. And to run a decent model your system costs $2000 or more.
Even if so, if China is coming behind 6 months later selling laptops with hyper-efficient local models that are 80% as good as "frontier" ones, I imagine they'll get the consumer business AND a fair share of the enterprise business as IT managers look at their options during the next refresh cycle.
Given economies of scale, I think it's ultimately inevitable that the enterprise more-or-less follows the consumer on this, and the consumer is going to prefer local models. There's no ongoing cost after the initial purchase, and your data at least nominally stays within your control.
Like I don't need an H100 or a dozen to summarize a PDF. And that's most of what I use AI for.
Corporate America is where the money is, and corporate America will dictate what products are successful by virtue of spend. Individuals aren't going to be paying $100s or $1000s/month en masse for these models but businesses will be. Being local and efficient isn't that important at this stage but even so as American companies continue to scale and invest they'll be able to make those models more local and efficient if the market wants it. Sort of like how you had a big, giant desktop computer and now you've got a super computer in your phone which is in your pocket. Going straight to "local and efficient" means going straight to being behind because at some point, perhaps now even, the local and efficient model won't be able to keep up.
For some reason people think that they somehow know something that Google or Nvidia or whoever, with hundreds of billions of dollars of real money at stake don't already know and it's both amusing and bizarre to see this play out again and again in off-hand comments like "lol tiny benefits".
You buy an iPhone even though the cheap-o Wal-Mart Android phone for $100 "does the same thing". Except that in this case the Android phone just puts you out of business while those spending big money for "tiny benefits" beat you in the market.
People buy iPhones because of status signalling and network effects, neither of which appears to apply to AI model choice. LLMs are already rapidly on the way to being interchangeable commodities.
To the extent LLMs are commodity products you're right (so far), but that is limited to the main model providers, such as ChatGPT, Claude, Gemini, &c. with interoperability on cloud platform providers and other technology providers like an Apple offering you a choice of LLM with Siri or something.
If you want to suggest that some other model is in the same bucket as those primary 3, it goes back to the crappy, cheap phone analogy which is accurate. Yea you can make calls with it, but you make calls better with an iPhone.
https://mashable.com/article/apple-messages-green-doj
https://www.sfgate.com/tech/article/apple-green-bubble-messa...
I'm going off of rough memory here, but don't like half of all Americans have an iPhone? Do half of all Americans own a Porsche?
There is no equivalent in LLM land. AI models are not like Coke vs Other Cola. AI is like electricity or water, a generic commodity with minimal cost or friction to switching. I can flip the VSCode plugin between a dozen different models a day.
> AI is like electricity or water, a generic commodity with minimal cost or friction to switching. I can flip the VSCode plugin between a dozen different models a day.
I don't think that's the case, and as companies continue to build out AI products we will move more into opinionated workflows and different vendor design patterns precisely because the model you suggest will result in a race to the bottom which is the opposite of the intended business model.
Yes, exactly. That's how capitalism works. No business plan survives contact with the market.
I get your point but in what sense is that "free"? What mobile plan giving you an iphone doesn't come with explicit debt?
They run various schemes like this all the time, you can also trade in your existing phone a lot of times for pretty favorable terms. I've traded in phones that were a few years old and gotten $1000+ for them, especially when switching providers.
$729.99 purchase on device payment or at retail price required. New line req'd. Unlimited Welcome, Unlimited Plus or Unlimited Ultimate plans required. Less $730 promo credit applied to account over 36 mos; promo credit ends if eligibility requirements are no longer met; 0% APR.Taxes & fees may apply. Credits will appear on your Verizon Wireless bill.
If you think the iPhone is a status symbol you’re just wrong.
I'm just pointing out the statement:
> What mobile plan giving you an iphone doesn't come with explicit debt?
isn't invalidated by some Yahoo article pushing a marketing promo that when you actually do the math and read the fine print its not really a "free" phone, its always some form of debt or bill credit or something along those lines that makes the phone "free". You're still paying for the phone in the end if you read the fine print. In the end one commits to spending several hundred dollars over 36 months or whatever or you pay up front and they give you bill credits if you keep the plan.
People who prefer truth in advertising.
> Why be so argumentative over something so stupid?
I don't want people to believe untrue marketing statements and make poor financial decisions without actually bothering to read the fine print.
> some companies run free promotions
This just isn't true. They're not really "free". They come with lots of financial commitments.
> Apparently Verizon ran some promo in the past and may again in the future giving away iPhones
They still say they do on their website. If you're getting one "free" iPhone it comes with a commitment to spend at least $65/mo for 36 months. A commitment to spend $2,340 is a lot different from $0.
These are far from "free" phones. Can I go into a Verizon store, not give them a dime or sign any contracts and walk out with a phone free and clear to do whatever I want? No? Sounds like it's not really free then!
My point is if you're poor/homeless you're probably not looking to sign a 3-year commitment to spend a few grand to get a "free" phone. A lot of those people won't even pass the credit check to qualify to even sign up for one of these post-paid plans required to get the "free" phone. If you're really broke you would probably be looking at signing up for a lifeline plan and get yourself a cheap used iPhone instead of signing up for a $2,340 contract.
You’re anchoring yourself to one payment scheme and ignoring others and it’s besides the point which is that iPhones aren’t status symbols even if these schemes didn’t exist and iPhones weren’t extremely cheap or freely available.
I don’t have anything left to say here besides that I proved my point unequivocally.
I already said I largely agreed with this.
> major carriers can and do give them away in various schemes and did so in the past and will continue to do so in the future
They only do if you're financially illiterate.
> You’re anchoring yourself to one payment scheme and ignoring others
I'm being honest and taking about the real deal instead of blindly repeating marketing bullshit and lies.
> freely available
A commitment to spend thousands of dollars isn't the same as freely available.
The bank gave me this free house all I have to do is pay this mortgage for thirty years. But hey the house was free!
Once again, was the deal that you could walk into the store, grab a new iPhone, and walk out without signing a contract or other form of commitment? If not, it's not really free. It's bad financial advice for people struggling financially to get one of these "free" phones, they're often more expensive than buying outright and getting a much cheaper (or potentially even subsidized!) plan. Especially if you're just needing one or two lines. Many of these postpaid plans only really make financial sense once you're at like 4+ lines on it.
I'm reminded of seeing all those cell phones in the RadioShack mailer ads back in the day. Only 99¢! Dad, can't I get one? It's only a dollar!.
If you spent hundreds of dollars on box seats to a sporting event and they had a complimentary buffet, is that food really free or did it cost you hundreds of dollars? Would you tell someone struggling with money they could get free food, they just need to go spend hundreds on sports tickets first?
Maybe one shouldn't be so willingly close-minded to the truth.
Capital inflows are different from manufacturing outflows. The US has historically imported capital which is part of why we have such a large trade imbalance. I’d encourage you to do some more digging here.
> The world where we could compete is gone.
Sigh no that’s just not true at all. We compete hard and fast all day everyday, economy is growing and will continue to do so, and no amount of leftist doomer, Chinese, Iranian, or Russian propaganda changes those facts.
No but money only has value because of a product of the human labor and production capacity it refers to. Money is not capital, it is a reference to/legal coercion of capital
> We compete hard and fast all day everyday
Sir have you ever been to the us? Lmao. We are only competitive in the industry of white collar work (financial/artisanal services), an industry that capital is actively gutting
These are just strings of words without meaning or importance.
> Sir have you ever been to the us? Lmao. We are only competitive in the industry of white collar work (financial/artisanal services), an industry that capital is actively gutting
Yes, I live here. Why are you posting obviously untrue and asinine statements like this? Go look at the Fortune 500. There ya go. What other evidence do you need? And not only are you writing dumb things here, your original post was wrong too! Please get off of social media or whatever doomscrolling news you are partaking in because it is bad for your health and perception of reality. The United States by any measure, as a matter of indisputable fact, a highly competitive and dynamic economy across pretty much all sectors. This is not up for debate.
Strange reading that on HN and realizing I'm not on Facebook
The whole idea of the deep state is that it’s part of the state, ie government, so not private citizens, and they’re “deep” ie hidden below the layers of government. Thats the exact opposite of politicians and the ultra rich.
Also, your link specifically starts with:
""a hybrid association of government elements and parts of top-level industry and finance that is effectively able to govern the United States without reference to the consent of the governed as expressed through the formal political process."
which exactly how this was defined by your opponent.