upvote
These are 90-95% cheaper than Anthropic. I'd prefer open source, too, but this has nothing to do with Windows Phone OS (which failed because of network effects).

In this case there is huge demand from companies who consume API tokens at currently high prices who do not want to buy from the labs and who find that existing open source models are starting to lag the frontier too much, or are not actually that cost effective once accounting for the amount of tokens they consume.

The audience here is enterprise looking to save money, and there is no natural monopoly preventing this from gaining traction.

reply
> which failed because of network effects

Not to nitpick, but Windows Phone also failed because Microsoft released the first generation of devices with Windows Phone 7, convinced a bunch of people to buy them, and then released a second generation of devices with updated Windows Phone 8, a version that the first generation couldn't upgrade to meaning that anyone who got in on the ground floor got locked out immediately.

When you go out of your way* to screw the people most interested in your new product it doesn't really engender large amounts of trust in what would have been your second wave of customers.

* Well, to be specific, WP8 was based off of the NT kernel and WP7 was based off of the WinCE kernel so it was probably 'the right choice' on some level, but making the entire first generation of a new product line EOL immediately rather than making an effort to ensure those people get... something... is still a dick move.

reply
yeah they should have had a trade in program, that would have bought them serious brownie points all around.

But Windows Phone history is a long list of things they should have done

reply
WP7 -> WP8 was rough (as was WM6.5 -> WP7), but WP8 -> WM10 was worse... while you could upgrade WP8 devices to WM10, IMHO, it wasn't worth it. Better to support old and new until the old ones age out. IIRC, WP8 had a big spec jump (single -> dual core, ram requirements, etc), so an upgrade probably wouldn't have worked...

The final build of WM10 was actually not awful... too bad it came 2 years after launch. :P

People talking about network effects killing windows phone probably don't know about how well WP8 sold low end phones in developing markets. Of course, WM10 abandoned that part of the market ... just another thing Microsoft could have done differently. :P

reply
100% this. Lots of people want cheaper. The demand for same performance but cheaper is off the charts.
reply
Agree. I was talking to a coworker the other day and remarked that I would be pretty content if we had five years of Claude stagnating in quality/capability but reducing in price/environmental/electrical impact.

It reminds me of when Apple switched to their own silicon in the iPhones and we had year after year of hardware with 1.5-2.5x performance compared to the previous year. We very rapidly got to the point where the processor in my phone was more power than I would ever need (unless apps got more and more bloated and inefficient, which they obviously did).

reply
The performance is really fuzzy too, but the price you do know for certain.
reply
Price is quite fuzzy too though when it's pricing tokens, because a model that's more token efficient but more expensive per token can be cheaper for a given task. And token efficiency is as fuzzy as performance so you're back where you started.
reply
> a model that's more token efficient but more expensive per token can be cheaper for a given task.

True, but I'm skeptical that this is now overly used to ignore cost per token. Your comment inspired me to do a quick investigation. Looks like in my data, 92% of cost per task can be predicted by cost per token https://micjm.com/blog/cost-per-task-vs-token/

reply
Definitely. Cost per task is nice in theory, pretty absurd in practice.
reply
Well, it depends on the data source. Cost per task for benchmarks is absurd. Cost per task for real world usage, where the model identity is randomized (Like Arena or Agent Duel) seems better, though the tasks still are not going to be representative if you're not doing the same stuff as the battle participants.
reply
Or even 90% of the performance but much cheaper. Many business tasks to not require frontier intelligence and were solvable two years ago.
reply
Yeah if you're talking 85-90% of the performance at 10-15% the cost, you're going to win most of the business use cases over. That has been the broad theoretical appeal of the Chinese models, that they might provide that kind of value. Most businesses could not care less about open weights vs not, that does not enter into their discussions very heavily. They care about cost to performance. Fable 5.2 is amazing, and it's as good at eating dollars as it is at producing code.
reply
> These are 90-95% cheaper than Anthropic. I'd prefer open source, too, but this has nothing to do with Windows Phone OS (which failed because of network effects).

FWIW it is worth noting that the GP's suggestion is more in line with Microsoft's own stated belief in the future of "unmetered AI".

At the moment, Microsoft is arguably meeting that claim with their support for and encouragement of Nvidia Nemotron Bolt, which is an actually pretty good, quite interesting, unusually-trained-and-sized-to-fit MoE model that was designed to go with the launch of the Nvidia/Microsoft RTX Spark machines.

(Good Sam Witteveen video about it: https://www.youtube.com/watch?v=WJpeW9lCSUM )

But it would be good to see Microsoft themselves distilling an open weights model.

Like any vendor with a profit motive they do have to decide the obvious, though: how do you make money from it, when right now it could cost several hundred million dollars to train (even if you adjust the training of a larger proprietary model so you can distill the smaller one from it)?

There is, essentially, no way to keep an open weights model from being copied/distilled/extracted, and IMO what that tends to suggest is that open weights models will essentially gravitate to sort of uncontroversial, "standard library" tasks.

So I think it also means that Microsoft's approach on open weights will ultimately be the same as Apple's: they will focus their efforts on LLMs that meaningfully add function to their OS and can be decapitated to make similarly useful decision models.

Put another way: given the geopolitical angle of the last few weeks, I think it is possible that the open weights coding models we have now may be among the best we will ever get, until the nearly inevitable GPU/tensor hardware glut arrives.

In the meantime, something else is clearly happening: much broader competition in the "good enough" models category, which is what we need to drive down the cost of inference hardware such that open source and open weights are feasible over the longer term.

reply
Long term I think the economics point to having a "Linux of AI". I.e. Operating systems were the same way, expensive to make but everyone needed one and did not want to pay for one. So maybe many of the big corporations will eventually collaborate on one ecosystem of open weight models where they share the costs of training it. Then they can compete on other things like serving it or whatever.
reply
Yeah, I think this too. It is not going to be cutting edge but it is going to be something that can be supported, reasoned about, customised etc.

I think we are not far off this with Pi, Muse Glimmer, Qwen, Gemma etc., but sooner or later we will all have to work out how to put money behind it.

reply
I mean, nobody is really out there broadcasting their 501c that is collecting funds to build a world class open weight model... the question is does this 501c exist, and if not, why not make one? The first major hurdle i'm guessing, is that it would take actual liquidity and not funny-money.
reply
I agree that is what it would take.

The main problem is that the open source movement has trouble even raising the money to properly pay linchpin individuals like Harlan Stenn (NTP).

Even Omarchy, which is uncomfortably effective at raising money for what amounts to a barely differentiated Linux distribution, is not raising LLM-training money; it’s barely even raising the kind of money it would take to post-train Qwen, I think.

reply
Nobody is actually paying the tag price for Claude. Their subscription covers at least 5-20x the token cost (depends on the usage and caching).

Yes, they can change it at any time and in fact they have done so in the past. But I just want to point out that the Microsoft tag price is not competitive as it looks.

reply
Go check their IPO filing. The large majority of revenue is from people paying the tag price.
reply
> The audience here is enterprise looking to save money, and there is no natural monopoly preventing this from gaining traction.

Fun fact - Enterprises are just big groups of people.

If none of your people have ever used a tool because it's expensive, locked away in a some walled garden, and obscure then none of the enterprises will have demand for it. Management might force them to use some cheap model, but users will all be pushing for the models with mindshare, and Microsoft will lose marketshare as a consequence.

Apple knew this when they put Apple IIe's in schools. It's still paying dividends. Today, Anthropic and OpenAI know it and are actively hemorrhaging money trying to become synonymous with AI. Microsoft seems to think that this is all a race to the bottom. I think they're wrong.

reply
FWIW, the frontier labs have like zero barrier to entry, even for general population. In contrast, open weight models require technical expertise to run (and/or paying third parties that host them, which requires researching and tracking which ones work and are trustworthy - i.e. hassle). So you're right in theory, but that argument evaluates strongly in favor of labs & current MS approach, and strongly against open weight.
reply
Plenty of Open Weight models available from API providers.

There is a lot of choice...

reply
ho do not want to buy from the labs and who find that existing open source models are starting to lag the frontier too much, or are not actually that cost effective once accounting for the amount of tokens they consume.

one is not true, the other is not all that relevant considering disparity in pricing local vs API even subsidized.

Even if both were true, this is Microsoft. There's negative chance of them producing anything close to frontier anytime soon or at all. They've been absent altogether and relied on others; The little they did is not even in also ran category like grok is for example.

reply
The point is you no longer need frontier models to get “good enough” AI, and MS is offering a marginal improvement over open-source models at very good value
reply
I know at least one company where people are forced to use coding agents via microsoft contract, and their monthly quotas for developers are limited to an equivalent of at best couple days of Opus 5.5.

they will happily use a microsoft model that is slightly less capable at fraction of the cost.

reply
that'd make sense
reply
But looking at Github's recent track record, and the outage last week, would you really depend on this offering?
reply
Cheaper per token when used via the API.

How do they compare with the fuzzily-priced only-our-agent cheap tokens you get on a Claude Pro or Max plan?

reply
If it were truly as good as Opus 5.5 and 95% cheaper with API pricing, then it would match what you get from a Claude plan, and I'd be willing to switch. Right now I go through some contortions to make sure I use up all of my tokens every week, and it would be nice to just pay for what I use, for those down weeks.
reply
I'm seeing MS code quality in their products. 90% cheaper isn't worth it
reply
Sharing open weights models is a way to break into a market where you need recognition and brand awareness.

Microsoft doesn’t need any of that. They have the market share, distribution, brand awareness, and a lot of their potential customers already use Microsoft products somewhere.

The phone comparison doesn’t apply, IMO. Phones are entire ecosystems and they’re very sticky. People don’t switch phone OSes casually because they only buy a phone every several years. Getting locked into a phone you don’t like is too risky.

AI plans are not like that. Not yet, anyway. Vendors push for contracts and one year lock ins via discounts, but individuals and nimble companies are changing AI providers all the time.

Even my wife’s big company technically has a contract with one AI provider for the company, but teams across the company are getting extra spending to use on Claude or other models of their choice and the favorites are changing every few months.

Trying an AI model is low risk. You can do it for a month or even just earmark a token budget and try it. Nothing like buying a phone that you’re stuck with for years.

reply
Sharing open weights models is a way to break into a market where you need recognition and brand awareness.

Microsoft doesn’t need any of that. They have the market share, distribution, brand awareness, and a lot of their potential customers already use Microsoft products somewhere.

https://deepmind.google/models/gemma/

https://openai.com/index/introducing-gpt-oss/

reply
This actually sounds like exactly why they should share open weight models. Microsoft is notoriously horrible at branding. Ask five different people what "copilot" is and you'll get five completely different answers. What's the latest Xbox? I regularly game on PC and I couldn't tell you, but I can tell you the latest PlayStation is PS5. I regularly run AI models locally, but, having not clicked on TFA, I couldn't tell you what models Microsoft has released since Phi.

Microsoft is essentially nobody when it comes to AI branding. People only know of copilot, and that brand is clear as mud now.

reply
deleted
reply
They just need to make VS Code’s tools as attractive as Codex/Claude. Their harness layer has fallen behind. (Could they just vibe one up? Hmm.)
reply
deleted
reply
Microsoft already has a large market share in model serving and their AI platform is well integrated into their office-business-cloud offering portfolio.

MS AI inference is heavily used in business, especially among companies who value or require 100% assurance that their data is NOT leaking into the open. Microsoft has a secure AI interference and training platform and provides such guarantees, even for classified information.

Also: this is important -- https://microsoft.ai/news/introducing-mai-licensed-weights/

Windows phone was hardware and was decades ago... it has little bearing on their AI business model which really more of Cloud offering. Microsoft is doing very well in Cloud services and revenue... Depending how you slice up their cloud services business, Microsoft is the largest (by a fair margin) or second largest cloud computing business in terms of annual revenue.

All in all, if the models perform as well in the real world as they do in benchmarks, this is fairly impressive and also concerning for OpenAI and Anthropic (downward price pressure).

reply
If you don't want your data leaking into the public, then you should probably not let Microsoft stuard any of your data. Azure's security model is based on imagination (vibes in modern parlance?) and should not be relied on for serious work.
reply
Knowing Microsoft, they would rather let their closed source OS die than open source it. That's rooted deep into their core DNA and that's exactly what happened to their phones. You can't really change who you are, fundamentally.
reply
Their phones failed because other companies like Google and Apple banned their apps from being in their app store - effectively making it impossible for either Android or iphone users to switch. MS also made it really hard for developers to get their apps in their app store as well. Submissions form failures, long approval processes and bottlenecks with rigid certification rules all contributed to the Windows Phone failure.

It had nothing to do with open sourcing their OS.

Its important to note most of the groundbreaking features the Windows Phone OS had were imitated by both iOS and Android in subsequent years after its failure.

reply
You mean the "groundbreaking" features from Maemo/MeeGo in Nokia N9 and even some from Palm Pre WebOS?
reply
[flagged]
reply
You would be surprised how many companies only allow their employees to use Copilot simply because they have existing agreements with Microsoft and it takes too much to start a relationship with one of the labs.
reply
The big advantage I see is you can run Claude in Copilot- while also getting full access to Sharepoint/Outlook/Teams. I can reference a conversation in email and get instant context.
reply
True in my case. My company and the main client company I do work for give developers Github Copilot. You can't just install Claude. I see these MAI models available at 50% off.
reply
Anything short of the absolute frontier models are now essentially fungible.

Price/token and data protection agreements are all that matters.

MS dominates at the latter, and they can subsidize the former. I would not bet against them.

reply
Some of their existing offerings provide finetuning service and I guess that'd be sufficient for enterprise customers who're locked into the Microsoft ecosystem anyway.
reply
This topic has its own dedicated section in the linked page.
reply
It's not enough for companies outside the US, though.
reply
They're not open weights but they're open... something? Kind of sort of?

> We’ve heard again and again from leaders that no one wants to pour their IQ into someone else’s model.

> We heard you. We started with Custom Models. AT&T developed an MAI custom model for 5G network operation analytics and it outperformed GPT-6.1 Sol at 50x cheaper cost. On complex scenarios, they found that Code 2 delivered frontier-level performance at a significantly lower price than alternatives.

And a link to: https://microsoft.ai/news/introducing-mai-licensed-weights/

I don't really understand what this means.

reply
Means if you have deep pockets you can license the weights and do your own training with them.
reply
I don't think you can compare to Windows Phone. That was a vastly different situation dependent on hardware partners, cellphone networks and network effects in terms of apps, etc. etc.

If anything this highlights how commoditizable LLMS are. Is it as good as Opus but significantly cheaper? Then that's a very easy switch. Not to mention Office and Windows... they're not short of ways to get this in front of people.

reply
Commoditize your complement.

But you have to choose which is your complement and which is your main product.

reply
It seems to me that secure inference and horizontal integration is their main product, and the complement is the LLM itself.
reply
> if they hope to secure any market share

Google and Microsoft are already the bulk of the market share.

Most knowledge workers are either on Microsoft 365 or Google cloud services for anything from mail to meetings, calendars, calcs, etc.

And all of Gemini and Copilot have already moved into the offices of most people.

reply
Why is hackernews absolutely obsessed with open source as a pathway to success? So extremely few open source projects have been successful, while almost all successful products are not open source. None of the most successful current AI models are open weight, so why should this be considered a factor in success?
reply
How do you define "success" and "extremely few"?

Linux, Android, ElasticSearch, Apache, Nginx, PHP, Python, Perl, WebKit, Mozilla/Firefox, Chromium, Postgresql, Rust, MySQL, Redis, React, Jquery, VueJS, Blender, RepRap/Prusa... I am sure I could come up with a 100+ off the top of my head, I was just mixing it up a bit.

reply
Because we want open source for all the usual reasons: freedom, price, availability, community, etc...
reply
Open source makes the world better, "successful products" make a couple assholes rich.
reply
This. I literally do not care about any of their offerings unless they are open weights.

I'll pay Microsoft to run them if they're open weights. I don't want to deal with the hassle of doing that myself. But I won't even touch them if I can't possibly own the weights myself.

The market is already full of closed weights. We don't need more.

reply
You have stated your position but not explained it. How does it help you if the weights are open?
reply
Risk.
reply
Can i have more explanation please? I'm not in risk management but i would like to understand the situation better. Just risk that they change it under you? Or that they're training on your data, or what kinds of risks are we most worried about?
reply
They can make your model disappear. If you have a system and a set of prompts and evals and everything is working well, it's no fun for that model to just disappear. Some will reply "do a better job building your system so it's not model dependent" and they are sort of right, but that isn't always economically feasible and/or just isn't the reality of how a lot of systems get built.
reply
Models hosted as a service can be subtly tweaked without any announcement, or suddenly be 'upgraded' to a new one with a ticking clock on how long the old one sticks around. In both cases, the flows people establish around them are disrupted or broken.

I've lost track of the anguished cries of those unhappy when either of these has happened.

reply
That's a problem with decision models, for example, but coding models have no such risk. I switch between multiple coding models from multiple providers each day.
reply
You must be new here

History shows that if you give a corporation power to extract money from you, most of them will do that without any regard to the user.

That power is the model weights. If there is a market around open weights, they will exist and corps will not be able to squeeze so hard.

Unfortunately not many people understand this simple and intuitive reality, and thats why we suffer

reply
This assumes material switching costs. I use frontier max plans for now but have fail over models for each class of model action with tuned context so I can keep the performance when I lose the max plan subsidy at a lower price that staying with the frontier labs for certain classes of work.

I see minimal downside in using closed weight models as long as they're behind a router, you have good prod sourced evals and you have fail over to other models configured and tested (running either dark or active:active) with real prod workloads.

reply
If you want relatively repeatable and predictable responses (even within the reality of being non-deterministic) then making sure you'll have continued access to a model to replay responses for debugging and tuning can be important.
reply
Yes, we do need more. I would like significantly lower price for same performance. I'd like higher throughput.
reply
deleted
reply