upvote
yep, all those coders paying $200-$500 per day to use claude once subsidy ends will be seriously rethinking how much they really want to vibe-code "rewriting X in rust". Helping people write word docs, recipes, and emails isn't going to justify $15K per month subscriptions either.
reply
> Helping people write word docs, recipes, and emails isn't going to justify $15K per month subscriptions either.

Those things can all be done today on a $250 used video card and pennies of electricity

reply
The subscription is certainly subsidized but its no where near 100x cheaper than API prices.

Heck, most large enterprise moved to usage based billing and are still happily paying for it. They are force multipliers for your top talent, and when a top engineer is being paid $500k a year, doubling their output for $500/day is a no brainer.

reply
Lowering the cost of hardware still won't solve the issue. HBM and DDR5 was never cheap, even before the shortages, so selling a full inference system is beyond the acceptable price range for most casual customers.

We're going to see Apple and Google compete over services and AI/OS integration instead, it will probably be years before your OEM takes local models seriously.

reply
Apple and Google (via smartphones) are in literally everyone's pocket.

Running KIMI on a phone is not possible today and I agree with you that it will "probably be years before..." it is.

But how many years do you guess? I personally do not think it will take even 10 years for the situation to be commonplace.

reply
> I personally do not think it will take even 10 years for the situation to be commonplace.

Do you personally remember how far smartphones progressed in the past 10 years? It's not as long a time as you think it is, the limits of what a smartphone GPU is capable of did not substantially change in that time. Nor did the amount of onboard RAM that we include in the package. This is true even for Nvidia's ARM SOCs, frankly.

Apple, Microsoft and Google all eventually want to enforce OS-level lock-in for the most profitable AI services (eg. their own). It's much more attainable and profitable to use that lock-in to sell you exclusive service integration, the local AI revolution probably won't begin on their hardware.

reply