upvote

points

by paxys16 hours ago |
comments
upvoteby monatron16 hours ago|
next
[-]
I think your last point is exactly why I'm so interested in local models. The current landscape doesn't feel sustainable. The last few months we've seen the big providers (OpenAI, Anthropic) start to play with usage limits, resets, banked resets, pulling models, etc. I think local models are close to the point where, with a sufficiently well-architected harness, you can get results that are on par with the experience you'd have with cloud inference. It is nice to know that I have hardware under my desk that I control with open weight models that I can interact with on my terms.
reply
upvoteby polnoner8 hours ago|
parent|
next
[-]
It is certainly not sustainable but that is exactly why I want to use $400-$800 of resources a month for $20 while the deal last.

It is really a once in a lifetime deal.

Once the deal is over the local models will be better than what I am using now anyway and the hardware will be all the better than what I can get now for the price.

reply
upvoteby htrp16 hours ago|
parent|
prev|
next
[-]
yes, you have to unfortunately adopt a 2025 mindset when working with smaller local models because that's where they are compared to the frontier.
reply
upvoteby julianlam16 hours ago|
parent|
prev|
[-]
> local models are close to the point where, with a sufficiently well-architected harness, you can get results that are on par with the experience you'd have with cloud inference

In my opinion, 98% of the work most devs would send to an AI can be capably achieved with a local model and a frontier-level model is overkill.

The goalpost moving feeds right into Anthropic and OpenAI's interests.

reply
upvoteby apparent12 hours ago|
prev|
next
[-]
> AI subscriptions are too highly subsidized right now

I've been running into annoying limits with Claude recently. It gives me like 5 questions over the course of 15 mins and then tells me to wait 5 hours. When companies can change things up to make the base subscription nearly useless (the last question always gets messed up, too), then you realize the value of owning your own infrastructure.

reply
upvoteby adastra2212 hours ago|
parent|
[-]
On the $200/mo plan I have never hit a five hour limit, and I struggle to use my full credits each week.

$200/month is vastly cheaper than owning and operating comparable hardware.

reply
upvoteby apparent11 hours ago|
parent|
next
[-]
You're right that $200/mo is much cheaper than comparable infrastructure. OTOH, you don't get to have a computer that can also be used for other applications, or which works when the internet is down. Also, you remain tethered to whatever pricing the AI companies want to charge. If AI pricing goes like Uber/Lyft did when the VC cash ran out, then we'll be paying much more in a few years' time. We could look back and think "I wish I'd bought my own setup back in 2026" if it's going to be inevitable.

And all this before you get into privacy/security/compliance stuff.

reply
upvoteby wolvoleo6 hours ago|
parent|
[-]
Ohhh trust me we're going to pay a hell of a lot more. It'll be nothing like Uber's VC running out. Someone has to be make back all those trillions.

What we're paying now is just akin to the drug dealer's free starting shot.

reply
upvoteby 0x45711 hours ago|
parent|
prev|
next
[-]
> On the $200/mo plan I have never hit a five hour limit, and I struggle to use my full credits each week.

I started tasking fable with huge projects over the weekend and now I hit at very least fable limit by monday.

reply
upvoteby anslopic7 hours ago|
parent|
[-]
[flagged]
reply
upvoteby limewedge7 hours ago|
parent|
prev|
next
[-]
[dead]
reply
upvoteby wolvoleo6 hours ago|
parent|
[-]
Well it's not just text to text. It's text to code, text to images, research. For me 200 is too much but my 20€ sub yeah I do find that worth it.

If I actually made money with it (I don't and I don't want to) the 200 one probably would start making sense. If I were using it all day I'm sure it would save me more than that 200 by simply being able to do more work.

reply
upvoteby anslopic4 hours ago|
parent|
[-]
[dead]
reply
upvoteby anslopic7 hours ago|
parent|
prev|
[-]
[flagged]
reply
upvoteby 16 hours ago|
prev|
[-]
deleted
reply