upvote
It is certainly not sustainable but that is exactly why I want to use $400-$800 of resources a month for $20 while the deal last.

It is really a once in a lifetime deal.

Once the deal is over the local models will be better than what I am using now anyway and the hardware will be all the better than what I can get now for the price.

reply
yes, you have to unfortunately adopt a 2025 mindset when working with smaller local models because that's where they are compared to the frontier.
reply
> local models are close to the point where, with a sufficiently well-architected harness, you can get results that are on par with the experience you'd have with cloud inference

In my opinion, 98% of the work most devs would send to an AI can be capably achieved with a local model and a frontier-level model is overkill.

The goalpost moving feeds right into Anthropic and OpenAI's interests.

reply