I agree with the common trope that open models lag behind by about a year, but something magical happened just around a year ago when the state of the art models became extremely useful. By this reasoning we're about to see open models perform well, but I'm afraid there is more to it than just waiting for another revolution around the sun.
Note, my application is coding assistance. Open models can be great for other purposes.
In latest experiment I used opus for implementation plan then used cursor composer 2.5 for execution.
I must say that combo is really good. Main drawback of claude code is that is super slow. So when paired with composer that is super fast it flies.
Same. It's a nightmare from a Porter's Five Forces perspective.
There will be a ton of businesses competing in this space, and there will be something of a moat due to how capital intensive the business can be, but there will still basically be infinite competitors.
Great for consumers.
Most of the money right now is in coding. Openai and Anthropic just have to be 6 months ahead of SOTA open source models and they'll capture most of the enterprise and dev market
I highly doubt I'll ever use Claude again.
I think you are wrong about Claude being any significant level better
Will this always be true? There will never be an event horizon/point of diminishing returns where something not-bleeding-edge is "good enough" for 51%+ of users?
Unless ofc there was an actual speed difference, only reason I'd be willing to go with a worse model couple of percent worse than current best model is if the speed was at least 5x higher. Looking forward to kimi k2.6 offered publicly by Cerebras
That's fine. Other people may not want to pay 300 more and will rather make do with last year's SOTA.
> For coding you always want to go with the best model
Maybe you meant "For coding I always want to go with the best model"?
Oh, hey, I recognize you. Thank you for the very forward and thorough orbital sander recommendation at Home Depot. That's exactly what I wanted to deal with on my holiday weekend. You just know so much about this and the rest of us are simple passersbys.
And also, people have it wrong… their models are not the main problem anymore. It’s the RAG