upvote
The reality is most people building their own models and providing that alongside SOTA ones don't really care about how great these models are. They just prove that 'hey we are smart enough to build our own models so you can trust us instead of going with a single provider like Claude via Claude Code', also a cheap alternative for cost sensitive/free users - at least this was the case for Windsurf, not sure if Devin Desktop still has that tier. They just need to hillclimb the benchmarks and show something reasonable enough there.
reply
Benchmarks are just vibes with error bars... wake me up when it survives a week on a real codebase without hallucinating a package that doesn't exist.
reply
Funny, the cheerleading at HN for leading Chinese models, but a non Chinese lab (building on top of a Chinese model) gets dissed here.
reply
It's simple: close weights = not welcome.
reply
It's almost as if HN users aren't all the same.
reply
all the open source models are a waste of time relative to the bleeding edge from openai/anthropic
reply
At work I wouldn't want to use anything else. Compared to my salary a Claude subscription (or two) is cheap

For hobby projects I've completely switched to DeepSeek v4 pro. I spend less than on a $10 Claude plan and am not subjected to quota limits (when I have time and motivation, the last thing I want is a 5 hour quota running out). And the difference in model performance is fine for those smaller projects, most of which will end up abandoned or in a state of "good enough" anyways

And for utility tasks, those 30b models are also great. I'm a big fan of gemma4

reply
ive just got better things to do with my life than fuss with an inferior model. its like why hire a dumb employee over a smart one
reply
I think you misspelled "I've got plenty of money".
reply
200 bucks a month?
reply
Is a lot of money. The majority of people here aren't willing to spend $200/mo for coding unless their little projects provide a comparable value back to them.

For context, I'm paying under $30/year and get GLM-5.2. An extra $2300/year isn't going to get me much better outcomes.

reply
it seems cheap for what is borderline AGI
reply
The point is that the less capable models are also borderline AGI. You're paying 10-100x more to get a few percentage points improvement in performance.

Put another way, what I get for my under $3/mo is better than what you were getting 3-5 months ago paying $200/mo. So you're paying a lot just to be ahead by a few paltry months.

reply
Not true since a few months, genuinely try GLM 5.2 and Minimax M3, especially in adversarial/gating... as a general model, I can agree, but as a coding model, they are not bad, comparable to maybe Opus 4.5 in real usage which is quite impressive.
reply
I use GLM or DS4 to help me draft a better initial prompt with more information that I then give to Sonnet 5/Fable/GPT5.5. While benchmarks show the open models close to frontier level, my experience with them is drastically different. I have high confidence that Fable or GPT will 1 shot solutions.

At least with low level programming languages. They're all very good for webdev stuff.

reply
yeah but why waste your time on these models, just use the one that gets the better results
reply
I actively prefer GLM-5.2 for some tasks. For simple tasks the results are just as good as e.g. Opus, and it produces results significantly faster.
reply
Because you can get them from more trustworthy providers or with hardware encryption.
reply
i trust anthropic/openai with my data far more than some random startup.
reply
I was going to respond until I saw your account name lol.
reply
haha i outsource my thinking to the smartest model
reply