upvote
Astra and 5.5 came out in september, so I didn't compare to them I compared to "where the SOTA was less than a year ago".

But ok, let's compare: https://benchlm.ai/compare/gpt-6-astra-vs-qwen3-8-flash-next

Astra's score: 85.8/100

Qwen3.8-flash-next's score: 55.87/100

So there's a ~30 pt difference between them. Let's add 5% more for quantization damage.

My perspective is, yes - that's a huge difference. No - it doesn't matter. Flash-next is above the threshold of useful intelligence. I can ask it to do something and it does it. Sure, it burns some tokens on bad ideas on the way, and sure it can't turn a single paragraph prompt into million dollar business. I don't need or want that - I want something I can ask to refactor a module, and it does it and it doesn't stop until the module compiles and all the tests pass. flash-next does that.

reply
Local models at that scale just aren’t comparable to the frontier. I’m a big DeepSeek glazer but even the gap between full DS 1017 and Opus 5.5 is vast. Local models will never be able to reach that level, there’s real limitations at play. SOTA models are getting bigger and bigger.
reply
>Local models at that scale just aren’t comparable to the frontier.

Don't have to be. They just have to be good enough for the tasks you need.

reply
Local models are useable and practical today. There is very clear diminishing returns from just increasing model size. You say you are a 'deepseek glazer' but the anthropic/openai glazers were saying the local models we have now were literally impossible just a year ago... and it seems the propaganda is still flowing
reply
It’s a $20-100 a month outlay for an otherwise low expense discipline to access the best models available, without any local dev ops requirement or expense. If access ever becomes a problem, the open models are there. That’s a fairly straightforward calculation for a lot of people.
reply
This is a great example of why benchmark racing is useless for LLMs.

I use both models extensively and there is no way I would ever agree that Astra and Qwen3.8-FN are that close in the real world.

I agree with the other comments: These comparisons are silly.

You keep saying that you don’t understand why anyone would have a Claude subscription and reciting ideological reasons not to. I’m assuming this means you don’t use their new models much? That’s the only explanation I can think of for how someone could think that Opus 5.5 or even Sonnet 5.5 and Qwen3.8-FN are close.

I use them both (often Qwen3.8-FN as a subagent) and any claims that they’re actually pretty close read as downright delusional to me.

reply
I don't need or want that

Putting aside the absurd straw man, you’re touching on an important point: these small open weight models are sufficient for how you like to work, but it’s not remotely good enough for how I like to work. Opus 5.5 is barely sufficient for how I like to work (many parallel work streams, as little of me in the loop as possible, etc).

reply
> as little of me in the loop as possible

So not really work, then?

You’re automating yourself out of a job using capital you don’t own, and you think your position will hold? I am skeptical.

reply
> So not really work, then?

I work like the parent poster does. I am working harder than before the AI tools came around. I am just working at a higher level. Not too dissimilar from someone moving from programming in assembly language to significantly higher level language.

> as little of me in the loop as possible

You may be confused about this. If I am running just one loop at a time, you'd be right. What modern tools allow me to do is think more like a supervisor that has dozens of engineering teams available to him. I always have a long list of problems I need to solve. I used to sit with one and bang on it until it would pass acceptance criteria. Sometimes that took months. Now I just farm out each task to an agent orchestrator, provide it details on what I want done, a bit of design and architecture and acceptance criteria. I then step away from it and move to the next agent orchestrator and repeat the process for the next task. I usually have 6 or 7 large tasks being worked on at the same time. This is currently my personal limit. I can't babysit more than that. But as the models and harnesses get better I suspect I will have to do less babysitting and this process will get more autonomous.

It may sound like this process would remove the need for engineers. In my organization it is doing quite the opposite. As the organization figures out that we can do a lot more, we change our plans to build more. A lot more. Building still requires engineers, more than before, for us. But only those who can think like architects and can manage large teams of AI agents and orchestrators that work 24x7.

reply
He's automating you out of a job just as well though, whether you keep yourself in the loop or not.
reply
Haha, yes, it’s not work, just like any EM, tech lead, principal engineer, etc, isn’t doing work either. Everyone knows if you’re not scrutinizing each line of code, it’s not really work.

And I work for myself, so no, not automating myself out of a job.

Although I suppose I’m automating the people I won’t hire now out of a future potential job.

reply
Only if people continue to hire you… or pay for what you make. Hope so for you sake (genuinely!)
reply
I hope so too, but not using the best AI will only put me at a massive disadvantage, and won’t change the macro picture at all.
reply
> I can ask it to do something and it does it.

I run my own local models, and I can tell that yes, one ask and they do... with many more errors, and much much slower, compared to the lowest levels of frontier models.

Sure, if one has no standards at all, local LLMs definitely are "above the threshold of useful intelligence".

reply
Assuming that you need frontier models like Opus or Astra for every use case that you'd throw at an LLM is also silly
reply
For programming, I care about correctness and intelligent/robust design at the expense of all else

I'd rather wait all day for an impeccable implementation of a single feature than get 10 features worth of "okayish" code

reply
Ok, but as parent said, not every use case is programming. If I want a model to extract or guess column's units from CSV header names plus the column's first 5 values, I don't need Opus 5.5, do I?
reply
You have the harness pick the appropriate model for the appropriate task. Most high level software development projects can be broken down into tasks, many which do not need the smartest model.
reply