Eh I don't know, I care whether it gets the job done and I can see the difference when I review the code, not how well it needs to explain the code to me, I can just read it myself.
replyIs that what it feels like when the models get smarter than us?
replyNo the models are just ass at communication without being directed.
replyTry asking them to make useful diagrams for some stuff in a codebase, out of the box without excessive hand holding they don't make good choices about what's worth communicating and how to do it.
You see this in their pointless frontend copy all the time too.
A smarter model would know how to communicate with you correctly, and not just throw jargon it has just invented at you without explaining it.
replyBut if you have two experts in a field talking to each other you wouldn't expect them to dumb down their communication.
replys/model/engineer
reply"There is a view in some philosophical circles that anything that can be understood by people who have not studied philosophy is not profound enough to be worth saying. To the contrary, I suspect that whatever cannot be said clearly is probably not being thought clearly either."
replyGuess that's the exact point of the "intelligence" benchmarks
replyNo, a smart model should also give a concise executive summary, "brevity is the soul of wit".
replySo, in short, once models get smart enough they stop bothering telling us what they did.
replyYeah, makes sense. A parent wouldn't bother explaining the details of their job to a toddler.
Which would be fine, but the parents also just smeared tomato sauce over the walls too, so let’s not get too ahead of ourselves.
replyGPT 5.6 has similar language quirks that makes its comments nearly unusable.
replyI wonder if this is a side effect of MoE models — they can write excellent prose, but not simultaneously with writing code.
Damn I thought it was my extra instructions, I swear everything it writes is in some shorthand with direct references to variables that literally nobody could figure out unless you literally just wrote that code 5 minutes ago. I had it stop writing comments altogether cause it was always four lines of complete and utter nonsense, and it doesn't even obey that rule half the time. Despite doing an extensive back and forth to make a complete plan, 5 seconds into the implementation it changes its mind and makes another assumption, adding some extra thing that tends to break the entire approach and needs follow-ups to repair or cleanup. Instruction following is basically non-existent compared to Fable, it just does whatever the fuck it wants.
replyEverything is load-bearing with 3 measured blockers.
replyDon’t forget the smoking guns! I think these new models have been reading too many Agatha Christie novels.
reply