upvote
Right now, all top tier LLMs are as eager, bright 20ish year old interns.

Very gung ho, full of energy, loads of book learning, no real world experience or understanding of why things are as they are.

Leave them to their own devices at your peril. Trust nothing they do.

Yet directly guide them, monitor everything they do, some value emerges.

reply
I sure hope they stop training them to be spaghetti throwers, please stop and ask questions when there is ambiguity
reply
Have you used a frontier model since 2025? You are underplaying their strength.
reply
Kroah-Hartmann has used the closed frontier++ model, and it made up 37 out of 76 vulnerabilities.
reply
And the bugs that actually were real rely on a setup so contrived it’s unlikely anyone in the world is impacted.

It’s still good that some real bugs are being patched but what is being reported to the media is so overblown.

reply
Okay so now they're like a top percentile fresh grad on meth. Still a lack of real world experience plus some bizarre failures that illustrate gaping holes in the mental model. Does that description work for you?
reply
Well, so basically supercharged fresh grad. CS/math implied.

In human terms, that's already at least a standard deviation above average person.

reply
Before:

There is a vulnerability in library X when you call Y with these specially crafted parameters; as seen in the attached logs it can overflow buffer Z and clobber memory potentially leading to an RCE.

After:

Honest take: the load-bearing constraint violation is real. The log documenting the exploit gate is the ledger which weaves the story.

reply