upvote
> If it is so critical, why don't we have tests and benchmarks for it?

Thats a fair point, but Ive seen LLMs modify the surrounding environment to “pass the test”

A human still has to be responsible at some point.

reply
Good thing you reviewed the PR so you could catch the gap in Greg’s documentation and force him to write it before approving his PR!
reply
> Your best coder is now Opus or Astra

No, that's our _fastest_ coder, which is a different thing than _best_

reply