I don't trust agents writing specs without human approval.
replyI've been bitten by agent-written ADRs. Agents carelessly add extrapolated details and speculated nice-to-haves that I never asked for, and this becomes a source of bloat that keeps coming back like a boomerang.
I’ve found that Agents cannot differentiate between a general principle or abstraction to be followed vs a one-off code review comment that’s applicable only to a single PR.
replyLack of this capability makes automated principles or patterns update a recipe for more bloat.
Perhaps this is precisely the type of work product that humans should produce instead of LLMs. Humans are the ones making these decisions, after all.
replyOf course I meant you review the docs the agent writes (as well as everything else the agent writes)
replyThere is a hierarchical distillation of understanding in human processes that agentic processes do not yet execute.
replyThere are some systems that do that, but I don't know how effective they are. I've been meaning to evaluate AWS AgentCore Memory which has strategies you can apply for reconciling and organizing memories.
reply