upvote
We're going to the same direction in my company, AI produces and AI reviews it which I feel is kind of like shaking your own hand.

For now there's still human reviews but soon it will be all automated. I estimate that the AI review (latest Opus) is around 15% to 20% accurate

reply
I'm still holding down keeping a human in the mix where I'm at now but it's a tough battle. Other problem with AI review is it will try to find issues that are not issues and you can get in this loop of an agent fixing something, triggering another review, fixing those findings and basically going in a circle. Has happened multiple times now which ends up with a massively overbuilt task that would have taken a human a few minutes to just do to begin with.
reply
Yes indeed, we have the same problem. You can run these agents 10 times and 10 times they will find different issues. It makes me trust the AI reviews even less, is the new feedback accurate if the previous one didn't catch it?
reply