I never let it go into planning mode, other than to output a plan file that I can audit before giving it the go-ahead to implement. After that I don't want to be bothered, so --dangerously-skip-permissions keeps all but real questions out of the loop, and I can do something else while it works rather than babysit.
This is my impression too. Whenever it needs permissions outside of a small set of defaults I've allowed, it's often because it's trying to do something ridiculous that it doesn't need to do.
I think the yoloist counter-argument is "So what? Let it. It'll take longer that way and consume more tokens, but you can work on something else in parallel instead of being hooked in to this one session".