Making eye contact and waiting for a vehicle to actually respond to the conditions at hand will eliminate the vast majority of "assumed" mistakes. Trying to be 100% aware of traffic and understanding that folks can be even bigger aggressive idiots is also part of it, but not perfect.
You just have to accept that in some rare instances the swiss cheese holes will line up regardless of what you do. And be at peace with it.
I suppose since this seems to logical and "not a big deal" to me means that I am extreme outlier on the subject.