Maybe a tug of war between flags and vouches might work like downvotes?