But the thing for your manager is, if you leave because he didn't handle this, that will also reflect badly on him. And it sounds like leaving because of this is a real option for you. You wouldn't just be saying it to blackmail your manager - you're really thinking that you may have to leave because of this.