A decade of consulting had me always ready to wrap my engagement at the end of any day, and (for better and worse) I carried this with me to future jobs. I always miss (at least some of) the people, but never the situation when it turns sour and I leave. The good news: you often get a chance to work with the good ones again (even if that's because you entice them away to your next gig).
^1 https://archive.org/details/ifthisisntnicewh0000vonn/mode/2u...