This is true for finite sets. For infinite sets, the Sierpinski triangle is a counterexample.