If the amount of individuals in your sample is large enough, it shouldn't be the case.

Relevant XKCD: 882

But that's why you do multiple testing correction