There are currently around 10 openly transgender women in the NCAA.
Small numbers either way.
I mean the word freak in the most loving and caring way possible, mind you.
What does fairness mean in that context?
Also, there are a significant number of these sorts of arguments in high-level sports, probably precisely because these "0.1%" cases are exactly the ones that result in exceptional ability relative to norms. It's also curious that there is such obsession about naturally occurring genetic outliers with respect to females or gender but absolute silence about naturally occurring genetic outliers among men unrelated to gender. And surprise surprise the top athletes often have such outlier genetics!
If you're drawing a distinction between natural genetic difference related to only gender and no other factors then sadly it's exactly a culture war, not a war based in science or fairness.