And yet, sim players are using it. Players want to use small headmovements to simulate large head movements ingame. It seems to work.
The other problem is that I have a fancy throttle and stick with lots of extra buttons and switches. I know common functions by touch but if I wanna toggle exterior lights or something I have to look down and find a label.
For me choosing a screen + head tracking vs VR is like choosing to use speakers instead of headphones. The headphones sound way nicer and give much more immersive soundscapes but sometimes you want to have some tunes going and not have your ears get sweaty.