Typically people don’t use 1:1 movement when using something like this. It’s a much higher ratio so you only have to slightly move your head to look around. It allows you to do it quicker but also avoids exactly what you’re describing.
Not necessarily if you've got a curved ultra-wide display. Combine this with some rotation factor and you can look around while still looking at the screen.