the theory being, at constant velocity in a straight line, your body feels at rest, so you want to look somewhere that reinforces that. looking out the side window has scenery rushing past, which is the opposite.
turning sideways and reading sounds like a nightmare.