I could never get very far in GTA 3 or Vice City because of the controls. I tried when they came out and I think I tried again later.
It wasn’t looking around, that was never a problem. The shooting controls were abysmal. If I ended up in a fight with more than one person I was pretty much guaranteed to die.
GTA 4 was the first of the main line series where the controls were good enough for me to enjoy the whole game.