The easiest place in France I've traveled as an English speaker was Nice. They all speak English well and don't seem to care if you don't speak French.
It seems the fact I knew some paltry french and I was trying was enough. A strange but nice experience.
How they keep their English speaking "in shape" then?
> and "shortcuts" for pointing/hand-waving through what you want
To expand on this idea, there are books designed specifically for travels which are pocket sized and contain a bunch of images so you can point at what you want.