As a bonus you can even set your general location on the mirror for extra accuracy, since the earth's magnetic line directions differ a bit based on location.
But in any case, I found that if you want to remember routes, it is far better to study the route before you begin driving, and then not rely on CarPlay altogether. This gives you much higher awareness of street names and directions.