The cost isnt zero, previously you were exercising your brain and spatial awareness, you've now offloaded that critical thinking. Repeat this often enough in all areas of your life and you'll start to see impacts down the line on brain and memory function.
Taxi/ambulance drivers who are required to memorise large parts of their city have the lowest dementia risk out of all (studied) professions.