How would an LLM know not to take that road then?

If your answer is you tell it, then the obvious solution to improve the app is to provide a way of specifying a road exclusion list, and that is extremely feasible.

So it's wrong about the fastest route. Fix that instead of inventing a new type of app.