But it's so inefficient to run AI everywhere all the time for everything.

In all likelihood, AI enabled this to happen in the first place.