One problem is that such information can be useful for non surveillance purposes, for example: how they knew certain roads were congested before GPS was the mobile networks. I personally do not see anything nefarious about this, nor would I necessarily wish to see this kind of information as uncollectable. Such things are different from tracking specific individuals, yes, but it's not that different. It then becomes a matter of what, how much, and for what purposes the information can be collected, which can be somewhat moot since the government in all likelihood will give themselves an opt out anyway.

None of this is to say that we shouldn't try, or that it's futile, but rather that it's a daunting task: the only way to really defeat this is to not only regulate private entities but also the government itself. And the only way to do that is to make such surveillance political suicide. And the only way to do that is to get the people to care about privacy. Here in the UK, the public has more or less come to accept CCTV cameras being everywhere, with the government now introducing AI face-scanning cameras, which has not been met with much public resistance. And so I do have to echo what @everdrive said: "We've done this to ourselves". Whether it's about convenience or apathy or whatever, we've had the means to object to this and we haven't.