Time has stopped being an astronomical fact, and is a social contract nowadays. It's possible that you can afford to opt out of that contract, but most people can't.
Instead, the public discourse centers around which minority can force the majority to follow their preferred terms in the social contract. At best, it's a zero sum game - most likely, it's a net loss for everyone if we include all externalities, especially the suppression of discussions about more individuality.
(*) DST is not a social contract, it's entirely made up by the law.
There's wanting to work a bit earlier or a bit later than everyone around you but there's a limit to how out-of-sync you can get.
The modern society started with the Industrial Revolution, when the people understood that there are some very tangible benefits when everyone starts working at the same hour, and started building around that. This building included discarding "local time" (an astronomical fact) in favour of standard time (social contract.)