My brother had a neighbour build a crematorium next door in NZ; not an industrial or rural area, just the suburbs, no permits, no consultation, no notification. Very entrepreneurial. They got shut down but the flip side of "you can just do things" is surprises like a plume of smoke and the smell of burning corpses when you step outside.
It might be a bit Harder, but business is difficult.
So anyone who just goes “grr, regulation bad”, I can’t take seriously. If you have specific examples of regulations that are objectively bad, and should be removed, that’s fine, but the examples you cited protect something else, and ignoring that is intellectually dishonest at best, and blatantly partisan at worst.