I mean, if I could live at my current level (middle class) without working, I would gladly do so, and let others also live at the same level, anywhere in the world, freely (if it was in my power). I do give to charity, always have, but, the crazier things get, the less secure I feel in giving $$ away.

Even replicators need feedstock - people who own the rocks or sand or whatever feeds them will start charging an arm and a leg. Sure, I could feed it dirt and rocks from my own property, but only for so long before I'm undermining the foundation of my own house. To say nothing of people who live in apartments.

And then, if everyone has equal $$, how do you decide who gets to live in the better locations / nicer housing?

Solving unlimited power before solving unlimited greed invites unlimited tragedy.