Why would you own them, instead of some well capitalized billionaire?
To the extent that you do have capital, why do you assume that your 'minimal direction and guidance' would outcompete a full time specialist working for that billionaire?
And in this world of abundant agents, what advantage does the billionaire have exactly over the non-billionaire? Their employees are less motivated than owner-operators, and they no longer have the scale advantage that large corporations used to have. Each individual can effectively operate like a large corporation, because each individual can have their own large synthetic workforce at very low cost. The scarce resource here then becomes uniquely human insights and real motivation, which entrepreneurs are always going to have more of than employees.
One would assume the difficulty of building housing has gone down with the general progress of technology - and if all else fails, you can just do what they did 50, 100 years ago where affordability was far less a struggle - people, who had less income in real terms spent proportionally less on it.
So did society devolve that an unit of industrial output has become more expensive? Or did money and resources just go into a parallel 'rich people economy', that has created a constant drain on the resources of average people?
I'm not sure if this addresses the point you're trying to make though. If not, please clarify your argument for me.