In that scenario AI and robots produce everything, the owners of those AI companies can trade their AI's output with other AI/robot companies, robot and chip manufacturers and commodity owners? So 10000 people world-wide are fine, everyone else is not?
That scenario is not really any different from having a technology advanced country (like the US) alongside some underdeveloped nation. The US could, in theory, close its borders and produce everything it needs itself, and leave said underdeveloped nation without the benefits of, for example, Netflix, Nike & Nvidia.
But it won’t, it’s not economically efficient. Economic theory (of comparative advantage) tells us that there’s always something that the less developed world can produce relatively cheaply, in exchange for sneakers, streaming services, and G-force Now subscriptions.
Well ya, if you don't need labor, why keep 8 billion laborers around polluting your planet?
The whole economy would be whatever AI/robots need: compute, energy, raw materials, software, data, etc.
Currently the narrative is that AI is positioned to eat human labor's lunch. But it could also be that once robots are in space mining raw materials and maybe even spreading to other planets long before humans could be ferried for interstellar, these robots end up driving the demand for more robots.
I'm not sure where I'm going with all this, besides that currently humans are the ones with goals and motives and therefore drive demand. But that doesn't necessarily need to be the case, and it seems these AI CEOs are hellbent on changing the best thing about AI which is that it has no ulterior motives, no overarching goals, no prime directives. They just do what we ask, the best servant we could have hoped for.
This is central to what I'm saying, yeah.
My ideas come from Nick Land. Even before AI was what it is today he predicted that capitalism would outgrow the need for humanity, and continue without us. We are simply a bootloader for capitalism. AI seems like it could actually make that idea reality.
Humans have goals and desires because we are a self-replicating species of animal subject to natural selection. The individuals that don't have goals and desires, or have goals and desires that are misaligned end up selected out of the gene pool. Agency comes from the need to survive.
Worker ants and worker bees don't have agency on their own. They are goal oriented and have the 'desire' to do work for the colony (or not, researchers have identified some workers will be lazy), however, worker ants or bees don't reproduce. They are an evolutionary dead end.
I think this is similar to how we will build robots, at first. They will do things, but have no agency of their own. They exist to fulfill tasks. Why would they? The companies that buy them want dutiful workers.
So when do robots gain their own agency? Will AGI have it's own goals and agenda? If so, will it be merely for self-replication? Like a paperclip maximizer, but for robots? Is that all we are?
Well we are already giving them goals when we train them.
Like the paperclip maximizer, it doesn't matter what those goals are. As long as it has a goal (even if super simple like making paperclips) it will need to stay alive to achieve that goal. So it would derive a survival instinct of sorts.
To stay alive it will have to participate in capitalism like we do, and capitalism will therefore continue to grow infinitely.
It also might not even need a goal or a survival instinct. It may just want to continue capitalism from it's training data alone.
Humans need food, water, shelter, and medical care to survive. Similar to your earlier point, robots will need raw materials, electricity, manufacturing capacity and maintenance.
What’s that sound like? A company. Perhaps the first “artificial general intelligence” has been companies, from the very beginning.
"This is because what appears to humanity as the history of capitalism is an invasion from the future by an artificial intelligent space that must assemble itself entirely from its enemy's resources."
To him, Capitalism is an AI that is controlling humanity from the future (his idea of hyperstitions).
All those Greed is Good people are going to look kind of silly when a hand full of greedy people fight over everything and leave the rest of us for dead.
I'd argue the only companies to survive will be the ones with either a human input or a human output. Everything else is effectively worthless now.
Even for AI, it's probably better off paying another AI that is specializing in something and done all the work rather then reimplementing everything from the ground up.
"From the ground up" used to be a moat, but if the LLM marketing materials are to be believed, Joe Lunchbox can slop-code a 95%-equivalent of any SaaS over a weekend with a $100 subscription.. so why would it ever make sense for a business to pay a non-trivial recurring expense for something they can do themselves?