Are you claiming that the majority doesn't live in cities? 80% of the US population lives in urban areas. Self driving cars contribute to the transit problem in those areas because it's even more traffic.
For the 'don't want to live in transit-dense cities like London' crowd, beating the economics of taxis may not be enough since that's not what you're competing with out in the suburbs.
On the other hand, the suburbs don't have much that is even comparable to city taxis in price or availability today, so maybe if it existed that price point would indeed do just as well away from cities too.