How do you "force" people out? The existing owners have to sell land, and once they do the new owners have as much right to decide as the other residents. Are there thugs going door to door forcing sellers to sign papers?
Allowing higher density construction doesn't mean higher density must get built there. That's still up to the property owner to decide. True freedom.
And the occasional eminent domain.