Having all countries open the borders to anyone (ignoring security risks for the sake of the argument) would mean all poor people would emigrate to rich countries and strain the economy, while their home country would collapse from lack of workforce.