"Nobody" puts down 20%. That hasn't been a requirement for decades (in the US).

And there are plenty of places in the US where you can buy a house for $150-$200k. Maybe not places you want to live for one reason or another, but they're there.

Well a substantial proportion of home buyers in Canada put down only the minimum 5% down payment.