points
Most regular people can only visit Japan for 3 months out of the year. Even if you buy a home you can't get a visa just for that.
Maybe in your case the visa thing isn't an issue because of your wife but that won't be the case for most people.