Predatory property taxes were a part of how so many black American farmers lost their land: https://archive.is/exkhR

This is all conceding the argument already. Many of us would happily accept these sorts of limitations on a wealth tax if it means there is a wealth tax.