Which is likely why they are doing it. The City of Huntington Beach had a similar problem: there was simply no room to build additional housing. They sued the state and lost. The law is overreaching, but it's the law.
If the neighbors of these lots care to maintain their vacancy, they ought to do so the more naturally legal way: by collectively buying and owning those lots.