Sure, but 1) there's still an amazing amount of life when you look up close and 2) desert ecosystems are more fragile than grasslands. Grass grows "like weeds" because that's exactly what it is. There's no risk of running out of grassland.
The big problem putting solar panels over grass is that it dries out in the summer. Inevitable grass fires will damage your panels. Grazing helps with that. Or you can mow.