Whats right with it?

Its slow, large, excessively complex and not that resilient to failure.

You either want a bunch of NFS machines backed on to ZFS on nvme, with a central jumping off point that allows sharding (this is critical to allow one or more NFS server to fuck up and not kill access to everything else.)

Or, pay the money and use GPFS