EDIT: Maybe I completely forgot how Teamspeak works. It seems like there is a global friends list, but I can't remember that it was a thing back in the day (10+ years ago).
And that is what Discord alternatives will have to solve - the ease of setting up a new Discord "server" by any old random user is hard to beat in terms of convenience. Matrix is the only real alternative on that front.
However, if you have an established community and have at least a little hosting knowledge among the staff, the moat is shallow to nonexistent, and it's just a matter of how much of a pain in the neck Discord decides to be.
tl;dr Discord has a moat, but it's not very wide or deep.
Migrating all of that stuff to a new service (which may not even support it all) would be a huge pain.