But I don't know why I'd pick Swift on the server when Rust is better in almost every dimension, with a thriving and more community-driven ecosystem.
Thats the problem.
I assume the server side usage is not zero, but not enough to reach a critical mass, you're probably right there.