It is, but if you send more efficient deltas, batch packets more intelligently, and introduce non-blocking UI tricks, the experience can be improved by quite a bit. mosh demonstrates some of that.

this is a solved problem with mosh