If you copy the clang binary to a random place in your filesystem, it will fail to compile programs that include standard headers.
Yes, that is the case for pretty much every compiler. I suppose you could build the headers into the binary, but nobody does that.