You lose more evolved vocabulary and formal grammatical structures, but you gain a liveliness and a colloquial dexterity that bookish people often lack.
You can also be more inventive in your metaphors and figures of speech, instead of relying on the usual stock cliches - something often seen in oral interviews with illiterate folk.
In the case of music, you virtually always only hear the music, and the written down form is just a formalisation of said music.
In the case of language, a vast corpus of information (the majority of it) is available only in written form, with only recent proliferation of recorded audiobooks.
Additionally written text is a separate form of language with its own beauty and particularity, while in the case of music notation it is just an imperfect way of making notes of music. So many of the parts and details which make music beautiful are absent from the vast majority of partitures.