upvote
The benefit is that you can take input in one "mode" and extract output in another; that is, the input is audio mode and the output is text mode. The intermediate representation is the "embedding".
reply
Multimodality seems to just help with everything
reply
Correctly transcribing requires context too, no?
reply
I suppose it depends on the words in question... language knowledge and general world knowledge may not always both be necessary to transcribe accurately.
reply