What I described is essentially how the vast majority of E2EE messaging platforms work. And I say that having worked for one of them.