Having AI "do the task directly" sounds just as miserable as anything else people keep insisting is the future. We can't rely on probabilistic methods. We will still need humans in the loop to pin down the deterministic parts and also the parts we intended (often the same, but not always).
What else did you have in mind?
If AI keeps getting better, then it is inevitable that voice conversations will become the dominant way in which mostbpeople use most computers for most tasks most of the time. It's just part of human nature and there's no way around it. The only way this doesn't happen is if AI never becomes good enough to support it.
Personally, I'm not a fan of voice input. But I want AI to get better. And the future where voice conversations work well enough to be used as the main HCI method is inevitably also the future where voice conversations are used as the main HCI method by most people. I'm hopeful for technological progress, that's all. It's just that you cannot have this progress but not have people take advantage of it in this exact way.
Compare it to the future where most people vibe code their own apps, which has zero chance of happening no matter how good AI gets.