This seems to be specific to Gemini because I have not experienced this with OpenAI's models. In fact, Codex now has a feature such that the model can ask a question and continue making progress on work that is not blocked while waiting on your answer.
I wasn't benchmarking or anything rigorous, but I noticed it with GLM 5.3 Flash. It was downloading and installing stuff to my computer, and constantly trying to work around websites' bot prevention measures. I stopped it often.