But if you say “but what if you don’t know” then it’s the same as if literally anyone else at the company is needed at the second half of a meeting: you say “let’s loop in mrhottakes, this seems like it’s his expertise” and you get looped in.
Preemptively adding every single person on the off chance they may be needed can lead to madness: at the limit you may as well add the whole company to the invite. After all, what if they’re needed at some point? It’s extremely wasteful. Multiply the number of people by their hourly salary: that’s how much a hour meeting “costs”. Don’t be wasteful.