You're absolutely right - filler words are genuinely load-bearing

At 1500 tps, "uh" is about 0.7 ms, instead of 200-300 ms for a human.