Dense models run at a very usable speed (Qwen 3.6 was running at ~50t/s last I looked) on my dual 7900 XTX desktop. (And before anyone brings it up, I did not buy them for this purpose, so the up-front cost is irrelevant in my case.)

3090/4090 probably would do 40 t/s, for 5090 75 t/s is shown in the blog.

The benchmark comparison is against the dense variants not MoE