Experts aren't trained on separate tasks. More recent routers are designed to spread out requests even more evenly, and they were already pretty even.

Yes. It's called REAP and from what I've seen, results aren't stellar.

Glazing over a lot, that's how they work already, just not in the way you think. A relatively small fraction of the model is active at any given time