Deepseek’s R1 paper was the first paper to describe how to do it. O1 was released before R1 came out.
replyA month before the R1 paper came out, they released the Deepseek math paper which described their method for MoE load balancing.
A month before the R1 paper came out, they released the Deepseek math paper which described their method for MoE load balancing.