It's not the same KDA as used in Kimi Linear, though.
replyWhat's the difference? They are both called Kimi Delta Attention.
replyThe differences are explained in section 2.1.1 of the Kimi K3 technical report: https://arxiv.org/pdf/2607.24653#page=4
reply