6 ms·
What's the difference? They are both called Kimi Delta Attention.
by GaggiX 2mo ago
What's the difference? They are both called Kimi Delta Attention.
- yorwba 2mo agoThe differences are explained in section 2.1.1 of the Kimi K3 technical report: https://arxiv.org/pdf/2607.24653#page=4 https://arxiv.org/pdf/2607.24653#page=4