6 ms·

Fireworks has been working on porting the Kimi Delta Attention (KDA) hybrid linear attention mechanism to their hosting infrastructure https://x.com/FireworksA

by Maxious 2mo ago

Fireworks has been working on porting the Kimi Delta Attention (KDA) hybrid linear attention mechanism to their hosting infrastructure https://x.com/FireworksAI_HQ/status/2079776331609584005 https://x.com/FireworksAI_HQ/status/2079776331609584005