9 ms·
Deepseek v3.2 is that cheap because its attention mechanism is ridiculously efficient.
by aimanbenbaha 9mo ago
Deepseek v3.2 is that cheap because its attention mechanism is ridiculously efficient.
- esafak 9mo agoYeah, DeepSeek Sparse Attention. Section 2: https://arxiv.org/abs/2512.02556 https://arxiv.org/abs/2512.02556