5 ms·
Thanks for the quick response and for being willing to update the explainer. I really appreciate the clarification.
by amitport 5mo ago
Thanks for the quick response and for being willing to update the explainer. I really appreciate the clarification.
- 0xA2kag 5mo agoI have added the lineage section in the explainer: https://arkaung.github.io/interactive-turboquant/#lineage https://arkaung.github.io/interactive-turboquant/#lineage
- amitport 5mo agoThanks for that! Note that the residual chain is empirically and theoretically inferior to our unbiased scale; furthermore, it requires an additional bit in certain cases. Additionally, TurboQuant was not the first to apply EDEN to KV-cache (see for example https://arxiv.org/abs/2411.17525 https://arxiv.org/abs/2411.17525 from 2024).