12 ms·
32 bits vs 4 bits it looks like
by 0-_-0 3mo ago
32 bits vs 4 bits it looks like
- mxfeinberg 3mo agoYup, and unlike the original turboquant paper, my implementation is pinned to using a 4 bit code book so I could use SIMD kernels for performance.