5 ms·Very cool idea. Can't wait for converted models on HF.by olq_plo 1y agoVery cool idea. Can't wait for converted models on HF.MichaelMoser123 1y agodeepseek-v2,v3,r1 are all using multi-headed attention.