7 ms·
Tesla Patent Don't multiply, add. It saves time and energy
Tesla has filed a patent "High Precision Complex Number Based Rotary Positional Encoding Calculation On 8-Bit Compute Hardware"
(US20260017019)
There are several ideas in the patent but it appears that this work will be available in the latest AI5 chip.
A good introduction is https://www.youtube.com/watch?v=GG9yOsPEGek
One of the key ideas is to use logarithms and addition rather than multiplication. Faster and less power needed.
NVIDIA is going to hurt from this.
- IsTom 8mo agoSo, they invented the slide rule?
- beardyw 8mo agoNo, slide rules are more efficient.
- ReptileMan 8mo agoMy mother has used such manually operating machine in the late 60s. It was called the slide ruler or something.
- defrost 8mo agoMine also. Truly what goes around, comes around: https://www.instructables.com/Circular-Slide-Rule/ https://www.instructables.com/Circular-Slide-Rule/
- Someone 8mo agohttps://patentscope.wipo.int/search/en/detail.jsf?docId=US471307204&_cid=P11-MKJASB-71422-1 https://patentscope.wipo.int/search/en/detail.jsf?docId=US47... doesn’t mention “8-bit” at all, so why did they put “on 8-bit Compute hardware” in the title? Seems it could at least slightly open up the world for doing it on 9-bit Compute hardware or (partially) in software, for example.