5 ms·
I don't think so. The new ISA that is in the SPR is mostly about deep learning: it supports int8 and bfloat16 (https://fuse.wikichip.org/news/3600/the-x86-advan
by kolbusa 5y ago
I don't think so. The new ISA that is in the SPR is mostly about deep learning: it supports int8 and bfloat16 (https://fuse.wikichip.org/news/3600/the-x86-advanced-matrix-extension-amx-brings-matrix-operations-to-debut-with-sapphire-rapids/ https://fuse.wikichip.org/news/3600/the-x86-advanced-matrix-...). You can emulate higher precision using bfloat16 (https://arxiv.org/abs/1904.06376 https://arxiv.org/abs/1904.06376), but I have not seen this used in the wild.
- freemint 5y agoYou know about surrogate models being run in simulations (physics informed neural network and all that stuff) the US is investing a lot in this. Maybe then it makes sense why bfloat16 exist in SPR.