8 ms·
This IBM Research looks very promising: https://research.ibm.com/blog/northpole-llm-inference-results https://research.ibm.com/blog/northpole-llm-inference-resu
by softwarewright 9d ago
This IBM Research looks very promising: https://research.ibm.com/blog/northpole-llm-inference-results https://research.ibm.com/blog/northpole-llm-inference-result...
which I found after watching this video: https://www.youtube.com/watch?v=G4nEpY1LYzM https://www.youtube.com/watch?v=G4nEpY1LYzM - The AI Chip With No Ram (and still 22x Faster)