5 ms·
From what I remember, these chips are not mobile size yet
by superb_dev 1mo ago
From what I remember, these chips are not mobile size yet
- bradfa 1mo agoA small model would be. I think that’s more the point. It’s definitely not SOTA but it’s fast and energy efficient and local.
- mdp2021 1mo ago> A small model would be [mobile size] A ~30mm side for the HC1 tech for an 8b model (still unclear the planned HC2)?
- teaearlgraycold 1mo agoIs that analogue or are they baking floating points into the silicon?
- AlotOfReading 1mo agoIt's entirely possible they're using something like block floating point, where most of the hardware is simply fixed point. AMD's NPU does this, for example.
- wmf 1mo agoNope, a small model would be larger than the whole iPhone SoC.