4 ms·
That’s only for a 70B param LLM. The one he includes is 15M params and weighs about 60MB. Not tiny, but doable.
by codezero 2y ago
That’s only for a 70B param LLM. The one he includes is 15M params and weighs about 60MB. Not tiny, but doable.
- bandrami 2y agoThat's smaller than Noto