5 ms·
This is Amazing and a game changer. Millions were spent during NLP era to achieve even <50% what this model offers. Now this on a CPU is next level. When algor
by namegulf 2mo ago
This is Amazing and a game changer. Millions were spent during NLP era to achieve even <50% what this model offers.
Now this on a CPU is next level. When algorithms perform well on commodity hardware, the scale tips.
This gives hope that CPULLM's are not far off that'll be just fine for majority of use cases.
- namegulf 2mo agoJust ran on Podman on a older hardware with intel CPU processor and ubuntu linux. When given a large text, it nicely chunked them up (debug statements showed), generated the audio and played back nicely. Well done!