5 ms·
5 years? 5 years is a millennia these days. We’ll have small local models beating gpt-4/Claude opus in 2024. We already have sub 100b models trading blows with
by Deverauxi 2y ago
5 years? 5 years is a millennia these days.
We’ll have small local models beating gpt-4/Claude opus in 2024. We already have sub 100b models trading blows with former gpt-4 models, and the future is racing toward us. All these little breakthroughs are piling up.
- refulgentis 2y agoAbsolutely not on the first one. Not even close.
- ashirviskas 2y agoWhy not? There's still 7 months left for breakthroughs.
- refulgentis 2y agoSmall leaves wiggle room, but it's extremely unlikely trad small, <= 7B, will get there this year even on these evals. UX matching is a whole different matter and needs a lot of work: Worked heavily with Llama 8B over last days, and Phi 3 today, and the Q+A benchmarks don't tell the full story. Ex. It's nigh impossible to get Llama _70_B to answer in JSON; when Phi sees RAG from search it goes off inventing new RAG material and a new question.