10 ms·
What does it take to go from here to a model on a pcie card or an m.2 card, so I can plug one into my workstation / laptop? Will 'intelligence' become much like
by sgc 1mo ago
What does it take to go from here to a model on a pcie card or an m.2 card, so I can plug one into my workstation / laptop? Will 'intelligence' become much like a gpu, where most people just live with the performance of whatever they have installed, outside large companies that must have cutting edge, or prosumers that have a incrementally better version than the masses?
Are we a couple years away, a decade away, or something else?
- mdp2021 1mo ago> What does it take to go from here to a model on a pcie card or an m.2 card It is already that. > Will "intelligence" become much like a gpu As an option among the implementations. > Are we a couple years away They could mass produce now, but it makes no sense at this rate of improvements in the models.
- sgc 1mo agoThanks for answering. This is an 8b model, which are mainly curiosities outside niche tasks. I guess I am asking how far we are away from having today's more generally useful frontier model equivalents widely available for everyday users in their personal pcs/laptops via a single pcie or m.2 drop in.
- mdp2021 1mo ago> how far we are away from having It depends on AMD now. What was planned after the 8b was a ~30b, which is already sufficient (or more, when running at ultra-high speed).