5 ms·
A computer created around a GPU and/or a shared ram to run LLMs should not be called a computer anymore. It should be called an inference engine. I'm not agains
by okokwhatever 22d ago
A computer created around a GPU and/or a shared ram to run LLMs should not be called a computer anymore. It should be called an inference engine.
I'm not against it but it could be stripped down to reduce some cost and it would be the perfect companion in a lab.