15 ms·
What is the advantage of this versus running something like https://github.com/simonw/llm https://github.com/simonw/llm , which also gives you options to e.g. u
by avivo 3y ago
What is the advantage of this versus running something like https://github.com/simonw/llm https://github.com/simonw/llm , which also gives you options to e.g. use https://github.com/simonw/llm-mlc https://github.com/simonw/llm-mlc for accelerated inference?