7 ms·
This doesn't mention text-generation-inference, vllm, or Mistral which is raises eyebrows. I would like to see more importance given to privately deployed LLMs
by sa-code 3y ago
This doesn't mention text-generation-inference, vllm, or Mistral which is raises eyebrows. I would like to see more importance given to privately deployed LLMs that are not consumed through third party APIs