4 ms·
But how to get these guarantees from the upstream vendors? Or do you run the LLMs on premises?
by panta 2y ago
But how to get these guarantees from the upstream vendors? Or do you run the LLMs on premises?
- Karrot_Kream 2y agoIf you're using LLM APIs there are SLAs from the vendors to make sure your inputs are not used as training data and other guarantees. Generally these endpoints cost more to use (the compliance fee essentially) but they solve the problem.