7 ms·
sure. It may be more than that...possibly due to variable operating params on the servers and current load. On whole, if I compare my AI assistant to a human w
by jhancock 9mo ago
sure. It may be more than that...possibly due to variable operating params on the servers and current load.
On whole, if I compare my AI assistant to a human worker, I get more variance than I would from a human office worker.
- pixl97 9mo agoThats because you don't 'own' the LLM compute. If you instead bought your office workers by the question I'm sure the variability would increase.
- astrange 9mo agoThey're not really capable of producing varying answers based on load. But they are capable of producing different answers because they feel like behaving differently if the current date is a holiday, and things like that. They're basically just little guys.