7 ms·
What's the error rate of the pen guy? Also, if your AI has a 20% error rate, you're not holding it right. You need to spend more time keeping it on rails - uni
by adriancooney 6mo ago
What's the error rate of the pen guy?
Also, if your AI has a 20% error rate, you're not holding it right. You need to spend more time keeping it on rails - unit tests, integration tests, e2e tests, local dev + browser use, preview deployments, staging environments, phased rollouts, AI PR reviews, rolling releases. The error rate will be much closer to 0%.
- davebren 6mo agoHow does a phased rollout improve LLM error rates exactly?
- adriancooney 6mo agoError rate here is the rate of shipping bugs to customers.
- davebren 6mo agoThat wasn't what the comment you responded to was referring to. I guess it makes sense since you are kind of like an LLM with how you respond to input.