5 ms·
Only if you're incapable of throttling to assure quality of service. Are you saying they have so much demand that even their load balancers were overloaded?
by therein 24d ago
Only if you're incapable of throttling to assure quality of service. Are you saying they have so much demand that even their load balancers were overloaded?
- slopinthebag 24d agoThere is no point having this discussion. Some people have had their brains genuinely broken by Anthropic and will defend them to the last breath, despite having no clue what they are talking about.
- lelanthran 23d agoThrottling helps to prevent a 30% failure rate (with a quick recovery time) turning into a 100% failure rate (with practically infinite recovery time), but some users are still going to see failures, and the news is still going to be "Anthropic is down again" because some users are seeing an outage. I'm not really sure how they can avoid getting in the news with "Anthropic is down", TBH. Although, at least by throttling they might get "Anthropic is down for some requests" and not "Anthropic is down for all requests".