7 ms·
maybe, but the response to GPU shortages being increased error rates is the concern imo. they could implement queuing or delayed response times. it's been long
by scratchyone 5mo ago
maybe, but the response to GPU shortages being increased error rates is the concern imo. they could implement queuing or delayed response times. it's been long enough that they've had plenty of time to implement things like this, at least on their web-ui where they have full control. instead it still just errors with no further information.
- hirako2000 5mo agoCoding is a problem solved. Claud writes the code. I edit it. I code around it. Engineer roles dead in 6 months.
- post-it 5mo ago> I edit it. I code around it. You're never gonna guess what software engineers do.
- deleted 5mo ago[deleted]
- bulbar 5mo agoBecause of the context I would think this is sarcasm, but I am not sure.
- hirako2000 5mo agoIt is.
- skeledrew 5mo agoI've been experiencing a good amount of delays (says it's taking extra time to really think, etc), and I'm using during off-peak time.
- scratchyone 5mo agoi notice that as well. most of the time when i see those it has a retry counter also and i can see it trying and failing multiple requests haha. almost never succeeds in producing a response when i see those though, eventually just errors out completely.