5 ms·
> Why would you add a penalty of 50 ms at a minimum? All of the customer service bots I've dealt with recently were reasoning models that thought for multiple
by MallocVoidstar 27d ago
> Why would you add a penalty of 50 ms at a minimum?
All of the customer service bots I've dealt with recently were reasoning models that thought for multiple seconds. I would not have noticed 50ms extra.