5 ms·
Sure, but to clarify, so you are probably setting temperature to close to 0 in order to try to get as consistent output as possible based on the input? Have you
by jasonriddle 1y ago
Sure, but to clarify, so you are probably setting temperature to close to 0 in order to try to get as consistent output as possible based on the input? Have you made any changes to top k and/or top p that you have found makes agents output more consistent/deterministic?
- imsh4yy 1y agoYes, temp is close to 0 for most models. For top k and top p, I've been using the default values set in OpenRouter.