7 ms·
i want 5.4 nano to decide whether my prompt needs 5.4 xhigh and route to it automatically
by dack 6mo ago
i want 5.4 nano to decide whether my prompt needs 5.4 xhigh and route to it automatically
- exitb 6mo agoLike any work estimation, it will likely disappoint.
- mrtesthah 6mo agoAs per OpenAI themselves, xhigh is only necessary if the agent gets stuck on a long running task. Otherwise it’s thinking trades use so many tokens of context that it’s less effective than high for a great majority of tasks. This has also been my experience.
- dack 6mo agoyes but didn't greg brockman say he just runs on xhigh at all times?