7 ms·
That is exactly why we enforce a hard budget cap (default is $1.00). The system runs a pre-flight check before every LLM call. If you're about to go over budge
by abdulbasitali 9mo ago
That is exactly why we enforce a hard budget cap (default is $1.00).
The system runs a pre-flight check before every LLM call. If you're about to go over budget, it kills the process immediately (SentinelBudgetExceeded).
We don't have a specific "max retries" counter wired up yet, but I'll likely add that soon based on your feedback. For now, the budget cap would have caught it at $1.