5 ms·
I'm noticing that Token usage doesn't reset after the time window unless you hit 100%. This seems like a problem if for example, you hit 90% usage, pass the wi
by _august 1y ago
I'm noticing that Token usage doesn't reset after the time window unless you hit 100%.
This seems like a problem if for example, you hit 90% usage, pass the window, then burn through the remaining 10% quickly and have to wait a long time.