6 ms·
I'm still leeching off the free tier, so it's going to be hard to beat the price. But yes, I intend to support several models, to handle the overload situation
by sfink 13d ago
I'm still leeching off the free tier, so it's going to be hard to beat the price.
But yes, I intend to support several models, to handle the overload situation (automatic failover). And switch to a cheap paid plan, though it seems like that'll mostly improve rate limits, which barely matters for my usage.
Faster is always good, though. I do care about latency.