5 ms·
How else would you expect them to calculate it?
by RussianCow 18d ago
How else would you expect them to calculate it?
- dakolli 17d agoDo you really think they're docking points because cache invalidation due to provider switching? Seriously llms are frying ya'lls brain.
- RussianCow 17d agoThey're not "docking points", they're calculating it in the most straightforward way. If I start a session and the majority of requests are sent to Provider A, and my last request gets routed to Provider B, I have a 0% cache hit rate with Provider B. I'm very curious how else you expect this to be calculated? Do you think they're completely omitting requests that switch providers mid-session? FWIW, I get significantly higher than listed cache hit rates when I pin my session to a specific provider, which is further evidence of the above.
- dakolli 16d agoWhy wouldn't you only calculate consecutive requests with the same provider....