7 ms·
Interesting, I assumed all model-routing was done utilizing an LLM. (I.e. non-deterministic.)
by PaulStatezny 3mo ago
Interesting, I assumed all model-routing was done utilizing an LLM. (I.e. non-deterministic.)
- tuvix 3mo agoIt’s possible that there’s a set of words or phrases that route deterministically to save money on obvious stuff. I kind of wonder, though, which model they’re using to do the routing. It seems like a huge added cost to do these kinds of checks on every request
- eugmai86 3mo ago[dead]
- dakolli 3mo agoWasn't it leaked in the Claude Code source that it was all regex?