24 ms·
> Something I think would be interesting for model APIs and consumer apps to exposed would be the probability of each individual token generated. Isn't that wh
by never_inline 1y ago
> Something I think would be interesting for model APIs and consumer apps to exposed would be the probability of each individual token generated.
Isn't that what logprobs is?