5 ms·
It depends on what your "currency" is: inference cost vs. models getting dumber/slower with a fuller context.
by iamjackg 6mo ago
It depends on what your "currency" is: inference cost vs. models getting dumber/slower with a fuller context.
loading thread…