8 ms·
The way I put it when working on LLM-enabled things is: Get the hell out of the LLM as soon as possible. And I guess for 2, stay out as long as possible. I gu
by furyofantares 18d ago
The way I put it when working on LLM-enabled things is: Get the hell out of the LLM as soon as possible.
And I guess for 2, stay out as long as possible.
I guess this is somewhat different; it admits that in some cases you do need the LLM doing more work somewhere in the middle.
But it also means sometimes you never enter the LLM to begin with, or never re-enter it for output.