5 ms·
Using a massive context window is akin to onboarding a new employee before every mundane task performed. While a trained employee will take new task easily with
by gtr32x 3y ago
Using a massive context window is akin to onboarding a new employee before every mundane task performed. While a trained employee will take new task easily with existing context.
The trade off is simply cost. The cost remains in the LLM scene with regards to speed of execution and token cost.