6 ms·
What if the next-gen models are trained on RTK output as well? Then you will actually have less tokens in the context window, and the model won't become confuse
by nextaccountic 5d ago
What if the next-gen models are trained on RTK output as well? Then you will actually have less tokens in the context window, and the model won't become confused (which would require more turns, wasting tokens)
- vrighter 5d agodoesn't change the fact that it doesn't do what it claims to now. I just don't care about vague promises and "trust us bro" vibes that tech is sold for nowadays. It claims x, it doesn't deliver x. Maybe it could in the future, or maybe not.
- nextaccountic 5d agoThat's indeed not something that RTK can promise. However, if RTK becomes popular enough, it's unavoidable that its output will start seeping into the training data of future models, which will make RTK perform better So it's a kind of self-fulfilling prophecy