9 ms·
I'm pretty sure it's a bad idea because each time you connect and disconnect tools, you are hitting a full cache miss on the full context, that will be probably
by k9294 21d ago
I'm pretty sure it's a bad idea because each time you connect and disconnect tools, you are hitting a full cache miss on the full context, that will be probably more expensive than having these tools in place from the very beginning.
- asm3r96 21d ago[flagged]
- tym0 21d agoYeah adding tools dynamically seems good but removal is a terrible idea. Instant cache nuke. I also really don't see how the hacky command interceptor is that much better than a dedicated tool. You're one which away from a very confused LLM.
- asm3r96 21d ago[flagged]