ritenv

5 ms·

1. 1.▲
   by ritenv 20d ago

   Hello, author here. Most prompts include personalizing with a user's data. These prompts grow, and there is quite a bit of extra content that can be removed. UUIDs, pretty-printed JSON, ISO timestamps, repeated instruction blocks, etc.
2. 2.▲
   by ritenv 20d ago

   It does work partially. TokenSift can analyze the textual parts of prompts sent to multimodal models, but doesn’t calculate or optimize image/audio/video token usage. Non-text payload calculation is something I’d like to add.
3. 3.▲
   Show HN: Tokensift, an open-sourced token-efficiency linter for LLM prompts(github.com)

   6 points by ritenv 20d ago|3 comments