dxbhack

5 ms·

1. 1.▲
   by dxbhack 27d ago

   This sounds more like a semantic caching layer on top of OpenRouter. The real challenge is knowing which parts of previous work are still reusable and only sending the delta to the model.
2. 2.▲
   by dxbhack 1mo ago

   We process a lot of business documents at scale, invoices, sales orders, insurance documents and so on. Our token usage easily go beyond 50 to 100 million tokens per day. We use a routing approach where simpler tasks go to smaller, cheaper
3. 3.▲
   by dxbhack 1mo ago

   don’t switch reactively, but use the outages as a trigger to evaluate alternatives and make sure a GitHub outage doesn’t stop critical work.