5 ms·

Wouldn't the obvious solution to this problem to stop using agents that don't respect your usage limits instead of trying to build sketchy containers around mis

• stingraycharles 1y ago
  Yeah I don’t understand this problem, who uses so many agents at the same time in the first place? And if this is really a problem, why not funnel your AI agents through a proxy server which they all support instead of this hacky approach? It would be super easy to build a proxy server that keeps track of costs per day/session and just returns errors once you hit a limit.
  • sothatsit 1y ago
    In fact, proxy servers like LiteLLM[1] already exist that are very easy to setup and set limits in. [1] LiteLLM: https://www.litellm.ai/ https://www.litellm.ai/
• deleted 1y ago
  [deleted]