ponywombat

8 ms·

1. 1.▲
   by ponywombat 8mo ago

   Ah, the painful migration to Clickhouse from v2 to v3 makes sense now https://langfuse.com/self-hosting/upgrade/upgrade-guides/upg...
2. 2.▲
   by ponywombat 1y ago

   AWS have also made their own cost analysis MCP server https://github.com/awslabs/mcp/tree/main/src/cost-analysis-m...
3. 3.▲
   by ponywombat 2y ago

   LiteLLM seemed to be the best approach for what I needed - simple integration with different models (mainly OpenAI and the various Bedrock models) and the ability to track costs / limit spending. It's working really well so far.
4. 4.▲
   by ponywombat 3y ago

   Why would you want to build your own accounting ledger from scratch? Accounting is a completely new domain for most engineers, and TigerBeetle ( https://tigerbeetle.com/ ) already solves this problem.
5. 5.▲
   by ponywombat 3y ago

   This is very impressive, but whilst it was very fast with Mixtral yesterday, today I waited 59.44s for a response. If I was to use your API, the end-to-end is much more important than the Output Tokens Throughput and Time to first token me