taupi

8 ms·

1. 1.▲
   by taupi 5mo ago

   They see their competitors as Claude Code, Codex, and Cursor, not ghostty or something.
2. 2.▲
   by taupi 5mo ago

   Glad you found it interesting! What you described is the goal of Attainable SOL, but using GPU utilization as the metric rather than throughput. We're answering "for a given model and workload, have you optimized this well enough?
3. 3.▲
   by taupi 5mo ago

   AMD support is on the roadmap, but we mentioned it for now to highlight that AMD calculates their utilization metric the same way -- it's not just NVIDIA.
4. 4.▲
   by taupi 5mo ago

   There's a new "Effective Load" metric that we've looked at -- it's derived from Power, which has the same problems we mentioned here: https://news.ycombinator.com/item?id=47925149 It's useful a
5. 5.▲
   by taupi 5mo ago

   Part of me wonders if they're not releasing it for safety reasons, but just because it's too expensive to serve. Why not both?
6. 6.▲
   by taupi 1y ago

   Right now authentication doesn't work if you're working on a remote machine and try to authenticate with Google, FYI. You need an alternate auth flow that gives the user a link and lets them paste a key in (this is how Claude Code