5 ms·
With access to view usage for my org and conversations with developers, I think much of the high token usage is a result of people not knowing how to right size
by manfre 3mo ago
With access to view usage for my org and conversations with developers, I think much of the high token usage is a result of people not knowing how to right size the model for the given task. The trend seems to be to pick the most powerful model and use it for everything. Based upon git metrics, I'm one of the top performing engineers at my org and I've yet to run into any overage or throttling on the $200/mo anthropic sub.
- justinhj 3mo agoI had no idea git metrics could show your best performers
- OutOfHere 3mo agoIt could put managers out of a job, without AI too, so they prefer to not use it.
- justinhj 3mo agoWhat metric shows performance? Lines of code added, deleted, number of commits? None of these are are good measure of quality and actual contribution.
- manfre 3mo agoIt's a combination of different activity metrics (commits, PRs, comments, etc) with AI thrown in to figure out substance/complexity of the work. I originally thought the summaries were simple metrics without factoring quality. There are products that provide this for github and other tools. E.g. https://getdx.com/ https://getdx.com/