7 ms·
In short, the others have a huge margin if you ignore training costs. See https://martinalderson.com/posts/are-openai-and-anthropic-really-losing-money-on-infer
by burroisolator 10mo ago
In short, the others have a huge margin if you ignore training costs. See https://martinalderson.com/posts/are-openai-and-anthropic-really-losing-money-on-inference/ https://martinalderson.com/posts/are-openai-and-anthropic-re... for details.
- throwdbaaway 10mo agoSomehow that article totally ignored the insane pricing of cached input tokens set by Anthropic and OpenAI. For agentic coding, typically 90~95% of the inference cost is attributed to cached input tokens, and a scrappy China company can do it almost for free: https://api-docs.deepseek.com/news/news0802 https://api-docs.deepseek.com/news/news0802