5 ms·
DeepSeek-R1 at 3,872 tokens / second on a single Nvidia HGX H200
- deleted 2y ago[deleted]
- billconan 2y agohttps://news.ycombinator.com/item?id=42879864 https://news.ycombinator.com/item?id=42879864 this is cerebras' 70B number, 1600 tokens / sec, not sure about the costs.