7 ms·
It did not exactly help that we saw traffic to DS (over OpenCode) jump from around 1.6T tokens per day, to over 14T token in a matter of days. Nobody has the co
by benjiro29 26d ago
It did not exactly help that we saw traffic to DS (over OpenCode) jump from around 1.6T tokens per day, to over 14T token in a matter of days. Nobody has the compute to deal with such increases.
This keeps happening with every good new model release. People jumping from one to another, and as prices get lower, they start using the models even more.
People make not like to hear it but prices and usage limits are ways to shape traffic. The third option is the nuclear one like Kimi did, by just stopping to sell subscription at all. But that is something that DeepSeek can not do as all they offer is API.
Even OpenAI despite having the most compute is not immune to client influx = capacity issues. As people found their usage dropping, despite the push to the easier to run Luna models.
Reality is, that compute can not keep up with demand, especially when models get more capable and cheaper. What trigger people being using them more, what trigger compute crisis's.
This constant up and down cycle is going to keep happening for a long time, as this new market grows and eventually, somewhere in the future stabilizes. But yea, that is still going to be a few more years for sure.