6 ms·
Because of the ongoing training costs. They are certainly making a healthy profit margin on inference.
by irthomasthomas 12d ago
Because of the ongoing training costs. They are certainly making a healthy profit margin on inference.
- Philip-J-Fry 12d agoNever really a sound argument. It's like having new solar panels installed every week. Sure you're "profitable" on the $0.20/kWh you're selling your "free" energy at when you ignore the cost of the solar panels you're buying every week.
- ludwik 12d agoIt is a sound argument in the context of trying to estimate what it costs them to generate this specific output. They have training cost eather way.
- kinj28 11d agoI would like to imagine accounting inference revenue on trained model and the depreciation cost for training that specific model must already been capitalized + compute to serve would be a net positive margin business. Ongoing training must rather be for future models. But again once future models arrive they would render older models useless, so the asset must be depreciating really fast. Would love someone to throw light on revenue and cost recognition at the unit level for this.