5 ms·
I agree with you but it also makes me think: Google's TPUs are also fixed costs and these research experiments could have been run at times when production serv
by dontreact 2y ago
I agree with you but it also makes me think: Google's TPUs are also fixed costs and these research experiments could have been run at times when production serving need isn't as high.
- ec109685 2y agoThey sell them on the spot market, so there’s someone that would consume the baseline compute.
- dontreact 2y agoI imagine it would never be optimal to set a price so low that utilization is always 100% externally
- londons_explore 2y agoThere is plenty of people who want cheap compute and are willing to wait till 3am if that's when the cheap compute is. Happens for all computing services, but for ML stuff the effect is even more pronounced because compute costs are typically a large part of the cost of many projects.