5 ms·
Training an AI in 2020 is best thought of as a capital investment. Like digging a mine or building a wind farm, the initial investment is very large but the ope
by andyljones 6y ago
Training an AI in 2020 is best thought of as a capital investment. Like digging a mine or building a wind farm, the initial investment is very large but the operating costs are much lower, and in the long run you expect to get a lot more money out - a lot more value out - than you put in.
Training GPT-3 cost $5m; running it costs .04c per page of output.
- stainforth 6y agoOnce the investment is recouped and a small margin rewarded, the value should be spread equitably among society.
- dragongod2718 6y agoWhy only a small margin?
- ac29 6y agoIf it is scaled up by 1000x as the article proposes, does that mean it will cost $40/page of output? Or does the additional cost just go into training the model?
- deleted 6y ago[deleted]
- andyljones 6y agoIf it's 100x from increased investment and 10x from short-term efficiency gains, yeah you'd expect $4/page. Model compression or some other tech might make it more efficient in the long-run.