5 ms·

I feel like the idea that GPUs wear out in 3 years is as far as I can tell, generally unfounded. The GPU build out will keep pumping tokens until the cost to r

I feel like the idea that GPUs wear out in 3 years is as far as I can tell, generally unfounded. The GPU build out will keep pumping tokens until the cost to replace is less that the cost to maintain. It is effectively sunk cost.

pseudosavant 20d ago
Even if it is 5 or 7 years, houses last decades. Even cars last longer than GPUs. GPUs are a highly depreciating asset. They'll last longer than 3 years, but might not be very cost effective (tokens per Wh) compared to the latest AI accelerators that are available. I wonder if it will be that the U.S. (and allied countries) will be using the latest 1-2 generations of AI accelerators, and if the 3-5+ year old stuff will be sold to Chinese datacenters since that will still be the most powerful tech we'll be allowed to export to them?