5 ms·
So if an AI company spends $5B on a cluster, is this optimization worth $250m?
by BryanLegend 1y ago
So if an AI company spends $5B on a cluster, is this optimization worth $250m?
- disofu234 1y agoDon't think so. This is an optimization on multiplying a matrix times its own transpose, not for generic matrix multiplication.
- qoez 1y agoDefinitely didn't cost that much to solve this particluar problem (that cost is amortized over the lifetime of the clusters existence). Compared to the CO2 to feed academics eating red meat, this is like wind power compared to coal it's way more environmentally friendly.