4 ms·
Becuase unless you have a certain (high) level of sparsity, sparse formats are infact ineffective in storing. There are cases where sparse formats take more mem
by antixk 5y ago
Becuase unless you have a certain (high) level of sparsity, sparse formats are infact ineffective in storing. There are cases where sparse formats take more memory than storing dense tensors.
- posharma 5y agoSure. It’s still one of the methods to compress models. You might be surprised how often the weights are really quite sparse.