6 ms·
Weights should not be 0 (at least not frequently) but in a ReLU-based neural network, activations are 0 pretty often. You're absolutely right about die area th
by Thorondor 4mo ago
Weights should not be 0 (at least not frequently) but in a ReLU-based neural network, activations are 0 pretty often. You're absolutely right about die area though.
- nomel 4mo ago> near zero chance for you main customers workload What percent of this hardware is running inference for ReLU models? ;)