5 ms·
There's the other (orthogonal) possible explanation of using more GPUs for stress-testing before product launch.
by winwang 4mo ago
There's the other (orthogonal) possible explanation of using more GPUs for stress-testing before product launch.
- zamadatix 4mo agoThat's less an orthogonal explanation and more an example of why they'd do something like serve a quantized model.