7 ms·
- 1,800tps on llama 3.1 8B - 450tps on llama 3.1 70B free chat interface is at: https://inference.cerebras.ai https://inference.cerebras.ai (requires login)
by davidfiala 2y ago
- 1,800tps on llama 3.1 8B
- 450tps on llama 3.1 70B
free chat interface is at: https://inference.cerebras.ai https://inference.cerebras.ai (requires login)