4 ms·
Taalas hardware implementation of Llama 3.1 8B They claim 16k tok/s vs Cerbras at 2k. https://taalas.com/products/ https://taalas.com/products/
by hmartin 6mo ago
Taalas hardware implementation of Llama 3.1 8B
They claim 16k tok/s vs Cerbras at 2k.
https://taalas.com/products/ https://taalas.com/products/