5 ms·
Version that runs on the CPU: https://github.com/krychu/llama https://github.com/krychu/llama I get 1 word per ~1.5 secs on a Mac Book Pro M1.
by krychu 3y ago
Version that runs on the CPU: https://github.com/krychu/llama https://github.com/krychu/llama
I get 1 word per ~1.5 secs on a Mac Book Pro M1.