9 ms·I'm getting around 90 tok/s on a 3090 using Ollama. Pretty impressiveby Matsta 1y agoI'm getting around 90 tok/s on a 3090 using Ollama. Pretty impressive