5 ms·You could run it on a single high end GPU. I can run llama2's models ,(except 70b) on my 4080.by mutex_man 3y agoYou could run it on a single high end GPU. I can run llama2's models ,(except 70b) on my 4080.