4 ms·
I've got the same spec, are you running the 27B or the 35B-A3B? I found the 27B was unusably slow (like 10-15t/s not to mention the prefill times)
by russelg 3mo ago
I've got the same spec, are you running the 27B or the 35B-A3B? I found the 27B was unusably slow (like 10-15t/s not to mention the prefill times)