5 ms·
Great, thanks! :-) and to mirror another poster: what kind of prompt parsing (prefill) speed do you get for that model? Also how is the speed for the 27B model?
by busfahrer 4mo ago
Great, thanks! :-) and to mirror another poster: what kind of prompt parsing (prefill) speed do you get for that model?
Also how is the speed for the 27B model?