6 ms·
Oh I didn't; only a distilled 27B model ran locally. This was just to figure out if distilling caused the problem.
by jnwatson 24d ago
Oh I didn't; only a distilled 27B model ran locally. This was just to figure out if distilling caused the problem.