6 ms·

how are you running the 2.4t model locally if you don't mind me asking

• jnwatson 24d ago
  Oh I didn't; only a distilled 27B model ran locally. This was just to figure out if distilling caused the problem.