5 ms·
Isn't distillation done through SFT by having the student model approximate the teacher's output distribution?
by maleldil 1mo ago
Isn't distillation done through SFT by having the student model approximate the teacher's output distribution?
loading thread…