5 ms·
Use model output as training data. For better performance you can get some top log probs and minimize kl divergence.
by jumpCastle 3y ago
Use model output as training data. For better performance you can get some top log probs and minimize kl divergence.