4 ms·
That’s why we use top p and top k! They limit the probability space to a certain % or number of tokens ordered by likelihood
by pelillian 2y ago
That’s why we use top p and top k! They limit the probability space to a certain % or number of tokens ordered by likelihood