If you set temperature to zero the output will be always the same, not a distribution. If instead you increase temperature the LLM will sometimes choose other t

If you set temperature to zero the output will be always the same, not a distribution. If instead you increase temperature the LLM will sometimes choose other tokens than the one with the highest score, but it won’t be that much different