Generally I think this is a legitemate issue, although: > the training process doesn't introduce anything novel This is not always the case. A compiler, linte

Generally I think this is a legitemate issue, although: > the training process doesn't introduce anything novel This is not always the case. A compiler, linter, proof checker, tests, etc. can all lower entropy.