I don’t know much about how these models work, but does this mean that a lot of ‘smartness’ that they show in how they articulate the answers are just them ‘par

I don’t know much about how these models work, but does this mean that a lot of ‘smartness’ that they show in how they articulate the answers are just them ‘parroting’ the contractors who ‘role played ai’?