I'd be surprised if one's intentions or goals could be trained into LLM's; more likely one would emotionally migrate to the intentions that LLM's can represent

I'd be surprised if one's intentions or goals could be trained into LLM's; more likely one would emotionally migrate to the intentions that LLM's can represent because you+they would be more effective. People already change depending on social context and available prostheses (in Freud's sense of humans as prosthetic gods); since AI is not free (integrations even less so), social divisions along power/wealth lines will increase. And just as each of us apparently needs a military to defend against the others, so too will we need digital guards for any virtual presence; thus there's no avoiding the who-guards-the-guardians problem.