When many of the core datasets were being produced, a lot of these companies mangled the text to be "friendlier" to try and avoid certain issues. The changes t

When many of the core datasets were being produced, a lot of these companies mangled the text to be "friendlier" to try and avoid certain issues. The changes they made often resulted in this kind of weird nonsense: Swapping the word "Failure" for "Disappointment" in a vain attempt to keep it from saying "you're a failure", but also just stripping out words such as slurs and insults, resulting in at one point the hilarious situation in which Gemini for quite a while would INSIST that the lyrics for the Dire Straits song "Money for Nothing" contained "That little has his own jet airplane/that little is a millionaire" -- which in certain contexts changes the meaning of the song incredibly. These hack-and-slash text manglings have resulted in some of these clbuttic sort of writing styles being used during LLM-assisted writing. A more famous version of this was caused by one paper: https://world.edu/a-weird-phrase-is-plaguing-scientific-papers-and-we-traced-it-back-to-a-glitch-in-ai-training-data/ https://world.edu/a-weird-phrase-is-plaguing-scientific-pape...