5 ms·
The story of a bug that caused the AI to optimize for maximally disturbing text that went unchecked because the only people authorized to stop it were asleep is
by honoredb 7y ago
The story of a bug that caused the AI to optimize for maximally disturbing text that went unchecked because the only people authorized to stop it were asleep is a great illustration of how easy it is for an AI to "go evil" when you're not worrying about safety.
- GranPC 7y agoLink, please?
- ipsum2 7y agoNot OP, but I think they're referring to: https://slatestarcodex.com/2018/10/30/sort-by-controversial/ https://slatestarcodex.com/2018/10/30/sort-by-controversial/ Though I hesitate to draw strong conclusions from fiction.
- wgjordan 7y agohttps://openai.com/blog/fine-tuning-gpt-2/#bugscanoptimizeforbadbehavior https://openai.com/blog/fine-tuning-gpt-2/#bugscanoptimizefo... (Someone didn't read the whole article..)