5 ms·
Maybe it's worth worrying about because AIs might eventually become orders of magnitude more powerful than humans.
by capisce 12y ago
Maybe it's worth worrying about because AIs might eventually become orders of magnitude more powerful than humans.
- hyperion2010 12y agoAnd somehow being more intelligent makes them a threat? We have absolutely no evidence about any of this, it is pure fear of the unknown and instead of imagining a peaceful and cooperative future they somehow imagine that AI will treat us like we treat our various 'lesser' races. But that is just us projecting our own current and historical behavior onto a class of beings that doesn't even exist yet and who WE have to bring into being. If you imagine that your children will be evil and kill you you have damned them before they have even been born. Not only that but the analogy sucks even more because in this case there isn't even the excuse that we don't understand how biology leads to behavior because we will have build the systems ourselves.
- capisce 12y agoEven if you imagine just a small risk of an AI being hostile or indifferent toward us, is it worth gambling our future on that risk? Where is your evidence that a vastly greater intelligence would have a moral that is perfectly aligned with ours, unless we programmed it perfectly for that purpose and made sure any self-modification by the AI preserved those moral invariants? http://kajsotala.fi/2007/10/14-objections-against-aifriendly-aithe-singularity-answered/#hostile http://kajsotala.fi/2007/10/14-objections-against-aifriendly...