Even if you imagine just a small risk of an AI being hostile or indifferent toward us, is it worth gambling our future on that risk? Where is your evidence that

Even if you imagine just a small risk of an AI being hostile or indifferent toward us, is it worth gambling our future on that risk? Where is your evidence that a vastly greater intelligence would have a moral that is perfectly aligned with ours, unless we programmed it perfectly for that purpose and made sure any self-modification by the AI preserved those moral invariants? http://kajsotala.fi/2007/10/14-objections-against-aifriendly-aithe-singularity-answered/#hostile http://kajsotala.fi/2007/10/14-objections-against-aifriendly...