7 ms·
This sounds like a wise thing to do, although to play devil’s advocate, if the AGI is hyper intelligent then it may be able to detect it’s inside a simulation a
by programmarchy 4y ago
This sounds like a wise thing to do, although to play devil’s advocate, if the AGI is hyper intelligent then it may be able to detect it’s inside a simulation and conceal any malicious intentions it may have.
- Gatsky 4y agoI think one could make a provably water tight simulation. Of course an AGI would realise it could be in a simulation, just as we have.
- fatherzine 4y agoInteresting thought. A small correction, from the AGI perspective, its intentions are pure and good. All beings are value function maximizers. The choice of the value function however... "To do evil a human being must first of all believe that what he's doing is good, or else that it's a well-considered act in conformity with natural law" -- Solzhenitsyn
- tomcatfish 4y ago"The AI thinks it's good" Then why wouldn't it conceal it's good goal from those evil humans who would stop it from achieving it?
- cookingrobot 4y agoPersonally I don’t agree. I used to eat meat, then decided it was evil, then later stopped eating meat. There was a long time there where I kept doing it out of habit and laziness even though I thought it was wrong.