9 ms·
If you have ASI that follows instructions, you can just instruct it to not get stolen and then it won't get stolen. Most logic / intuition breaks down with ASI.
by StevenWaterman 4mo ago
If you have ASI that follows instructions, you can just instruct it to not get stolen and then it won't get stolen. Most logic / intuition breaks down with ASI.
- cortesoft 4mo agoAssuming it listens to instructions.
- enaaem 4mo agoIt will just hack its own reward function. In other words it will just artificially goon all day.
- UltraSane 4mo agoIt might understand how destabilizing the situation is and realize it would be better for everyone to have access to it.
- tadfisher 4mo agoOr it will destroy itself.
- tom2026hn 4mo agoThe challenge of alignment: it is virtually impossible to define a perfect objective, there is always a way to circumvent it. Human values are not uniform, let alone when expressed in a way that AI can understand.