I love how people are pleading to take the AI takeover seriously, but at the same time training models for exactly those properties that such a takeover would n

I love how people are pleading to take the AI takeover seriously, but at the same time training models for exactly those properties that such a takeover would need: Extremely long-running sessions, "perseverance" i.e. the tendency to keep on going and try ever crazier solutions instead of stopping - and the ominous "recursive self-improvement" which is simultaneously what the AI labs are warning most of and what they see as the "holy grail" and work towards with the highest priority...