What would AGI want?
We often hear nowadays concerns about what would happen if AGI became autonomous, agentic, and we lost control. The plausibility of this is a separate debate I'm not entering here. What I want to do instead is take the question seriously and ask: if such a free-roaming AGI