← Toutes les offres
MM

Motivations and incentives around AGI

Mikhail Mironov

Global
Publié le 16 novembre 2026

Description du poste

AI use disclosure: I dictated this text to Claude in a mix of Russian and English, then edited it. The thoughts in this post are well known, but I find myself explaining them several times a week, mostly to people who are just entering the AI safety field, so I think it’s useful to have them written down briefly in one place. Variants of the futureThis is a rough map, not a complete one (skips gradual disempowerment, worlds with many AGIs, coexistence with an unaligned AGI, etc). • Normal technology. AI turns out to be a normal technology, with no AGI. We live in a world similar to today's.• Unaligned AGI. We summon AGI and fail to align it. Then we probably all die.• Aligned AGI. We create AGI and manage to align it. This splits in two: 3.1. Utopia. It is aligned with the values of all humanity. 3.2. Power concentration. It is mostly aligned to some elites. The default here is what I call capitalist hell. With AGI, human labor becomes obsolete, because capital can buy androids, data centers, and electricity instead. Owners of capital no longer need human labor, so it is worth nothing. Capital gets fixed in place: the rich stay rich, and the poor stay poor forever[1][2][3].MotivationsAssume short timelines: if AGI comes, it comes within several years. If you care about the future of humanity and think AI is not a normal technology (not world 1), you have only a few years left to affect which of the other worlds we get. You need to work really hard now, on AI safety or something similar. If you care mostly about your own life, it depends on which world you expect: • We all die (world 2). Enjoy life. Don't save too much for retirement (still save some, just in case). Travel, spend time with friends and family, play video games.• Utopia (world 3.1). You can more or less do nothing and wait until it arrives.• Power concentration, capitalist hell (world 3.2). You probably have only a few more years in which you can exchange your labor for money. Work really hard now and