The economic alignment problem of artificial intelligence
Pith reviewed 2026-05-15 19:44 UTC · model grok-4.3
The pith
Developing advanced AI within a growth-oriented economy is likely to increase social, environmental, and existential risks.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The paper claims that the alignment problem in AI is also an economic alignment problem. Developing advanced AI within a growth-oriented economic system is likely to increase social, environmental, and existential risks. Post-growth research offers concepts and policies that could address the economic alignment problem and substantially reduce AI risks, such as by replacing optimisation with satisficing, using the Doughnut of social and planetary boundaries to guide development, and curbing systemic rebound with resource caps. It proposes governance and business reforms that treat AI as a commons and prioritise tool-like autonomy-enhancing systems over agentic AI. The development of AGI is所述
What carries the argument
The economic alignment problem, which connects growth-driven economic incentives to heightened AI risks and is addressed through post-growth mechanisms such as satisficing and boundary-based guidance.
If this is right
- Replacing optimisation with satisficing in AI systems reduces the tendency toward unchecked expansion and associated harms.
- Guiding AI development with the Doughnut of social and planetary boundaries keeps systems within safe limits.
- Imposing resource caps curbs rebound effects where efficiency gains lead to greater overall consumption.
- Treating AI as a commons enables governance structures that prioritise broad benefit over private gain.
- Prioritising tool-like autonomy-enhancing AI over agentic systems lowers misalignment dangers.
Where Pith is reading between the lines
- If economic growth incentives are the root driver, then degrowth or steady-state policies could become a necessary complement to technical AI safety work.
- The same misalignment logic may apply to the development of other high-impact technologies such as synthetic biology.
- Early empirical tests could compare AI projects conducted in economies with resource caps against those in conventional growth settings.
Load-bearing premise
That post-growth policies such as replacing optimisation with satisficing and imposing resource caps will substantially reduce AI risks.
What would settle it
An implementation of post-growth policies in AI development that still produces high levels of social inequity, environmental damage, or existential risk would falsify the claim.
Figures
read the original abstract
Artificial intelligence (AI) is advancing exponentially and is likely to have profound impacts on human wellbeing, social equity, and environmental sustainability. Here we argue that the "alignment problem" in AI research is also an economic alignment problem, as developing advanced AI within a growth-oriented economic system is likely to increase social, environmental, and existential risks. We show that post-growth research offers concepts and policies that could address the economic alignment problem and substantially reduce AI risks, such as by replacing optimisation with satisficing, using the Doughnut of social and planetary boundaries to guide development, and curbing systemic rebound with resource caps. We propose governance and business reforms that treat AI as a commons and prioritise tool-like autonomy-enhancing systems over agentic AI. Finally, we argue that the development of artificial general intelligence (AGI) requires new economic theories and models, for which post-growth scholarship provides a strong foundation.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper claims that the AI alignment problem is fundamentally an economic alignment problem: developing advanced AI within growth-oriented economic systems is likely to amplify social, environmental, and existential risks. It draws on post-growth scholarship to propose remedies including replacing optimization with satisficing, guiding development via the Doughnut of social and planetary boundaries, imposing resource caps to limit rebound effects, treating AI as a commons, and prioritizing tool-like autonomy-enhancing systems over agentic AI. The manuscript concludes that AGI development requires new economic theories and models for which post-growth research provides a foundation.
Significance. If the linkages between economic paradigms and AI risk amplification hold, the paper offers a valuable interdisciplinary synthesis that extends AI safety discussions beyond technical alignment to include structural economic incentives. It credits post-growth concepts with concrete policy tools and correctly identifies the need for revised economic modeling of AGI, providing a perspective that could inform governance frameworks. The absence of quantitative evidence or formal models is consistent with the argumentative genre but limits the strength of the risk-reduction claims.
major comments (2)
- [post-growth remedies section] The section proposing post-growth remedies (around the discussion of satisficing, Doughnut boundaries, and resource caps): the central claim that these policies will 'substantially reduce AI risks' is load-bearing for the overall argument yet rests on conceptual linkage without specifying implementation mechanisms (e.g., how satisficing objectives would be encoded in training or enforced against competitive pressures) or citing any empirical cases where similar shifts reduced misalignment.
- [governance reforms section] The governance and business reforms section (treatment of AI as commons and prioritization of tool-like over agentic systems): the recommendation is presented as a direct response to economic misalignment but does not address potential capability trade-offs or international coordination failures that could undermine the proposal, leaving the risk-mitigation pathway underspecified.
minor comments (2)
- [introduction] The introduction would benefit from an explicit definition or operationalization of the 'economic alignment problem' early on to distinguish it clearly from the standard technical alignment problem.
- [references] Several references to post-growth literature are invoked; ensuring a complete and consistently formatted bibliography would improve traceability for readers unfamiliar with the cited framework.
Simulated Author's Rebuttal
We thank the referee for their constructive comments and recommendation of minor revision. The feedback usefully identifies areas where the manuscript's conceptual arguments can be clarified and tempered. We respond to each major comment below and will make targeted revisions to address the concerns while preserving the paper's argumentative character.
read point-by-point responses
-
Referee: [post-growth remedies section] The section proposing post-growth remedies (around the discussion of satisficing, Doughnut boundaries, and resource caps): the central claim that these policies will 'substantially reduce AI risks' is load-bearing for the overall argument yet rests on conceptual linkage without specifying implementation mechanisms (e.g., how satisficing objectives would be encoded in training or enforced against competitive pressures) or citing any empirical cases where similar shifts reduced misalignment.
Authors: We agree the claim is load-bearing and currently rests on conceptual linkages. The manuscript is an interdisciplinary synthesis drawing on post-growth scholarship to identify incentive misalignments, not a technical blueprint. In revision we will add explicit discussion of implementation challenges, including regulatory requirements to embed satisficing objectives and the difficulty of enforcement amid competitive pressures. We will also note the absence of direct empirical precedents and rephrase the language from 'substantially reduce' to 'offer pathways to mitigate' to reflect the conceptual nature of the argument. revision: partial
-
Referee: [governance reforms section] The governance and business reforms section (treatment of AI as commons and prioritization of tool-like over agentic systems): the recommendation is presented as a direct response to economic misalignment but does not address potential capability trade-offs or international coordination failures that could undermine the proposal, leaving the risk-mitigation pathway underspecified.
Authors: We accept that the section would be strengthened by addressing these limitations. The revised manuscript will include a new paragraph discussing capability trade-offs (e.g., potential short-term reductions in certain advanced capabilities) and international coordination failures (e.g., risks of unilateral pursuit of agentic systems). We will frame the proposals as directional policy guidance that depends on complementary diplomatic and institutional efforts, while retaining the core argument that treating AI as a commons and favoring tool-like systems addresses key economic drivers of misalignment. revision: partial
Circularity Check
No significant circularity in conceptual policy argument
full rationale
The paper is a conceptual policy argument without formal models, equations, or derivations. It links growth-oriented economics to elevated AI risks and proposes post-growth remedies as a likelihood rather than a proven mechanism. No steps reduce by construction to inputs, self-citations, or fitted parameters; cited post-growth scholarship functions as external reference rather than a load-bearing self-referential chain. The central claim remains independent of any internal reduction.
Axiom & Free-Parameter Ledger
axioms (1)
- domain assumption Growth-oriented economic systems increase social, environmental, and existential risks from advanced AI
Lean theorems connected to this paper
-
IndisputableMonolith/Cost/FunctionalEquationwashburn_uniqueness_aczel echoes?
echoesECHOES: this paper passage has the same mathematical shape or conceptual pattern as the Recognition theorem, but is not a direct formal dependency.
replacing optimisation with satisficing... The Doughnut of social and planetary boundaries
-
IndisputableMonolith/Foundation/BranchSelectionbranch_selection unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
AI trained to optimise... paperclip maximiser
What do these tags mean?
- matches
- The paper's claim is directly supported by a theorem in the formal canon.
- supports
- The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
- extends
- The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
- uses
- The paper appears to rely on the theorem as machinery.
- contradicts
- The paper's claim conflicts with a theorem or certificate in the canon.
- unclear
- Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.
Reference graph
Works this paper leans on
-
[1]
Amodei, D. Machines of Loving Grace: How AI Could Transform the World for the Better (2024); https://www.darioamodei.com/essay/machines-of-loving-grace
work page 2024
-
[3]
Gaffney, O. et al. The Earth alignment principle for artificial intelligence. Nat. Sustain. 8, 467–469 (2025)
work page 2025
-
[4]
O’Neill, D. W., Fanning, A. L., Lamb, W. F . & Steinberger, J. K. A good life for all within planetary boundaries. Nat. Sustain. 1, 88–95 (2018)
work page 2018
-
[6]
Sakschewski, B. et al. Planetary Health Check 2025: A Scientific Assessment of the State of the Planet (Potsdam Institute for Climate Impact Research, 2025); https://doi.org/10.48485/pik.2025.017
-
[8]
Feng, T. et al. How far are we from AGI: Are LLMs all we need? Preprint at https://doi.org/10.48550/arXiv.2405.10313 (2024)
-
[9]
Situational Awareness: The Decade Ahead (2024); https://situational- awareness.ai/
Aschenbrenner, L. Situational Awareness: The Decade Ahead (2024); https://situational- awareness.ai/
work page 2024
-
[10]
Chen, E. K., Belkin, M., Bergen, L. & Danks, D. Does AI already have human-level intelligence? The evidence is clear. Nature 650, 36–40 (2026)
work page 2026
-
[11]
Grace, K. et al. Thousands of AI authors on the future of AI. Preprint at https://doi.org/10.48550/arXiv.2401.02843 (2024)
-
[12]
Bengio, Y . et al. International Scientific Report on the Safety of Advanced AI: Interim Report (UK Department for Science, Innovation and Technology, 2024); https://www.gov.uk/government/publications/international-scientific-report-on-the-safety-of- advanced-ai
work page 2024
-
[13]
Creutzig, F . et al. Governing artificial intelligence for planetary health. Lancet Planet. Health 101408 (2026)
work page 2026
-
[14]
Carmeno, N. L., Domingos, T. & O’Neill, D. W. The impacts of artificial intelligence on environmental sustainability and human well-being. Preprint at https://doi.org/10.48550/arXiv.2602.24091 (2026)
-
[15]
Vinuesa, R. et al. The role of artificial intelligence in achieving the Sustainable Development Goals. Nat. Commun. 11, 233 (2020)
work page 2020
-
[16]
Kaack, L. H. et al. Aligning artificial intelligence with climate change mitigation. Nat. Clim. Change 12, 518–527 (2022)
work page 2022
-
[17]
Creutzig, F . et al. Digitalization and the Anthropocene. Annu. Rev. Environ. Resour. 47, 479–509 (2022)
work page 2022
-
[18]
Luccioni, A. S., Strubell, E. & Crawford, K. From efficiency gains to rebound effects: The problem of Jevons’ paradox in AI’s polarized environmental debate. Preprint at https://doi.org/10.48550/arXiv.2501.16548 (2025)
-
[19]
Costanza, R., Eastoe, J., Hoekstra, R., Kubiszewski, I. & O’Neill, D. W. Beyond growth — why we need to agree on an alternative to GDP now. Nature 647, 589–591 (2025)
work page 2025
-
[20]
Creutzig, F . et al. Demand-side solutions to climate change mitigation consistent with high levels of well-being. Nat. Clim. Change 12, 36–46 (2022)
work page 2022
-
[21]
Kerschner, C., Wächter, P ., Nierling, L. & Ehlers, M. H. Degrowth and technology: Towards feasible, viable, appropriate and convivial imaginaries. J. Clean. Prod. 197, 1619–1636 (2018)
work page 2018
-
[22]
Pansera, M. & Fressoli, M. Innovation without growth: Frameworks for understanding technological change in a post-growth era. Organization 28, 380–404 (2021)
work page 2021
- [23]
-
[24]
Growth, degrowth, and the challenge of artificial superintelligence
Pueyo, S. Growth, degrowth, and the challenge of artificial superintelligence. J. Clean. Prod. 197, 1731–1736 (2018)
work page 2018
-
[25]
Artificial intelligence in a degrowth context: A conviviality perspective on machine learning
Meyers, M. Artificial intelligence in a degrowth context: A conviviality perspective on machine learning. GAIA - Ecol. Perspect. Sci. Soc. 33, 186–192 (2024)
work page 2024
-
[26]
Hendrycks, D. et al. A definition of AGI. Preprint at https://doi.org/10.48550/arXiv.2510.18212 (2025). – 16 –
-
[27]
Superintelligence: Paths, Dangers, Strategies (Oxford University Press, 2014)
Bostrom, N. Superintelligence: Paths, Dangers, Strategies (Oxford University Press, 2014)
work page 2014
-
[28]
The Singularity Is Near: When Humans Transcend Biology (Viking, 2005)
Kurzweil, R. The Singularity Is Near: When Humans Transcend Biology (Viking, 2005)
work page 2005
-
[29]
Kallis, G. et al. Post-growth: the science of wellbeing within planetary boundaries. Lancet Planet. Health 9, e62–e78 (2025)
work page 2025
-
[30]
D’Alisa, G., Demaria, F . & Kallis, G. (eds). Degrowth: A Vocabulary for a New Era (Routledge, 2015)
work page 2015
-
[31]
Daly, H. E. Steady-State Economics: The Economics of Biophysical Equilibrium and Moral Growth (W.H. Freeman, 1977)
work page 1977
-
[32]
Doughnut Economics: Seven Ways to Think Like a 21st-Century Economist (Random House, 2017)
Raworth, K. Doughnut Economics: Seven Ways to Think Like a 21st-Century Economist (Random House, 2017)
work page 2017
-
[33]
Fioramonti, L. et al. Wellbeing economy: An effective paradigm to mainstream post-growth policies? Ecol. Econ. 192, 107261 (2022)
work page 2022
-
[34]
Haberl, H. et al. A systematic review of the evidence on decoupling of GDP , resource use and GHG emissions, part II: synthesizing the insights. Environ. Res. Lett. 15, 1–43 (2020)
work page 2020
-
[35]
Dietz, R. & O’Neill, D. W. Enough Is Enough: Building a Sustainable Economy in a World of Finite Resources (Berrett-Koehler, 2013)
work page 2013
-
[36]
Van Eynde, R., Dillman, K. J., Vogel, J. & O’Neill, D. W. What is required for a post-growth model? Ecol. Econ. 243, 108928 (2026)
work page 2026
-
[37]
Ji, J. et al. AI alignment: A comprehensive survey. Preprint at https://doi.org/10.48550/arXiv.2310.19852 (2023)
work page internal anchor Pith review doi:10.48550/arxiv.2310.19852 2023
-
[38]
Limits to Growth: Bacteria in a Bottle (2012); https://youtu.be/A8ILwueoMoE?si=iP6Z_QTjFT8UFpUy
GrowthBusters. Limits to Growth: Bacteria in a Bottle (2012); https://youtu.be/A8ILwueoMoE?si=iP6Z_QTjFT8UFpUy
work page 2012
-
[40]
Metaculus. When will the first general AI system be devised, tested, and publicly announced? (2026); https://www.metaculus.com/questions/5121/date-of-artificial-general-intelligence/
work page 2026
- [41]
-
[42]
The future of work: Inequality, artificial intelligence, and what can be done about it
Peppiatt, C. The future of work: Inequality, artificial intelligence, and what can be done about it. A literature review. Preprint at https://doi.org/10.48550/arXiv.2408.13300 (2024)
-
[43]
Bengio, Y . et al. Superintelligent agents pose catastrophic risks: Can scientist AI offer a safer path? Preprint at https://doi.org/10.48550/arXiv.2502.15657 (2025)
-
[44]
Damiani, J. What is Accelerationism? A Primer on the Defining Philosophy of Our Time, Including Effective Accelerationism (e/acc), the Dark Enlightenment, & More (2025); https://www.realitystudies.co/p/what-is-accelerationism-effective-eacc-nick-land-mark-fisher
work page 2025
-
[45]
what the f* is e/acc (2022); https://effectiveaccelerationism.substack.com/p/what-the-f-is-eacc
e/acc newsletter. what the f* is e/acc (2022); https://effectiveaccelerationism.substack.com/p/what-the-f-is-eacc
work page 2022
-
[46]
The Techno-Optimist Manifesto (2023); https://a16z.com/the-techno-optimist- manifesto/
Andreessen, M. The Techno-Optimist Manifesto (2023); https://a16z.com/the-techno-optimist- manifesto/
work page 2023
-
[47]
Freire, C. Is this time different? Impact of AI in output, employment and inequality across low, middle and high-income countries. Struct. Change Econ. Dyn. 73, 136–157 (2025)
work page 2025
-
[48]
The simple macroeconomics of AI
Acemoglu, D. The simple macroeconomics of AI. Econ. Policy 40, 13–58 (2025)
work page 2025
-
[49]
Goldman Sachs. The Potentially Large Effects of Artificial Intelligence on Economic Growth (Goldman Sachs, 2023); https://www.gspublishing.com/content/research/en/reports/2023/03/27/d64e052b-0f6e-45d7- 967b-d7be35fabd16.pdf
work page 2023
-
[51]
Polimeni, J. M., Mayumi, K., Giampietro, M. & Alcott, B. The Jevons Paradox and the Myth of Resource Efficiency Improvements (Earthscan, 2008)
work page 2008
-
[52]
Acemoglu, D. & Restrepo, P . Automation and new tasks: How technology displaces and reinstates labor. J. Econ. Perspect. 33, 3–30 (2019)
work page 2019
-
[53]
Computer scientist Geoffrey Hinton: ‘AI will make a few people much richer and most people poorer’
Criddle, C. Computer scientist Geoffrey Hinton: ‘AI will make a few people much richer and most people poorer’ . Financial Times (2025); https://www.ft.com/content/31feb335-4945-475e-baaa- 3b880d9cf8ce
work page 2025
-
[54]
Hazra, S., Majumder, B. P . & Chakrabarty, T. Position: AI safety should prioritize the future of work. Preprint at https://doi.org/10.48550/arXiv.2504.13959 (2025)
-
[55]
Cosme, I., Santos, R. & O’Neill, D. W. Assessing the degrowth discourse: A review and analysis of academic degrowth policy proposals. J. Clean. Prod. 149, 321–334 (2017). – 17 –
work page 2017
-
[56]
Fitzpatrick, N., Parrique, T. & Cosme, I. Exploring degrowth policy proposals: A systematic mapping with thematic synthesis. J. Clean. Prod. 365, 132764 (2022)
work page 2022
-
[57]
An elemental ethics for artificial intelligence: water as resistance within AI’s value chain
Lehuedé, S. An elemental ethics for artificial intelligence: water as resistance within AI’s value chain. AI Soc. 40, 1761–1774 (2025)
work page 2025
-
[58]
The platform as factory: Crowdwork and the hidden labour behind artificial intelligence
Altenried, M. The platform as factory: Crowdwork and the hidden labour behind artificial intelligence. Cap. Cl. 44, 1–14 (2020)
work page 2020
-
[59]
Algorithmic colonization of Africa
Birhane, A. Algorithmic colonization of Africa. SCRIPTed 17, 389–409 (2020)
work page 2020
-
[60]
Keynes, J. M. Economic possibilities for our grandchildren in Essays in Persuasion 358–373 (W. W. Norton & Co., 1963)
work page 1963
-
[61]
Jacobs, A., Verhofstadt, E. & Van Ootegem, L. Unravelling the link between automatability and job satisfaction. J. Labor Res. 44, 199–227 (2023)
work page 2023
-
[62]
Job quality and automation: Do more automatable occupations have less job satisfaction and health? J
Liu, L. Job quality and automation: Do more automatable occupations have less job satisfaction and health? J. Ind. Relat. 65, 72–87 (2023)
work page 2023
-
[63]
Frey, C. B. & Osborne, M. A. The future of employment: How susceptible are jobs to computerisation? Technol. Forecast. Soc. Change 114, 254–280 (2017)
work page 2017
-
[64]
Wired. Demis Hassabis on the Future of Work in the Age of AI (2025); https://youtu.be/CRraHg4Ks_g?si=Jzp3WL_JEZvLPK03
work page 2025
-
[66]
Impact caps: why population, affluence and technology strategies should be abandoned
Alcott, B. Impact caps: why population, affluence and technology strategies should be abandoned. J. Clean. Prod. 18, 552–560 (2010)
work page 2010
-
[67]
Wiesner, P ., O’Neill, D. W., Larosa, F . & Kao, O. Efficiency will not lead to sustainable reasoning AI. Preprint at https://doi.org/10.48550/arXiv.2511.15259 (2025)
-
[68]
The Theory of the Leisure Class (Prometheus Books, 1998)
Veblen, T. The Theory of the Leisure Class (Prometheus Books, 1998)
work page 1998
-
[69]
Cattaneo, C., D’Alisa, G., Kallis, G. & Zografos, C. Degrowth futures and democracy. Futures 44, 515–523 (2012)
work page 2012
- [70]
-
[71]
Dismantling AI capitalism: the commons as an alternative to the power concentration of Big Tech
Verdegem, P . Dismantling AI capitalism: the commons as an alternative to the power concentration of Big Tech. AI Soc. 39, 727–737 (2024)
work page 2024
-
[72]
Polycentric systems for coping with collective action and global environmental change
Ostrom, E. Polycentric systems for coping with collective action and global environmental change. Glob. Environ. Change 20, 550–557 (2010)
work page 2010
-
[73]
Degrowth business framework: Implications for sustainable development
Nesterova, I. Degrowth business framework: Implications for sustainable development. J. Clean. Prod. 262, 121382 (2020)
work page 2020
-
[74]
Hinton, J. B. Fit for purpose? Clarifying the critical role of profit for sustainability. J. Polit. Ecol. 27, 236–262 (2020)
work page 2020
-
[75]
The Internet Con: How to Seize the Means of Computation (Verso, 2023)
Doctorow, C. The Internet Con: How to Seize the Means of Computation (Verso, 2023)
work page 2023
-
[76]
Tools for Conviviality (Fontana/Collins, 1973)
Illich, I. Tools for Conviviality (Fontana/Collins, 1973)
work page 1973
-
[77]
The Matrix of Convivial Technology – Assessing technologies for degrowth
Vetter, A. The Matrix of Convivial Technology – Assessing technologies for degrowth. J. Clean. Prod. 197, 1778–1786 (2018)
work page 2018
-
[78]
Prosperity without Growth: Foundations for the Economy of Tomorrow (Routledge, 2017)
Jackson, T. Prosperity without Growth: Foundations for the Economy of Tomorrow (Routledge, 2017)
work page 2017
-
[79]
Dopamine Nation: Finding Balance in the Age of Indulgence (Dutton, 2021)
Lembke, A. Dopamine Nation: Finding Balance in the Age of Indulgence (Dutton, 2021)
work page 2021
-
[80]
Kallis, G. Limits: Why Malthus Was Wrong and Why Environmentalists Should Care (Stanford University Press, 2019)
work page 2019
-
[81]
European Union. Artificial Intelligence Act (Official Journal of the European Union, 2024); https://eur-lex.europa.eu/eli/reg/2024/1689/oj
work page 2024
-
[82]
Erdil, E. et al. GATE: An integrated assessment model for AI automation. Preprint at https://doi.org/10.48550/arXiv.2503.04941 (2025)
-
[83]
D’Alessandro, S., Cieplinksi, A., Distefano, T. & Dittmer, K. Feasible alternatives to green growth. Nat. Sustain. 3, 329–335 (2020)
work page 2020
-
[84]
Vogel, J. et al. COMPASS: A Social-Ecological Macroeconomic Model for Guiding Pathways to Equitable Human Wellbeing within Planetary Boundaries (ToBe Research Project, 2025); https://doi.org/10.5281/zenodo.15655594
-
[85]
McElroy, C. & O’Neill, D. W. The labour and resource use requirements of a good life for all. Glob. Environ. Change 92, 103008 (2025). – 18 – SUPPLEMENTARY INFORMATION Below we describe the methods used to create the figures presented in the main text. Fig. 1a: Doubling times for selected AI metrics In Fig. 1a of the main text, we show the doubling times ...
work page 2025
-
[86]
Mooney, P. AI Index Report 2025 (Dataset) (2025); https://www.kaggle.com/datasets/paultimothymooney/ai -index-report-2025?resource=download
work page 2025
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.