REVIEW 1 major objections 5 minor 7 references
AGI, Governments, and Free Societies
T0 review · 1 major / 5 minor · reviewed 2026-08-07 · deepseek-v4-flash
Pith's one-line read Artificial general intelligence, if it arrives as expected, poses twin risks of state despotism and institutional collapse, and preserving liberal freedom depends on deliberate institutional design now.
desk verdict A solid, clearly written policy essay that applies the narrow-corridor framework to AGI with a useful channel taxonomy; the central 'distinct risks' claim is underdetermined but the paper is honest about its speculative status. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing idea is the 'narrow corridor': a meta-stable equilibrium between state capacity and societal power in which liberty survives only between the extremes of an absent Leviathan (too little state) and a despotic Leviathan (too much state). The paper treats AGI as an exogenous technological shock to this equilibrium and analyzes it at three levels—micro (individual discretionary decisions), meso (bureaucratic form), and macro (democratic input)—to show how the same capability can push in either direction. The central objects doing the work are 'artificial discretion' (how much decision-making authority an AI system is given) and 'artificial bureaucrats' (AI agents embedded in organizational roles), which together determine whether AGI strengthens or dissolves the corridor.
What would settle it
A concrete check: if by the mid-2030s no system consistently performs at the 90th percentile of skilled adults across a broad battery of cognitive tasks, or if government adoption remains limited to narrow decision-support tools with no movement toward agentic, high-discretion automation, the paper's near-term scenario loses its empirical footing.
Extended reading notes
Core claim
The paper's central claim is that the arrival of AGI at the 'expert' level—performance at or above the 90th percentile of skilled adults across a wide range of cognitive tasks—would constitute an exogenous shock to the narrow corridor in which free societies balance state capacity against societal power. On one side, AGI-enhanced administrative capacity, cheaper monitoring, and greater legibility could tip states toward a despotic Leviathan; on the other, rapid diffusion of AGI to individuals and civil society could hollow out state authority and yield an absent Leviathan. The same technology, the paper argues, will automate high-discretion decisions within agencies, push bureaucracies toward system-level architectures in which humans oversee fleets of agents, and transform democratic feedback through digital twins and large-scale deliberation. None of these outcomes is predetermined: the paper holds that deliberate institutional innovation—hybrid human-AI oversight, privacy-enhancing technologies, adaptive regulation, and anticipatory governance—can keep liberal institutions inside the corridor.
Load-bearing premise
The load-bearing premise is that expert-level AGI—performance at or above the 90th percentile of skilled adults across a wide range of cognitive tasks—will arrive within roughly a decade and be adopted widely by both governments and non-state actors.
Editorial extensions
If this is right
- If AGI reaches expert level, governments will face strong pressure from cost, quality, and scalability to hand high-discretion decisions to AI agents, turning many civil servants into supervisors of agent fleets.
- Cheaper monitoring and comprehensive legibility could produce 'perfect enforcement' of laws that currently rely on discretionary leniency, forcing legal reforms or creating oppressive rigidity.
- If AGI diffuses faster to individuals and private organizations than to states, the state's relative capacity and legitimacy could erode, risking a slide toward the absent Leviathan.
- AGI-enabled digital twins and large-scale deliberation could shift representative democracy toward direct, continuous citizen input, making elected representatives overseers of AI systems.
- Securing the corridor requires investments in privacy-enhancing technologies, explainability tools, hybrid human-AI institutions, and governance experimentation before deployment becomes widespread.
Reading between the lines
- The paper leaves implicit that the decisive variable is not raw AGI capability but the relative speed of adoption by states versus non-state actors; this suggests a testable research program comparing deployment trajectories across regime types.
- Its framework implies that AI-safety discussions focused only on model alignment miss the institutional layer: even a fully aligned AGI can corrode liberty if embedded in unaccountable system-level bureaucracies, a claim that could be examined in agencies already rolling out LLM-based decision support.
- A testable extension would measure whether introducing agentic AI in agencies increases quantification bias, control centralization, and administrative evil relative to comparable human-run offices.
- The analysis also points to a prudential policy corollary: government procurement of AGI systems should be treated as a constitutional-design decision with democratic oversight, not as an ordinary information-technology purchase.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper is a policy-oriented essay examining how the arrival of artificial general intelligence (AGI) could destabilize the 'narrow corridor' between state capacity and individual liberty, drawing on Acemoglu and Robinson's framework. It argues that AGI poses distinct risks of pushing societies toward either a 'despotic Leviathan' through enhanced state surveillance and control, or an 'absent Leviathan' through erosion of state legitimacy relative to AGI-empowered non-state actors. After reviewing scaling-law evidence and uncertainties about AGI timelines, the paper analyzes three governance channels — micro-level administrative discretion, meso-level bureaucratic structure, and macro-level democratic feedback — and concludes with recommendations including privacy-enhancing technologies, hybrid human-AI oversight, and adaptive regulation. The paper is a synthesis without a formal model or original empirical data, and it explicitly acknowledges that its claims are sensitive to diffusion and adoption assumptions.
Significance. If its central claim is accepted, the paper provides a useful bridge between AI-capabilities research and public-administration theory, giving scholars and policymakers a structured vocabulary for AGI-related governance risks. It deserves credit for explicitly hedging its claims ('It is impossible to fully anticipate', 'a non-exhaustive taxonomy') and for grounding its scenarios in concrete mechanisms such as artificial discretion, system-level bureaucracies, enhanced legibility, and perfect enforcement. The paper also offers actionable (if generic) recommendations. Its chief limitation is that the central two-Leviathan prediction is underdetermined by the mechanisms it presents, and the paper does not provide a testable derivation; its value is agenda-setting rather than evidential.
major comments (1)
- [VI (esp. final paragraph; also IV and V)] The central claim that AGI will push societies toward either a 'despotic Leviathan' or an 'absent Leviathan' requires an asymmetry in AGI adoption or empowerment between state and society that is never derived. Section IV's 'legibility arms race' explicitly describes AGI empowering both state surveillance and citizen obfuscation, and Section V states that 'good governance would essentially demand widespread automation of governance tasks,' implying rapid state adoption. The only asymmetry offered is the conditional clause in Section VI: 'if AGI diffuses more rapidly among individuals and civil society groups than governments.' That is an assumption, not an argued consequence. I recommend the authors either (a) state clearly that the two-Leviathan outcome is conditional on adoption paths and justify why both paths are plausible (e.g., open-source diffusion versus bureaucratic inertia), or (b) provide structural reasons why even symmetric augmentation favors the state (e.g., its coercive monopoly, legal authority, or the different quality of 'legibility' that public and private actors can achieve). As written, a reader can construct a balanced-adoption scenario in which AGI strengthens both sides roughly equally and the corridor's width is unchanged, leaving the 'distinct risks' claim underdetermined.
minor comments (5)
- [II, 'Next stop: AGI'] The paper states that 'there are few signs of a slowdown' and 'anticipates near-AGI capabilities within the next decade,' but it also acknowledges that 'the very nature of intelligence itself is contested'; please reconcile the level of confidence, since the decade-specific claim is stronger than the cited evidence justifies and is not necessary for the institutional-adaptation argument.
- [IV, 'Monitoring and compliance costs'] The Tesla FSD example claims automated enforcement imposes 'a degree of perfect compliance that would be considered draconian'; this conflates the AI's behavior with the regulator's enforcement policy, since a regulator could choose to enforce rolling stops only in safety-relevant contexts, so the example should be framed as one possible enforcement regime rather than an inevitability.
- [V, 'Decision making within government agencies'] The EITC example suggests AGI will be more context-sensitive and reduce audit disparities, but Section VI later acknowledges AGI 'may inadvertently replicate or exacerbate societal biases'; please specify under what conditions AGI would avoid the failures of narrow rules-based automation, or soften the optimism in the EITC passage.
- [VI, final paragraph] The paper introduces 'artificial superintelligence' in the concluding discussion without defining it relative to the 'Expert AGI' level used in Section II; please clarify whether the risks and recommendations apply equally to superintelligent systems or only to expert-level AGI.
- [Throughout] Many sources appear only as URLs in footnotes; for journal submission, please move the core references into the reference list using a consistent citation style.
Circularity Check
No circularity: the paper is a conditional conceptual synthesis with no equations, fitted parameters, or self-derived predictions.
full rationale
This paper is a conceptual and speculative synthesis rather than a derivation chain. Its central claims are explicitly conditional scenarios: the 'despotic Leviathan' and 'absent Leviathan' outcomes are presented as two possible directions of disruption, not as unique predictions forced by a model. The 'narrow corridor' framing is borrowed from an external source (Acemoglu and Robinson), and the AGI capability levels are borrowed from external work (Morris et al.). The authors' own prior publications, such as Young et al. (2019) on artificial discretion and Bullock and Kim (2020) on artificial bureaucrats, are used to supply organizing vocabulary and prior conceptual categories, but the paper does not claim to prove those concepts here, nor does it fit parameters to data and then rename those fits as predictions. Section VI explicitly conditions one of the two central scenarios on an openly stated assumption: 'if AGI diffuses more rapidly among individuals and civil society groups than governments.' That is a stated contingency, not a conclusion smuggled in from an earlier premise. There are no equations, no fitted parameters, and no uniqueness theorems invoked to rule out alternatives. The main intellectual risk is underdetermination or speculative extrapolation about AGI timing and adoption asymmetry, which is a correctness and evidentiary concern, not a circularity concern. Therefore the circularity burden is zero.
Assumptions & free parameters
assumptions (5)
- domain assumption The narrow corridor model (Acemoglu-Robinson) accurately characterizes the conditions for liberal freedom.
- domain assumption AGI at the 'Expert AGI' level is plausible within roughly a decade and will be broadly deployed.
- domain assumption Liberal institutions are a contingent, path-dependent equilibrium vulnerable to technological shocks.
- domain assumption AGI can be built to be more context-sensitive and equitable than current rules-based automation.
- domain assumption Public administration frameworks (artificial discretion, system-level bureaucracy) extend directly to AGI agents.
Cite this review
Pith. "Pith review of AGI, Governments, and Free Societies." pith.science (2026). https://pith.science/paper/47LUM657
@misc{pith2026250305710,
author = {Pith},
title = {Pith review of: AGI, Governments, and Free Societies},
year = {2026},
howpublished = {\url{https://pith.science/paper/47LUM657}},
note = {Machine review of arXiv:2503.05710}
}
read the original abstract
This paper examines how artificial general intelligence (AGI) could fundamentally reshape the delicate balance between state capacity and individual liberty that sustains free societies. Building on Acemoglu and Robinson's 'narrow corridor' framework, we argue that AGI poses distinct risks of pushing societies toward either a 'despotic Leviathan' through enhanced state surveillance and control, or an 'absent Leviathan' through the erosion of state legitimacy relative to AGI-empowered non-state actors. Drawing on public administration theory and recent advances in AI capabilities, we analyze how these dynamics could unfold through three key channels: the automation of discretionary decision-making within agencies, the evolution of bureaucratic structures toward system-level architectures, and the transformation of democratic feedback mechanisms. Our analysis reveals specific failure modes that could destabilize liberal institutions. Enhanced state capacity through AGI could enable unprecedented surveillance and control, potentially entrenching authoritarian practices. Conversely, rapid diffusion of AGI capabilities to non-state actors could undermine state legitimacy and governability. We examine how these risks manifest differently at the micro level of individual bureaucratic decisions, the meso level of organizational structure, and the macro level of democratic processes. To preserve the narrow corridor of liberty, we propose a governance framework emphasizing robust technical safeguards, hybrid institutional designs that maintain meaningful human oversight, and adaptive regulatory mechanisms.
Reference graph
Works this paper leans on
-
[1]
ogy shaped our contemporary institutions can shed light on how the mechanisms of a free society may change going forward. III. Mechanics of Free Societies Historical pathways The development of free and liberal democratic societies is a relatively recent phenomenon in human history. While ideas of individual liberty and constraints on power can be traced ...
work page 2011
-
[3]
Social progress. Free societies have often been leaders in expanding civil rights, promoting equality, and addressing social injustices. The ability to freely advocate for change, coupled with democratic mechanisms for translating public will into policy, allows these societies to evolve and address their shortcomings over time. Many scholars have found t...
work page 1999
-
[891]
https://doi.org/10.3390/ph16060891 Bovens, M., & Zouridis, S. (2002). From street-level to system-level bureaucracies: How information and communication technology is transforming administrative discretion and constitutional control. Public Administration Review, 62(2), 174–184. 35 Bullock, J. B. (2019). Artificial Intelligence, Discretion, and Bureaucrac...
-
[1917]
The prosecution of its editors for conspiring to obstruct conscription also illustrates the dark side of state-society conflict. 37 https://press.stripe.com/the-revolt-of-the-public 38 https://www.cambridge.org/core/services/aop-cambridge-core/content/view/74889B3017697FD29E7C2150D2283C59/S0027950122000047a.pdf/populism-and-the-narrow-corridor-of-liberty-...
arXiv 2020
-
[2016]
mass mobilization both more likely to occur and more costly to suppress,
provides a powerful framework for understanding the delicate balance required to maintain free societies. This concept is particularly relevant as we consider the potential impact of AGI on governance and liberty. The narrow corridor represents a space where state capacity and societal power are in equilibrium. On one side of the corridor lies the ‘absent...
work page 2004
-
[2019]
Large Language Models in Politics and Democracy: A Comprehensive Survey
has conceptualized three levels of government impacted by AI: micro, meso, and macro. Roughly speaking, the micro level of governance occurs at the individual decision or individual task level within a government agency. Meso, or organizational, level governance determines organizational shape and the allocation of tasks and decision making within agencie...
work page Pith review arXiv 2019
-
[2024]
Generative AI Voting: Fair Collective Choice is Resilient to LLM biases and Inconsistencies
considers LLMs’ capacity to accurately simulate elections.44 “Generative AI Voting: Fair Collective Choice is Resilient to LLM biases and Inconsistencies” shows that, under specific circumstances, LLMs “prove to be a win-win: fairer voting outcomes for humans with fairer AI representation.” For simple ballots (say, two national candidates for president), ...
arXiv 2024
Reviewed August 7, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.