pith. sign in

arxiv: 2602.00355 · v2 · submitted 2026-01-30 · 💰 econ.EM

Coping with Inductive Risk When Theories are Underdetermined: Decision Making with Partial Identification

Pith reviewed 2026-05-16 08:27 UTC · model grok-4.3

classification 💰 econ.EM
keywords partial identificationunderdeterminationinductive riskpolicy decision makingeconometric analysiswelfare economicsscientific uncertainty
0
0 comments X

The pith

Combining partial identification with decision criteria under uncertainty enables coherent policy choices without selecting one among underdetermined theories.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper examines how underdetermination of theories by data creates significant inductive risk for policy predictions. Partial identification tools characterize the broad set of outcomes consistent with data and assumptions rather than pinning down unique values. Pairing these bounds with rules for choosing under uncertainty allows decisions to be made on the available information. A sympathetic reader would see this as a practical way to inform public policy amid ongoing scientific debates. The author argues this deserves more attention in philosophical discussions of science and risk.

Core claim

Study of partial identification finds underdetermination and inductive risk to be highly consequential for credible prediction of important societal outcomes and for credible public decision making. Mathematical tools characterize scientific uncertainties arising from data and well-supported assumptions. Combining partial identification with criteria for reasonable decision making under uncertainty yields coherent approaches to make policy choices without accepting one among multiple empirically underdetermined theories.

What carries the argument

Partial identification analysis, the process of determining the set of possible values for a population outcome that are consistent with the observed data and the maintained assumptions.

Load-bearing premise

Well-supported assumptions together with available data are sufficient to characterize the relevant scientific uncertainties for making credible societal predictions.

What would settle it

An empirical application in which the identified set of outcomes is so wide that no standard decision criterion can rank policy options would show the approach provides no guidance.

read the original abstract

Controversy about the significance of underdetermination of theories persists in the philosophy and conduct of science. The issue has practical import when research is used to inform decision making, because scientific uncertainty yields inductive risk. Seeking to enhance communication between philosophers and researchers who study public policy, this paper describes econometric analysis of partial identification and its use in welfare-economic policy analysis. Study of partial identification finds underdetermination and inductive risk to be highly consequential for credible prediction of important societal outcomes and, hence, for credible public decision making. It provides mathematical tools to characterize a broad class of scientific uncertainties that arise when available data and well-supported assumptions are combined to predict population outcomes. Combining study of partial identification with criteria for reasonable decision making under uncertainty yields coherent approaches to make policy choices without accepting one among multiple empirically underdetermined theories. The paper argues that study of partial identification warrants attention in philosophical discourse on underdetermination and inductive risk.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

2 major / 1 minor

Summary. The paper claims that partial identification in econometrics provides mathematical tools to characterize a broad class of scientific uncertainties arising from underdetermined theories when combining data with well-supported assumptions, and that integrating these tools with standard decision criteria under uncertainty (such as maximin or minimax regret) yields coherent policy decision procedures that avoid the need to select among competing empirically underdetermined theories, thereby addressing inductive risk in public policy contexts.

Significance. If the integration holds, the work offers a substantive bridge between philosophy-of-science discussions of underdetermination and practical econometric methods for welfare-economic policy analysis, potentially enabling more credible societal-outcome predictions and decisions that explicitly account for identified sets rather than point estimates.

major comments (2)
  1. [Abstract and decision-criteria section] Abstract and decision-criteria section: The central claim that the combination produces coherent approaches without relocating underdetermination requires explicit discussion of how to select among decision criteria when they disagree on the same identified set; different criteria (maximin vs. minimax regret) can yield conflicting policy rankings, and absent a further grounding that itself avoids underdetermination, the inductive-risk problem is shifted rather than eliminated.
  2. [Partial-identification applications] Partial-identification applications: The manuscript should supply at least one fully worked numerical example deriving explicit bounds on an outcome distribution from data plus assumptions and then applying a specific decision criterion to produce a policy ranking, to demonstrate that the claimed coherence is operational rather than conceptual only.
minor comments (1)
  1. Clarify notation for identified sets and decision functionals early and maintain consistency; avoid switching between set-valued and interval representations without explicit mapping.

Simulated Author's Rebuttal

2 responses · 0 unresolved

We thank the referee for these constructive comments, which highlight important aspects of how partial identification interacts with decision criteria under uncertainty. We address each major comment below and will revise the manuscript to strengthen the exposition while preserving the core argument that partial identification tools address inductive risk without requiring selection among underdetermined theories.

read point-by-point responses
  1. Referee: [Abstract and decision-criteria section] Abstract and decision-criteria section: The central claim that the combination produces coherent approaches without relocating underdetermination requires explicit discussion of how to select among decision criteria when they disagree on the same identified set; different criteria (maximin vs. minimax regret) can yield conflicting policy rankings, and absent a further grounding that itself avoids underdetermination, the inductive-risk problem is shifted rather than eliminated.

    Authors: We agree that explicit discussion of criterion selection is warranted when maximin and minimax regret (or other rules) produce conflicting rankings on the same identified set. However, this does not relocate the original inductive-risk problem. The underdetermination addressed by partial identification concerns the empirical content of the model (what outcomes are consistent with data plus maintained assumptions). In contrast, the choice among decision criteria is a normative matter of how the policy maker wishes to handle ambiguity, which can be grounded in explicit preferences or robustness considerations without reintroducing empirical underdetermination. In the revised version we will add a dedicated paragraph in the decision-criteria section clarifying this distinction and outlining practical approaches (e.g., reporting rankings under multiple criteria or adopting a meta-criterion such as maximin regret over the set of admissible rules). This addition will make the coherence claim more precise without altering the manuscript's central thesis. revision: yes

  2. Referee: [Partial-identification applications] Partial-identification applications: The manuscript should supply at least one fully worked numerical example deriving explicit bounds on an outcome distribution from data plus assumptions and then applying a specific decision criterion to produce a policy ranking, to demonstrate that the claimed coherence is operational rather than conceptual only.

    Authors: We accept that a concrete numerical illustration would better demonstrate operational coherence. Although the manuscript is primarily conceptual to facilitate dialogue between philosophy of science and econometrics, we will add a short worked example in a new subsection of the applications section. The example will derive sharp bounds on a binary outcome distribution from a simple data-generating process plus a monotonicity assumption, then apply the maximin criterion to rank two policy alternatives. This will show explicitly how the identified set feeds into a decision rule and produces a determinate policy recommendation without point identification. The addition will be kept concise to maintain the paper's focus while addressing the referee's request. revision: yes

Circularity Check

0 steps flagged

No load-bearing circularity; external criteria and prior methods keep derivation independent

full rationale

The paper combines established partial-identification bounds with separate decision criteria (maximin, minimax regret, etc.) drawn from decision theory. No equation or step in the described framework defines a prediction in terms of itself or renames a fitted parameter as a novel result. Self-citations to Manski's earlier partial-ID work are present but not load-bearing for the central claim that the combination yields coherent policy choices; that claim rests on the external decision criteria rather than reducing to a tautology within this manuscript.

Axiom & Free-Parameter Ledger

0 free parameters · 2 axioms · 0 invented entities

The central argument rests on standard econometric assumptions about data and assumptions yielding partial identification bounds, plus domain assumptions from decision theory under uncertainty. No new free parameters or invented entities are introduced.

axioms (2)
  • domain assumption Available data and well-supported assumptions can be combined to bound population outcomes
    Invoked throughout the abstract as the basis for characterizing uncertainties in prediction.
  • domain assumption Criteria exist for reasonable decision making under uncertainty that do not require selecting a single theory
    Used to derive coherent policy approaches from the partial identification bounds.

pith-pipeline@v0.9.0 · 5454 in / 1125 out tokens · 22514 ms · 2026-05-16T08:27:20.991554+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Lean theorems connected to this paper

Citations machine-checked in the Pith Canon. Every link opens the source theorem in the public Lean library.

  • IndisputableMonolith/Cost/FunctionalEquation.lean washburn_uniqueness_aczel echoes
    ?
    echoes

    ECHOES: this paper passage has the same mathematical shape or conceptual pattern as the Recognition theorem, but is not a direct formal dependency.

    Manski (2003) introduced a principle called 'The Law of Decreasing Credibility: The credibility of inference decreases with the strength of the assumptions maintained.'

  • IndisputableMonolith/Foundation/ArithmeticFromLogic.lean LogicNat recovery from non-trivial generator echoes
    ?
    echoes

    ECHOES: this paper passage has the same mathematical shape or conceptual pattern as the Recognition theorem, but is not a direct formal dependency.

    Combining study of partial identification with criteria for reasonable decision making under uncertainty yields coherent approaches to make policy choices without accepting one among multiple empirically underdetermined theories.

What do these tags mean?
matches
The paper's claim is directly supported by a theorem in the formal canon.
supports
The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
extends
The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
uses
The paper appears to rely on the theorem as machinery.
contradicts
The paper's claim conflicts with a theorem or certificate in the canon.
unclear
Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.