REVIEW 2 major objections 4 minor 151 references
Ex-ante minimax rules often prescribe actions the researcher would reject after seeing the data; two new criteria keep decisions optimal both before and after the sample arrives.
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
T0 review · grok-4.5
2026-07-14 11:05 UTC pith:ASV2NOK2
load-bearing objection Clean formalization of interim credibility for frequentist minimax rules, plus solid axiomatizations of two natural fixes that nest known special cases. the 2 major comments →
Dynamically Consistent Statistical Decisions
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
Ex-ante minimax-loss and minimax-regret rules are dynamically consistent precisely when their interim actions coincide with the conditional Bayes problem induced by a least-favorable prior. Two new optimality criteria—dynamically consistent minimax loss and dynamically consistent minimax regret—aggregate interim worst-case payoffs with a subjective marginal over samples and are the unique preference and choice representations that remain optimal after every data realization while nesting Manski’s as-if optimization and Gamma*-minimax.
What carries the argument
The least-favorable-prior representation of minimax optimality (Proposition 1) together with the two axiomatized criteria DC-MML and DC-MMR, which evaluate a rule by the expected interim worst-case payoff or regret under a subjective marginal µ over the sample and a correspondence of interim belief sets Q_z.
Load-bearing premise
The decision maker must already possess a well-defined subjective distribution over possible samples even when she cannot form a prior over the high-dimensional state space.
What would settle it
In a binary treatment-choice experiment with known arm sizes, compute the least-favorable distance d_N; if after a large positive estimated treatment effect the researcher still finds the least-favorable posterior (supported only on |µ1−µ0|=d_N) a credible interim belief, the paper’s claim that classical minimax lacks interim credibility is false.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper studies dynamic consistency of frequentist statistical decision rules justified by ex ante criteria such as minimax loss and minimax regret. It shows that any interim criterion dynamically consistent with an ex ante minimax rule must coincide with the conditional Bayes problem induced by a least-favorable prior (Proposition 1), and uses this fact as a diagnostic: in treatment choice (Stoye 2009) and evidence aggregation (Yata 2021), least-favorable posteriors concentrate on effect sizes that the realized data make implausible, so a researcher may wish to deviate from the ex ante rule after seeing the data. The authors then define and axiomatize two dynamically consistent criteria (DC-MML and DC-MMR) that aggregate interim worst-case objectives with a subjective marginal µ over the sample space and an interim belief correspondence z ↦ Q_z; these nest Manski’s as-if optimization and Lim’s Gamma*-minimax. Applications to Bursztyn et al. (2020) and a simulated evidence-aggregation design illustrate that as-if MMR avoids the interim pathologies of pure minimax regret.
Significance. The contribution is substantial for econometric decision theory. The literature has produced many finite-sample and asymptotic minimax-regret rules for treatment choice and policy learning, yet has largely ignored whether those rules remain optimal after the data realize. Formalizing the interim problem via least-favorable priors, documenting empirically relevant inconsistencies, and supplying complete axiomatizations of dynamically consistent alternatives that nest existing proposals (Manski as-if, Gamma*) fills a clear gap. The proofs of Propositions 1–3 and Theorems 1–2 are standard game-theoretic and Anscombe–Aumann arguments and appear carefully checked; the empirical illustrations use public data and transparent Monte-Carlo designs. The framework also clarifies when a researcher can use a subjective marginal over data without a full prior over a high-dimensional state space—an attractive semi-Bayesian middle ground.
major comments (2)
- Section 6.2 and Axioms 1/5: the DC criteria require a well-defined full-support subjective marginal µ over Z. When Θ is high-dimensional this is presented as weaker than a prior over Θ, yet the paper never discusses how a practitioner should elicit or validate µ, nor what happens under misspecification of µ. Because the ex-ante ranking is defined by aggregation under µ, this is load-bearing for the claim that DC rules are operationally usable; a short discussion of elicitation or robustness would strengthen the contribution.
- Section 7.2 / Table 1 and Figure 2: the empirical illustration enumerates overlapping covariate cells (Appendix B.1) rather than a single partition. While each cell is a valid randomized experiment, the reported counts of disagreements (e.g., 18 subgroups at α=0.10) are therefore not independent observations. The qualitative message is unaffected, but the paper should state more clearly that the exercise is illustrative rather than a formal frequency claim about the population of cells.
minor comments (4)
- Page 12, Remark 1: the distinction between “too conservative” and “not conservative enough” forms of dynamic inconsistency is useful; a one-sentence pointer back to Figure 1 would help the reader locate the quantitative illustration.
- Figure 3 caption: the pink/beige/blue regions are described in the text but the color legend in the figure itself is dense; a short key in the caption would improve readability.
- Appendix A.2, Example A.1: the numerical value d_1100 ≈ 0.023 is given without stating the optimization routine or tolerance; a one-line note would aid replication.
- References: a few recent related papers on pre-analysis plans and robust Bayes (already cited in the introduction) could be cross-referenced again in Section 7 when the interim credibility of pre-committed rules is discussed.
Circularity Check
No significant circularity: DC criteria are intentionally defined to aggregate interim objectives, and the axiomatizations and least-favorable-prior rationalization are independent representation arguments.
full rationale
The paper’s load-bearing claims do not reduce to their own inputs by construction in the sense of the circularity patterns. Proposition 1 is a standard iterated-expectation / pasting argument: once a least-favorable prior π* supports an ex ante minimax rule, the rule’s continuation is posterior-Bayes almost surely under P_π*; π* is an endogenous saddle-point object of the zero-sum game, not a free parameter fitted to force interim agreement. Definitions 2–3 deliberately build dynamic consistency by aggregating interim Q_z objectives with a marginal µ; that is design of a criterion class, not a claimed independent derivation of consistency from something else. Theorems 1–2 recover (µ,{Q_z}) from independent axioms (Z-SEU / IIA on Z-measurable acts, Θ-MEU or Stoye’s endogenous-prior regret axioms plus Z-separability); the representations are standard and do not smuggle the target optimality into the primitives. Nesting of Manski as-if (Q_z = Δ(Θ̂(z))) and Lim’s Gamma*-minimax (Q_z = Π_z) is exact specialization of the same objects, not a prediction forced by a fit. The Lim (2026) self-citation is only used to exhibit nesting and is not a uniqueness theorem that forbids alternatives for the main results. Empirical diagnostics compare least-favorable posteriors to conventional evidence without fitting parameters that are then re-labeled as predictions. No equation equates a claimed first-principles result to a quantity defined by that same result.
Axiom & Free-Parameter Ledger
axioms (6)
- standard math Z-SEU: preference restricted to Z-measurable acts is full-support subjective expected utility (Axiom 1)
- standard math Θ-MEU: every conditional preference ≿_z is maxmin expected utility (Axiom 3)
- standard math Stoye (2011a) axioms for endogenous-prior minimax regret (non-triviality, monotonicity, independence, INA, mixture continuity, ambiguity aversion, C-betweenness) (Axiom 4)
- domain assumption Z-Separability / Z-Separable Choice: ranking or choice of acts that differ only at a single data realization z is independent of the continuation outside z (Axioms 2 and 6)
- standard math IIA on Z-measurable acts (Axiom 5)
- domain assumption D closed under measurable pasting
invented entities (2)
-
Dynamically Consistent Minimax Loss (DC-MML) and Dynamically Consistent Minimax Regret (DC-MMR)
no independent evidence
-
Interim belief correspondence z ↦ Q_z
no independent evidence
read the original abstract
A large literature in econometrics proposes decision rules with optimality guarantees based on ex ante criteria, such as minimax regret. We develop a framework for analyzing the dynamic consistency of such rules and show that, in many empirically relevant settings, the researcher may wish to deviate from the interim prescription of ex ante optimal rules after observing the data realization. To address this problem, we propose and axiomatize two classes of optimality criteria that yield dynamically consistent decision rules.
Figures
Reference graph
Works this paper leans on
-
[1]
A Smooth Model of Decision Making under Ambiguity , urldate =
Peter Klibanoff and Massimo Marinacci and Sujoy Mukerji , journal =. A Smooth Model of Decision Making under Ambiguity , urldate =
-
[2]
2007 , author =
A subjective model of experimentation , journal =. 2007 , author =
2007
-
[3]
Subjective Probability and Expected Utility without Additivity , urldate =
David Schmeidler , journal =. Subjective Probability and Expected Utility without Additivity , urldate =
-
[4]
Maxmin expected utility with non-unique prior , journal =. 1989 , issn =. doi:https://doi.org/10.1016/0304-4068(89)90018-9 , url =
-
[5]
Part I , journal =
Knightian decision theory. Part I , journal =. 2002 , author =
2002
-
[6]
Objective and Subjective Rationality in a Multiple Prior Model , urldate =
Itzhak Gilboa and Fabio Maccheroni and Massimo Marinacci and David Schmeidler , journal =. Objective and Subjective Rationality in a Multiple Prior Model , urldate =
-
[7]
Objective rationality foundations for (dynamic) -MEU , journal =
Mira Frick and Ryota Iijima and Yves. Objective rationality foundations for (dynamic) -MEU , journal =. 2022 , issn =. doi:https://doi.org/10.1016/j.jet.2021.105394 , url =
-
[8]
Differentiating ambiguity and ambiguity attitude , journal =. 2004 , issn =. doi:https://doi.org/10.1016/j.jet.2003.12.004 , url =
-
[9]
Decision Making with Belief Functions: Compatibility and Incompatibility with the Sure-Thing Principle , urldate =
Jean-Yves Jaffray and Peter Wakker , journal =. Decision Making with Belief Functions: Compatibility and Incompatibility with the Sure-Thing Principle , urldate =
-
[10]
Choice under uncertainty with the best and worst in mind: Neo-additive capacities , journal =. 2007 , issn =. doi:https://doi.org/10.1016/j.jet.2007.01.017 , author =
-
[11]
Expected Uncertain Utility Theory , urldate =
Faruk Gul and Wolfgang Pesendorfer , journal =. Expected Uncertain Utility Theory , urldate =
-
[12]
mimeo , year =
Igor Kopylov , title =. mimeo , year =
-
[13]
Coping with Ignorance: Unforeseen Contingencies and Non-Additive Uncertainty , urldate =
Paolo Ghirardato , journal =. Coping with Ignorance: Unforeseen Contingencies and Non-Additive Uncertainty , urldate =
-
[14]
Proceedings of the Eleventh International Symposium on Imprecise Probabilities: Theories and Applications , pages =
An Axiomatic Utility Theory for Dempster-Shafer Belief Functions , author =. Proceedings of the Eleventh International Symposium on Imprecise Probabilities: Theories and Applications , pages =. 2019 , volume =
2019
-
[15]
A. P. Dempster , journal =. A Generalization of Bayesian Inference , urldate =
-
[16]
A. P. Dempster , journal =. Upper and Lower Probabilities Generated by a Random Closed Interval , urldate =
-
[17]
A. P. Dempster , journal =. New Methods for Reasoning Towards Posterior Distributions Based on Sample Data , urldate =
-
[18]
A Mathematical Theory of Evidence , urldate =
Glenn Shafer , publisher =. A Mathematical Theory of Evidence , urldate =
-
[19]
Additive Representations of Non-Additive Measures and the Choquet Integral , volume =
Gilboa, Itzhak and Schmeidler, David , year =. Additive Representations of Non-Additive Measures and the Choquet Integral , volume =. Annals of Operations Research , doi =
-
[20]
Savage , editor =
Leonard J. Savage , editor =. The Foundations of Statistics , year =
-
[21]
Risk, Ambiguity, and the Savage Axioms , urldate =
Daniel Ellsberg , journal =. Risk, Ambiguity, and the Savage Axioms , urldate =
-
[22]
Decision analysis using belief functions , journal =. 1990 , issn =. doi:https://doi.org/10.1016/0888-613X(90)90014-S , author =
-
[23]
Modeling the Change of Paradigm: Non-Bayesian Reactions to Unexpected News , urldate =
Pietro Ortoleva , journal =. Modeling the Change of Paradigm: Non-Bayesian Reactions to Unexpected News , urldate =
-
[24]
Revisiting Savage in a Conditional World , urldate =
Paolo Ghirardato , journal =. Revisiting Savage in a Conditional World , urldate =
-
[25]
Recursive multiple-priors , journal =. 2003 , issn =. doi:https://doi.org/10.1016/S0022-0531(03)00097-8 , author =
-
[26]
Proceedings of the National Academy of Sciences , volume =
Simone Cerreia-Vioglio and Fabio Maccheroni and Massimo Marinacci and Luigi Montrucchio , title =. Proceedings of the National Academy of Sciences , volume =
-
[27]
2023 , issn =
Strength of preference over complementary pairs axiomatizes alpha-MEU preferences , journal =. 2023 , issn =
2023
-
[28]
Symmetry or Dynamic Consistency? , author =. The B.E. Journal of Theoretical Economics , year =
-
[29]
Epstein and Kyoungwon Seo , journal =
Larry G. Epstein and Kyoungwon Seo , journal =. Symmetry of evidence without evidence of symmetry , volume =
-
[30]
2003 , author =
IID: independently and indistinguishably distributed , journal =. 2003 , author =
2003
-
[31]
2024 , url =
Alpha-maxmin as an aggregation of two selves , journal =. 2024 , url =
2024
-
[32]
2009 , author =
Subjective states: A more robust model , journal =. 2009 , author =
2009
-
[33]
2007 , author =
Coarse contingencies and ambiguity , journal =. 2007 , author =
2007
-
[34]
2014 , issn =
A theory of subjective learning , journal =. 2014 , issn =
2014
-
[35]
Preference for Flexibility
David M. Kreps , journal =. A Representation Theorem for "Preference for Flexibility" , volume =
-
[36]
and Border, Kim C
Aliprantis, Charalambos D. and Border, Kim C. , publisher =
-
[37]
Random Choice and Private Information , volume =
Jay Lu , journal =. Random Choice and Private Information , volume =
-
[38]
Random Ambiguity , volume =
Jay Lu , journal =. Random Ambiguity , volume =
-
[39]
2006 , author =
A Behavioral Characterization of Plausible Priors , journal =. 2006 , author =
2006
-
[40]
2018 , author =
Blackwell's informativeness theorem using diagrams , journal =. 2018 , author =
2018
-
[41]
2025 , author =
A Theory of Coarse Information Structures , journal =. 2025 , author =
2025
-
[42]
and Schneider, Martin , title =
Epstein, Larry G. and Schneider, Martin , title =. The Review of Economic Studies , volume =. 2007 , month =
2007
-
[43]
2024 , author =
On comparisons of information structures with infinite states , journal =. 2024 , author =
2024
-
[44]
2025 , author =
A simple proof of Blackwell’s theorem on the comparison of experiments for a general state space , journal =. 2025 , author =
2025
-
[45]
Equivalent comparisons of experiments , journal =
David Blackwell , pages =. Equivalent comparisons of experiments , journal =
-
[46]
Comparison of experiments , journal =
David Blackwell , volume =. Comparison of experiments , journal =
-
[47]
2021 , author =
A Proof of Blackwell's Theorem , journal =. 2021 , author =
2021
-
[48]
2019 , author =
Ambiguous persuasion , journal =. 2019 , author =
2019
-
[49]
Mechanism Design with Ambiguous Communication Devices , volume =
Subir Bose and Ludovic Renou , journal =. Mechanism Design with Ambiguous Communication Devices , volume =
-
[50]
Bayesian Persuasion , volume =
Emir Kamenica and Matthew Gentzkow , journal =. Bayesian Persuasion , volume =
-
[51]
2016 , author =
Bayesian persuasion with heterogeneous priors , journal =. 2016 , author =
2016
-
[52]
2024 , author =
Dynamic Consistency and Ambiguous Communication , journal =. 2024 , author =
2024
-
[53]
2024 , journal=
Persuasion with Ambiguous Communication , author=. 2024 , journal=
2024
-
[54]
2025 , journal=
Ambiguous Persuasion: An Ex-Ante Formulation , author=. 2025 , journal=
2025
-
[55]
2021 , journal=
A Concavification Approach to Ambiguous Persuasion , author=. 2021 , journal=
2021
-
[56]
2017 , journal=
Public Persuasion , author=. 2017 , journal=
2017
-
[57]
2024 , author =
Informativeness orders over ambiguous experiments , journal =. 2024 , author =
2024
-
[58]
2012 , author =
Informativeness of experiments for meu , journal =. 2012 , author =
2012
-
[59]
2016 , author =
Blackwell's informativeness ranking with uncertainty-averse preferences , journal =. 2016 , author =
2016
-
[60]
2015 , author =
Comparisons of Ambiguous Experiments , journal =. 2015 , author =
2015
-
[61]
2022 , author =
Biased learning under ambiguous information , journal =. 2022 , author =
2022
-
[62]
2025 , author =
Sequential learning under informational ambiguity , journal =. 2025 , author =
2025
-
[63]
American Economic Review , Volume =
Auster, Sarah and Che, Yeon-Koo and Mierendorff, Konrad , Title =. American Economic Review , Volume =
-
[64]
Econometrica , volume =
Dütting, Paul and Feldman, Michal and Peretz, Daniel and Samuelson, Larry , title =. Econometrica , volume =
-
[65]
Theoretical Economics , volume =
Wolitzky, Alexander , title =. Theoretical Economics , volume =
-
[66]
2025 , author =
Contagious Ambiguity , journal =. 2025 , author =
2025
-
[67]
Theoretical Economics , volume =
Kosterina, Svetlana , title =. Theoretical Economics , volume =
-
[68]
Model Uncertainty , volume =
Massimo Marinacci , journal =. Model Uncertainty , volume =
-
[69]
R. H. Strotz , journal =. Myopia and Inconsistency in Dynamic Utility Maximization , volume =
-
[70]
2023 , issn =
Ambiguous information and dilation: An experiment , journal =. 2023 , issn =
2023
-
[71]
2021 , author =
Evaluating ambiguous random variables from Choquet to maxmin expected utility , journal =. 2021 , author =
2021
-
[72]
Choice deferral and ambiguity aversion , volume =
Kopylov, Igor , year =. Choice deferral and ambiguity aversion , volume =
-
[73]
SSRN Electronic Journal , year =
Experimental Persuasion , author =. SSRN Electronic Journal , year =
-
[74]
and Maschler, Michael B
Aumann, Robert J. and Maschler, Michael B. , title =. 1995 , publisher =
1995
-
[75]
A Rule For Updating Ambiguous Beliefs , volume =
Pires, Cesaltina , year =. A Rule For Updating Ambiguous Beliefs , volume =. Theory and Decision , doi =
-
[76]
SSRN Electronic Journal , year =
Raphael Boleslavsky and Kyungmin Kim , title =. SSRN Electronic Journal , year =. doi:10.2139/ssrn.2913669 , url =
-
[77]
Econometrica , volume =
Giacomini, Raffaella and Kitagawa, Toru , title =. Econometrica , volume =
-
[78]
Robust Bayesian Analysis for Econometrics , booktitle=
Giacomini, Raffaella and Kitagawa, Toru and Read, Matthew , editor=. Robust Bayesian Analysis for Econometrics , booktitle=. 2025 , pages=
2025
-
[79]
Model and Predictive Uncertainty: A Foundation for Smooth Ambiguity Preferences , volume =
Denti, Tommaso and Pomatto, Luciano , year =. Model and Predictive Uncertainty: A Foundation for Smooth Ambiguity Preferences , volume =. Econometrica , doi =
-
[80]
Model and Predictive Uncertainty: A Foundation for Smooth Ambiguity Preferences , journal =
Denti, Tommaso and Pomatto, Luciano , year =. Model and Predictive Uncertainty: A Foundation for Smooth Ambiguity Preferences , journal =
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.