A Sensitivity Analysis Framework for Causal Inference Under Interference

AmirEmad Ghassami; Matvey Ortyashov

REVIEW 1 major objections 4 minor 2 references

A Sensitivity Analysis Framework for Causal Inference Under Interference

T0 review · 1 major / 4 minor · reviewed 2026-08-03 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read The bias from ignoring interference and unmeasured confounding is a sum of interpretable covariances.

desk verdict Theorem 1's bias decomposition is a genuine and useful contribution, but the transportability sensitivity bound in Theorem 2 is wrong as stated: sigma_tilde_upsilon(g) <= beta does not follow from Popoviciu and can fail badly. read the letter →

arxiv 2511.21534 v2 pith:LGPQ6AT4 submitted 2025-11-26 stat.ME

Matvey Ortyashov , AmirEmad Ghassami This is my paper · ORCID

classification stat.ME MSC 62D20

keywords causalinferenceinterferencespillovereffectssensitivityanalysisunmeasuredconfoundingtransportabilityinverseprobabilityweightingpotentialoutcomes

verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper claims that when a researcher uses a naive inverse-probability-weighting estimator that ignores spillovers and unmeasured confounders, the resulting systematic bias is not an opaque quantity: it decomposes exactly into covariances between the estimator's errors-in-weights and two types of causal effects, baseline outcomes and natural spillover effects. Each covariance can be rewritten as a correlation times two standard deviations, which become sensitivity parameters a practitioner can bound using domain knowledge. A third term arises when transporting the estimate to a new population, capturing the contribution of non-transportability. The decomposition is meant to let researchers gauge how strong interference and confounding would have to be to overturn their conclusions, without specifying a full model of the data.

What carries the argument

The machinery is the multiplicative error in weights (MEW) score, eps_a = p(A=a|X,U)/p(A=a|X), which collapses both unmeasured confounding and ignored common causes of A and A_N into one quantity. Alongside an exposure mapping G that summarizes neighbors' treatments, the paper expands Y(a) = Y(a,0) + gamma(a), splitting bias into baseline-outcome covariance and spillover-effect covariance. The transport term uses upsilon(g), the difference between populations in the conditional probability of neighborhood treatment level g.

What would settle it

Simulate a network where treatment is contagious (A_i affects A_j's treatment) with an unmeasured common cause of A and Y, then compare the empirical bias of the naive IPW estimator against the Theorem 1 expression computed from true potential outcomes. If the difference exceeds the bound implied by the true correlations and standard deviations, the decomposition is incomplete; if it is at most that, the bound is supported.

Watch

Extended reading notes

Core claim

The central result (Theorem 1) is the identity Bias = sum over a in {0,1} of (-1)^{1-a}[Cov(Y(a,0), eps_a) + Cov(gamma(a), eps_a)] where eps_a is the ratio of the true propensity score to the pseudo-propensity score used by the naive estimator. Written as correlation-standard-deviation products, the first covariance captures confounding of treatment assignment with baseline outcomes and the second captures the interaction of confounding with heterogeneity in spillover effects. Theorem 2 adds T3 = sum_g [Cov(tau(g), upsilon(g)) + E[tau(g)](p(G=g|S=1)-p(G=g|S=2))] for transporting to a target population. The paper further extends the identity to settings where some potential outcomes are undef

Load-bearing premise

The whole bias identity depends on Assumption 2's consistency form, which fixes each unit's neighbors' treatments G when defining the natural potential outcome; if a unit's own treatment pushes neighbors to change treatment, the potential outcome should be Y(a,G(a)), and the decomposition no longer holds (a limitation the paper acknowledges in Remark 4).

Editorial extensions

If this is right

A practitioner who can bound the three standard deviations and two correlations obtains a worst-case bias interval for the naive IPW estimate under interference.
The T2 term implies that unmeasured confounding matters even when there are no common causes of A and A_N; it is driven by how much spillover effects vary across units.
If the outcome follows an additive model in A and G, the transport bias T3 vanishes (Proposition 2), so non-transportability only bites through interactions.
The extension to undefined potential outcomes (e.g., units with too few neighbors) keeps the same covariance logic with N-conditional covariances for spillover terms.
The framework applies to general interference structures beyond partial interference, since the exposure mapping only needs a scalar summary G.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

The decomposition treats the pseudo-propensity model as correctly specified; if that model is itself misspecified, the MEW score would carry an additional term, so the framework's bounds are lower bounds on total misspecification bias.
Because T3 separates a covariance term from a marginal-imbalance term, the same framework could guide data collection in the target population: the imbalance term is estimable with lighter covariate data than the covariance term.
The discrete exposure mapping assumption could be relaxed to continuous G using density-ratio weighting, preserving the covariance structure with G-specific conditional effects.
The sensitivity parameters could be calibrated against observed proxies by computing partial correlations from auxiliary data, giving an empirical lower bound on the required correlation magnitude.

Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Desk Editor's Note

read the letter

Two things to know. First, the bias decomposition for the reference estimand (Theorem 1) is a real contribution: it cleanly extends Shen et al. to interference plus unmeasured confounding, and the split into baseline-outcome and spillover-effect covariances is both new and interpretable. Second, the transportability sensitivity parameterization in Theorem 2 has a load-bearing error: the claim that sigma_tilde_upsilon(g) <= beta follows from Popoviciu is false.

The reader's take is largely on target. The algebra in Theorems 1 and 2 is correct under the stated assumptions, and the no-interference special case reducing to Shen et al. is a nice sanity check. The sensitivity parameters are intuitive, and the paper is honest about its scope limitations in Remark 4. No simulations are a real gap for a methods paper, but not fatal for the theoretical core.

The beta issue is the main problem. As written, beta bounds the marginal difference p(G=g|S=1) - p(G=g|S=2). But upsilon(g) is a random variable that can have large conditional variation even when its mean is zero. The stress-test example is correct: if G depends on X within each population but the marginal probabilities match, beta=0 while sigma_tilde_upsilon(g) can be 1. So the proposed bound is simply unsupported, and any sensitivity analysis using it will understate the transportability bias. The fix is straightforward: either define beta as a pointwise bound on |upsilon(g)| or replace the Popoviciu step with Bhatia-Davis using the known mean, as the paper already does in Remark 7. But as written, the T3 sensitivity bounds are not valid.

Assumption 2 precludes A->A_N feedback, which the paper acknowledges. That limits applicability to settings where interference acts only on outcomes, not on treatment adoption. It is a stated limitation, not a hidden one, but it deserves more emphasis than it gets.

The citation pattern looks honest, and the claimed novelty relative to VanderWeele et al. and Forastiere et al. is reasonable. This paper deserves peer review: the core decomposition is likely correct and useful, and the beta flaw is fixable. A good referee would catch it. I would encourage the editor to send it out rather than desk reject.

Referee Report

1 major / 4 minor

Summary. The paper proposes a sensitivity analysis framework for causal inference under interference, focusing on the bias of a naive inverse-probability-weighting (IPW) estimator that ignores interference and unmeasured confounding. The main result (Theorem 1) decomposes the bias into a sum of covariances between multiplicative error-in-weights (MEW) scores ε_a and baseline potential outcomes Y(a,0) and natural spillover effects γ(a). Theorem 2 extends the decomposition to transportability, adding a term T3 that captures differences between the reference and target populations. The framework is parameterized by interpretable sensitivity parameters (η_baseline, η_ε, η_γ, β, ρ terms). Section 5 extends the results to settings with undefined potential outcomes. The paper is largely theoretical, with proofs in the appendix and no simulation or empirical illustration.

Significance. If correct, this is a useful contribution to the sensitivity-analysis literature for interference. The bias decomposition is exact under the stated assumptions, and the framework allows practitioners to simultaneously assess unmeasured confounding, ignored interference, and lack of transportability without strong parametric assumptions. The MEW score formulation and the explicit covariance decomposition are elegant and generalize earlier weighting-based results (e.g., Shen et al. 2011). The extension to undefined potential outcomes in Section 5 addresses a real practical concern. However, the lack of any numerical illustration leaves the practical behavior of the sensitivity bounds unexamined, and the transportability parameterization contains a technical error that must be fixed before the framework can be used as stated.

major comments (1)

[Proof of Theorem 2 (Appendix A)] The proof uses the independence S ⊥ X_GY,U_GY (to replace p(S=s|X_GY,U_GY) with p(S=s)), but this is not stated in Assumption 6. The bullet points only give Y(a,g) ⊥ A_N | X_GY,U_GY, S has direct causal effect on A and G, and Y(a,g) ⊥ S. The DAG in Figure 1 may imply the needed independence, but the assumptions as written do not. This is load-bearing for the derivation of T3. Please add the condition explicitly to Assumption 6 (or justify it from the existing conditions) and update the proof.

minor comments (4)

[Section 4, Theorem 2] The expectation E[τ(g)] in T3 is not clearly defined with respect to which population. The proof shows it is an unconditional expectation over the pooled (S=1 and S=2) distribution. This should be stated explicitly, since the sensitivity parameter for E[τ(g)] would then refer to the pooled population, not the reference or target population.
[Assumption 2 and Remark 4] Assumption 2 implicitly precludes a direct causal path from A to A_N, as Remark 4 acknowledges. This limits the framework to settings where interference acts only on outcomes, not on treatment adoption. This is a substantive limitation and should be highlighted earlier in the paper, not only in a remark.
[Throughout] The paper does not include any simulation study, data example, or even a small numerical demonstration of how the sensitivity parameters translate into bias bounds. This makes it difficult for a practitioner to calibrate the parameters or see the method in action. At least one illustrative example would strengthen the paper.
[Remark 7] The Bhatia-Davis bound in Remark 7 is correct for the case where all values of ζ(g) are known, but it is worth noting that this requires stronger information than the β parameter. The distinction between a pointwise bound and a mean bound should be made clear here, in light of the β issue.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the bias decompositions are exact algebraic identities and the sensitivity parameters are user-specified inputs, not fitted or predicted quantities.

full rationale

The paper's central derivations are self-contained algebraic decompositions, not fitted relationships. In Theorem 1, the proof shows E[I(A=1)Y/p(A=1|S=1,X_AY)|S=1] = E[Y(1)ε_1|S=1] by iterated expectation and Assumption 5, and because E[ε_1|S=1]=1, the bias relative to E[Y(1)|S=1] is Cov(Y(1),ε_1|S=1). Splitting Y(1)=Y(1,0)+γ(1) by definition of the natural spillover effect yields the T1+T2 covariance decomposition. This is an exact identity, not a parameter fitted to data and then relabeled as a prediction. The MEW score ε_a is defined as the ratio of true to pseudo propensity scores; the decomposition is proven from that definition and the exchangeability assumption, so the conclusion is not assumed within the input. Theorem 2 similarly derives T3 by conditioning on (X_GY,U_GY) and using Assumption 6; the covariance-plus-mean term is an algebraic consequence, not a fitted output. The sensitivity parameters (η_baseline, η_ε, η_γ, η_τ, ρ_baseline, ρ_spillover, ρ_transport, β) are user-specified bounds and magnitudes, intended to be chosen by the practitioner; they are not estimated from the data to reproduce the bias. No load-bearing self-citation appears: the references to Aronow and Samii, Shen et al., Rosenbaum, Tan, and others are used for positioning, identification formulas, or standard inequalities, and the main proofs are in the appendix. One non-circular correctness concern deserves flagging: in Section 4, the paper states that β, defined by p(G=g|S=1)-p(G=g|S=2)∈[-β,β], 'can also be used to create an upper bound for the standard deviation of υ(g) through Popoviciu’s inequality: σ̃_υ(g) ≤ β.' Under the literal marginal definition of β, this does not follow from Popoviciu, since β bounds only the mean of υ(g), not its conditional variability; a pointwise bound on the conditional difference would be needed. This is a mathematical-support issue, not a circularity issue, so it does not raise the circularity score. The paper also candidly acknowledges the restrictiveness of Assumption 2 in Remark 4, which is a stated limitation rather than a circular move. Overall, the derivation chain is transparent and the claimed decompositions do not reduce to their inputs by construction.

Assumptions & free parameters 5 free parameters · 8 assumptions · 1 invented entities

The framework's derivations rest on a sequence of strong domain assumptions (exchangeability, transportability, consistency under interference) plus user-specified sensitivity parameters. No free parameters are fitted to data; all are user inputs. The only ad hoc axiom is Assumption 10, which is not well-motivated.

free parameters (5)

η_baseline ∈ [0,1]
User-specified proportion of maximum standard deviation of baseline potential outcomes. Not fitted; a sensitivity input.
η_ε ∈ [0,1]
User-specified proportion of the worst-case standard deviation of MEW scores. Determines the practical bound on σ_ε.
η_γ ∈ [0,1]
User-specified bound on the standard deviation of natural spillover effects.
β ∈ [0,1]
User-specified bound on the imbalance in neighborhood-treatment distributions between populations.
ρ_baseline, ρ_spillover, ρ_transport ∈ [0,1]
Common magnitudes of correlations between MEW scores and outcomes; user sets signs to maximize bias.

assumptions (8)

domain assumption Assumption 1: Existence of outcome exposure mapping g_i that summarizes neighbor treatments.
Invoked in Section 2 to define G_i and reduce potential outcomes; not universally valid.
domain assumption Assumption 2: Consistency under interference, Y(a)=Y(a,G), precluding A→A_N feedback.
Invoked in Section 2; if violated, bias decomposition does not follow.
domain assumption Assumption 3: All potential outcomes are well-defined for every unit (used in Sections 3–4).
Relaxed in Section 5, but main theorems rely on it.
domain assumption Assumption 4: Positivity of treatment and selection probabilities.
Standard for IPW; needed for identification formula.
domain assumption Assumption 5: Weak conditional exchangeability Y(a)⊥⊥A | S, X̃, Ũ.
The crux of the causal interpretation; unverifiable without additional design.
domain assumption Assumption 6: Transportability assumptions (S only affects A and G, Y and S share no causes).
Used to prove Theorem 2; ambiguous whether S may have incoming edges.
ad hoc to paper Assumption 10: True and pseudo propensity scores do not depend on the number of neighbors N.
Introduced for undefined-potential-outcome extension; strong and not justified substantively.
standard math Standard probabilistic inequalities (Popoviciu, Bhatia–Davis) and covariance bilinearity.
Used in sensitivity parameter bounds and Theorem 2 proof.

invented entities (1)

Multiplicative Error in Weights (MEW) score ε_a
purpose: Encodes the ratio of true to pseudo propensity scores, central to the bias decomposition.
A mathematical construct, not an observable entity; no falsifiable handle outside the model.

how reviews work

0 comments

Cite this review

Pith. "Pith review of A Sensitivity Analysis Framework for Causal Inference Under Interference." pith.science (2026). https://pith.science/paper/LGPQ6AT4

@misc{pith2026251121534,
  author       = {Pith},
  title        = {Pith review of: A Sensitivity Analysis Framework for Causal Inference Under Interference},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/LGPQ6AT4}},
  note         = {Machine review of arXiv:2511.21534}
}

read the original abstract

In many applications of causal inference, the treatment received by one unit may influence the outcome of another, a phenomenon referred to as interference. Although there are several frameworks for conducting causal inference in the presence of interference, practitioners often lack the data necessary to adjust for its effects. In this paper, we propose a weighting-based sensitivity analysis framework that can be used to assess the systematic bias arising from ignoring interference. Unlike most of the existing literature, we allow for the presence of unmeasured confounding, and show that the combination of interference and unmeasured confounding is a notable challenge to causal inference. We also study a third factor contributing to systematic bias: lack of transportability. Our framework enables practitioners to assess the impact of these three issues simultaneously through several easily interpretable sensitivity parameters that can reflect a wide range of intuitions about the data.

Figures

Figures reproduced from arXiv: 2511.21534 by the authors.

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

2 extracted references · 1 linked inside Pith

[1]

Aronow, P. M. and Samii, C. (2017). Estimating average causal effects under general interference, with application to a social network experiment.The Annals of Applied Statistics, 11(4):1912 –

2017
[1947]

and Pearl, J

Bareinboim, E. and Pearl, J. (2016). Causal inference and the data-fusion problem.Proceedings of the National Academy of Sciences, 113(27):7345–7352. Bhadra, S. and Schweinberger, M. (2025). Causal inference under network interference.arXiv preprint arXiv:2508.06808. 14 Buchanan, A. L., Katenka, N., Lee, Y., Wu, J., Pantavou, K., Friedman, S. R., Halloran...

arXiv 2016

Pith tools

Reviewed August 3, 2026 · model on record in the stance chip above.

[1] [1]

Aronow, P. M. and Samii, C. (2017). Estimating average causal effects under general interference, with application to a social network experiment.The Annals of Applied Statistics, 11(4):1912 –

2017

[2] [1947]

and Pearl, J

Bareinboim, E. and Pearl, J. (2016). Causal inference and the data-fusion problem.Proceedings of the National Academy of Sciences, 113(27):7345–7352. Bhadra, S. and Schweinberger, M. (2025). Causal inference under network interference.arXiv preprint arXiv:2508.06808. 14 Buchanan, A. L., Katenka, N., Lee, Y., Wu, J., Pantavou, K., Friedman, S. R., Halloran...

arXiv 2016