pith. machine review for the scientific record. sign in

arxiv: 2505.06452 · v3 · submitted 2025-05-09 · 🧮 math.ST · stat.TH

Recognition: unknown

Semiparametric semi-supervised learning for general targets under distribution shift and decaying overlap

Jing Lei, Kathryn Roeder, Lorenzo Testa, Qi Xu

classification 🧮 math.ST stat.TH
keywords overlapundersemiparametricshiftapplicationsasymptoticd2s3data
0
0 comments X
read the original abstract

In modern scientific applications, large volumes of covariate data are readily available, while outcome labels are costly, sparse, and often subject to distribution shift. This asymmetry has spurred interest in semi-supervised (SS) learning, but most existing approaches rely on strong assumptions -- such as missing completely at random (MCAR) labeling or strict positivity -- that put substantial limitations on their practical usefulness. In this work, we introduce a general semiparametric framework for estimation, inference, and efficiency benchmarking in SS settings where labels are missing at random (MAR) and the overlap may vanish as sample size increases. Our framework, that we label D2S3, accommodates a wide range of smooth statistical targets -- including means, linear regression coefficients, quantiles, and causal effects -- and remains valid under high-dimensional nuisance estimation and distributional shift between labeled and unlabeled samples. We extend the theoretical guarantees of augmented inverse probability weighting estimators to preserve double robustness, asymptotic normality, and semiparametric efficiency under this challenging D2S3 regime. A key insight is that classical root-n convergence fails under vanishing overlap; we instead provide corrected asymptotic rates that capture the impact of the decay in overlap. We validate our theory through simulations and demonstrate practical utility in real-world applications on the internet of things and public health where labeled data are scarce.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Transporting treatment effects by calibrating large-scale observational outcomes

    stat.ME 2026-05 unverdicted novelty 6.0

    Proposes a calibration-based estimator for transported average treatment effects that is consistent under correct specification and achieves semiparametric efficiency with large observational data.