pith. machine review for the scientific record. sign in

citation dossier

Conformal Prediction Assessment: A Framework for Conditional Coverage Evaluation and Selection

stub below hub threshold · 1 Pith inbound

· 2026 · stat.ME · arXiv 2603.27189

Conformal prediction provides rigorous distribution-free finite-sample guarantees for marginal coverage under the assumption of exchangeability, but may exhibit systematic undercoverage or overcoverage for specific subpopulations. Assessing conditional validity is challenging, as standard stratification methods suffer from the curse of dimensionality. We propose Conformal Prediction Assessment (CPA), a framework that reframes the evaluation of conditional coverage as a supervised learning task by training a reliability estimator that predicts instance-level coverage probabilities. Building on this estimator, we introduce the Conditional Validity Index (CVI), which decomposes reliability into safety (undercoverage risk) and efficiency (overcoverage cost). We establish convergence rates for the reliability estimator and prove the consistency of CVI-based model selection. Extensive experiments on synthetic and real-world datasets demonstrate that CPA effectively diagnoses local failure modes and that CC-Select, our CVI-based model selection algorithm, consistently identifies predictors with superior conditional coverage performance.

1Pith papers citing it
1reference links
stat.MEtop field · 1 papers
UNVERDICTEDtop verdict bucket · 1 papers

open full Pith review

why this work matters in Pith

Pith has found this work in 1 reviewed paper. Its strongest current cluster is stat.ME (1 papers). The largest review-status bucket among citing papers is UNVERDICTED (1 papers). For highly cited works, this page shows a dossier first and a bounded explorer second; it never tries to render every citing paper at once.

fields

stat.ME 1

years

2026 1

verdicts

UNVERDICTED 1

representative citing papers

citing papers explorer

Showing 1 of 1 citing paper.