Introduces decision-alignment to evaluate uncertainty metrics against downstream decision utilities and proposes prior-weighted proper scoring rules that align better in benchmarks and case studies.
Athanasios Tsanas, Max Little, Patrick McSharry, and Lorraine Ramig
2 Pith papers cite this work. Polarity classification is still indexing.
2
Pith papers citing it
fields
cs.LG 2representative citing papers
Systematic benchmarking reveals that regression calibration metrics frequently disagree on recalibration quality, with ENCE and CWC identified as more consistent performers.
citing papers explorer
-
Decision-Aligned Evaluation of Uncertainty Quantification
Introduces decision-alignment to evaluate uncertainty metrics against downstream decision utilities and proposes prior-weighted proper scoring rules that align better in benchmarks and case studies.
-
Evaluating the Quality of the Quantified Uncertainty for (Re)Calibration of Data-Driven Regression Models
Systematic benchmarking reveals that regression calibration metrics frequently disagree on recalibration quality, with ENCE and CWC identified as more consistent performers.