REVIEW 5 cited by
An unexpected unity among methods for interpreting model predictions
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Understanding why a model made a certain prediction is crucial in many data science fields. Interpretable predictions engender appropriate trust and provide insight into how the model may be improved. However, with large modern datasets the best accuracy is often achieved by complex models even experts struggle to interpret, which creates a tension between accuracy and interpretability. Recently, several methods have been proposed for interpreting predictions from complex models by estimating the importance of input features. Here, we present how a model-agnostic additive representation of the importance of input features unifies current methods. This representation is optimal, in the sense that it is the only set of additive values that satisfies important properties. We show how we can leverage these properties to create novel visual explanations of model predictions. The thread of unity that this representation weaves through the literature indicates that there are common principles to be learned about the interpretation of model predictions that apply in many scenarios.
Forward citations
Cited by 5 Pith papers
-
Optimizing for Interpretability in Deep Neural Networks with Tree Regularization
Tree regularization, which penalizes the decision path length of a tree fitted to a deep network's predictions, produces deep models with higher accuracy at low complexity than L1 or L2 penalties.
-
Global Aggregations of Local Explanations for Black Box models
GALE aggregates local explanations to reveal global model behavior, showing that LIME's global importance measure is unreliable while the proposed aggregations better capture how features affect predictions.
-
Wavelet Scattering Transform for Interpretable Schizophrenia Biomarker Discovery and Classification from Resting-State EEG
A single sentence stating the discovery directly. ≤ 300 chars.
-
Parkinson's Disease Recognition Using SPECT Image and Interpretable AI: A Tutorial
Guided backpropagation gives the most accurate fine-grained localizations, and SHAP gives the most discriminative heatmaps at the dopamine-depletion site, among six interpretation methods applied to SPECT-based Parkin...
-
AI-Augmented LLMs Achieve Therapist-Level Responses in Motivational Interviewing
A custom prompt built from machine-learning-identified therapy behavior features improved GPT-4's motivational interviewing quality scores, though the model remained slightly below human therapists on the paper's own metric.
Discussion (0). Continue with ORCID to comment.