REVIEW 4 major objections 4 minor 29 references
Finding Uncommon Ground: A Human-Centered Model for Extrospective Explanations
T0 review · 4 major / 4 minor · reviewed 2026-08-06 · deepseek-v4-flash
Pith's one-line read For surprising AI behavior, explain the fact or rule the user is least likely to share.
desk verdict A clear, honest conceptual proposal for personalizing explanations through interaction memory, but its core selection rule needs a counterfactual-relevance check before it does what it claims. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the SUDO model of the agent's worldview, which separates knowledge into four contexts: situational context (facts about the current state, the Abox), user context (knowledge about the user's abilities, preferences, and state), discourse context (memory of previous requests, actions, and reactions), and ontological context (general rules and commonsense knowledge, the Tbox). User and discourse contexts attach "support" to facts and rules in the other two contexts whenever an interaction suggests the user shares that item, such as explicitly communicated facts, facts the user has perceived, or rules used in successful interactions. Explanation generation then becomes a selection problem: among the knowledge used in the reasoning chain that led to the behavior, choose the item with the least support. The paper also uses defeasible logic, in which specific rules can outrank general ones, to model the reasoning itself.
What would settle it
An empirical study in which users interact with a household agent while privately holding a belief they never express, and the agent later acts on that belief, would test the claim: the least-supported selection would point to some other unsupported item, and users would remain confused about the actual disagreement. Repeatedly observing this confusion would falsify the claim that accumulated support ranks the uncommon ground.
Extended reading notes
Core claim
The paper's central claim is that, for repeated human-AI interaction in the home, the purpose of an explanation is to locate the uncommon ground: the set of facts and rules that the AI used in its reasoning but that the user does not know or accept. Because the exact counterfactual the user had in mind is usually only implied, the agent cannot rely on being told what was expected. Instead, the agent should maintain a personal memory of the user, and explain by presenting the knowledge item with the lowest accumulated support from prior user and discourse contexts. The authors work through a household-robot scenario in which a robot stores a birthday cake outside because the fridge is too small and the patio is cool; which fact is "uncommon" differs per user, and only the support model, not salience or rule priority, picks the right one. The paper frames this as a first step: the agent still cannot know the user's mind, and several unsupported items may remain.
Load-bearing premise
The selection rule assumes that how much support a fact or rule accumulated from past interactions reliably indicates whether this user already knows or accepts it; a user can be silent or polite during a successful interaction while privately disagreeing, which would give the wrong item high support.
Editorial extensions
If this is right
- For the same agent action, two users can receive different explanations, each pointing at the fact or rule that is new to that user.
- The agent does not need to know the user's expected outcome in advance; the least-supported item in the used reasoning chain is a candidate explanation without solving the counterfactual.
- Users can tell quickly whether they lacked information or disagree with the agent, and can then correct the agent's knowledge base.
- In domains where consistency or completeness matters, such as medical or legal decisions, introspective explanations remain necessary; the approach is aimed at local, personalized surprise explanations.
- The support model can be built from interaction history without explicit user profiles, avoiding the configuration burden of direct user input.
Reading between the lines
- A testable extension would measure explanation quality by the number of follow-up questions a user needs before the uncommon ground becomes clear.
- The support signal conflates "user did not object" with "user agrees"; weighting silent acceptance less than explicit confirmation would make the ranking safer.
- The same uncommon-ground selection could be applied to black-box models by treating feature-attribution or influence scores as the reasoning chain and interaction logs as support.
- A user who privately disagrees without saying so is the hard case: the model will rank their disputed belief as supported, so an explanation study should include users instructed to stay silent while disagreeing.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a conceptual framework for generating personalized explanations in long-term human–AI interaction. It introduces "extrospective explanations," which are explanations selected not only from the agent's internal reasoning but also from what the agent has learned about the user through prior interactions. The central idea is that, when a user is surprised by an AI behavior, the agent should identify the "uncommon ground" — the fact or rule in its reasoning that the user does not share — and present the piece of knowledge with the lowest support from the user and discourse contexts. The framework is built on the SUDO model with situational, user, discourse, and ontological contexts, and is illustrated with a defeasible-logic household robotics example involving a birthday cake. The paper is a position/proposal: it contains no formal algorithm, implementation, or user study.
Significance. If the framework is developed further, it addresses a genuine gap in XAI: local explanations for non-expert users in repeated, personalized interactions. The paper correctly identifies that surprise-driven explanation requests are implicitly counterfactual, and it makes a reasonable case that explanations should be tailored to the user's presumed knowledge. It also has strengths: it explicitly builds on a formal context model (SUDO), uses defeasible logic rather than black-box approximations, and candidly acknowledges several limitations in Section 4. However, the central selection rule — least-supported fact or rule — is not justified as a way to identify the counterfactual difference-maker, and the support model itself is under-specified. The manuscript is more of a well-motivated position statement than a validated model, and its claims should be scaled accordingly.
major comments (4)
- [Section 4, Figure 5] The selection rule "present the piece of information with the lowest support" conflates the likelihood that the user does not know a fact with the counterfactual relevance of that fact. Section 3 defines the uncommon ground counterfactually: the explanation should be an item such that, if it were changed to the user's belief, the agent's prediction would match the user's expectation. But support, as described in Figure 5, only estimates whether the user is aware of or agrees with an item; it says nothing about whether that item is necessary for the agent's conclusion. In a defeasible derivation, a premise can be non-essential — for example, a side condition or a redundant support for a conclusion already entailed by other rules. If such an inert fact happens to have low support, the algorithm would present a novel but irrelevant fact, and the user would still not understand why the agent acted as it did. The paper itself notes (Section 4) that several facts or rules can have no support, but it offers no criterion for choosing among them beyond support. The central claim therefore needs either an additional relevance check (e.g., verify that changing the candidate item flips the agent's conclusion) or a careful restriction to cases where the least-supported item is on the derivation path.
- [Section 4, Figure 5] The support model is not formally defined. The star levels in Figure 5 are described in prose (three stars for explicit communication, two for perceived facts, one for agreed-upon facts in past interactions), but there is no precise account of how support is accumulated, updated, combined across user and discourse contexts, or decayed over time. More importantly, the framework treats absence of support as evidence that the user does not know a fact. This is an inference from silence: a fact may have no support simply because it was never mentioned, yet the user may still know it from general world knowledge. Conversely, a user may have privately disagreed during a previous interaction while remaining silent, which would give an unsupported item an incorrect rank. Because the entire selection mechanism rests on this support-as-proxy assumption, the model needs either a formalization of support with explicit update rules or a statement that the support estimate is a heuristic assumption requiring empirical validation.
- [Section 3, Figure 4] The running example appears internally inconsistent about what the user knows. The text says the user is not aware that the outside temperature is cool, but also says the user expected the cake to be placed in the hallway "which they thought was just as cool as the outside." If the user believes the hallway is just as cool as the outside, then the user's knowledge includes a belief about hallway temperature that is not listed in the agent's knowledge, and the uncommon ground is not limited to the outside-temperature fact. The Figure 4 caption states that "the only difference in their respective worldview is that the AI agent is aware that it is quite cool outside today," which appears to contradict the narrative. This matters because the example is used to motivate the least-support rule, and the ambiguity makes it unclear which fact the framework is supposed to select.
- [Section 4, Section 5] The paper makes prescriptive claims about the helpfulness of extrospective explanations without empirical support. Section 4 states that "our approach presents a viable first step at presenting a helpful explanation tailored to the user," and Section 5 claims that "extrospective explanations can provide more helpful information for end-users." Since the paper contains no user study, simulation, or formal argument establishing these properties, these claims should be framed as hypotheses or design goals rather than established results. This is a load-bearing issue only to the extent that the paper presents itself as a model; if the authors intend this as a position paper, the claims should be softened accordingly.
minor comments (4)
- [Title page] The affiliation line contains a typo: "Univserity of Bremen" should be "University of Bremen."
- [Section 2] The paper mentions several strategies for discovering the implied counterfactual (explicitly asking, predicting, or using a mental model) but does not connect these to the proposed framework. A brief explanation of why the framework chooses the last option would improve readability.
- [Section 4] The paper uses "most specific rules" and "last logical step" as examples of introspective selection, but it does not define these terms formally in the defeasible-logic setting. A sentence clarifying the intended priority or specificity semantics would help.
- [Figure 5] The caption says "three stars in the situational context indicate that a fact has been communicated to the robot by the user," but the text in Section 4 says "The other facts and rules have received varying levels of support, depending on whether or not the information was explicitly communicated by the human." The relationship between star levels and the user/discourse context distinction could be stated more explicitly.
Circularity Check
No significant circularity: the least-support rule is a stated proposal, not a derived prediction, and the SUDO self-citation is a framework choice rather than load-bearing evidence.
full rationale
The paper does not fit any parameter to data and then relabel it as a prediction; the only numerical quantity, the star-based 'support' in Figure 5, is an illustrative model annotation. The central claim—that for a surprising behavior the agent should present the least-supported item in its uncommon ground—is introduced as a normative proposal ('we propose that our approach presents a viable first step'), and the paper explicitly acknowledges the selection problem when several facts have no support. This is an unvalidated assumption, not a conclusion that reduces to its definition. The model's division into situational, user, discourse, and ontological contexts is taken from [Porzel, 2010], a former author's monograph, but it is used as a starting terminology and not cited as proof of the explanation-selection claim; no uniqueness theorem or fitted result is imported from that work. The counterfactual characterization of uncommon ground ('if this had been different and had aligned with the belief of the user, then the prediction of the agent would have been the same as the prediction of the user') is not shown to be equivalent to least support, and the paper does not claim it is—it simply adopts support as a proxy. That gap is a correctness or evaluation concern, not circularity. The paper is therefore self-contained as a conceptual model and contains no load-bearing reduction to its own inputs.
Assumptions & free parameters
assumptions (4)
- domain assumption Both human and AI understanding can be modeled as facts and rules in a defeasible logic knowledge base.
- domain assumption Whenever user surprise occurs, the cause lies in a fact or logical step in the agent's reasoning chain that the user does not share.
- domain assumption The support history of a fact or rule from user and discourse contexts is a reliable proxy for the probability the user already knows or agrees with it.
- domain assumption The SUDO context model is a valid way to organize the agent's memory into situational, user, discourse, and ontological contexts.
invented entities (2)
-
Extrospective explanation
-
Support markers (stars)
Cite this review
Pith. "Pith review of Finding Uncommon Ground: A Human-Centered Model for Extrospective Explanations." pith.science (2026). https://pith.science/paper/P6XLXHJ2
@misc{pith2026250721571,
author = {Pith},
title = {Pith review of: Finding Uncommon Ground: A Human-Centered Model for Extrospective Explanations},
year = {2026},
howpublished = {\url{https://pith.science/paper/P6XLXHJ2}},
note = {Machine review of arXiv:2507.21571}
}
read the original abstract
The need for explanations in AI has, by and large, been driven by the desire to increase the transparency of black-box machine learning models. However, such explanations, which focus on the internal mechanisms that lead to a specific output, are often unsuitable for non-experts. To facilitate a human-centered perspective on AI explanations, agents need to focus on individuals and their preferences as well as the context in which the explanations are given. This paper proposes a personalized approach to explanation, where the agent tailors the information provided to the user based on what is most likely pertinent to them. We propose a model of the agent's worldview that also serves as a personal and dynamic memory of its previous interactions with the same user, based on which the artificial agent can estimate what part of its knowledge is most likely new information to the user.
Figures
Figures from the paper (3 more)
Reference graph
Works this paper leans on
-
[1]
Ashraf Abdul, Jo Vermeulen, Danding Wang, Brian Y. Lim, and Mohan Kankanhalli. Trends and Trajectories for Explainable , Accountable and Intelligible Systems : An HCI Research Agenda . In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems , pages 1--18, Montreal QC Canada, April 2018. ACM
work page 2018
-
[2]
Peeking Inside the Black - Box : A Survey on Explainable Artificial Intelligence ( XAI )
Amina Adadi and Mohammed Berrada. Peeking Inside the Black - Box : A Survey on Explainable Artificial Intelligence ( XAI ). IEEE Access , 6:52138--52160, 2018
work page 2018
-
[3]
User-friendly Conversational Explanations : A Research Summary
Fatemeh Alizadeh and Dominik Pins. User-friendly Conversational Explanations : A Research Summary . In Proceedings of the ACM CHI Workshop on ACM CHI Workshop Human - Centered Perspectives in Explainable AI ( HCXAI 2022) , 2022
work page 2022
-
[4]
Alejandro Barredo Arrieta, Natalia Díaz-Rodríguez, Javier Del Ser, Adrien Bennetot, Siham Tabik, Alberto Barbado, Salvador Garcia, Sergio Gil-Lopez, Daniel Molina, Richard Benjamins, Raja Chatila, and Francisco Herrera. Explainable Artificial Intelligence ( XAI ): Concepts , taxonomies, opportunities and challenges toward responsible AI . Information Fusi...
work page 2020
-
[5]
At your service: Designing voice assistant personalities to improve automotive user interfaces
Michael Braun, Anja Mainz, Ronee Chadowitz, Bastian Pfleging, and Florian Alt. At your service: Designing voice assistant personalities to improve automotive user interfaces. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems , pages 1--11, New York, NY, USA, 2019. ACM
work page 2019
- [6]
-
[7]
Personalized XAI for AI -driven Personalization
Christina Conati, Katrien Verbert, Oswald Barral, and Martijn Millecamp. Personalized XAI for AI -driven Personalization . In Proceedings of the 2022 Workshop on Explainable Artificial Intelligence ( XAI ) , July 2022
work page 2022
-
[8]
Mediators: Conversational Agents Explaining NLP Model Behavior , June 2022
Nils Feldhus, Ajay Madhavan Ravichandran, and Sebastian Möller. Mediators: Conversational Agents Explaining NLP Model Behavior , June 2022. arXiv:2206.06029 [cs]
arXiv 2022
Show all 29 references
-
[9]
Gilpin, David Bau, Ben Z
Leilani H. Gilpin, David Bau, Ben Z. Yuan, Ayesha Bajwa, Michael Specter, and Lalana Kagal. Explaining Explanations : An Overview of Interpretability of Machine Learning , February 2019. arXiv:1806.00069 [cs, stat]
2019 arXiv
-
[10]
Why and How ? A User Study to Evaluate Explainability Within the Automotive Context
Julia Graefe, Selma Paden, and Klaus Bengler. Why and How ? A User Study to Evaluate Explainability Within the Automotive Context . In Proceedings of the ACM CHI Workshop on ACM CHI Workshop Human - Centered Perspectives in Explainable AI ( HCXAI 2022) , 2022
2022
-
[11]
Pattichis, and Douglas B
Andreas Holzinger, Chris Biemann, Constantinos S. Pattichis, and Douglas B. Kell. What do we need to build explainable AI systems for the medical domain?, December 2017. arXiv:1712.09923 [cs, stat]
2017 arXiv
-
[12]
Putting people’s common sense into knowledge bases of household robots
Lars Kunze, Moritz Tenorth, and Michael Beetz. Putting people’s common sense into knowledge bases of household robots. In KI 2010: Advances in Artificial Intelligence: 33rd Annual German Conference on AI, Karlsruhe, Germany, September 21-24, 2010. Proceedings 33 , pages 151--1...
2010
-
[13]
Improving Model Understanding and Trust with Counterfactual Explanations of Model Confidence
Thao Le, Tim Miller, Ronal Singh, and Liz Sonenberg. Improving Model Understanding and Trust with Counterfactual Explanations of Model Confidence . In Proceedings of the IJCAI 2022 workshop on Explainable Artificial Intelligence ( XAI ) , 2022. Publisher: arXiv Version Number: 1
2022
-
[14]
Vera Liao, Daniel Gruen, and Sarah Miller
Q. Vera Liao, Daniel Gruen, and Sarah Miller. Questioning the AI : Informing Design Practices for Explainable AI User Experiences . In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems , pages 1--15, April 2020. arXiv:2001.02478 [cs]
2020 arXiv
-
[15]
Alterfactual Explanations -- The Relevance of Irrelevance for Explaining AI Systems
Silvan Mertes, Christina Karle, Tobias Huber, Katharina Weitz, Ruben Schlagowski, and Elisabeth André. Alterfactual Explanations -- The Relevance of Irrelevance for Explaining AI Systems . In Proceedings of the IJCAI 2022 workshop on Explainable Artificial Intelligence ( XAI )...
2022
-
[16]
Explainable AI : Beware of Inmates Running the Asylum Or : How I Learnt to Stop Worrying and Love the Social and Behavioural Sciences , December 2017
Tim Miller, Piers Howe, and Liz Sonenberg. Explainable AI : Beware of Inmates Running the Asylum Or : How I Learnt to Stop Worrying and Love the Social and Behavioural Sciences , December 2017. arXiv:1712.00547 [cs]
2017 arXiv
-
[17]
Explanation in Artificial Intelligence : Insights from the Social Sciences , August 2018
Tim Miller. Explanation in Artificial Intelligence : Insights from the Social Sciences , August 2018. arXiv:1706.07269 [cs]
2018 arXiv
-
[18]
Automatic personalization based on web usage mining
Bamshad Mobasher, Robert Cooley, and Jaideep Srivastava. Automatic personalization based on web usage mining. Communications of the ACM , 43(8):142--151, 2000
2000
-
[19]
AI Explainability : Why One Explanation Cannot Fit All
Milda Norkute. AI Explainability : Why One Explanation Cannot Fit All . In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems , Honolulu HI USA, April 2020. ACM
2020
-
[20]
R. Porzel. Contextual Computing: Models and Applications . Cognitive Technologies. Springer Berlin Heidelberg, 2010
2010
-
[21]
Explainable AI : Interpreting , Explaining and Visualizing Deep Learning , volume 11700 of Lecture Notes in Computer Science
Wojciech Samek, Grégoire Montavon, Andrea Vedaldi, Lars Kai Hansen, and Klaus-Robert Müller, editors. Explainable AI : Interpreting , Explaining and Visualizing Deep Learning , volume 11700 of Lecture Notes in Computer Science . Springer International Publishing, Cham, 2019
2019
-
[22]
The Effect of Diversity in Counterfactual Machine Learning Explanations
Rick Tompkins, Ronal Singh, and Tim Miller. The Effect of Diversity in Counterfactual Machine Learning Explanations . In Proceedings of the IJCAI 2022 workshop on Explainable Artificial Intelligence ( XAI ) , 2022
2022
-
[23]
Reducing working memory load in spoken dialogue systems
Maria Wolters, Kallirroi Georgila, Johanna D Moore, Robert H Logie, Sarah E MacPherson, and Matthew Watson. Reducing working memory load in spoken dialogue systems. Interacting with Computers , 21(4):276--287, 2009
2009
-
[24]
Toward human-centered AI : a perspective from human-computer interaction
Wei Xu. Toward human-centered AI : a perspective from human-computer interaction. Interactions , 26(4):42--46, June 2019
2019
-
[25]
i want it that way
Nima Zargham, Dmitry Alexandrovsky, Jan Erich, Nina Wenig, and Rainer Malaka. “i want it that way”: Exploring users’ customization and personalization preferences for home assistants. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems , CHI ...
2022
-
[26]
Understanding circumstances for desirable proactive behaviour of voice assistants: The proactivity dilemma
Nima Zargham, Leon Reicherts, Michael Bonfert, Sarah Theres Voelkel, Johannes Schoening, Rainer Malaka, and Yvonne Rogers. Understanding circumstances for desirable proactive behaviour of voice assistants: The proactivity dilemma. In Proceedings of the 4th Conference on Conver...
2022
-
[27]
Vera Liao, and Rachel K
Yunfeng Zhang, Q. Vera Liao, and Rachel K. E. Bellamy. Effect of confidence and explanation on accuracy and trust calibration in AI -assisted decision making. In Proceedings of the 2020 Conference on Fairness , Accountability , and Transparency , pages 295--305, Barcelona Spai...
2020
-
[28]
Personalization and context management
Andreas Zimmermann, Marcus Specht, and Andreas Lorenz. Personalization and context management. User modeling and user-adapted interaction , 15(3-4):275--302, 2005
2005
-
[29]
write newline
" write newline "" before.all 'output.state := FUNCTION fin.entry add.period write newline FUNCTION new.block output.state before.all = 'skip after.block 'output.state := if FUNCTION new.sentence output.state after.block = 'skip output.state before.all = 'skip after.sentence '...
Reviewed August 6, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.