REVIEW 8 cited by
Determinants of LLM-assisted Decision-Making
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Decision-making is a fundamental capability in everyday life. Large Language Models (LLMs) provide multifaceted support in enhancing human decision-making processes. However, understanding the influencing factors of LLM-assisted decision-making is crucial for enabling individuals to utilize LLM-provided advantages and minimize associated risks in order to make more informed and better decisions. This study presents the results of a comprehensive literature analysis, providing a structural overview and detailed analysis of determinants impacting decision-making with LLM support. In particular, we explore the effects of technological aspects of LLMs, including transparency and prompt engineering, psychological factors such as emotions and decision-making styles, as well as decision-specific determinants such as task difficulty and accountability. In addition, the impact of the determinants on the decision-making process is illustrated via multiple application scenarios. Drawing from our analysis, we develop a dependency framework that systematizes possible interactions in terms of reciprocal interdependencies between these determinants. Our research reveals that, due to the multifaceted interactions with various determinants, factors such as trust in or reliance on LLMs, the user's mental model, and the characteristics of information processing are identified as significant aspects influencing LLM-assisted decision-making processes. Our findings can be seen as crucial for improving decision quality in human-AI collaboration, empowering both users and organizations, and designing more effective LLM interfaces. Additionally, our work provides a foundation for future empirical investigations on the determinants of decision-making assisted by LLMs.
Forward citations
Cited by 8 Pith papers
-
Discrimination by LLMs: Cross-lingual Bias Assessment and Mitigation in Decision-Making and Summarisation
LLMs show significant demographic bias in decision-making, favoring women, younger ages, and certain minority backgrounds; summarization shows little bias, and bias patterns largely transfer from English to Dutch.
-
Design Patterns of Human-AI Interfaces in Healthcare
The paper synthesizes 15 information entities and 12 design patterns from 43 papers, then uses interviews and a designer workshop to argue these patterns support healthcare human-AI interface design.
-
Ethical Considerations of Large Language Models in Game Playing
In Werewolf games, LLM agents change their kills, votes, and trust scores based on explicit gender labels and even based on gender-implied first names, behaving differently for male and female players.
-
Finding Common Ground: Using Large Language Models to Detect Agreement in Multi-Agent Decision Conferences
LLM agents can run a simulated decision conference, and a dedicated agreement-detection agent helps the debate cover topics that match a real expert workshop.
-
Exploring LLM-Generated Feedback for Economics Essays: How Teaching Assistants Evaluate and Envision Its Use
In a think-aloud study, five economics teaching assistants found AI-generated essay feedback useful as suggestions, especially when it included highlighted evidence and intermediate judgments.
-
RALLY: Role-Adaptive LLM-Driven Yoked Navigation for Agentic UAV Swarms
RALLY couples a two-stage LLM consensus module with a QMIX-style role-assignment network and reports higher reward and better generalization than three baselines in drone-swarm coverage simulations.
-
AI-Supported Platform for System Monitoring and Decision-Making in Nuclear Waste Management with Large Language Models
A retrieval-augmented, multi-LLM agent system for nuclear waste regulatory compliance is demonstrated on a Winslow, Arizona case study, with self-reported relevance and agreement metrics.
-
Explainable Information Retrieval in the Audit Domain
A position paper proposing research directions and challenges for explainable information retrieval (XIR) in the audit domain, with no empirical results.
Discussion (0). Continue with ORCID to comment.