REVIEW 4 cited by
Understanding the LLM-ification of CHI: Unpacking the Impact of LLMs at CHI through a Systematic Literature Review
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Large language models (LLMs) have been positioned to revolutionize HCI, by reshaping not only the interfaces, design patterns, and sociotechnical systems that we study, but also the research practices we use. To-date, however, there has been little understanding of LLMs' uptake in HCI. We address this gap via a systematic literature review of 153 CHI papers from 2020-24 that engage with LLMs. We taxonomize: (1) domains where LLMs are applied; (2) roles of LLMs in HCI projects; (3) contribution types; and (4) acknowledged limitations and risks. We find LLM work in 10 diverse domains, primarily via empirical and artifact contributions. Authors use LLMs in five distinct roles, including as research tools or simulated users. Still, authors often raise validity and reproducibility concerns, and overwhelmingly study closed models. We outline opportunities to improve HCI research with and on LLMs, and provide guiding questions for researchers to consider the validity and appropriateness of LLM-related work.
Forward citations
Cited by 4 Pith papers
-
Conversational AI as a Catalyst for Informal Learning: An Empirical Large-Scale Study on LLM Use in Everyday Learning
Most adults in a German Prolific sample report using large language models for informal learning, with four distinct learner profiles emerging from their usage patterns.
-
Exploring the Innovation Opportunities for Pre-trained Models
A taxonomy of 294 capabilities from 85 HCI research applications shows pre-trained models most often add value through content understanding, not generation.
-
How Managers Perceive AI-Assisted Conversational Training for Workplace Communication
Managers view AI-assisted role-play as useful low-stakes practice for workplace conversations, provided it offers customizable scenarios, actionable feedback, and human-AI teaming.
-
Emphasizing Deliberation and Critical Thinking in an AI Hype World
An HCI researcher argues that resisting AI solutionism requires slow, deliberate use and critical thinking rather than outright bans.
Discussion (0). Continue with ORCID to comment.