REVIEW 4 cited by
Redefining Qualitative Analysis in the AI Era: Utilizing ChatGPT for Efficient Thematic Analysis
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
AI tools, particularly large-scale language model (LLM) based applications such as ChatGPT, have the potential to simplify qualitative research. Through semi-structured interviews with seventeen participants, we identified challenges and concerns in integrating ChatGPT into the qualitative analysis process. Collaborating with thirteen qualitative researchers, we developed a framework for designing prompts to enhance the effectiveness of ChatGPT in thematic analysis. Our findings indicate that improving transparency, providing guidance on prompts, and strengthening users' understanding of LLMs' capabilities significantly enhance the users' ability to interact with ChatGPT. We also discovered and revealed the reasons behind researchers' shift in attitude towards ChatGPT from negative to positive. This research not only highlights the importance of well-designed prompts in LLM applications but also offers reflections for qualitative researchers on the perception of AI's role. Finally, we emphasize the potential ethical risks and the impact of constructing AI ethical expectations by researchers, particularly those who are novices, on future research and AI development.
Forward citations
Cited by 4 Pith papers
-
Dynamic Surveys: Using LLMs to Blend Qualitative Depth,Quantitative Structure, and Collaborative Interaction
A survey platform that uses LLMs to cluster open-ended responses live and lets respondents rate, rank, and explain those clusters produced positive user reactions in two small field studies, though the 'richer than tr...
-
Should LLMs be WEIRD? Exploring WEIRDness and Human Rights in Large Language Models
LLMs that align most with WEIRD-country values, especially GPT-4, also violate human rights charters least, while less WEIRD models such as BLOOM and Qwen are 2 to 4 percentage points more likely to produce rights-vio...
-
Investigation of the Inter-Rater Reliability between Large Language Models and Human Raters in Qualitative Analysis
GPT-4o and GPT-4.5-preview reached moderate to substantial Cohen's kappa with human coders for three of four student thinking themes after per-theme hyperparameter and prompt tuning.
-
A Framework for LLM-powered Design Assistants
LLMs are organized into a three-modality framework for design assistance, but no evidence is provided that the framework works.
Discussion (0). Continue with ORCID to comment.