PDSQI-9 is a 9-item instrument for rating LLM-generated clinical summaries; in a validation study with 7 physician raters and 779 summary evaluations, it showed Cronbach's alpha 0.879 and ICC 0.867, but Krippendorff's alpha was only 0.575.
Effect of Ambient Voice Technology, Natural Language Processing, and Artificial Intelligence on the Patient-Physician Relationship
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
citation-role summary
background 1
citation-polarity summary
fields
cs.AI 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
Development and Validation of the Provider Documentation Summarization Quality Instrument for Large Language Models
PDSQI-9 is a 9-item instrument for rating LLM-generated clinical summaries; in a validation study with 7 physician raters and 779 summary evaluations, it showed Cronbach's alpha 0.879 and ICC 0.867, but Krippendorff's alpha was only 0.575.