Fine-tuned DeBERTa-large outperforms LLMs on extracting clinical and social impacts from opioid-use Reddit posts (relaxed token F1 0.61 vs 0.44), yet remains below human agreement (kappa 0.81).
Cohen, A coefficient of agreement for nominal scales, Educational and psychological measure- ment 20, 37 (1960)
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
citation-role summary
method 1
citation-polarity summary
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1roles
method 1polarities
unclear 1representative citing papers
citing papers explorer
-
Inference Gap in Domain Expertise and Machine Intelligence in Named Entity Recognition: Creation of and Insights from a Substance Use-related Dataset
Fine-tuned DeBERTa-large outperforms LLMs on extracting clinical and social impacts from opioid-use Reddit posts (relaxed token F1 0.61 vs 0.44), yet remains below human agreement (kappa 0.81).