LLMs assigned advocate roles in political statement analysis frequently override those roles due to epistemic constraints, as quantified by new metrics and a stance classifier across 60 English and German statements.
21 Appendix D: Confusion Matrices Table 10 shows the confusion matrix for the Mistral Large classifier on all 450 Phase-3 reasoning texts (three roles, 30 statements, 5 runs)
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.AI 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
When Roles Fail: Epistemic Constraints on Advocate Role Fidelity in LLM-Based Political Statement Analysis
LLMs assigned advocate roles in political statement analysis frequently override those roles due to epistemic constraints, as quantified by new metrics and a stance classifier across 60 English and German statements.