REVIEW 3 cited by
WiCE: Real-World Entailment for Claims in Wikipedia
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Textual entailment models are increasingly applied in settings like fact-checking, presupposition verification in question answering, or summary evaluation. However, these represent a significant domain shift from existing entailment datasets, and models underperform as a result. We propose WiCE, a new fine-grained textual entailment dataset built on natural claim and evidence pairs extracted from Wikipedia. In addition to standard claim-level entailment, WiCE provides entailment judgments over sub-sentence units of the claim, and a minimal subset of evidence sentences that support each subclaim. To support this, we propose an automatic claim decomposition strategy using GPT-3.5 which we show is also effective at improving entailment models' performance on multiple datasets at test time. Finally, we show that real claims in our dataset involve challenging verification and retrieval problems that existing models fail to address.
Forward citations
Cited by 3 Pith papers
-
Deceptive Grounding: Entity Attribution Failure in Clinical Retrieval-Augmented Generation
Clinical RAG can attribute real evidence about drug Y to queried drug X at high rates under adversarial retrieval, a failure invisible to faithfulness and citation metrics but detectable by entity-attribution verification.
-
Lost in the Maze: Overcoming Context Limitations in Long-Horizon Agentic Search
SLIM separates search and browse tools and summarizes trajectories every 50 turns, beating several open-source agentic search systems on BrowseComp and HLE with fewer tool calls and lower cost.
-
SUCEA: Reasoning-Intensive Retrieval for Adversarial Fact-checking through Claim Decomposition and Editing
SUCEA improves adversarial fact-checking by decomposing claims into atomic sub-claims, editing each sub-claim toward retrieved evidence, and re-retrieving before predicting the final label.
Discussion (0). Continue with ORCID to comment.