REVIEW 1 cited by
Figurative Language in Recognizing Textual Entailment
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We introduce a collection of recognizing textual entailment (RTE) datasets focused on figurative language. We leverage five existing datasets annotated for a variety of figurative language -- simile, metaphor, and irony -- and frame them into over 12,500 RTE examples.We evaluate how well state-of-the-art models trained on popular RTE datasets capture different aspects of figurative language. Our results and analyses indicate that these models might not sufficiently capture figurative language, struggling to perform pragmatic inference and reasoning about world knowledge. Ultimately, our datasets provide a challenging testbed for evaluating RTE models.
Forward citations
Cited by 1 Pith paper
-
Large Vision-Language Models for Knowledge-Grounded Data Annotation of Memes
CM50, a 33k-meme dataset with GPT-4o-generated annotations, and mtrCLIP, a fine-tuned CLIP model, together improve meme-text retrieval on MemeCap over the original CLIP.
Discussion (0). Continue with ORCID to comment.