REVIEW 1 cited by
Revisiting the Effects of Leakage on Dependency Parsing
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Recent work by S{\o}gaard (2020) showed that, treebank size aside, overlap between training and test graphs (termed leakage) explains more of the observed variation in dependency parsing performance than other explanations. In this work we revisit this claim, testing it on more models and languages. We find that it only holds for zero-shot cross-lingual settings. We then propose a more fine-grained measure of such leakage which, unlike the original measure, not only explains but also correlates with observed performance variation. Code and data are available here: https://github.com/miriamwanner/reu-nlp-project
Forward citations
Cited by 1 Pith paper
-
Knowledge Bases in Support of Large Language Models for Processing Web News
BERTGraph, which adds rule-extracted relational graphs to BERT via a graph convolutional network, improves news classification accuracy over fine-tuned BERT on N24News and Snopes datasets.
Discussion (0). Continue with ORCID to comment.