Assessing BERT's Syntactic Abilities
classification
💻 cs.CL
keywords
agreementbertstimulisubject-verbmodelphenomenasyntacticwords
read the original abstract
I assess the extent to which the recently introduced BERT model captures English syntactic phenomena, using (1) naturally-occurring subject-verb agreement stimuli; (2) "coloreless green ideas" subject-verb agreement stimuli, in which content words in natural sentences are randomly replaced with words sharing the same part-of-speech and inflection; and (3) manually crafted stimuli for subject-verb agreement and reflexive anaphora phenomena. The BERT model performs remarkably well on all cases.
This paper has not been read by Pith yet.
Forward citations
Cited by 1 Pith paper
-
PIQA: Reasoning about Physical Commonsense in Natural Language
PIQA is a new benchmark showing that current AI models achieve 77% on physical commonsense questions versus humans at 95%.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.