Pith. sign in

REVIEW 3 major objections 6 minor 234 references

Linear representations of grammaticality in neural language models

T0 review · 3 major / 6 minor · reviewed 2026-08-01 · deepseek-v4-flash

Pith's one-line read Pretrained language models encode grammaticality as a single linear direction in their sentence representations, a direction that generalizes across phenomena and languages and cannot be reduced to string probability or the tested extra-gra

desk verdict The paper's core finding—mass-mean probes generalize across benchmarks and survive probability deconfounding—is real, but the abstract's 'cannot be fully explained' overreaches: the acceptability deconfounding removes only one direction. read the letter →

arxiv 2607.15175 v1 pith:J7METGEB submitted 2026-07-16 cs.CL

classification cs.CL
keywords grammaticalitymass-meanprobinglinearrepresentationsneurallanguagemodelssyntacticknowledgeacceptabilitydeconfoundingcross-linguisticgeneralization
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper argues that pretrained neural language models encode grammaticality as a coherent linear dimension in their sentence representations. Using a mass-mean probe—a single direction defined by the difference between the average representation of grammatical and ungrammatical sentences—the authors show that a direction learned on one set of acceptability judgments generalizes to held-out datasets covering a wide range of syntactic phenomena. They show that this direction is not just a proxy for string probability: when probes are fit on deliberately counterfactual subsets (low-probability grammatical vs. high-probability ungrammatical), performance barely drops. They also find that the direction is only mildly entangled with other acceptability-related properties such as plausibility, truth, imageability, and arousal, and that removing the shared signal with those properties still leaves a usable grammaticality direction. For the strongest models, the encoding transfers across languages, suggesting grammaticality is a major organizing axis of the representational space.

What carries the argument

The key object is the mass-mean probe direction θ, defined as the difference between the mean representations of the positive (grammatical) and negative (ungrammatical) classes. Classification is done by thresholding the inner product θ·x at zero. The paper also uses token-region-of-interest extraction (critical, pre-critical, final) to localize when the grammaticality signal appears, and a boundary-tilting operation in which the projection of θ onto an extra-grammatical difference vector is subtracted from θ, isolating the component of the direction that is not shared with acceptability-related properties.

What would settle it

Train a mass-mean probe on grammaticality contrasts using only sentences whose ungrammaticality arises from purely syntactic violations (e.g., agreement mismatches with matched lexical content and plausibility), then apply it to a held-out set of word-shuffle ungrammatical sentences after regressing out length, word-frequency, and plausibility from the representations. If the probe's success drops to chance, the claim that a single robust grammaticality direction exists would be undercut.

Watch

Extended reading notes

Core claim

The central claim is that a single mass-mean difference vector, computed as the difference between the mean hidden-state representations of grammatical and ungrammatical sentences, captures a robust and generalizable grammaticality signal in the final-layer sentence representations of pretrained language models. This direction, fitted on a mixed set of acceptability judgments, succeeds on unseen minimal-pair tests across many syntactic phenomena; it is largely unaffected by counterfactual manipulation of string probability during probe fitting; and after regressing out the shared component with several extra-grammatical acceptability factors via boundary tilting, it still classifies grammati

Load-bearing premise

The grammaticality labels in the benchmarks used to fit and evaluate probes are taken as ground truth; if those labels are systematically contaminated by plausibility, frequency, or other extra-grammatical factors that were not deconfounded, what the probe isolates could be a direction for acceptability rather than grammar per se.

Editorial extensions

If this is right

  • Probability-based targeted syntactic evaluation may underestimate the grammatical knowledge of language models, since representational separation does not always propagate to output probabilities.
  • The existence of a single, generalizable direction makes grammaticality a candidate for activation steering, analogous to other linearly encoded properties.
  • Grammaticality representations are incrementally updated: the signal is already present at the critical word, not only at the final token.
  • Cross-linguistic transfer suggests that, in multilingual models, grammaticality is encoded in a way that is at least partially shared across languages, bearing on claims about a universal grammar-like abstraction.
  • The deconfounding methodology provides a template for separating a target linguistic property from correlated sentence-level properties in representation space.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • If the grammaticality direction is as robust as claimed, the same mass-mean probe could be used as a training signal or regularizer to encourage syntactic generalisation in smaller models.
  • The paper leaves open whether the direction emerges from co-occurrence statistics in training data; a direct test would be to track the probe's success during the training of an autoregressive model from checkpoints.
  • The boundary-tilting method could be extended to a systematic atlas of extra-grammatical factors (e.g., length, word frequency, surprisal) beyond the handful tested; the claim would be strengthened if the direction survives tilting against all of them.
  • One natural next experiment is jabberwocky or nonce-word stimuli: if the direction still separates grammatical from ungrammatical nonsense sentences, that would confirm the abstraction is syntactic rather than lexical.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 6 minor

Summary. This paper asks whether grammaticality is linearly encoded in the sentence representations of pretrained neural language models, going beyond probability-based targeted syntactic evaluation. The authors fit mass-mean probes on the LI-Adger acceptability dataset and evaluate them on held-out BLiMP and SCaMP datasets, finding above-null probe success across 25 models (Experiment 1). They then localize the signal to the critical region and show cross-phenomenon generalization (Experiment 2), deconfound scalar string probability via Counter/Favour sampling (Experiment 3), test whether the probe is reducible to plausibility/truth/imageability/arousal etc. via cross-probing and boundary tilting (Experiment 4), and report partial cross-linguistic generalization for five stronger models (Experiment 5). The paper concludes that grammaticality is a robust, generalizable linear representational dimension that 'cannot be fully explained by alternative sentence-level factors.'

Significance. The study is a serious and mostly well-designed contribution to the debate on whether NLMs represent grammaticality. Its strengths include the external probe-transfer design (fit on LI-Adger, evaluate on BLiMP/SCaMP), the 100-run resampling protocol, the inclusion of 25 models across families and scales, and the attempt to deconfound probability and several extra-grammatical factors. The probability-decorrelation experiment (Experiment 3) is a particularly clean test, and the cross-linguistic analysis, while limited, is a useful step. If the central claim is suitably calibrated, the paper would provide a valuable representation-based complement to probability-based benchmarks. The main weakness is that the abstract's 'cannot be fully explained' claim is stronger than what the deconfounding experiments can support, given that the boundary-tilting procedure removes only a single direction at a time and the set of extra-grammatical factors tested is finite.

major comments (3)
  1. [§6.3 / §6.1] The abstract's 'cannot be fully explained by alternative sentence-level factors' rests mainly on Experiment 4, but the boundary-tilting analysis removes from θ only the projection onto a single ϕ: either the mean of all extra-grammatical difference vectors (Tilt-all) or the single most collinear vector (Tilt-one). If extra-grammatical acceptability is a multidimensional subspace (plausibility, truth, imageability, arousal, frequency, length are correlated but distinct), a grammaticality direction could lie in that subspace while having low cosine with each individual ϕ and with their mean. The Control condition shows only that the projection operation can destroy a grammaticality signal when ϕ is itself a grammaticality direction; it does not establish that the 26 extra-grammatical ϕs span the relevant subspace. The paper also does not report the cosine between θ and the extra-grammatica
  2. [Abstract / §5 / §6.1] The phrase 'alternative sentence-level factors' is broader than the factors actually deconfounded at the representation level. Experiment 3 deconfounds scalar string probability, and Experiment 4 covers the extra-grammatical datasets in Table 2 (Shades, Drive, Truth), but lexical frequency and length — both cited in §1 as documented confounds — are only used as similarity regressors in §4.3, not as probe-fitting contrasts whose direction is removed from θ. A probe direction could therefore still be partially aligned with a frequency or length contrast. The conclusion should either test these additional contrasts or be reformulated as conditional on the factors examined.
  3. [§8.4] The discussion states that the results settle the premise that NLMs can represent grammaticality distinctions at all. Given that the probe is fitted on benchmark labels and evaluated on the same kind of benchmark, and that the deconfounding evidence is partial (see above), this framing is too strong. The paper itself in §8.1.1 notes that the link between the grammaticality boundary and syntactic representations 'has yet to be established.' Please align the strength of the conclusion with this acknowledged limitation.
minor comments (6)
  1. [§2.5] The 5% probe-success threshold is calibrated from the Pre-critical region results of Experiment 2. Since this threshold is used throughout the paper, please report sensitivity of the main conclusions to the threshold choice (e.g., 2% or 10%) or justify more formally why 5% is conservative beyond the observed null range.
  2. [§2.2] Models are pre-selected for above-chance BLiMP probability comparisons. This is a reasonable precondition, but it means the claims about 'a wide range of pretrained NLMs' are conditional on prior behavioral sensitivity. Please state this explicitly and discuss whether pre-selection could inflate the Experiment 1 success rates.
  3. [§6] The text refers to 'Table A.1' for the extra-grammatical datasets, but the relevant table is Table 2. Please fix the cross-reference.
  4. [Figure 14] Typo in the caption: 'Experiemnt' should be 'Experiment.'
  5. [Conclusion] The final paragraph contains 'and and model classes' — remove the duplicated 'and.'
  6. [Figures 2–12] Several correlation values are reported without confidence intervals or p-values. Please add these, or at least indicate which correlations are significant under a multiple-comparison correction.

Circularity Check

1 steps flagged · score 2.0 of 10

Minor circularity: Pre-critical control failure is guaranteed by the 5% threshold calibrated to that control; central claims are external.

  1. fitted input called prediction [§2.5 (success threshold) applied in §4.1 (Result #1)]
    "Observing that probes fitted on single BLiMP datasets at the Pre-Critical region (a manipulation in Experiment 2) are in the range [-2.62%, 1.65%], we set the threshold to 5% as a conservative estimate of false positives. ... We find that all 25 models we examine demonstrate sensitivity to grammaticality in the Critical and Final regions and not the Pre-critical region."

    Success is defined as probing accuracy being at least 5% above the null distribution. The 5% threshold is explicitly calibrated to exceed the Pre-critical range of [-2.62%, 1.65%]. Consequently, any Pre-critical probe necessarily falls below the success threshold, making the 'not the Pre-critical region' result true by definition rather than by evidence. This is a fitted parameter (threshold) used to certify a closely related null outcome. The main Critical/Final and cross-dataset results are not forced by this threshold, so the circularity is minor and non-load-bearing.

full rationale

The central claim is supported by held-out and cross-benchmark evaluation: the mass-mean direction θ is fit on LI-Adger and evaluated on BLiMP/SCaMP; cross-linguistic probes are fit on English benchmarks and tested on non-English benchmarks; deconfounding experiments use external datasets (Shades, Drive, Truth). These evaluations are external to the fitted direction, so the main results are not circular. The only circular step is the Pre-critical control: the 5% success threshold is set from the observed Pre-critical range, which guarantees Pre-critical probes are classified as unsuccessful. This is a control-condition artifact rather than a load-bearing step, since the paper's positive claims concern Critical/Final sensitivity and generalization. Model pre-selection on BLiMP probability success is a sampling filter, not a fitted parameter, and does not make the probe results equivalent to its inputs.

Assumptions & free parameters 4 free parameters · 6 assumptions · 0 invented entities

The paper introduces no new entities. Its central assumptions are that benchmark labels capture grammaticality, that the mass-mean direction is a good probe, that the null/shuffle baseline is valid, and that projection deconfounding works. The main free parameters are the success threshold and model selection choices.

free parameters (4)
  • probe success threshold = 5% above null
    Set in §2.5 based on observed Pre-critical false-positive range [-2.62%, 1.65%]; determines whether a probing configuration counts as successful.
  • top-5 model selection for cross-lingual experiment = Llama-3.2-3B, Llama-3.1-8B, Qwen3-4B, OLMo-7B-hf, OLMo-2-1124-7B
    Section 7 selects models with strongest English grammaticality signals; this selection biases the cross-lingual generalization results.
  • probability quantiles for Counter/Favour conditions = top/bottom 20%
    Experiment 3 samples the 20% most/least probable sentences; this arbitrary cut affects the deconfounding manipulation but is not itself fitted to the outcome.
  • Drive grammaticality cutoff = 4.0 Likert
    Appendix A.1 filters Drive stimuli to sentences rated above 4.0 on grammaticality; affects the extra-grammatical dataset used in Experiment 4.
assumptions (6)
  • domain assumption Benchmark labels are valid ground truth for grammaticality
    All probing uses BLiMP/SCaMP/LI-Adger labels as the target; if these labels reflect acceptability or artifact, the probe measures that instead. Introduced in §2.1 and throughout.
  • domain assumption Mass-mean vector (class centroid difference) is a sufficient linear probe for the encoding
    The paper equates linear separability with a 'grammaticality dimension' using θ=μ1−μ0 (§2.4); more complex linear probes might find different directions.
  • standard math Null distribution from label shuffling is the correct baseline
    Used to define probe success (§2.5); assumes shuffled-label probes estimate chance performance for this geometry.
  • domain assumption Projection out of extra-grammatical vectors isolates grammaticality
    Boundary tilting in §6.3 assumes shared variance between θ and extra-grammatical ϕ is acceptability signal, and removing it leaves grammaticality; if grammaticality and acceptability share structure, this can remove grammaticality too.
  • domain assumption Models above chance on BLiMP probability comparisons are the population of interest
    §2.2 pre-selects 25 models based on BLiMP performance; conclusions do not apply to models that fail BLiMP.
  • domain assumption Final-token representation is a valid sentence representation
    §2.3 uses final punctuation token when region annotations are unavailable; this representation may encode sentence-level properties beyond grammaticality.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Linear representations of grammaticality in neural language models." pith.science (2026). https://pith.science/paper/J7METGEB

@misc{pith2026260715175,
  author       = {Pith},
  title        = {Pith review of: Linear representations of grammaticality in neural language models},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/J7METGEB}},
  note         = {Machine review of arXiv:2607.15175}
}
read the original abstract

Whether neural language models (NLMs) possess the ability to distinguish strings on the basis of their grammaticality remains a debated topic in the computational linguistics literature. Existing evidence has largely relied on probability-based measures, testing whether models assign higher probabilities to grammatical than ungrammatical strings. However, probability comparisons have been criticized as a measure for grammatical knowledge based on the assumption that grammaticality is inherently entangled with likelihood. Model-assigned probability is a function of many related sentence properties, such as lexical frequency, plausibility, and world knowledge. In this work, we move beyond probability-based evaluations and investigate whether grammaticality is encoded in the internal representations of NLMs. Using mass-mean probing, we test whether grammatical and ungrammatical sentences are systematically separated in representational space. We further examine the extent to which these representations are independent of sentence properties that are correlated with grammaticality, as well as their generalization across grammatical phenomena and languages. Our results provide evidence that grammaticality is robustly encoded in sentence representations of a wide range of pretrained NLMs, yielding clear representational separation on the dimension of grammaticality that cannot be fully explained by alternative sentence-level factors. Moreover, this encoding generalizes across a broad range of grammatical phenomena and to some degree, across languages, suggesting that grammaticality constitutes a coherent representational dimension in contemporary NLMs. These findings contribute new evidence to debates about the nature of syntactic knowledge in language models and offer a complementary framework for evaluating grammatical competence that is not dependent on string probabilities alone.

Figures

Figures reproduced from arXiv: 2607.15175 by the authors.

Figure 1
Figure 1. A step-by-step summary of the methods used in the experiments of this paper. [PITH_FULL_IMAGE:figures/full_fig_p004_1.png] view at source ↗
Figure 2
Figure 2. Model-level results from Experiment 1. R reports the Pearson correlation between model size (log10 parameter count) and the main measure of each subplot. (A) Percentage of successful probes out of the 67 BLiMP datasets. (B) Average accuracy (in %) of each probe. (C) Average accuracy within the set of successful probes. We find that all 25 models we examine demonstrate some probe sensitivity to grammaticality, albeit… view at source ↗
Figure 3
Figure 3. (A) Comparisons between accuracy measures. Each point represents an aggregate measure of accuracy for a model. (B) A dataset-level comparison of MP Rep advantage, ordered on the x-axis by the proportion of models that exhibit advantage on that dataset. (C) The magnitude of the MP Rep advantage, following the ordering as sub-figure 3B. based comparisons tend to detect grammaticality contrasts more effectively than pr… view at source ↗
Figures from the paper (11 more)
Figure 4
Figure 4. Figure 4: The success rate (as defined by §2.5) of mass-mean probes on detecting grammaticality across models (A) and [PITH_FULL_IMAGE:figures/full_fig_p008_4.png]
Figure 5
Figure 5. Figure 5: Probing accuracies of Experiment 2 in the Critical and Final region. ( [PITH_FULL_IMAGE:figures/full_fig_p009_5.png]
Figure 6
Figure 6. Figure 6: The relationship between surface-level similarity measures between BLiMP datasets and the probing [PITH_FULL_IMAGE:figures/full_fig_p010_6.png]
Figure 7
Figure 7. Figure 7: Results from Experiment 3. (A) The distribution of average fitting sentence probabilities for Llama-3.1-8B, across conditions. Each datapoint in the plot represents the mean sentence probability per fitting subset, separated by grammaticality label. (B-D) Probing perfo…
Figure 8
Figure 8. Figure 8: Probing results when grammaticality probes are tested on extra-grammatical datasets and vice versa. [PITH_FULL_IMAGE:figures/full_fig_p012_8.png]
Figure 9
Figure 9. Figure 9: Probing results on SCaMP plausible and implausible datasets. The fitting datasets are always in the [PITH_FULL_IMAGE:figures/full_fig_p012_9.png]
Figure 10
Figure 10. Figure 10: Probing results across different θ, pre- and post- tilting. All probes are evaluated on grammaticality datasets (BLiMP and SCaMP). (A) Success rates across conditions. (B) Accuracy scores across conditions. (C) Success rates of tilted and control probes, given success…
Figure 11
Figure 11. Figure 11: Within-language (left bars) and cross-language (right bars) probing success rates across the five models [PITH_FULL_IMAGE:figures/full_fig_p014_11.png]
Figure 12
Figure 12. Figure 12: Probing results across six languages, across five high-performant models. “*” marked in a grid indicates that [PITH_FULL_IMAGE:figures/full_fig_p015_12.png]
Figure 13
Figure 13. Figure 13: Minimal pair probability comparison-based BLiMP accuracies for each model we examine. Each dot on the [PITH_FULL_IMAGE:figures/full_fig_p024_13.png]
Figure 14
Figure 14. Figure 14: Critical and Final region accuracies on BLiMP dataset-level probing (Experiemnt 2) on Pythia-14m, OLMo [PITH_FULL_IMAGE:figures/full_fig_p025_14.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

234 extracted references · 58 canonical work pages

  1. [1]

    Language Acquisition , booktitle =

    Pinker, Steven , year = 1995, month = oct, eprint =. Language Acquisition , booktitle =. doi:10.7551/mitpress/3964.003.0010 , isbn =

  2. [2]

    and Murty, Shikhar , year = 2025, month = nov, number =

    Agarwal, Ananth and Jian, Jasper and Manning, Christopher D. and Murty, Shikhar , year = 2025, month = nov, number =. Mechanisms vs. doi:10.48550/arXiv.2506.16678 , urldate =. arXiv , keywords =:2506.16678 , primaryclass =

  3. [3]

    Transactions on Machine Learning Research , issn =

    Synthesizing World Models for Bilevel Planning , author =. Transactions on Machine Learning Research , issn =

  4. [4]

    Proceedings of the 2023

    Ahuja, Kabir and Diddee, Harshita and Hada, Rishav and Ochieng, Millicent and Ramesh, Krithika and Jain, Prachi and Nambi, Akshay and Ganu, Tanuja and Segal, Sameer and Ahmed, Mohamed and Bali, Kalika and Sitaram, Sunayana , editor =. Proceedings of the 2023. doi:10.18653/v1/2023.emnlp-main.258 , urldate =

  5. [5]

    Modeling

    Albright, Adam and Hayes, Bruce , year = 2002, month = jul, pages =. Modeling. Proceedings of the. doi:10.3115/1118647.1118654 , urldate =

  6. [6]

    Rules vs

    Albright, Adam and Hayes, Bruce , year = 2003, month = dec, journal =. Rules vs. Analogy in. doi:10.1016/S0010-0277(03)00146-X , urldate =

  7. [7]

    Naturalistic

    Amini, Afra and Pimentel, Tiago and Meister, Clara and Cotterell, Ryan , year = 2023, journal =. Naturalistic. doi:10.1162/tacl_a_00554 , urldate =

  8. [8]

    Avitan, Matan and Cotterell, Ryan and Goldberg, Yoav and Ravfogel, Shauli , editor =. A. Findings of the. doi:10.18653/v1/2025.findings-naacl.180 , urldate =

Show all 234 references
  1. [9]

    Azaria, Amos and Mitchell, Tom , editor =. The. Findings of the. doi:10.18653/v1/2023.findings-emnlp.68 , urldate =

  2. [10]

    The Atoms of Language , author =

  3. [11]

    Constraint-Based

    Barke, Shraddha and Kunkel, Rose and Polikarpova, Nadia and Meinhardt, Eric and Bakovic, Eric and Bergen, Leon , editor =. Constraint-Based. Proceedings of the 2019. doi:10.18653/v1/D19-1639 , urldate =

  4. [12]

    Baroni, Marco , year = 2022, publisher =. On the. Algebraic

  5. [13]

    Behzad, Shabnam and Zeldes, Amir and Schneider, Nathan , editor =. To. Findings of the. doi:10.18653/v1/2024.findings-emnlp.916 , urldate =

  6. [14]

    Analyzing

    Belinkov, Yonatan and Glass, James , year = 2017, volume =. Analyzing. Advances in

  7. [15]

    Analysis

    Belinkov, Yonatan and Glass, James , editor =. Analysis. Transactions of the Association for Computational Linguistics , volume =. doi:10.1162/tacl_a_00254 , urldate =

  8. [16]

    Belinkov, Yonatan , year = 2022, month = mar, journal =. Probing. doi:10.1162/coli_a_00422 , urldate =

  9. [17]

    and Flickinger, Dan and Oepen, Stephan and Packard, Woodley and Copestake, Ann , editor =

    Bender, Emily M. and Flickinger, Dan and Oepen, Stephan and Packard, Woodley and Copestake, Ann , editor =. Layers of. Proceedings of the 11th

  10. [18]

    and Gebru, Timnit and

    Bender, Emily M. and Gebru, Timnit and. On the. Proceedings of the 2021. doi:10.1145/3442188.3445922 , urldate =

  11. [19]

    and Wexler, Kenneth , editor =

    Berwick, Robert C. and Wexler, Kenneth , editor =. Parsing. Studies in the. doi:10.1007/978-94-009-3387-3_3 , urldate =

  12. [20]

    Cognitive Psychology , volume =

    Broken Agreement , author =. Cognitive Psychology , volume =. doi:10.1016/0010-0285(91)90003-7 , urldate =

  13. [21]

    Paradigm

    Breiss, Canaan and Katsuda, Hironori and Kawahara, Shigeto , langid =. Paradigm

  14. [22]

    and Woolley, Jacqueline D

    Browne, Cheryl A. and Woolley, Jacqueline D. , year = 2004, month = may, journal =. Preschoolers'. doi:10.1207/s15327647jcd0502_4 , urldate =

  15. [23]

    Discovering

    Burns, Collin and Ye, Haotian and Klein, Dan and Steinhardt, Jacob , year = 2022, month = sep, urldate =. Discovering. The

  16. [24]

    Explanatory Models in Neuroscience,

    Cao, Rosa and Yamins, Daniel , year = 2024, month = jun, journal =. Explanatory Models in Neuroscience,. doi:10.1016/j.cogsys.2023.101200 , urldate =

  17. [25]

    Explanatory Models in Neuroscience,

    Cao, Rosa and Yamins, Daniel , year = 2024, month = sep, journal =. Explanatory Models in Neuroscience,. doi:10.1016/j.cogsys.2024.101244 , urldate =

  18. [26]

    Meaning and

    Chierchia, Gennaro and. Meaning and

  19. [27]

    Syntactic

    Chomsky, Noam , year = 1957, publisher =. Syntactic

  20. [28]

    Behavioral and Brain Sciences , volume =

    Rules and Representations , author =. Behavioral and Brain Sciences , volume =. doi:10.1017/S0140525X00001515 , urldate =

  21. [29]

    Chomsky, Noam , year = 1995, month = sep, publisher =. The

  22. [30]

    Aspects of the

    Chomsky, Noam , year = 1965, publisher =. Aspects of the

  23. [31]

    Grammar of

    Cole, Peter and Hermon, Gabriella and. Grammar of. Cognition , volume =. doi:10.1016/j.cognition.2015.04.005 , urldate =

  24. [32]

    Language

    Comrie, Bernard , year = 1989, month = jul, publisher =. Language

  25. [33]

    Structure

    Crain, Stephen and Nakayama, Mineharu , year = 1987, month = sep, journal =. Structure. doi:10.2307/415004 , urldate =

  26. [34]

    Generalising to

    Dankers, Verna and Langedijk, Anna and McCurdy, Kate and Williams, Adina and Hupkes, Dieuwke , editor =. Generalising to. Proceedings of the 25th. doi:10.18653/v1/2021.conll-1.8 , urldate =

  27. [35]

    Dankers, Verna and Bruni, Elia and Hupkes, Dieuwke , editor =. The. Proceedings of the 60th. doi:10.18653/v1/2022.acl-long.286 , urldate =

  28. [36]

    Memorisation

    Dankers, Verna and Titov, Ivan and Hupkes, Dieuwke , editor =. Memorisation. Proceedings of the 2023. doi:10.18653/v1/2023.emnlp-main.518 , urldate =

  29. [37]

    Generalisation

    Dankers, Verna and Titov, Ivan , editor =. Generalisation. Findings of the. doi:10.18653/v1/2024.findings-acl.852 , urldate =

  30. [38]

    Incremental

    Davis, Forrest , editor =. Incremental. Proceedings of the 26th. doi:10.18653/v1/2022.conll-1.11 , urldate =

  31. [39]

    Systematic Testing of Three

    Dentella, Vittoria and G. Systematic Testing of Three. Proceedings of the National Academy of Sciences , volume =. doi:10.1073/pnas.2309583120 , urldate =

  32. [40]

    Proceedings of the 2019

    Devlin, Jacob and Chang, Ming-Wei and Lee, Kenton and Toutanova, Kristina , editor =. Proceedings of the 2019. doi:10.18653/v1/N19-1423 , urldate =

  33. [41]

    Language to

    Dong, Li and Lapata, Mirella , editor =. Language to. Proceedings of the 54th. doi:10.18653/v1/P16-1004 , urldate =

  34. [42]

    , year = 2025, month = may, number =

    Duan, Xufeng and Yao, Zhaoqian and Zhang, Yunhao and Wang, Shaonan and Cai, Zhenguang G. , year = 2025, month = may, number =. How. doi:10.48550/arXiv.2505.19548 , urldate =. arXiv , keywords =:2505.19548 , primaryclass =

  35. [43]

    Probing for

    Eisape, Tiwalayo and Gangireddy, Vineet and Levy, Roger and Kim, Yoon , editor =. Probing for. Findings of the. doi:10.18653/v1/2022.findings-emnlp.203 , urldate =

  36. [44]

    Elazar, Yanai and Ravfogel, Shauli and Jacovi, Alon and Goldberg, Yoav , year = 2021, month = mar, journal =. Amnesic. doi:10.1162/tacl_a_00359 , urldate =

  37. [45]

    Synthesizing Theories of Human Language with

    Ellis, Kevin and Albright, Adam and. Synthesizing Theories of Human Language with. Nature Communications , volume =. doi:10.1038/s41467-022-32012-w , urldate =

  38. [46]

    Epstein, Samuel David , editor =. Un-. Working. doi:10.7551/mitpress/7305.003.0014 , urldate =

  39. [47]

    Language , volume =

    The Effect of Allophonic Processes on Word Recognition:. Language , volume =. 48771157 , eprinttype =

  40. [48]

    and Griffiths, Thomas L

    Feldman, Naomi H. and Griffiths, Thomas L. and Morgan, James L. , year = 2009, journal =. The Influence of Categories on Perception:. doi:10.1037/a0017196 , abstract =

  41. [49]

    Feldman, Vitaly and Zhang, Chiyuan , year = 2020, volume =. What. Advances in

  42. [50]

    Finlayson, Matthew and Mueller, Aaron and Gehrmann, Sebastian and Shieber, Stuart and Linzen, Tal and Belinkov, Yonatan , editor =. Causal. Proceedings of the 59th. doi:10.18653/v1/2021.acl-long.144 , urldate =

  43. [51]

    Finn, Chelsea and Abbeel, Pieter and Levine, Sergey , year = 2017, month = jul, number =. Model-. doi:10.48550/arXiv.1703.03400 , urldate =. arXiv , keywords =:1703.03400 , primaryclass =

  44. [52]

    Meaningful Questions:

    Fitz, Hartmut and Chang, Franklin , year = 2017, month = sep, journal =. Meaningful Questions:. doi:10.1016/j.cognition.2017.05.008 , urldate =

  45. [53]

    and Pylyshyn, Zenon W

    Fodor, Jerry A. and Pylyshyn, Zenon W. , year = 1988, month = mar, journal =. Connectionism and Cognitive Architecture:. doi:10.1016/0010-0277(88)90031-5 , urldate =

  46. [54]

    Free Choice and the Theory of Scalar Implicatures , booktitle =

    Fox, Danny , editor =. Free Choice and the Theory of Scalar Implicatures , booktitle =. doi:10.1057/9780230210752_4 , abstract =

  47. [55]

    Fox, Danny and Katzir, Roni , year = 2024, month = jun, journal =. Large. doi:10.1515/tl-2024-2005 , urldate =

  48. [56]

    Cognition , volume =

    Structural Complexity and the Time Course of Grammatical Development , author =. Cognition , volume =. doi:10.1016/S0010-0277(98)00024-9 , urldate =

  49. [57]

    Frank, Robert and Mathis, Donald and Badecker, William , year = 2013, month = jul, journal =. The. doi:10.1080/10489223.2013.796950 , urldate =

  50. [58]

    Sequence-to-

    Frank, Robert and Petty, Jackson , editor =. Sequence-to-. Proceedings of the

  51. [59]

    , year = 1971, journal =

    Fromkin, Victoria A. , year = 1971, journal =. The. doi:10.2307/412187 , urldate =. 412187 , eprinttype =

  52. [60]

    Neural Language Models as Psycholinguistic Subjects:

    Futrell, Richard and Wilcox, Ethan and Morita, Takashi and Qian, Peng and Ballesteros, Miguel and Levy, Roger , editor =. Neural Language Models as Psycholinguistic Subjects:. Proceedings of the 2019. doi:10.18653/v1/N19-1004 , urldate =

  53. [61]

    Futrell, Richard and Mahowald, Kyle , year = 2025, month = jul, journal =. How. doi:10.1017/S0140525X2510112X , urldate =. arXiv , keywords =:2501.17047 , primaryclass =

  54. [62]

    , editor =

    Gauthier, Jon and Breiss, Canaan and Leonard, Matthew K and Chang, Edward F. , editor =. Emergent Morpho-Phonological Representations in Self-Supervised Speech Models , booktitle =. doi:10.18653/v1/2025.emnlp-main.1425 , urldate =

  55. [63]

    Compositionality:

    van Gelder, Tim , year = 1990, month = jul, journal =. Compositionality:. doi:10.1207/s15516709cog1403_2 , urldate =

  56. [64]

    Bootstrapping Word Order in Prelexical Infants: A

    Gervain, Judit and Nespor, Marina and Mazuka, Reiko and Horie, Ryota and Mehler, Jacques , year = 2008, month = aug, journal =. Bootstrapping Word Order in Prelexical Infants: A. doi:10.1016/j.cogpsych.2007.12.001 , abstract =

  57. [65]

    From Fieldwork to Linguistic Theory:

    Gibson, Edward and Poliak, Moshe , year = 2024, month = sep, publisher =. From Fieldwork to Linguistic Theory:

  58. [66]

    Information and Control , volume =

    Language Identification in the Limit , author =. Information and Control , volume =. doi:10.1016/S0019-9958(67)91165-5 , urldate =

  59. [67]

    Reporting Bias and Knowledge Acquisition , booktitle =

    Gordon, Jonathan and Van Durme, Benjamin , year = 2013, month = oct, series =. Reporting Bias and Knowledge Acquisition , booktitle =. doi:10.1145/2509558.2509563 , urldate =

  60. [68]

    Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences , volume =

    Inductive Biases for Deep Learning of Higher-Level Cognition , author =. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences , volume =. doi:10.1098/rspa.2021.0068 , urldate =

  61. [69]

    Grattafiori, Aaron and Dubey, Abhimanyu and Jauhri, Abhinav and Pandey, Abhinav and Kadian, Abhishek and. The. doi:10.48550/arXiv.2407.21783 , urldate =. arXiv , keywords =:2407.21783 , primaryclass =

  62. [70]

    Universals of language , volume =

    Some Universals of Grammar with Particular Reference to the Order of Meaningful Elements , author =. Universals of language , volume =

  63. [71]

    Universals of Language , editor =

  64. [72]

    , year = 2021, month = jul, journal =

    Guest, Olivia and Martin, Andrea E. , year = 2021, month = jul, journal =. How. doi:10.1177/1745691620970585 , urldate =

  65. [73]

    Colorless

    Gulordava, Kristina and Bojanowski, Piotr and Grave, Edouard and Linzen, Tal and Baroni, Marco , editor =. Colorless. Proceedings of the 2018. doi:10.18653/v1/N18-1108 , urldate =

  66. [74]

    Proceedings of the National Academy of Sciences , volume =

    Hierarchical Dynamic Coding Coordinates Speech Comprehension in the Human Brain , author =. Proceedings of the National Academy of Sciences , volume =. doi:10.1073/pnas.2422097122 , urldate =

  67. [75]

    , year = 1994, journal =

    Hadley, Robert F. , year = 1994, journal =. Systematicity in. doi:10.1111/j.1468-0017.1994.tb00225.x , urldate =

  68. [76]

    Generative

    Hao, Sophie , year = 2025, month = mar, number =. Generative. doi:10.48550/arXiv.2503.20088 , urldate =. arXiv , keywords =:2503.20088 , primaryclass =

  69. [77]

    and Gobbini, M

    Haxby, James V. and Gobbini, M. Ida and Furey, Maura L. and Ishai, Alumit and Schouten, Jennifer L. and Pietrini, Pietro , year = 2001, month = sep, journal =. Distributed and. doi:10.1126/science.1063736 , urldate =

  70. [78]

    Hayes, Bruce and Wilson, Colin , year = 2008, month = jul, journal =. A. doi:10.1162/ling.2008.39.3.379 , urldate =

  71. [79]

    , year = 2024, month = mar, number =

    He, Linyang and Chen, Peili and Nie, Ercong and Li, Yuanning and Brennan, Jonathan R. , year = 2024, month = mar, number =. Decoding. doi:10.48550/arXiv.2403.17299 , urldate =. arXiv , keywords =:2403.17299 , primaryclass =

  72. [80]

    Proceedings of the National Academy of Sciences , volume =

    A Hierarchy of Linguistic Predictions during Natural Language Comprehension , author =. Proceedings of the National Academy of Sciences , volume =. doi:10.1073/pnas.2201968119 , urldate =

  73. [81]

    Semantics in

    Heim, Irene and Kratzer, Angelika , editor =. Semantics in

  74. [82]

    Measuring

    Hendrycks, Dan and Burns, Collin and Basart, Steven and Zou, Andy and Mazeika, Mantas and Song, Dawn and Steinhardt, Jacob , year = 2020, month = oct, urldate =. Measuring. International

  75. [83]

    Designing and

    Hewitt, John and Liang, Percy , editor =. Designing and. Proceedings of the 2019. doi:10.18653/v1/D19-1275 , urldate =

  76. [84]

    , editor =

    Hewitt, John and Manning, Christopher D. , editor =. A. Proceedings of the 2019. doi:10.18653/v1/N19-1419 , urldate =

  77. [85]

    Hochreiter, Sepp and Schmidhuber, J. Long. Neural Computation , volume =. doi:10.1162/neco.1997.9.8.1735 , urldate =

  78. [86]

    Proceedings of the National Academy of Sciences , volume =

    Derivational Morphology Reveals Analogical Generalization in Large Language Models , author =. Proceedings of the National Academy of Sciences , volume =. doi:10.1073/pnas.2423232122 , urldate =

  79. [87]

    Florian and Arnon, Inbal and Sag, Ivan A

    Hofmeister, Philip and Jaeger, T. Florian and Arnon, Inbal and Sag, Ivan A. and Snider, Neal , year = 2013, month = jan, journal =. The Source Ambiguity Problem:. doi:10.1080/01690965.2011.572401 , abstract =

  80. [88]

    A Closer Look at the Performance of Neural Language Models on Reflexive Anaphor Licensing , booktitle =

    Hu, Jennifer and Chen, Sherry Yong and Levy, Roger , editor =. A Closer Look at the Performance of Neural Language Models on Reflexive Anaphor Licensing , booktitle =

  81. [89]

    Hu, Jennifer and Gauthier, Jon and Qian, Peng and Wilcox, Ethan and Levy, Roger , editor =. A. Proceedings of the 58th. doi:10.18653/v1/2020.acl-main.158 , urldate =

  82. [90]

    Prompting Is Not a Substitute for Probability Measurements in Large Language Models , booktitle =

    Hu, Jennifer and Levy, Roger , editor =. Prompting Is Not a Substitute for Probability Measurements in Large Language Models , booktitle =. doi:10.18653/v1/2023.emnlp-main.306 , urldate =

  83. [91]

    Proceedings of the National Academy of Sciences , volume =

    Language Models Align with Human Judgments on Key Grammatical Constructions , author =. Proceedings of the National Academy of Sciences , volume =. doi:10.1073/pnas.2400917121 , urldate =

  84. [92]

    and Petty, Jackson and Shi, Chuan and Merrill, William and Linzen, Tal , editor =

    Hu, Michael Y. and Petty, Jackson and Shi, Chuan and Merrill, William and Linzen, Tal , editor =. Between. Proceedings of the 63rd. doi:10.18653/v1/2025.acl-long.478 , urldate =

  85. [93]

    Shades of Zero:

    Hu, Jennifer and Sosa, Felix and Ullman, Tomer , year = 2025, month = aug, journal =. Shades of Zero:. doi:10.1016/j.jml.2025.104640 , urldate =

  86. [94]

    and Franke, Michael , year = 2025, month = may, number =

    Hu, Jennifer and Lepori, Michael A. and Franke, Michael , year = 2025, month = may, number =. Signatures of Human-like Processing in. doi:10.48550/arXiv.2504.14107 , urldate =. arXiv , keywords =:2504.14107 , primaryclass =

  87. [95]

    , year = 2026, month = jan, journal =

    Hu, Jennifer and Wilcox, Ethan Gotlieb and Song, Siyuan and Mahowald, Kyle and Levy, Roger P. , year = 2026, month = jan, journal =. What. doi:10.1162/TACL.a.611 , urldate =

  88. [96]

    and Newport, Elissa L

    Hudson Kam, Carla L. and Newport, Elissa L. , year = 2005, month = apr, journal =. Regularizing. doi:10.1080/15475441.2005.9684215 , urldate =

  89. [97]

    and Newport, Elissa L

    Hudson Kam, Carla L. and Newport, Elissa L. , year = 2009, month = aug, journal =. Getting It Right by Getting It Wrong:. doi:10.1016/j.cogpsych.2009.01.001 , urldate =

  90. [98]

    and Sulem, Elior and Cynthia, Fisher and Roth, Dan , editor =

    Huebner, Philip A. and Sulem, Elior and Cynthia, Fisher and Roth, Dan , editor =. Proceedings of the 25th. doi:10.18653/v1/2021.conll-1.49 , urldate =

  91. [99]

    Compositionality

    Hupkes, Dieuwke and Dankers, Verna and Mul, Mathijs and Bruni, Elia , year = 2020, month = apr, journal =. Compositionality. doi:10.1613/jair.1.11674 , urldate =

  92. [100]

    Ide, Yusuke and Nishida, Yuto and Oba, Miyu and Sakai, Yusuke and Vasselli, Justin and Kamigaito, Hidetaka and Watanabe, Taro , year = 2024, month = aug, number =. How to. doi:10.48550/arXiv.2408.09639 , urldate =. arXiv , keywords =:2408.09639 , primaryclass =

  93. [101]

    and Sathe, Aalok and Lipkin, Benjamin and Kumar, Unnathi U

    Ivanova, Anna A. and Sathe, Aalok and Lipkin, Benjamin and Kumar, Unnathi U. and Radkani, Setayesh and Clark, Thomas H. and Kauf, Carina and Hu, Jennifer and Pramod, R. T. and Grand, Gabriel and Paulun, Vivian C. and Ryskina, Maria and Aky. Elements of. Transactions of the Ass...

  94. [102]

    Survey of

    Ji, Ziwei and Lee, Nayeon and Frieske, Rita and Yu, Tiezheng and Su, Dan and Xu, Yan and Ishii, Etsuko and Bang, Ye Jin and Madotto, Andrea and Fung, Pascale , year = 2023, month = mar, journal =. Survey of. doi:10.1145/3571730 , urldate =

  95. [103]

    doi:10.48550/arXiv.2504.02768 , urldate =

    Jumelet, Jaap and Weissweiler, Leonie and Nivre, Joakim and Bisazza, Arianna , year = 2025, month = aug, number =. doi:10.48550/arXiv.2504.02768 , urldate =. arXiv , keywords =:2504.02768 , primaryclass =

  96. [104]

    Language

    Kadavath, Saurav and Conerly, Tom and Askell, Amanda and Henighan, Tom and Drain, Dawn and Perez, Ethan and Schiefer, Nicholas and. Language. arXiv.org , urldate =

  97. [105]

    Language , volume =

    The Impact of Conditioning Variables on the Acquisition of Variation in Adult and Child Learners , author =. Language , volume =

  98. [106]

    Katzir, Roni , year = 2023, month = dec, journal =. Why. doi:10.5964/bioling.13153 , urldate =

  99. [107]

    and Rambelli, Giulia and Chersoni, Emmanuele and She, Jingyuan Selena and Chowdhury, Zawad and Fedorenko, Evelina and Lenci, Alessandro , year = 2023, journal =

    Kauf, Carina and Ivanova, Anna A. and Rambelli, Giulia and Chersoni, Emmanuele and She, Jingyuan Selena and Chowdhury, Zawad and Fedorenko, Evelina and Lenci, Alessandro , year = 2023, journal =. Event. doi:10.1111/cogs.13386 , urldate =

  100. [108]

    Evidence of

    Kennedy, Mary , editor =. Evidence of. Proceedings of the 29th. doi:10.18653/v1/2025.conll-1.25 , urldate =

  101. [109]

    Testing for

    Kim, Najoung and Smolensky, Paul , editor =. Testing for. Proceedings of the

  102. [110]

    Kim, Najoung and Schuster, Sebastian , editor =. Entity. Proceedings of the 61st. doi:10.18653/v1/2023.acl-long.213 , urldate =

  103. [111]

    Kim, Junsol and Evans, James and Schein, Aaron , year = 2025, month = apr, number =. Linear. doi:10.48550/arXiv.2503.02080 , urldate =. arXiv , keywords =:2503.02080 , primaryclass =

  104. [112]

    Recurrent

    Kirov, Christo and Cotterell, Ryan , editor =. Recurrent. Transactions of the Association for Computational Linguistics , volume =. doi:10.1162/tacl_a_00247 , urldate =

  105. [113]

    Language and Cognitive Processes , volume =

    Subjacency as a Processing Phenomenon , author =. Language and Cognitive Processes , volume =. doi:10.1080/01690969308407588 , urldate =

  106. [114]

    Kodner, Jordan and Payne, Sarah and Heinz, Jeffrey , year = 2023, month = aug, number =. Why. doi:10.48550/arXiv.2308.03228 , urldate =. arXiv , keywords =:2308.03228 , primaryclass =

  107. [115]

    Frontiers in Systems Neuroscience , volume =

    Representational Similarity Analysis - Connecting the Branches of Systems Neuroscience , author =. Frontiers in Systems Neuroscience , volume =. doi:10.3389/neuro.06.004.2008 , urldate =

  108. [116]

    doi:10.48550/arXiv.2512.03676 , urldate =

    Different Types of Syntactic Agreement Recruit the Same Units within Large Language Models , author =. doi:10.48550/arXiv.2512.03676 , urldate =. arXiv , keywords =:2512.03676 , primaryclass =

  109. [117]

    Kumon, Ryoma and Yanaka, Hitomi , year = 2026, month = apr, journal =. Fine-

  110. [118]

    Behavioral and Brain Sciences , volume =

    Building Machines That Learn and Think like People , author =. Behavioral and Brain Sciences , volume =. doi:10.1017/S0140525X16001837 , urldate =

  111. [119]

    Nature , volume =

    Human-like Systematic Generalization through a Meta-Learning Neural Network , author =. Nature , volume =. doi:10.1038/s41586-023-06668-3 , urldate =

  112. [120]

    Benchmarking

    Lan, Nur and Chemla, Emmanuel and Katzir, Roni , year = 2023, month = aug, number =. Benchmarking. doi:10.48550/arXiv.2308.08253 , urldate =. arXiv , keywords =:2308.08253 , primaryclass =

  113. [121]

    Algebraic

    Lappin, Shalom and Bernardy, Jean-Philippe , year = 2022, month = dec, publisher =. Algebraic

  114. [122]

    Grammaticality,

    Lau, Jey Han and Clark, Alexander and Lappin, Shalom , year = 2017, journal =. Grammaticality,. doi:10.1111/cogs.12414 , urldate =

  115. [123]

    and Astudillo, Ram

    Lee, Celine and Sultan, Md Arafat and Naseem, Tahira and Rush, Alexander M. and Astudillo, Ram. Sampling. The

  116. [124]

    The Linguistic Review , volume =

    Empirical Re-Assessment of Stimulus Poverty Arguments , author =. The Linguistic Review , volume =. doi:10.1515/tlir.19.1-2.151 , urldate =

  117. [125]

    Reply to

    Leivada, Evelina and G. Reply to. Proceedings of the National Academy of Sciences , volume =. doi:10.1073/pnas.2406752121 , urldate =

  118. [126]

    Thomas , editor =

    Lepori, Michael and Linzen, Tal and McCoy, R. Thomas , editor =. Representations of. Proceedings of the 58th. doi:10.18653/v1/2020.acl-main.303 , urldate =

  119. [127]

    and Hu, Jennifer and Dasgupta, Ishita and Patel, Roma and Serre, Thomas and Pavlick, Ellie , year = 2026, month = apr, number =

    Lepori, Michael A. and Hu, Jennifer and Dasgupta, Ishita and Patel, Roma and Serre, Thomas and Pavlick, Ellie , year = 2026, month = apr, number =. Is. doi:10.48550/arXiv.2507.12553 , urldate =. arXiv , keywords =:2507.12553 , primaryclass =

  120. [128]

    Cognition , volume =

    Expectation-Based Syntactic Comprehension , author =. Cognition , volume =. doi:10.1016/j.cognition.2007.05.006 , urldate =

  121. [129]

    Levy, Roger and Kim, Yoon and Fox, Danny , year = 2024, month = mar, journal =. The. doi:10.21428/e4baedd9.f6a0052d , urldate =

  122. [130]

    Lew, Alexander K. and. Sequential

  123. [131]

    Inference-

    Li, Kenneth and Patel, Oam and Vi. Inference-. Advances in Neural Information Processing Systems , volume =

  124. [132]

    Cognition , volume =

    Children's Command of Quantification , author =. Cognition , volume =. doi:10.1016/S0010-0277(02)00013-6 , urldate =

  125. [133]

    Proceedings of the 60th

    Lin, Stephanie and Hilton, Jacob and Evans, Owain , editor =. Proceedings of the 60th. doi:10.18653/v1/2022.acl-long.229 , urldate =

  126. [134]

    Assessing the

    Linzen, Tal and Dupoux, Emmanuel and Goldberg, Yoav , editor =. Assessing the. Transactions of the Association for Computational Linguistics , volume =. doi:10.1162/tacl_a_00115 , urldate =

  127. [135]

    Lipkin, Ben and LeBrun, Benjamin and Vigly, Jacob Hoover and Loula, Jo. Fast. Second

  128. [136]

    Liu, Yikang and Shen, Yeting and Zhu, Hongao and Xu, Lilong and Qian, Zhiheng and Song, Siyuan and Zhang, Kejia and Tang, Jialong and Zhang, Pei and Yang, Baosong and Wang, Rui and Hu, Hai , year = 2025, month = dec, number =. A. doi:10.48550/arXiv.2411.06096 , urldate =. arXi...

  129. [137]

    doi:10.1016/j.jml.2025.104675 , urldate =

    Loo, Alyssa and Pavlick, Ellie and Feiman, Roman , year = 2026, month = feb, journal =. doi:10.1016/j.jml.2025.104675 , urldate =

  130. [138]

    Syntactic and

    Loula, Jo. Syntactic and. doi:10.48550/arXiv.2504.13139 , urldate =. arXiv , keywords =:2504.13139 , primaryclass =

  131. [139]

    Lu, Meng and Zhang, Ruochen and Eickhoff, Carsten and Pavlick, Ellie , editor =. Paths. Proceedings of the 2025. doi:10.18653/v1/2025.emnlp-main.762 , urldate =

  132. [140]

    Proceedings of the National Academy of Sciences , volume =

    Emergent Linguistic Structure in Artificial Neural Networks Trained by Self-Supervision , author =. Proceedings of the National Academy of Sciences , volume =. doi:10.1073/pnas.1907367117 , urldate =

  133. [141]

    , year = 2022, month = may, journal =

    Manning, Christopher D. , year = 2022, month = may, journal =. Human. doi:10.1162/daed_a_01905 , urldate =

  134. [142]

    Looking Forward:

    Mansfield, John and Wilcox, Ethan Gotlieb , year = 2025, month = feb, number =. Looking Forward:. doi:10.48550/arXiv.2502.18313 , urldate =. arXiv , keywords =:2502.18313 , primaryclass =

  135. [143]

    The Linguistic Review , volume =

    Generative Linguistics within the Cognitive Neuroscience of Language , author =. The Linguistic Review , volume =. doi:10.1515/tlir.2005.22.2-4.429 , urldate =

  136. [144]

    and Santorini, Beatrice and Marcinkiewicz, Mary Ann , editor =

    Marcus, Mitchell P. and Santorini, Beatrice and Marcinkiewicz, Mary Ann , editor =. Building a. Computational Linguistics , volume =

  137. [145]

    Cognition , volume =

    Negative Evidence in Language Acquisition , author =. Cognition , volume =. doi:10.1016/0010-0277(93)90022-N , urldate =

  138. [146]

    and Brinkmann, Ursula and Clahsen, Harald and Wiese, Richard and Pinker, Steven , year = 1995, month = dec, journal =

    Marcus, Gary F. and Brinkmann, Ursula and Clahsen, Harald and Wiese, Richard and Pinker, Steven , year = 1995, month = dec, journal =. German. doi:10.1006/cogp.1995.1015 , urldate =

  139. [147]

    , year = 1998, month = dec, journal =

    Marcus, Gary F. , year = 1998, month = dec, journal =. Rethinking. doi:10.1006/cogp.1998.0694 , urldate =

  140. [148]

    Marcus, G. F. and Vijayan, S. and Bandi Rao, S. and Vishton, P. M. , year = 1999, month = jan, journal =. Rule. doi:10.1126/science.283.5398.77 , urldate =

  141. [149]

    Marcus, Gary , year = 2018, month = jan, number =. Deep. doi:10.48550/arXiv.1801.00631 , urldate =. arXiv , keywords =:1801.00631 , primaryclass =

  142. [150]

    Marks, Samuel and Tegmark, Max , year = 2024, month = aug, urldate =. The. First

  143. [151]

    Targeted

    Marvin, Rebecca and Linzen, Tal , editor =. Targeted. Proceedings of the 2018. doi:10.18653/v1/D18-1151 , urldate =

  144. [152]

    Networks and

    McCloskey, Michael , year = 1991, month = nov, journal =. Networks and. doi:10.1111/j.1467-9280.1991.tb00173.x , urldate =

  145. [153]

    Proceedings of the Annual Meeting of the Cognitive Science Society , volume =

    Universal Linguistic Inductive Biases via Meta-Learning , author =. Proceedings of the Annual Meeting of the Cognitive Science Society , volume =

  146. [154]

    Proceedings of the National Academy of Sciences , volume =

    Embers of Autoregression Show How Large Language Models Are Shaped by the Problem They Are Trained to Solve , author =. Proceedings of the National Academy of Sciences , volume =. doi:10.1073/pnas.2322420121 , urldate =

  147. [155]

    Thomas and Griffiths, Thomas L

    McCoy, R. Thomas and Griffiths, Thomas L. , year = 2025, month = may, journal =. Modeling Rapid Language Learning by Distilling. doi:10.1038/s41467-025-59957-y , urldate =

  148. [156]

    Conditioning, but on

    McCurdy, Kate and Lopez, Adam and Goldwater, Sharon , editor =. Conditioning, but on. Proceedings of the. doi:10.18653/v1/2020.cmcl-1.8 , urldate =

  149. [157]

    Regularization or Lexical Probability-Matching?

    McCurdy, Kate and Goldwater, Sharon and Lopez, Adam , year = 2022, volume =. Regularization or Lexical Probability-Matching?. Proceedings of the

  150. [158]

    Rules, Frequency, and Predictability in Morphological Generalization: Behavioral and Computational Evidence from the

    McCurdy, Kate , year = 2024, urldate =. Rules, Frequency, and Predictability in Morphological Generalization: Behavioral and Computational Evidence from the

  151. [159]

    Propositions , booktitle =

    McGrath, Matthew and Frank, Devin , editor =. Propositions , booktitle =

  152. [160]

    Cognition , volume =

    A Precursor of Language Acquisition in Young Infants , author =. Cognition , volume =. doi:10.1016/0010-0277(88)90035-2 , urldate =

  153. [161]

    Language

    Milli. Language. doi:10.48550/arXiv.2408.07144 , urldate =. arXiv , keywords =:2408.07144 , primaryclass =

  154. [162]

    Generating Novel Experimental Hypotheses from Language Models:

    Misra, Kanishka and Kim, Najoung , year = 2024, month = oct, number =. Generating Novel Experimental Hypotheses from Language Models:. doi:10.48550/arXiv.2408.05086 , urldate =. arXiv , keywords =:2408.05086 , primaryclass =

  155. [163]

    Montague, Richard , year = 1974, publisher =. Formal

  156. [164]

    Mueller, Aaron and Nicolai, Garrett and. Cross-. Proceedings of the 58th. doi:10.18653/v1/2020.acl-main.490 , urldate =

  157. [165]

    Natural Language Engineering , volume =

    A Systematic Review of Unsupervised Approaches to Grammar Induction , author =. Natural Language Engineering , volume =. doi:10.1017/S1351324920000327 , urldate =

  158. [166]

    Refining

    Newman, Benjamin and Ang, Kai-Siang and Gong, Julia and Hewitt, John , editor =. Refining. Proceedings of the 2021. doi:10.18653/v1/2021.naacl-main.290 , urldate =

  159. [167]

    , year = 2008, month = apr, journal =

    Norris, Dennis and McQueen, James M. , year = 2008, month = apr, journal =. Shortlist. doi:10.1037/0033-295X.115.2.357 , abstract =

  160. [168]

    OLMo, Team and Walsh, Pete and Soldaini, Luca and Groeneveld, Dirk and Lo, Kyle and Arora, Shane and Bhagia, Akshita and Gu, Yuling and Huang, Shengyi and Jordan, Matt and Lambert, Nathan and Schwenk, Dustin and Tafjord, Oyvind and Anderson, Taira and Atkinson, David and Brahm...

  161. [169]

    Injecting Structural Hints:

    Papadimitriou, Isabel and Jurafsky, Dan , editor =. Injecting Structural Hints:. Findings of the. doi:10.18653/v1/2023.findings-emnlp.563 , urldate =

  162. [170]

    Mathematical

    Partee, Barbara and ter Meulen, Alice and Wall, Robert , year = 1987, publisher =. Mathematical

  163. [171]

    Weighted

    Pater, Joe , year = 2009, journal =. Weighted. doi:10.1111/j.1551-6709.2009.01047.x , urldate =

  164. [172]

    Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences , volume =

    Symbols and Grounding in Large Language Models , author =. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences , volume =. doi:10.1098/rsta.2022.0041 , urldate =

  165. [173]

    and Sprouse, Jon , year = 2013, month = jan, journal =

    Pearl, Lisa S. and Sprouse, Jon , year = 2013, month = jan, journal =. Syntactic. doi:10.1080/10489223.2012.738742 , urldate =

  166. [174]

    , year = 2019, month = mar, journal =

    Pearl, Lisa S. , year = 2019, month = mar, journal =. Fusion Is. doi:10.1353/lan.2019.0017 , urldate =

  167. [175]

    , editor =

    Pearl, Lisa S. , editor =. How. A. doi:10.1002/9781119598732.ch17 , urldate =

  168. [176]

    , editor =

    Pearl, Lisa S. , editor =. Modeling Syntactic Acquisition , booktitle =. doi:10.1093/oxfordhb/9780198797722.013.8 , urldate =

  169. [177]

    The Acquisition of Allophonic Rules:

    Peperkamp, Sharon and Le Calvez, Rozenn and Nadal, Jean-Pierre and Dupoux, Emmanuel , year = 2006, month = oct, journal =. The Acquisition of Allophonic Rules:. doi:10.1016/j.cognition.2005.10.006 , urldate =

  170. [178]

    Formal Grammar and Information Theory: Together Again? , shorttitle =

    Pereira, Fernando , year = 2000, month = apr, journal =. Formal Grammar and Information Theory: Together Again? , shorttitle =. doi:10.1098/rsta.2000.0583 , urldate =

  171. [179]

    Discovering

    Perez, Ethan and Ringer, Sam and Lukosiute, Kamile and Nguyen, Karina and Chen, Edwin and Heiner, Scott and Pettit, Craig and Olsson, Catherine and Kundu, Sandipan and Kadavath, Saurav and Jones, Andy and Chen, Anna and Mann, Benjamin and Israel, Brian and Seethor, Bryan and M...

  172. [180]

    Cognition , volume =

    The Learnability of Abstract Syntactic Principles , author =. Cognition , volume =. doi:10.1016/j.cognition.2010.11.001 , urldate =

  173. [181]

    Transformers

    Petty, Jackson and Frank, Robert , year = 2021, month = sep, journal =. Transformers

  174. [182]

    Phillips, Colin , year = 2006, journal =. The

  175. [183]

    On Language and Connectionism:

    Pinker, Steven and Prince, Alan , year = 1988, month = mar, journal =. On Language and Connectionism:. doi:10.1016/0010-0277(88)90032-7 , urldate =

  176. [184]

    Rules of

    Pinker, Steven , year = 1991, month = aug, journal =. Rules of. doi:10.1126/science.1857983 , urldate =

  177. [185]

    Research

    Podesva, Robert and Sharma, Devyani , year = 2013, publisher =. Research

  178. [186]

    Improving

    Poli, Maxime and Chemla, Emmanuel and Dupoux, Emmanuel , editor =. Improving. Proceedings of the 2024. doi:10.18653/v1/2024.emnlp-main.302 , urldate =

  179. [187]

    Artificial Intelligence , volume =

    Recursive Distributed Representations , author =. Artificial Intelligence , volume =. doi:10.1016/0004-3702(90)90005-K , urldate =

  180. [188]

    Portelance, Eva and Jasbi, Masoud , year = 2024, journal =. The. doi:10.1111/lnc3.70001 , urldate =

  181. [189]

    The Linguistic Review , volume =

    Empirical Assessment of Stimulus Poverty Arguments , author =. The Linguistic Review , volume =. doi:10.1515/tlir.19.1-2.9 , urldate =

  182. [190]

    , year = 2025, month = may, journal =

    Qiu, Zhuang and Duan, Xufeng and Cai, Zhenguang G. , year = 2025, month = may, journal =. Grammaticality Representation in. doi:10.1057/s41599-025-04907-8 , urldate =

  183. [191]

    Ravfogel, Shauli and Elazar, Yanai and Gonen, Hila and Twiton, Michael and Goldberg, Yoav , editor =. Null. Proceedings of the 58th. doi:10.18653/v1/2020.acl-main.647 , urldate =

  184. [192]

    Counterfactual

    Ravfogel, Shauli and Prasad, Grusha and Linzen, Tal and Goldberg, Yoav , editor =. Counterfactual. Proceedings of the 25th. doi:10.18653/v1/2021.conll-1.15 , urldate =

  185. [193]

    Emergence of

    Ravfogel, Shauli and Yehudai, Gilad and Linzen, Tal and Bruna, Joan and Bietti, Alberto , year = 2025, month = sep, urldate =. Emergence of. Mechanistic

  186. [194]

    Steering

    Rimsky, Nina and Gabrieli, Nick and Schulz, Julian and Tong, Meg and Hubinger, Evan and Turner, Alexander , editor =. Steering. Proceedings of the 62nd. doi:10.18653/v1/2024.acl-long.828 , urldate =

  187. [195]

    , year = 1958, journal =

    Rosenblatt, F. , year = 1958, journal =. The Perceptron:. doi:10.1037/h0042519 , abstract =

  188. [196]

    and McClelland, James L

    Rumelhart, David E. and McClelland, James L. and Group, PDP Research , year = 1986, month = jul, publisher =. Parallel. doi:10.7551/mitpress/5236.001.0001 , urldate =

  189. [197]

    Science , volume =

    Statistical Learning by 8-Month-Old Infants , author =. Science , volume =. doi:10.1126/science.274.5294.1926 , abstract =

  190. [198]

    Saparina, Irina and Lapata, Mirella , year = 2024, month = nov, urldate =. The

  191. [199]

    1842/38154 , eprinttype =

    Training Dynamics of Neural Language Models , author =. 1842/38154 , eprinttype =

  192. [200]

    Judgment Data , booktitle =

    Sch. Judgment Data , booktitle =

  193. [201]

    The Empirical Base of Linguistics:

    Sch. The Empirical Base of Linguistics:. doi:10.26530/OAPEN_603356 , urldate =

  194. [202]

    Quantifying

    Sclar, Melanie and Choi, Yejin and Tsvetkov, Yulia and Suhr, Alane , year = 2024, month = jul, number =. Quantifying. doi:10.48550/arXiv.2310.11324 , urldate =. arXiv , keywords =:2310.11324 , primaryclass =

  195. [203]

    Shen, Yikang and Lin, Zhouhan and Huang, Chin-wei and Courville, Aaron , year = 2018, month = feb, urldate =. Neural. International

  196. [204]

    Is C-Command

    Shin, Unsub and Park, Myung-Kwan and Song, Sanghoun , langid =. Is C-Command

  197. [205]

    Shinnick, Zachary and Jiang, Liangze and Saratchandran, Hemanth and Teney, Damien and van den Hengel, Anton , year = 2025, month = nov, number =. Can. doi:10.48550/arXiv.2511.13945 , urldate =. arXiv , keywords =:2511.13945 , primaryclass =

  198. [206]

    Behavioral and Brain Sciences , volume =

    On the Proper Treatment of Connectionism , author =. Behavioral and Brain Sciences , volume =. doi:10.1017/S0140525X00052432 , urldate =

  199. [207]

    Findings of the

    Someya, Taiga and Oseki, Yohei , editor =. Findings of the. doi:10.18653/v1/2023.findings-eacl.117 , urldate =

  200. [208]

    Proceedings of the 2022

    Song, Yixiao and Krishna, Kalpesh and Bhatt, Rajesh and Iyyer, Mohit , editor =. Proceedings of the 2022. doi:10.18653/v1/2022.emnlp-main.305 , urldate =

  201. [209]

    Assessing the Reliability of Textbook Data in Syntax:

    Sprouse, Jon and Almeida, Diogo , year = 2012, month = nov, journal =. Assessing the Reliability of Textbook Data in Syntax:. doi:10.1017/S0022226712000011 , urldate =

  202. [210]

    A Comparison of Informal and Formal Acceptability Judgments Using a Random Sample from

    Sprouse, Jon and Sch. A Comparison of Informal and Formal Acceptability Judgments Using a Random Sample from. Lingua , volume =. doi:10.1016/j.lingua.2013.07.002 , urldate =

  203. [211]

    Piantadosi , year = 2024, month = jul, publisher =

    Steven T. Piantadosi , year = 2024, month = jul, publisher =. Modern Language Models Refute. doi:10.5281/ZENODO.12665933 , urldate =

  204. [212]

    Extracting

    Subramani, Nishant and Suresh, Nivedita and Peters, Matthew , editor =. Extracting. Findings of the. doi:10.18653/v1/2022.findings-acl.48 , urldate =

  205. [213]

    Sun, Zhouyi and Rawski, Jonathan , editor =. Tensor. Proceedings of the

  206. [214]

    Proceedings of the 2024

    Taktasheva, Ekaterina and Bazhukov, Maxim and Koncha, Kirill and Fenogenova, Alena and Artemova, Ekaterina and Mikhailov, Vladislav , editor =. Proceedings of the 2024. doi:10.18653/v1/2024.emnlp-main.522 , urldate =

  207. [215]

    Proceedings of the 57th

    Tenney, Ian and Das, Dipanjan and Pavlick, Ellie , editor =. Proceedings of the 57th. doi:10.18653/v1/P19-1452 , urldate =

  208. [216]

    Tjuatja, Lindia and Neubig, Graham and Linzen, Tal and Hao, Sophie , editor =. What. Proceedings of the 2025. doi:10.18653/v1/2025.naacl-long.109 , urldate =

  209. [217]

    Nature Human Behaviour , volume =

    Driving and Suppressing the Human Language Network Using Large Language Models , author =. Nature Human Behaviour , volume =. doi:10.1038/s41562-023-01783-7 , urldate =

  210. [218]

    and Mini, Ulisse and MacDiarmid, Monte , year = 2024, month = oct, number =

    Turner, Alexander Matt and Thiergart, Lisa and Leech, Gavin and Udell, David and Vazquez, Juan J. and Mini, Ulisse and MacDiarmid, Monte , year = 2024, month = oct, number =. Steering. doi:10.48550/arXiv.2308.10248 , urldate =. arXiv , keywords =:2308.10248 , primaryclass =

  211. [219]

    Attention Is

    Vaswani, Ashish and Shazeer, Noam and Parmar, Niki and Uszkoreit, Jakob and Jones, Llion and Gomez, Aidan N and ukasz Kaiser,. Attention Is. Advances in

  212. [220]

    Evaluating

    V. Evaluating. Proceedings of the 1st. doi:10.18653/v1/2023.genbench-1.4 , urldate =

  213. [221]

    and Kim, Yoon , year = 2026, month = may, number =

    Wang, Yingshan Susan and Qiu, Linlu and Wu, Zhaofeng and Levy, Roger P. and Kim, Yoon , year = 2026, month = may, number =. Implicit. doi:10.48550/arXiv.2605.05197 , urldate =. arXiv , keywords =:2605.05197 , primaryclass =

  214. [222]

    , editor =

    Warstadt, Alex and Cao, Yu and Grosu, Ioana and Peng, Wei and Blix, Hagen and Nie, Yining and Alsop, Anna and Bordia, Shikha and Liu, Haokun and Parrish, Alicia and Wang, Sheng-Fu and Phang, Jason and Mohananey, Anhad and Htut, Phu Mon and Jeretic, Paloma and Bowman, Samuel R....

  215. [223]

    , year = 2019, month = sep, journal =

    Warstadt, Alex and Singh, Amanpreet and Bowman, Samuel R. , year = 2019, month = sep, journal =. Neural. doi:10.1162/tacl_a_00290 , urldate =

  216. [224]

    , editor =

    Warstadt, Alex and Parrish, Alicia and Liu, Haokun and Mohananey, Anhad and Peng, Wei and Wang, Sheng-Fu and Bowman, Samuel R. , editor =. Transactions of the Association for Computational Linguistics , volume =. doi:10.1162/tacl_a_00321 , urldate =

  217. [225]

    , year = 2022, publisher =

    Warstadt, Alex and Bowman, Samuel R. , year = 2022, publisher =. What. Algebraic

  218. [226]

    , year = 1980, month = may, publisher =

    Wexler, Kenneth and Culicover, Peter W. , year = 1980, month = may, publisher =. Formal

  219. [227]

    Wilcox, Ethan Gotlieb and Futrell, Richard and Levy, Roger , year = 2024, month = oct, journal =. Using. doi:10.1162/ling_a_00491 , urldate =

  220. [228]

    , year = 2002, publisher =

    Yang, Charles D. , year = 2002, publisher =. Knowledge and

  221. [229]

    Yang, Xiulin and Bisazza, Arianna and Schneider, Nathan and Wilcox, Ethan Gotlieb , year = 2026, month = feb, number =. A. doi:10.48550/arXiv.2602.09992 , urldate =. arXiv , keywords =:2602.09992 , primaryclass =

  222. [230]

    Understanding Deep Learning Requires Rethinking Generalization , booktitle =

    Zhang, Chiyuan and Bengio, Samy and Hardt, Moritz and Recht, Benjamin and Vinyals, Oriol , year = 2017, month = feb, urldate =. Understanding Deep Learning Requires Rethinking Generalization , booktitle =

  223. [231]

    , year = 2024, month = jul, series =

    Zhang, Muru and Press, Ofir and Merrill, William and Liu, Alisa and Smith, Noah A. , year = 2024, month = jul, series =. How Language Model Hallucinations Can Snowball , booktitle =

  224. [232]

    Zhang, Ruochen and Yu, Qinan and Zang, Matianyu and Eickhoff, Carsten and Pavlick, Ellie , year = 2024, month = oct, urldate =. The. The

  225. [233]

    Zimmermann, Thomas Ede , year = 2000, month = dec, journal =. Free. doi:10.1023/A:1011255819284 , abstract =

  226. [234]

    International Conference on Learning Representations , year=

    What do you learn from context? Probing for sentence structure in contextualized word representations , author=. International Conference on Learning Representations , year=

Pith tools

Reviewed August 1, 2026 · model on record in the stance chip above.