The reviewed record of science sign in
Pith

arxiv: 2502.16238 · v1 · pith:6LJLEDHP · submitted 2025-02-22 · q-bio.NC · cs.AI· cs.LG· cs.NE

Brain-Model Evaluations Need the NeuroAI Turing Test

Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:6LJLEDHPrecord.jsonopen to challenge →

classification q-bio.NC cs.AIcs.LGcs.NE
keywords brainbehaviorneuroaitestturingintelligenceinternalmodel
0
0 comments X
read the original abstract

What makes an artificial system a good model of intelligence? The classical test proposed by Alan Turing focuses on behavior, requiring that an artificial agent's behavior be indistinguishable from that of a human. While behavioral similarity provides a strong starting point, two systems with very different internal representations can produce the same outputs. Thus, in modeling biological intelligence, the field of NeuroAI often aims to go beyond behavioral similarity and achieve representational convergence between a model's activations and the measured activity of a biological system. This position paper argues that the standard definition of the Turing Test is incomplete for NeuroAI, and proposes a stronger framework called the ``NeuroAI Turing Test'', a benchmark that extends beyond behavior alone and \emph{additionally} requires models to produce internal neural representations that are empirically indistinguishable from those of a brain up to measured individual variability, i.e. the differences between a computational model and the brain is no more than the difference between one brain and another brain. While the brain is not necessarily the ceiling of intelligence, it remains the only universally agreed-upon example, making it a natural reference point for evaluating computational models. By proposing this framework, we aim to shift the discourse from loosely defined notions of brain inspiration to a systematic and testable standard centered on both behavior and internal representations, providing a clear benchmark for neuroscientific modeling and AI development.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 5 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Do Language Models Align with Brains? Prediction Scores Are Not Enough

    q-bio.NC 2026-05 unverdicted novelty 7.0

    Language model representations fail all L-PACT alignment gates once controls explain the apparent predictive and relational effects.

  2. Beyond Prediction Accuracy: Target-Space Recovery Profiles for Evaluating Model-Brain Alignment

    q-bio.NC 2026-05 unverdicted novelty 6.0

    The authors propose target-space recovery profiles to diagnose which reproducible dimensions of fMRI brain responses are captured by model predictions, showing that accuracy alone can mask alignment mismatches in visu...

  3. Decoding Alignment without Encoding Alignment: A critique of similarity analysis in neuroscience

    q-bio.NC 2026-05 unverdicted novelty 6.0

    Decoding alignment metrics can remain high and unchanged even when encoding manifold topology is causally altered, so they do not imply similar function or computation across neural populations.

  4. Only Brains Align with Brains: Cross-Region Alignment Patterns Expose Limits of Normative Models

    q-bio.NC 2026-04 unverdicted novelty 6.0

    Alignment pattern analysis reveals that models aligned to individual brain ROIs do not reproduce the stable cross-region alignment profiles observed across human subjects.

  5. Heterogeneous Neural Predictivity from Language Models During Naturalistic Comprehension

    cs.CL 2026-06 unverdicted novelty 3.0

    Frozen language model features predict held-out neural activity in naturalistic comprehension across multiple brain recording modalities with gains over low-level baselines in many but not all sources, after extensive...