Pith. sign in

REVIEW 3 major objections 5 minor 59 references

Learning to cluster neuronal function

T0 review · 3 major / 5 minor · reviewed 2026-08-07 · deepseek-v4-flash

Pith's one-line read By adding an explicit clustering bias to neural-response models, the paper argues that excitatory neurons in mouse V1 form a functional continuum rather than discrete cell types.

desk verdict A genuinely useful clustering method with solid retina validation, but the mouse V1 continuum conclusion rests on an unvalidated ARI-peak assumption. read the letter →

arxiv 2506.03293 v1 pith:6HHFABMB submitted 2025-06-03 q-bio.NC

classification q-bio.NC
keywords functionalcelltypesneuronalembeddingsdeepembeddingclusteringexpectationmaximizationStudent'st-mixturemodelclusterconsistencyAdjustedRandIndexmousevisualcortex
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

Predictive deep networks learn one embedding per neuron, and those embeddings have not shown clear clusters in mouse V1. This paper asks whether the missing clusters are a true property of the cortex or a limitation of the models. It introduces DECEMber, a clustering loss that trains the embeddings together with cluster centers and per-cluster scale matrices, and shows that the loss improves cluster consistency while preserving predictive accuracy. Applied to mouse V1, consistency improves but never peaks at any cluster count, which the authors read as evidence that excitatory neurons there form a functional continuum. On marmoset retina, where discrete cell types are known, the same method separates the types almost perfectly, supporting the method's sensitivity.

What carries the argument

The load-bearing object is the DECEMber loss, $L_{\mathrm{cluster}}=\mathrm{KL}(Q\|P)$, where $q_{ij}$ is the soft assignment of neuron $i$ to cluster $j$ under a multivariate Student's $t$-mixture with center $\mu_j$ and diagonal scale matrix $\Sigma_j$, and $p_{ij}\propto q_{ij}^2/f_j$ sharpens confident assignments. Cluster centers and scales are updated by expectation-maximization after each batch, while the core and readout weights are updated by gradient descent on the full loss. The learned per-cluster scale matrices are what prevent the degenerate fixed-scale solution in which every center collapses to the same point; this mechanism is what allows cluster consistency to improve without sacrificing prediction quality.

What would settle it

Train DECEMber on synthetic populations with known discrete cluster structure, including unbalanced and overlapping clusters whose embeddings have the same dimensionality and scale as mouse V1 readouts, and measure the Adjusted Rand Index across cluster counts; if ARI does not peak at the true number, the absence of a peak in mouse V1 cannot be taken as evidence of a continuum.

Watch

Extended reading notes

Core claim

The central claim is that the lack of clustered structure in state-of-the-art mouse V1 embeddings is not a modeling artifact: when an explicit clustering bias is added, the model can be made to produce more consistent clusters, yet no particular number of clusters is singled out. This is the pattern the authors expect if the neurons form a continuum rather than discrete types. The supporting evidence is that on marmoset retinal ganglion cells DECEMber recovers known discrete types with an Adjusted Rand Index of 0.96 and a near-perfect confusion matrix, whereas on mouse V1 ARI roughly doubles but stays flat over 5 to 60 clusters, and on mouse retina and macaque V4 it also improves consistency. The paper therefore concludes that functional cell types in mouse V1 are better described as a continuum, and that asking for discrete types may be the wrong question.

Load-bearing premise

The load-bearing premise is that the Adjusted Rand Index (ARI), a score for how consistently neuron pairs land in the same cluster across runs, would peak noticeably at the true number of clusters if discrete functional types existed in mouse V1.

Editorial extensions

If this is right

  • Known cell types become recoverable: on marmoset retinal ganglion cells, DECEMber reaches an Adjusted Rand Index of $0.96\pm0.01$ with a nearly perfect confusion matrix, so the method exposes discrete structure when it exists.
  • The flat ARI profile across 5 to 60 clusters for mouse V1, together with higher consistency than baseline, is evidence for a functional continuum and against a preferred discrete number of excitatory types.
  • The method also improves cluster consistency on mouse retina and macaque V4, so the benefit is not tied to one species, stimulus type, or readout architecture.
  • When the clustering loss dominates, predictive performance drops and consistency stops improving, so the useful operating regime is where consistency rises while performance stays at baseline.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The paper's interpretive step, that ARI would peak noticeably at the true cluster count if discrete types existed, could be checked directly on synthetic data with known discrete and unbalanced types; if that peak does not appear there, the mouse V1 continuum conclusion loses support.
  • A flat ARI profile is consistent with a continuum, but also with hierarchical or heavily overlapping discrete types, and the reported experiments do not distinguish those alternatives.
  • The same loss could serve as a general diagnostic in other brain areas: a sharp ARI peak would argue for discrete functional types, while a flat profile would argue for a gradient.
  • Because DECEMber learns per-cluster scale matrices, the fitted scales could be interpreted as within-type functional variability, potentially connecting model clusters to morphological or transcriptomic continua.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. The paper introduces DECEMber, an auxiliary clustering loss for predictive models of neural activity. The loss extends the deep embedding clustering (DEC) objective by modeling each cluster with a multivariate Student-t distribution and updating cluster centers and diagonal scale matrices via EM steps during training. The authors evaluate cluster consistency using the Adjusted Rand Index across different random seeds and report improved consistency with preserved predictive performance on marmoset retina (where discrete cell types are known), mouse V1, mouse retina, and macaque V4. From the absence of a clear peak in ARI as a function of the number of clusters in mouse V1, the paper concludes that excitatory neurons in mouse V1 form a functional continuum rather than discrete clusters.

Significance. If the conclusions hold, DECEMber would be a useful methodological contribution to a debated question in neuroscience, and the result on mouse V1 would be an important data point. The paper's strengths include making the code available, validating the method on marmoset retina with known cell types, and benchmarking against post-hoc GMM and k-means baselines. The main weakness is that the central biological conclusion depends on an unvalidated diagnostic: the claim that a true discrete cluster structure would produce a sharp ARI peak at the correct cluster count. Since the retina validation fixes the number of clusters to the known number of types, it does not calibrate this diagnostic, and the toy example is not an ARI-vs-K sweep with known ground truth. The manuscript is therefore best viewed as a solid methods paper whose strongest interpretive claim requires additional control experiments.

major comments (3)
  1. [Section 5, Fig. 4H (mouse V1 results)] The central conclusion that mouse V1 excitatory neurons form a functional continuum rests on the statement 'We would expect ARI to peak noticeably at the true number of clusters if such a structure existed' (Sec. 5, mouse V1 results). This expectation is not validated anywhere in the paper. ARI measures agreement between two partitions, not the match to a latent ground truth; for unbalanced or hierarchical clusterings the ARI-vs-K curve need not peak at the true K, and with finite noisy samples it can be flat or increasing. The marmoset retina validation (Fig. 3A) fixes J=4 to the known number of types and therefore does not calibrate the diagnostic, and the toy example (Fig. 2) is a two-cluster demonstration of the collapse failure, not an ARI-vs-J sweep under known ground truth. I request a synthetic calibration experiment: generate embeddings with known discrete structure (e.g., balanced and unbalanced clusters, several true K, overlapping or hierarchical geometry), apply DECEMber across the same J range used for mouse V1, and show that the ARI curve indeed peaks at the true K under the same embedding/model settings. Without such a control, the absence of a peak in Fig. 4H supports the continuum claim only under an untested assumption.
  2. [Algorithm 1, step (3); Eq. (2.2)] The definition of the target distribution P in Algorithm 1 is inconsistent with Eq. (2.2). Eq. (2.2) defines p_ij = (q_ij^2 / f_j) / sum_j' (q_ij'^2 / f_j'), whereas Algorithm 1 writes p_ij = (q_ij^2 / f_j) / sum_k (q_ik / f_k), with the denominator lacking the square on q_ik. Since the clustering loss depends directly on P, this discrepancy changes the objective and affects reproducibility. Please correct the algorithm box to match Eq. (2.2) or state explicitly if the unsquared version is intended and why.
  3. [Section 5, Figs. 4H and 5C] The absence of a sharp peak in ARI is assessed visually from curves that appear to be means over three seeds, with no error bars or statistical comparison. Given that ARI is computed from only three model fits per condition, the difference between a flat curve and a weak peak cannot be judged without variance estimates or a permutation-based test. Please report mean plus/minus standard deviation or confidence intervals across seeds for the key ARI curves, and if possible include per-seed curves for the mouse V1 analysis.
minor comments (5)
  1. [Algorithm 1] The label 'Gradiet step' should read 'Gradient step'.
  2. [Section 4] 'which alloed for different variances' should be 'which allowed for different variances'.
  3. [Figure 2] The caption lists panels A-D only, but the text refers to 'Fig. 2E'; either add panel E or correct the reference.
  4. [Appendix B.1] The section title 'Retina gagnlion cells' should be 'Retinal ganglion cells'.
  5. [Introduction] 'One could view it as model-driven hypothesis testing' is a fragment; consider integrating it into a complete sentence.

Circularity Check

0 steps flagged · score 2.0 of 10

No load-bearing circularity: the continuum conclusion rests on an unvalidated ARI-peak diagnostic, not on a reduction of the output to the clustering loss.

full rationale

DECEMber's clustering loss (Eq. 3.2) is an explicit inductive bias, so the observation that it raises ARI relative to a post-hoc GMM baseline is a verification that the bias does what it is designed to do, not an independent biological prediction; this is not a circular reduction because cross-seed ARI is not the optimized objective and no fitted quantity is later renamed as a result. The central continuum conclusion is drawn from the absence of an ARI peak across J=5..60 (Fig. 4H), under the stated expectation that ARI 'would peak noticeably at the true number of clusters if such a structure existed.' That expectation is not validated on synthetic data with known discrete, unbalanced, or hierarchical clusters, so the inference is risky; but the risk is an unvalidated diagnostic assumption about ARI behavior, not a definitional equivalence or a fitted-parameter-as-prediction. Independent checks exist: marmoset RGCs with ground-truth types (Fig. 3), mouse retina and macaque V4 generalization, and preservation of predictive performance. Self-citations to Turishcheva et al. [13] (baseline and pretraining) and Weis et al. [6] (corroborating continuum work) are methodological or corroborative, not uniqueness theorems, and do not carry the argument. Score 2 only for the mild self-referential flavor of evaluating a clustering loss by cluster consistency and same-group citations; no load-bearing circular step was identified.

Assumptions & free parameters 5 free parameters · 3 assumptions · 0 invented entities

The paper's central claims depend on several fitted hyperparameters (beta, J, learning rate, pretraining length) and on two assumptions that are not independently validated: the faithfulness of readout embeddings as functional descriptors, and the diagnostic power of an ARI peak. The cluster scale matrices are learned via EM but are not free parameters in the conventional sense; they are part of the model.

free parameters (5)
  • clustering strength beta = 1e1 to 1e7 (mouse V1); 0.001 (retina, V4)
    Controls the weight of the clustering loss relative to the predictive loss; tuned per dataset to balance ARI and predictive performance (Sec. 4, Fig. 4F-H).
  • number of clusters J = 5 to 60 (mouse V1); 4 (marmoset RGC); varied for retina/V4
    Must be specified; paper searches a range and finds no peak, which is central to the continuum claim.
  • degrees of freedom nu = 2.1
    Fixed by hand, just above the threshold where variance is defined; not tuned.
  • pretraining length m = 5, 9, 10, 11, 20, 30, 40 epochs
    Explored; 10 epochs gives best ARI for mouse V1 (Fig. 5C).
  • learning rate = tuned; examples 0.003-0.008 with beta=1e4-1e7
    Learning rate is tuned on validation set for each combination of beta and pretraining length (Fig. 5A-B).
assumptions (3)
  • domain assumption The readout weights z_i in the trained predictive model constitute a faithful functional embedding of each neuron.
    Invoked throughout; the entire clustering analysis is performed on these weights (Sec. 3.1). If the embeddings miss functionally relevant dimensions, cluster structure would be invisible.
  • ad hoc to paper The expectation that a true discrete cluster structure would produce a sharp peak in ARI as a function of the number of clusters.
    Used to interpret the mouse V1 results (Sec. 5, Fig. 4H). Not derived and not validated on synthetic data.
  • ad hoc to paper The Student-t mixture model with EM updates for cluster parameters, combined with the KL clustering loss, avoids degenerate solutions and recovers true clusters.
    Shown on a toy example (Sec. 5, Fig. 2) but no general proof; the composite objective is not a single well-defined optimization problem.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Learning to cluster neuronal function." pith.science (2026). https://pith.science/paper/6HHFABMB

@misc{pith2026250603293,
  author       = {Pith},
  title        = {Pith review of: Learning to cluster neuronal function},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/6HHFABMB}},
  note         = {Machine review of arXiv:2506.03293}
}
abstract

Deep neural networks trained to predict neural activity from visual input and behaviour have shown great potential to serve as digital twins of the visual cortex. Per-neuron embeddings derived from these models could potentially be used to map the functional landscape or identify cell types. However, state-of-the-art predictive models of mouse V1 do not generate functional embeddings that exhibit clear clustering patterns which would correspond to cell types. This raises the question whether the lack of clustered structure is due to limitations of current models or a true feature of the functional organization of mouse V1. In this work, we introduce DECEMber -- Deep Embedding Clustering via Expectation Maximization-based refinement -- an explicit inductive bias into predictive models that enhances clustering by adding an auxiliary $t$-distribution-inspired loss function that enforces structured organization among per-neuron embeddings. We jointly optimize both neuronal feature embeddings and clustering parameters, updating cluster centers and scale matrices using the EM-algorithm. We demonstrate that these modifications improve cluster consistency while preserving high predictive performance and surpassing standard clustering methods in terms of stability. Moreover, DECEMber generalizes well across species (mice, primates) and visual areas (retina, V1, V4). The code is available at https://github.com/Nisone2000/sensorium/tree/neuroips_version.

Figures

Figures reproduced from arXiv: 2506.03293 by the authors.

Figure 1
Figure 1. A: Model architecture: The model consists of a neuronwise shared core outputting a feature map of size (height × width × feature channels) and neuron specific Gaussian readouts. They consist of a receptive field position and a weight vector. The RF position chooses the vector in the feature map which is then combined with the neuron’s weight vector by a dot product to get the neuron’s response. B: Clustering procedu… view at source ↗
Figure 2
Figure 2. A: PDF of z1 (blue) and z2 (orange) of the underlying true uniform distribution and t-distribution with unit scale estimated by DEC-loss. The two t-distributions are highly overlapping whereas there is a clear separation in the uniform distributions. B+C t-SNE projection of toy data after training with DEC loss (B) vs our method (C). We first pretrain a simple linear regression model by minimizing an MSE-loss for 25… view at source ↗
Figure 3
Figure 3. A: ARI across 3 seeds for GMM, k￾means and DECEMber. B: DECEMber predictions. Pretraining length: 25 epochs. Corresponding test correlation: 0.805 ± 0.068 (std). As we observed substantial differences between the two retinas’ temporal response features (po￾tentially due to temperature variation [49]), we followed Vystrcilová et al. [ ˇ 16] and trained a separate model for each retina to avoid clus￾tering by retina. … view at source ↗
Figures from the paper (12 more)
Figure 4
Figure 4. Figure 4: A: t-SNE of baseline model without clustering loss. B-E: t-SNE projections of our model with clustering bias for different multipliers β and tuned learning rates (lr). All models use 15 clusters, PE = 10 and seed 100. B: β = 104 and lr = 0.008. C: β = 105 and lr = 0.00…
Figure 5
Figure 5. Figure 5: A–B: Learning rate tuning for β (A) and length of pretraining (B). We fixed amount of clusters to 15. If the learning rate is too high the clustering loss starts oscillating due to learning rate scheduling leading to a massive drop in performance. C ARI for different n…
Figure 6
Figure 6. Figure 6: The choice of pretrain epoch doesn’t influence perfor￾mance when we’re using an op￾timal learning rate. Consistency of embeddings depends on length of pretraining. To validate our conclusions that mouse V1 lacks discrete func￾tional cell types, we performed extensive t…
Figure 7
Figure 7. Figure 7: ARI on A mouse retina [19], weighted across six models. B monkeys V4 [51]. For macaque V4 data we used spiking extracellular multi￾electrode recorded responses of neurons to gray-scale nat￾ural images shown to awake macaque monkeys [51] and the model from Pierzchlewicz…
Figure 8
Figure 8. Figure 8: A: DECEMber predictions. Pretraining length: 20 epochs. Same predictions for GMM and k-means. All methods have ARI 1. B: t-SNE projections of the corresponding cells. To select reliable cells from the marmoset RGCs dataset [48], we used the same reliability assess￾ment…
Figure 9
Figure 9. Figure 9: All plots show evaluations of seed 4 of the trained marmoset RGC model [ [PITH_FULL_IMAGE:figures/full_fig_p017_9.png]
Figure 10
Figure 10. Figure 10: Clustering stability of k-means and GMM on retina 1 for marmoset RGC. We started with a single baseline RGC model of retina 1 (seed 2) and performed k-means and GMM clustering (4 clusters each), varying the random seed (42, 10, 100) for both algorithms. Clustering was…
Figure 11
Figure 11. Figure 11: Clustering stability of GMM on mouse V1. We trained a baseline model of mouse V1 for one seed (seed=42). We then did GMM for clusters ranging from 5 to 60 with a step size of 5 as the ground truth is not known varying just the seed for the initialization of the GMM bu…
Figure 12
Figure 12. Figure 12: Different clustering consistency metrics for monkey V4 and mouse retina datasets. Same [PITH_FULL_IMAGE:figures/full_fig_p018_12.png]
Figure 13
Figure 13. Figure 13: V-measure and Fowlkes-Mallows-score for PE 10, 15 clusters. [PITH_FULL_IMAGE:figures/full_fig_p019_13.png]
Figure 14
Figure 14. Figure 14: DECEMber, with PE = 10; DECEMber cluster consitency matches the rotation-equivariant [PITH_FULL_IMAGE:figures/full_fig_p019_14.png]
Figure 15
Figure 15. Figure 15: ARI per retina. n is the number of neurons in the model B.9 Further analysis of monkeys data 10 20 Number of clusters 0.2 0.3 0.4 0.5 0.6 ARI A baseline PE:5 PE:10 PE:20 0 1 2 3 4 5 6 7 8 9 10 11 Predicted Labels 0 1 2 3 4 5 6 7 8 9 10 11 True Labels 0 0 2 0 2 3 1 0 1…

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

59 extracted references · 48 canonical work pages

  1. [1]

    What is a cell type and how to define it?Cell, 185(15):2739–2755, 2022

    Hongkui Zeng. What is a cell type and how to define it?Cell, 185(15):2739–2755, 2022

  2. [2]

    New insights into the classification and nomenclature of cortical gabaergic interneurons

    Javier DeFelipe, Pedro L López-Cruz, Ruth Benavides-Piccione, Concha Bielza, Pedro Lar- rañaga, Stewart Anderson, Andreas Burkhalter, Bruno Cauli, Alfonso Fairén, Dirk Feldmeyer, et al. New insights into the classification and nomenclature of cortical gabaergic interneurons. Nature Reviews Neuroscience, 14(3):202–216, 2013

  3. [3]

    Cell type–specific three- dimensional structure of thalamocortical circuits in a column of rat vibrissal cortex.Cerebral cortex, 22(10):2375–2391, 2012

    Marcel Oberlaender, Christiaan PJ De Kock, Randy M Bruno, Alejandro Ramirez, Hanno S Meyer, Vincent J Dercksen, Moritz Helmstaedter, and Bert Sakmann. Cell type–specific three- dimensional structure of thalamocortical circuits in a column of rat vibrissal cortex.Cerebral cortex, 22(10):2375–2391, 2012

  4. [4]

    Reconstruction and simulation of neocortical microcircuitry.Cell, 163(2): 456–492, 2015

    Henry Markram, Eilif Muller, Srikanth Ramaswamy, Michael W Reimann, Marwan Abdellah, Carlos Aguado Sanchez, Anastasia Ailamaki, Lidia Alonso-Nanclares, Nicolas Antille, Selim Arsever, et al. Reconstruction and simulation of neocortical microcircuitry.Cell, 163(2): 456–492, 2015

  5. [5]

    Layer 4 of mouse neocortex differs in cell types and circuit organization between sensory areas.Nature communications, 10(1):4174, 2019

    Federico Scala, Dmitry Kobak, Shen Shan, Yves Bernaerts, Sophie Laturnus, Cathryn Rene Cadwell, Leonard Hartmanis, Emmanouil Froudarakis, Jesus Ramon Castro, Zheng Huan Tan, et al. Layer 4 of mouse neocortex differs in cell types and circuit organization between sensory areas.Nature communications, 10(1):4174, 2019

  6. [6]

    Weis, Stelios Papadopoulos, Laura Hansel, Timo Lüddecke, Brendan Celii, Paul G

    Marissa A. Weis, Stelios Papadopoulos, Laura Hansel, Timo Lüddecke, Brendan Celii, Paul G. Fahey, Eric Y . Wang, J. Alexander Bae, Agnes L. Bodor, Derrick Brittain, JoAnn Buchanan, Daniel J. Bumbarger, Manuel A. Castro, Forrest Collman, Nuno Maçarico da Costa, Sven Dorkenwald, Leila Elabbady, Akhilesh Halageri, Zhen Jia, Chris Jordan, Dan Kapner, Nico Kem...

  7. [7]

    The functional diversity of retinal ganglion cells in the mouse.Nature, 529 (7586):345–350, 2016

    Tom Baden, Philipp Berens, Katrin Franke, Miroslav Román Rosón, Matthias Bethge, and Thomas Euler. The functional diversity of retinal ganglion cells in the mouse.Nature, 529 (7586):345–350, 2016

  8. [8]

    Willeke, Paul G

    Konstantin F. Willeke, Paul G. Fahey, Mohammad Bashiri, Laura Pede, Max F. Burg, Christoph Blessing, Santiago A. Cadena, Zhiwei Ding, Konstantin-Klemens Lurz, Kayla Ponder, Taliah Muhammad, Saumil S. Patel, Alexander S. Ecker, Andreas S. Tolias, and Fabian H. Sinz. The sensorium competition on predicting large-scale mouse primary visual cortex activity, 2...

Show all 59 references
  1. [9]

    The dynamic sensorium competition for predicting large-scale mouse visual cortex activity from videos.ArXiv, pages arXiv–2305, 2024

    Polina Turishcheva, Paul G Fahey, Michaela Vystrˇcilová, Laura Hansel, Rachel Froebe, Kayla Ponder, Yongrong Qiu, Konstantin F Willeke, Mohammad Bashiri, Eric Wang, et al. The dynamic sensorium competition for predicting large-scale mouse visual cortex activity from videos.ArX...

  2. [10]

    Hofer, James A

    Ján Antolík, Sonja B. Hofer, James A. Bednar, and Thomas D. Mrsic-Flogel. Model con- strained by visual hierarchy improves prediction of neural responses to natural scenes.PLOS Computational Biology, 12(6):1–22, 06 2016. doi: 10.1371/journal.pcbi.1004927. URL https://doi.org/1...

  3. [11]

    Finn Schmidt, Polina Turishcheva, Suhas Shrinivasan, and Fabian H. Sinz. Modeling dynamic neural activity by combining naturalistic video stimuli and stimulus-independent latent factors,

  4. [12]

    Wang, Paul G

    Eric Y . Wang, Paul G. Fahey, Kayla Ponder, Zhuokun Ding, Andersen Chang, Taliah Muham- mad, Saumil Patel, Zhiwei Ding, Dat Tran, Jiakun Fu, Stelios Papadopoulos, Katrin Franke, Alexander S. Ecker, Jacob Reimer, Xaq Pitkow, Fabian H. Sinz, and Andreas S. Tolias. Towards 11 a f...

  5. [13]

    Sinz, and Alexander Ecker

    Polina Turishcheva, Max Burg, Fabian H. Sinz, and Alexander Ecker. Reproducibility of predictive networks for mouse visual cortex, 2024. URL https://arxiv.org/abs/2406. 12625

  6. [14]

    Behavioral state tunes mouse vision to ethological features through pupil dilation.bioRxiv, pages 2021–09, 2021

    Katrin Franke, Konstantin F Willeke, Kayla Ponder, Mario Galdamez, Taliah Muhammad, Saumil Patel, Emmanouil Froudarakis, Jacob Reimer, Fabian Sinz, and Andreas S Tolias. Behavioral state tunes mouse vision to ethological features through pupil dilation.bioRxiv, pages 2021–09, 2021

  7. [15]

    A rotation-equivariant convolutional neural network model of primary visual cortex.arXiv preprint arXiv:1809.10504, 2018

    Alexander S Ecker, Fabian H Sinz, Emmanouil Froudarakis, Paul G Fahey, Santiago A Cadena, Edgar Y Walker, Erick Cobos, Jacob Reimer, Andreas S Tolias, and Matthias Bethge. A rotation-equivariant convolutional neural network model of primary visual cortex.arXiv preprint arXiv:1...

  8. [16]

    Burg, Tim Gollisch, and Alexander S

    Michaela Vystrˇcilová, Shashwat Sridhar, Max F. Burg, Tim Gollisch, and Alexander S. Ecker. Convolutional neural network models of the primate retina reveal adaptation to natural stimulus statistics.bioRxiv, 2024. doi: 10.1101/2024.03.06.583740. URL https://www.biorxiv. org/co...

  9. [17]

    Inception loops discover what excites neurons most using deep predictive models.Nature neuroscience, 22(12):2060–2065, 2019

    Edgar Y Walker, Fabian H Sinz, Erick Cobos, Taliah Muhammad, Emmanouil Froudarakis, Paul G Fahey, Alexander S Ecker, Jacob Reimer, Xaq Pitkow, and Andreas S Tolias. Inception loops discover what excites neurons most using deep predictive models.Nature neuroscience, 22(12):2060...

  10. [18]

    State-dependent pupil dilation rapidly shifts visual feature selectivity.Nature, 610(7930):128–134, 2022

    Katrin Franke, Konstantin F Willeke, Kayla Ponder, Mario Galdamez, Na Zhou, Taliah Muham- mad, Saumil Patel, Emmanouil Froudarakis, Jacob Reimer, Fabian H Sinz, et al. State-dependent pupil dilation rapidly shifts visual feature selectivity.Nature, 610(7930):128–134, 2022

  11. [19]

    A chromatic feature detector in the retina signals visual context changes.Elife, 13:e86860, 2024

    Larissa Höfling, Klaudia P Szatko, Christian Behrens, Yuyao Deng, Yongrong Qiu, David Alexander Klindt, Zachary Jessen, Gregory W Schwartz, Matthias Bethge, Philipp Berens, et al. A chromatic feature detector in the retina signals visual context changes.Elife, 13:e86860, 2024

  12. [20]

    The feature landscape of visual cortex.bioRxiv, 2023

    Rudi Tong, Ronan da Silva, Dongyan Lin, Arna Ghosh, James Wilsenach, Erica Cianfarano, Pouya Bashivan, Blake Richards, and Stuart Trenholm. The feature landscape of visual cortex.bioRxiv, 2023. doi: 10.1101/2023.11.03.565500. URL https://www.biorxiv.org/ content/early/2023/11/...

  13. [21]

    Digital twin reveals combinatorial code of non-linear computations in the mouse primary visual cortex

    Ivan Ustyuzhaninov, Max F Burg, Santiago A Cadena, Jiakun Fu, Taliah Muhammad, Kayla Ponder, Emmanouil Froudarakis, Zhiwei Ding, Matthias Bethge, Andreas S Tolias, et al. Digital twin reveals combinatorial code of non-linear computations in the mouse primary visual cortex. bio...

  14. [22]

    Burg, Thomas Zenkel, Michaela Vystr ˇcilová, Jonathan Oesterle, Larissa Höfling, Konstantin F

    Max F. Burg, Thomas Zenkel, Michaela Vystr ˇcilová, Jonathan Oesterle, Larissa Höfling, Konstantin F. Willeke, Jan Lause, Sarah Müller, Paul G. Fahey, Zhiwei Ding, Kelli Restivo, Shashwat Sridhar, Tim Gollisch, Philipp Berens, Andreas S. Tolias, Thomas Euler, Matthias Bethge, ...

  15. [23]

    Comparing partitions.Journal of classification, 2:193–218, 1985

    Lawrence Hubert and Phipps Arabie. Comparing partitions.Journal of classification, 2:193–218, 1985

  16. [24]

    Unsupervised deep embedding for clustering analysis, 2016

    Junyuan Xie, Ross Girshick, and Ali Farhadi. Unsupervised deep embedding for clustering analysis, 2016. URLhttps://arxiv.org/abs/1511.06335

  17. [25]

    McLachlan and David Peel

    Geoffrey J. McLachlan and David Peel. Robust mixture modelling using the t distribu- tion.Statistical Science, 15(1):1–19, 2000. URL https://people.smp.uq.edu.au/ GeoffMcLachlan/pm_sc00.pdf. 12

  18. [26]

    Performance-optimized hierarchical models predict neural responses in higher visual cortex.Proceedings of the national academy of sciences, 111(23):8619–8624, 2014

    Daniel LK Yamins, Ha Hong, Charles F Cadieu, Ethan A Solomon, Darren Seibert, and James J DiCarlo. Performance-optimized hierarchical models predict neural responses in higher visual cortex.Proceedings of the national academy of sciences, 111(23):8619–8624, 2014

  19. [27]

    Deep neural networks rival the representation of primate it cortex for core visual object recognition.PLoS computational biology, 10(12):e1003963, 2014

    Charles F Cadieu, Ha Hong, Daniel LK Yamins, Nicolas Pinto, Diego Ardila, Ethan A Solomon, Najib J Majaj, and James J DiCarlo. Deep neural networks rival the representation of primate it cortex for core visual object recognition.PLoS computational biology, 10(12):e1003963, 2014

  20. [28]

    Deep convolutional models improve predictions of macaque v1 responses to natural images.PLoS computational biology, 15(4):e1006897, 2019

    Santiago A Cadena, George H Denfield, Edgar Y Walker, Leon A Gatys, Andreas S Tolias, Matthias Bethge, and Alexander S Ecker. Deep convolutional models improve predictions of macaque v1 responses to natural images.PLoS computational biology, 15(4):e1006897, 2019

  21. [29]

    Explaining v1 properties with a biologically constrained deep learning architecture.Advances in Neural Information Processing Systems, 36:13908–13930, 2023

    Galen Pogoncheff, Jacob Granley, and Michael Beyeler. Explaining v1 properties with a biologically constrained deep learning architecture.Advances in Neural Information Processing Systems, 36:13908–13930, 2023

  22. [30]

    Litke, E

    Eleanor Batty, Josh Merel, Nora Brackbill, Alexander Heitman, Alexander Sher, Alan M. Litke, E. J. Chichilnisky, and Liam Paninski. Multilayer recurrent network models of primate retinal ganglion cell responses. InInternational Conference on Learning Representations, 2016. URL...

  23. [31]

    McIntosh, Niru Maheswaranathan, Aran Nayebi, Surya Ganguli, and Stephen A

    Lane T. McIntosh, Niru Maheswaranathan, Aran Nayebi, Surya Ganguli, and Stephen A. Baccus. Deep learning models of the retinal response to natural scenes. InAdvances in Neural Information Processing Systems, volume 29, pages 1369–1377. Curran Associates, Inc., 2016

  24. [32]

    Stim- ulus domain transfer in recurrent models for large scale cortical population prediction on video

    Fabian Sinz, Alexander S Ecker, Paul Fahey, Edgar Walker, Erick Cobos, Emmanouil Froudarakis, Dimitri Yatsenko, Zachary Pitkow, Jacob Reimer, and Andreas Tolias. Stim- ulus domain transfer in recurrent models for large scale cortical population prediction on video. Advances in...

  25. [33]

    A flow-based latent state generative model of neural population responses to natural images

    Mohammad Bashiri, Edgar Walker, Konstantin-Klemens Lurz, Akshay Jagadish, Taliah Muham- mad, Zhiwei Ding, Zhuokun Ding, Andreas Tolias, and Fabian Sinz. A flow-based latent state generative model of neural population responses to natural images. In M. Ranzato, A. Beygelzimer, ...

  26. [34]

    Tan, Brian D

    Andrew Y . Tan, Brian D. Brown, Benjamin Scholl, Debarghya Mohanty, and Nicholas J. Priebe. Orientation selectivity of synaptic input to neurons in mouse and cat primary visual cortex. Journal of Neuroscience, 31(34):12339–12350, 2011. doi: 10.1523/JNEUROSCI.2039-11.2011. Erra...

  27. [35]

    V1t: large-scale mouse v1 response prediction using a vision transformer.arXiv preprint arXiv:2302.03023, 2023

    Bryan M Li, Isabel M Cornacchia, Nathalie L Rochefort, and Arno Onken. V1t: large-scale mouse v1 response prediction using a vision transformer.arXiv preprint arXiv:2302.03023, 2023

  28. [36]

    what” and “where

    David Klindt, Alexander S Ecker, Thomas Euler, and Matthias Bethge. Neural system identifi- cation for large populations separating “what” and “where”.Advances in neural information processing systems, 30, 2017

  29. [37]

    Jagadish, Eric Wang, Edgar Y

    Konstantin-Klemens Lurz, Mohammad Bashiri, Konstantin Willeke, Akshay K. Jagadish, Eric Wang, Edgar Y . Walker, Santiago A. Cadena, Taliah Muhammad, Erick Cobos, Andreas S. Tolias, Alexander S. Ecker, and Fabian H. Sinz. Generalization in data-driven models of primary visual c...

  30. [38]

    Energy guided diffusion for generating neurally exciting images.Advances in Neural Information Processing Systems, 36:32574–32601, 2023

    Pawel Pierzchlewicz, Konstantin Willeke, Arne Nix, Pavithra Elumalai, Kelli Restivo, Tori Shinn, Cate Nealley, Gabrielle Rodriguez, Saumil Patel, Katrin Franke, et al. Energy guided diffusion for generating neurally exciting images.Advances in Neural Information Processing Sys...

  31. [39]

    Rotation-invariant clustering of neuronal responses in primary visual cortex

    Ivan Ustyuzhaninov, Santiago A Cadena, Emmanouil Froudarakis, Paul G Fahey, Edgar Y Walker, Erick Cobos, Jacob Reimer, Fabian H Sinz, Andreas S Tolias, Matthias Bethge, et al. Rotation-invariant clustering of neuronal responses in primary visual cortex. InInternational Confere...

  32. [40]

    Some methods for classification and analysis of multivariate observations

    James MacQueen. Some methods for classification and analysis of multivariate observations. InProceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, pages 281–297, 1967

  33. [41]

    John Wiley & Sons, 2000

    Geoffrey J McLachlan and David Peel.Finite mixture models. John Wiley & Sons, 2000

  34. [42]

    Abbott.Theoretical Neuroscience: Computational and Mathemat- ical Modeling of Neural Systems

    Peter Dayan and Laurence F. Abbott.Theoretical Neuroscience: Computational and Mathemat- ical Modeling of Neural Systems. MIT Press, 2005

  35. [43]

    A convolutional subunit model for neuronal responses in macaque v1.Journal of Neuroscience, 35(44):14829–14841, 2015

    Brett Vintch, J Anthony Movshon, and Eero P Simoncelli. A convolutional subunit model for neuronal responses in macaque v1.Journal of Neuroscience, 35(44):14829–14841, 2015

  36. [44]

    Learning divisive normalization in primary visual cortex.PLoS computational biology, 17(6):e1009028, 2021

    Max F Burg, Santiago A Cadena, George H Denfield, Edgar Y Walker, Andreas S Tolias, Matthias Bethge, and Alexander S Ecker. Learning divisive normalization in primary visual cortex.PLoS computational biology, 17(6):e1009028, 2021

  37. [45]

    Visualizing data using t-sne.Journal of machine learning research, 9(Nov):2579–2605, 2008

    Laurens van der Maaten and Geoffrey Hinton. Visualizing data using t-sne.Journal of machine learning research, 9(Nov):2579–2605, 2008

  38. [46]

    Linderman and Stefan Steinerberger

    George C. Linderman and Stefan Steinerberger. Clustering with t-sne, provably, 2017. URL https://arxiv.org/abs/1706.02582

  39. [47]

    Survey of retinal ganglion cell morphology in marmoset.Journal of Comparative Neurology, 527(1): 236–258, 2019

    Rania A Masri, Kumiko A Percival, Amane Koizumi, Paul R Martin, and Ulrike Grünert. Survey of retinal ganglion cell morphology in marmoset.Journal of Comparative Neurology, 527(1): 236–258, 2019

  40. [48]

    Dataset - Marmoset retinal ganglion cell responses to naturalistic movies and spatiotemporal white noise, April 2025

    Shashwat Sridhar and Tim Gollisch. Dataset - Marmoset retinal ganglion cell responses to naturalistic movies and spatiotemporal white noise, April 2025. URL https://doi.gin. g-node.org/10.12751/g-node.3dfiti

  41. [49]

    The temporal structure of the inner retina at a single glance.Scientific reports, 10(1):4399, 2020

    Zhijian Zhao, David A Klindt, André Maia Chagas, Klaudia P Szatko, Luke Rogerson, Dario A Protti, Christian Behrens, Deniz Dalkara, Timm Schubert, Matthias Bethge, et al. The temporal structure of the inner retina at a single glance.Scientific reports, 10(1):4399, 2020

  42. [50]

    Classification of electrophysiological and morphological neuron types in the mouse visual cortex.Nature neuroscience, 22(7):1182–1195, 2019

    Nathan W Gouwens, Staci A Sorensen, Jim Berg, Changkyu Lee, Tim Jarsky, Jonathan Ting, Susan M Sunkin, David Feng, Costas A Anastassiou, Eliza Barkan, et al. Classification of electrophysiological and morphological neuron types in the mouse visual cortex.Nature neuroscience, 2...

  43. [51]

    Deep learning-driven characterization of single cell tuning in primate visual area v4 unveils topological organization

    KF Willeke, K Restivo, K Franke, AF Nix, SA Cadena, T Shinn, et al. Deep learning-driven characterization of single cell tuning in primate visual area v4 unveils topological organization. biorxiv. 2023.doi. org/10.1101/2023.05, 12, 2023

  44. [52]

    Functional and structural features of l2/3 pyramidal cells continuously covary with pial depth in mouse visual cortex.Cerebral Cortex, 33(7):3715–3733, 2023

    Sebastian Weiler, Daniel Guggiana Nilo, Tobias Bonhoeffer, Mark Hübener, Tobias Rose, and V olker Scheuss. Functional and structural features of l2/3 pyramidal cells continuously covary with pial depth in mouse visual cortex.Cerebral Cortex, 33(7):3715–3733, 2023. doi: 10.1093...

  45. [53]

    Khani, Dimokratis Karamanlis, He- lene M

    Shashwat Sridhar, Michaela Vystrˇcilová, Mohammad H. Khani, Dimokratis Karamanlis, He- lene M. Schreyer, Varsha Ramakrishna, Steffen Krüppel, Sören J. Zapp, Matthias Mietsch, Alexander S. Ecker, and Tim Gollisch. Modeling spatial contrast sensitivity in responses of pri- mate ...

  46. [54]

    A method for comparing two hierarchical clusterings

    Edward B Fowlkes and Colin L Mallows. A method for comparing two hierarchical clusterings. Journal of the American statistical association, 78(383):553–569, 1983. 14

  47. [55]

    V-measure: A conditional entropy-based external cluster evaluation measure

    Andrew Rosenberg and Julia Hirschberg. V-measure: A conditional entropy-based external cluster evaluation measure. InProceedings of the 2007 joint conference on empirical methods in natural language processing and computational natural language learning (EMNLP-CoNLL), pages 41...

  48. [56]

    Cluster ensembles—a knowledge reuse framework for combining multiple partitions.Journal of machine learning research, 3(Dec):583–617, 2002

    Alexander Strehl and Joydeep Ghosh. Cluster ensembles—a knowledge reuse framework for combining multiple partitions.Journal of machine learning research, 3(Dec):583–617, 2002. 15 A Acknowledgments We thank Suhas Shrinivasan, Max F. Burg, Larissa Höfling, Thomas Zenkel, Konstan...

  49. [59]

    not properly clustered

    and performed k-means and GMM clustering (4 clusters each), varying the random seed (42, 10, 100) for both algorithms. Clustering was done on all cells the model was trained on, but ARI was calculated using only labeled cells. 17 B.3 ARI stability for GMM on mouse V1 10 20 30 ...

  50. [2024]

    URLhttps://arxiv.org/abs/2401.05342

  51. [2025]

    URLhttps://arxiv.org/abs/2410.16136

Pith tools

Reviewed August 7, 2026 · model on record in the stance chip above.