Pith. sign in

Paper Citation Record · LEDGER

TRACE for Tracking the Emergence of Semantic Representations in Transformers

As of 20 August 2026, this Paper Citation Record lists 58 of 58 outbound references and 1 inbound Pith citation observation for arXiv:2505.17998.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.17998 v1

Coverage vector

measured 58 of 58 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T14:42:13.959881Z

measured 59 of 59 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-20T06:33:59.587034+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-05-10T00:50:49.134622Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-10T00:54:48.765802Z

Reference resolution

58 of 58 outbound references displayed

  • verified exact1
  • verified fuzzy29
  • unresolved27
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 54f9f796-dc94-44e3-bdfa-8935561b6600 · outbound

This paper cites Intrinsic dimensionality explains the effectiveness of language model fine-tuning.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Intrinsic dimensionality explains the effectiveness of language model fine-tuning

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:18.689558Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:09.519913Z digest=sha256:59b689074fda58ecb3ab3e24e2f9604c0b88a16e1d5e1a5c2c52dd1ab44b5a29

Observation 3dfaa656-3a0c-4931-aa98-3a8e1b81c8f8 · outbound

This paper cites How to escape sharp minima with random perturbations.

TRACE for Tracking the Emergence of Semantic Representations in Transformers How to escape sharp minima with random perturbations

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:18.527583Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:09.587864Z digest=sha256:9f57d2262f8eacf8f100c8527fb2d47becab83ff7364e74c4f6be1b420223654

Observation 7033f00e-c35d-4c06-8285-009e92155297 · outbound

This paper cites CARMA: Enhanced Compositionality in LLMs via Advanced Regularisation and Mutual Information Alignment.

TRACE for Tracking the Emergence of Semantic Representations in Transformers CARMA: Enhanced Compositionality in LLMs via Advanced Regularisation and Mutual Information Alignment

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:09.671639Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:09.671639Z digest=sha256:be412cf3e8c064f2be9be0d4e29b90e37ae656caee5ae9810717c764d0845417

Observation 305c588a-0f63-4b28-85ac-9dcb6e6e3a06 · outbound

This paper cites Intrinsic dimension of data representations in deep neural networks.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Intrinsic dimension of data representations in deep neural networks

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:09.733269Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:09.733269Z digest=sha256:73e5676d184fa48c2716f08517466982d3ddd824721d5da1a7fb7a04e4a65dd8

Observation 881781b3-0aea-4e6c-b148-87df5a54abf6 · outbound

This paper cites Baker, Charles J.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Baker, Charles J

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:09.836733Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:09.836733Z digest=sha256:d9f751e286ac9d8ef16613284e0c7eb02ade9d13fdc9f8ee8485bdd46dfc219b

Observation 40d9a486-8b2f-4393-8357-ec7e9a7e6e0f · outbound

This paper cites Mutual information neural estimation.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Mutual information neural estimation

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:18.339470Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:09.905580Z digest=sha256:9ecf672dda36f9e13f6bb7de965d4f5b78ab8de274a1c5ed5106dd7029c53ba6

Observation f3d00bd0-af7a-4ae3-8b41-1b45d978c945 · outbound

This paper cites Visualizing high-dimensional loss landscapes with hessian directions.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Visualizing high-dimensional loss landscapes with hessian directions

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:18.160650Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:09.977358Z digest=sha256:f4f7a04a10d13a29a51ff636923ac964712f0d0b10ef1ab5689cd90338a50fd2

Observation fa8b2097-3db1-40a7-be6d-faec3b87d122 · outbound

This paper cites Algorithms for manifold learning.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Algorithms for manifold learning

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:17.924828Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:10.032756Z digest=sha256:d0ab290f8bf2612304d7c426f8089ec4f52a3af3a09e33394085344873fe67ea

Observation d62fb9fa-6478-4d26-8251-47775b016c44 · outbound

This paper cites Bridging information-theoretic and geometric compression in language models.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Bridging information-theoretic and geometric compression in language models

Reference 9

Resolution
verified exact
doi, observed 2026-08-07T14:42:14.111642Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:10.096373Z digest=sha256:61982107e0d65b9a157e11e6d186c9975dda29f1cc29a7c800ab07ead516f659

Observation 333f5674-2172-4247-814b-e2876f2a23e7 · outbound

This paper cites Emergence of a high-dimensional abstraction phase in language transformers.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Emergence of a high-dimensional abstraction phase in language transformers

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:17.691396Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:10.217727Z digest=sha256:b96188742e0171ce2f44c5e09eb88c482efda9b1390a1c2809f5b9580669c7c8

Observation 89bd24da-afbe-4f92-8a42-d52ef315f4e9 · outbound

This paper cites Information-theoretic progress measures reveal grokking is an emergent phase transition.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Information-theoretic progress measures reveal grokking is an emergent phase transition

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:17.576368Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:10.316512Z digest=sha256:1620e9da9c03eb4391c0a617c89e943538acb674dd7b8c1f2a222c2f5dd1ebde

Observation 86db478a-b96e-42f5-a5dd-a1be703e2546 · outbound

This paper cites The devil is in the detail: Simple tricks improve systematic generalization of transformers.

TRACE for Tracking the Emergence of Semantic Representations in Transformers The devil is in the detail: Simple tricks improve systematic generalization of transformers

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:17.429375Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:10.358035Z digest=sha256:e144b540135bf165b850ee2f3d435409d129539aeabda8066be7401406673117

Observation 88972c94-ef66-4087-be9b-2c9fd136f58b · outbound

This paper cites Sparse Autoencoders Find Highly Interpretable Features in Language Models.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Sparse Autoencoders Find Highly Interpretable Features in Language Models

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:10.467741Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:10.467741Z digest=sha256:6af8d2efd99bb79109ed5070bfe3d3dd04dcf7497869604f91254d58fb3db376

Observation b277f457-bf29-4123-a67d-9a56eab948d0 · outbound

This paper cites Knowledge Neurons in Pretrained Transformers.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Knowledge Neurons in Pretrained Transformers

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:10.581513Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:10.581513Z digest=sha256:53e022c00fd85bbdd5d1e9428e85aaefea70869f3ba65c0d435380502e6d1484

Observation eab9e30a-c869-4828-a8f1-99353d4c46d9 · outbound

This paper cites The generalized ratios intrinsic dimension estimator.

TRACE for Tracking the Emergence of Semantic Representations in Transformers The generalized ratios intrinsic dimension estimator

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:17.226864Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:10.689459Z digest=sha256:50fcb60344f31ff90a3bcc5a189bf3f37ead0e0e5b0cf3f249abb5f5291e0af4

Observation 23f784e0-5248-430b-8c29-cf48d0cb68f6 · outbound

This paper cites A Complexity-Based Theory of Compositionality.

TRACE for Tracking the Emergence of Semantic Representations in Transformers A Complexity-Based Theory of Compositionality

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:10.760023Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:10.760023Z digest=sha256:2e2d5bf9fa5371626ce52732f844e43ff17f3b4ccee9e782f3740f298fdd5777

Observation 4205720b-396e-49f5-ac59-7ca5a8ecd6e9 · outbound

This paper cites Estimating the intrinsic dimension of datasets by a minimal neighborhood information.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Estimating the intrinsic dimension of datasets by a minimal neighborhood information

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:10.831423Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:10.831423Z digest=sha256:e6a058b6791afaf159cde8d331cf0ef6e308b9b55f71cf0f022e6b6bffe92bde

Observation 06a79309-8851-411c-b92e-49e741f4e1eb · outbound

This paper cites Not All Layers of LLMs Are Necessary During Inference.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Not All Layers of LLMs Are Necessary During Inference

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:10.919440Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:10.919440Z digest=sha256:9308fbb240130da77a3891682a63adbe0a03a08f5c0dd606ff6a5b2fdd10f76a

Observation c87277f1-00bd-4cbe-9005-e08d89bdd060 · outbound

This paper cites Fillmore.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Fillmore

Reference 19

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:17.133858Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:10.963321Z digest=sha256:62bc904e31dec60d51aff2f7a6e9bed7fd4a6065f8633bbfd081a77e7035f788

Observation 198ee351-fda7-43a3-ad2e-8a013737af29 · outbound

This paper cites Studying large language model generalization with influence functions.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Studying large language model generalization with influence functions

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:17.077514Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:11.056985Z digest=sha256:bceaf0bbf41d201d7707130c5302faa416e1ce5ece847334736313257c20ba97

Observation 5eb52840-a66f-4899-afa5-db4569a7ee96 · outbound

This paper cites Visualizing and Understanding the Effectiveness of BERT.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Visualizing and Understanding the Effectiveness of BERT

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:11.209841Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:11.209841Z digest=sha256:4341d282e40089a810d73df9eb596d073be17f5ef168b19e994fd55207a1ca57

Observation 96505720-da93-41be-ad6a-6367f2009d8c · outbound

This paper cites An empirical analysis of compute-optimal large language model training.

TRACE for Tracking the Emergence of Semantic Representations in Transformers An empirical analysis of compute-optimal large language model training

Reference 22

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:16.892462Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:11.280231Z digest=sha256:f7c81042bae42d42e3430dde842591eeb49a574cb25a9516664f5a11cdf2964d

Observation 36d38018-c528-49ad-8d71-e2bdae93d9fa · outbound

This paper cites Loss Landscape Degeneracy and Stagewise Development in Transformers.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Loss Landscape Degeneracy and Stagewise Development in Transformers

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:11.363810Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:11.363810Z digest=sha256:f14a513c140ec2ced8d2f9f31963bb346920b82348dc9ab00e95803cad23e08e

Observation 874e74ec-647d-4688-bda9-819497f7c57d · outbound

This paper cites Compositionality decomposed: How do neural networks generalise? Journal of Artificial Intelligence Research, 67:757–795, 2020.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Compositionality decomposed: How do neural networks generalise? Journal of Artificial Intelligence Research, 67:757–795, 2020

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:11.438531Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:11.438531Z digest=sha256:342a07560d4818447f46bcfc9aca76058dae265fc22eca9fc805e66141a2e9bb

Observation a7b3033b-cf0f-4785-b843-37bdeb121de3 · outbound

This paper cites Are Sparse Autoencoders Useful? A Case Study in Sparse Probing.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Are Sparse Autoencoders Useful? A Case Study in Sparse Probing

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:11.515244Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:11.515244Z digest=sha256:cc12ffa4500a01f722d3deb64eebe798f8f0f59893abb31a790b1ae837680c73

Observation 5f94e3bf-ee16-4919-9738-8ec136c7e6b7 · outbound

This paper cites On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima.

TRACE for Tracking the Emergence of Semantic Representations in Transformers On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:11.576632Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:11.576632Z digest=sha256:64558fb0689e77c199ae5c22d0ba45f70cceaf4ab491dd5cfa6a4facdca16b9b

Observation 31c4a7cb-99ff-4176-8501-8a7731b70e39 · outbound

This paper cites Flow of information in feed- forward denoising neural networks.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Flow of information in feed- forward denoising neural networks

Reference 27

Resolution
metadata mismatch
raw_fallback, observed 2026-08-07T14:42:14.469302Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:11.646556Z digest=sha256:a03435c24ea6b908da2dd70b75c8012f0bd965391bee571c43b61c2c8c18a21f

Observation b677f69b-6412-49d9-96d9-6ea98207608f · outbound

This paper cites Adam: A Method for Stochastic Optimization.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Adam: A Method for Stochastic Optimization

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:11.757633Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:11.757633Z digest=sha256:a29d4a261b650df9ec7b9d3cb8ac012589c83416eee058040cd6da6e38da115a

Observation 146740e2-e296-4078-b8df-c4eb80430911 · outbound

This paper cites Generalization without systematicity: On the compositional skills of sequence-to-sequence recurrent networks.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Generalization without systematicity: On the compositional skills of sequence-to-sequence recurrent networks

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:16.788122Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:11.846769Z digest=sha256:ff6c972cf5cd2203d9ee0882c652397fc8fca48d0ac3ac092343da58dd6aaffd

Observation 67b0c5ea-cef1-4bcd-a9de-d67d49b0c7ec · outbound

This paper cites An iteration method for the solution of the eigenvalue problem of linear differential and integral operators.

TRACE for Tracking the Emergence of Semantic Representations in Transformers An iteration method for the solution of the eigenvalue problem of linear differential and integral operators

Reference 30

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:16.677497Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:11.903547Z digest=sha256:d26ef58cef0731979037fa72d7c0360f6890f45c4ba20b04e80736606cdee7d6

Observation 14b76094-7a1a-4fc4-8358-4a0693261c70 · outbound

This paper cites Geometric Signatures of Compositionality Across a Language Model's Lifetime.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Geometric Signatures of Compositionality Across a Language Model's Lifetime

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:11.962777Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:11.962777Z digest=sha256:116d1d6e7c31cb8a0e9105dc14e57e31d7b3628cf92021b7a3247740648d9d8b

Observation c35ce934-db6b-4a40-a329-08db86ed596c · outbound

This paper cites Break it down: Evidence for structural compositionality in neural networks.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Break it down: Evidence for structural compositionality in neural networks

Reference 32

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:16.543976Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:11.994318Z digest=sha256:84d58cb211efb210d2ed18b7908d6344364f6f36f80024be0fa65f36b80515fe

Observation 4513ccb3-e580-4b04-a255-c5cfd495d3ff · outbound

This paper cites Systematic generalization and emergent structures in transformers trained on structured tasks, 2023.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Systematic generalization and emergent structures in transformers trained on structured tasks, 2023

Reference 33

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:16.415779Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:12.076497Z digest=sha256:36db69ae5622a59ff6b84e20905563448a425c203e68fc054e4fc2526fbaa16c

Observation 7996c54d-93ca-419b-8947-3ba9f2c917b4 · outbound

This paper cites Multiscale geometric methods for data sets i: Multiscale svd, noise and curvature.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Multiscale geometric methods for data sets i: Multiscale svd, noise and curvature

Reference 34

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:16.236157Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:12.139766Z digest=sha256:872596703cd4a2e064d205e63eeba2e0f37b903259e84bb7322ca8370b1c34a1

Observation ebaca91c-368d-4c05-9a66-f5ea048dd20e · outbound

This paper cites Deep double descent: Where bigger models and more data hurt.Journal of Statistical Mechanics: Theory and Experiment, 2021(12):124003, 2021.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Deep double descent: Where bigger models and more data hurt.Journal of Statistical Mechanics: Theory and Experiment, 2021(12):124003, 2021

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:12.191247Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:12.191247Z digest=sha256:41d58b331b88e4f1ce04bd86d37b7d99e8df3dbdc414fb85862a07d2fc9e6653

Observation 15fc1d8c-bf23-4caa-b093-53bf2cf48cfe · outbound

This paper cites Progress mea- sures for grokking via mechanistic interpretability.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Progress mea- sures for grokking via mechanistic interpretability

Reference 36

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:16.097272Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:12.263314Z digest=sha256:e292c1df3645227a0944c368997b534243ef7bb457c7a67060abd349843162c9

Observation 7c3a5340-ae92-410f-b65a-fe4eb9a0e841 · outbound

This paper cites In-context Learning and Induction Heads.

TRACE for Tracking the Emergence of Semantic Representations in Transformers In-context Learning and Induction Heads

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:12.352469Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:12.352469Z digest=sha256:652e662103a352dca8221652a1bf9e3364bb76bb23f61e819af95279e246dcec

Observation aa574f1f-36db-4587-8b82-cb8a29e1fb72 · outbound

This paper cites Lisa: Layerwise importance sampling for memory-efficient large language model fine-tuning.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Lisa: Layerwise importance sampling for memory-efficient large language model fine-tuning

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:12.436982Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:12.436982Z digest=sha256:4882c7a93e791d64cbd1316a63ea075b79e2fad615706ef93eaf457ef5fe4dbe

Observation 7e689f40-08ba-4431-bf17-258a1205f9f5 · outbound

This paper cites The geometry of categorical and hierarchical concepts in large language models.

TRACE for Tracking the Emergence of Semantic Representations in Transformers The geometry of categorical and hierarchical concepts in large language models

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:15.995645Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:12.501820Z digest=sha256:8cc640cab29a1b21ec34cfc9cbaaeb58b8dfca80be21226623b875506cbe9bda

Observation 80f4fa42-1a0b-4e61-96e4-5058de3aa99a · outbound

This paper cites Zipf’s word frequency law in natural language: A critical review and future directions.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Zipf’s word frequency law in natural language: A critical review and future directions

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:12.547150Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:12.547150Z digest=sha256:680e88157140cc7748055c9a0e7202a1c57a91f2211fe20b44191adf6b294e21

Observation eea18095-1869-4a43-9f65-819b6555e8aa · outbound

This paper cites Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets

Reference 41

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:12.616903Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:12.616903Z digest=sha256:0436ddd20b046e2940ec373beb2fe5da8f79177410598e3f0e77d56e2fcf46ca

Observation 7ecc17e4-e366-49ff-b57f-ec5f6d294456 · outbound

This paper cites The shape of learning: Anisotropy and intrinsic dimen- sions in transformer-based models.

TRACE for Tracking the Emergence of Semantic Representations in Transformers The shape of learning: Anisotropy and intrinsic dimen- sions in transformer-based models

Reference 42

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:15.931711Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:12.704795Z digest=sha256:93a365ff7ea5ded80cda94be70ecd3cd19249a2219b16cb256b1d2f0a8d84536

Observation 4ac94895-f962-4946-9816-dbedb7605b46 · outbound

This paper cites The effective rank: A measure of effective dimensionality.

TRACE for Tracking the Emergence of Semantic Representations in Transformers The effective rank: A measure of effective dimensionality

Reference 43

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:12.765119Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:12.765119Z digest=sha256:60e66b531ba1186a08fe1a6c46c9ee90f432c41b365a7d75b54856262bd64666

Observation 745dfc1e-f9e1-474b-899f-a2e5f2b741dc · outbound

This paper cites A deeper look at the hessian eigenspectrum of deep neural networks and its applications to regularization.

TRACE for Tracking the Emergence of Semantic Representations in Transformers A deeper look at the hessian eigenspectrum of deep neural networks and its applications to regularization

Reference 44

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:15.802883Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:12.869529Z digest=sha256:ee054347c8576c347c1767471da3c56f40be7b8b2c70fc8eb471c3711e06627b

Observation 4b56f033-2846-4659-aa97-2cca2b620443 · outbound

This paper cites Analysing mathematical reasoning abilities of neural models.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Analysing mathematical reasoning abilities of neural models

Reference 45

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:15.727679Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:12.959945Z digest=sha256:8c0b70030964e2bc1681a54edde76eb6b405e49b29351492598e53aea69f816a

Observation ecbbe8e1-dcf4-42ef-b93e-837d5c879434 · outbound

This paper cites Analytic insights into structure and rank of neural network hessian maps.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Analytic insights into structure and rank of neural network hessian maps

Reference 46

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:15.493617Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:13.087043Z digest=sha256:ff9fe9e33417f5512f214b08890840d08f4972fc74bb378865bd2fe2df2a90f7

Observation d324e018-af54-4058-b8c0-3f9035691025 · outbound

This paper cites Layer by Layer: Uncovering Hidden Representations in Language Models.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Layer by Layer: Uncovering Hidden Representations in Language Models

Reference 47

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:13.180944Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:13.180944Z digest=sha256:0d7d5a5e00990fb548942fdf7d4e234c822124479d101135b40bcdc3b0df5cac

Observation 63958d1e-82cc-4f90-a625-ca31dca3a88a · outbound

This paper cites Negative results for saes on downstream tasks and deprioritising sae research (gdm mech interp team progress up- date #2), March 2025.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Negative results for saes on downstream tasks and deprioritising sae research (gdm mech interp team progress up- date #2), March 2025

Reference 48

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:15.409779Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:13.262213Z digest=sha256:9f6e9018fd239aa004cb36adbb4c925602719a06c14ebe5ad3c10e73cf8452e3

Observation 285c6b45-8d1c-4b61-929d-c7825db2a158 · outbound

This paper cites The geometry of hidden representations of large transformer models.

TRACE for Tracking the Emergence of Semantic Representations in Transformers The geometry of hidden representations of large transformer models

Reference 49

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:13.361811Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:13.361811Z digest=sha256:28c3631129652ce6084c63c3542eb9aa25e6a4dc54c37c08776811cda52fd059

Observation e39d421b-cdf9-4308-bce5-7bb3400a8eb5 · outbound

This paper cites Attention is all you need.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Attention is all you need

Reference 50

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:13.445174Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:13.445174Z digest=sha256:2999229b136afed50e093847dffbd6ed84796dfbe2f0752039f7316da100198f

Observation 87ab987c-cfef-4b33-87d0-835ce5fa48b8 · outbound

This paper cites Loss landscape geometry reveals stagewise development of transformers.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Loss landscape geometry reveals stagewise development of transformers

Reference 51

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:15.261792Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:13.523403Z digest=sha256:d2c763541e6800b2b1b32550b8fc058184c1d93431fde813ecf1491c25025171

Observation a7ab022a-cea0-4cd2-9bb2-4c938f269b36 · outbound

This paper cites Penalizing gradient norm for efficiently improving generalization in deep learning.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Penalizing gradient norm for efficiently improving generalization in deep learning

Reference 52

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:15.163061Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:13.619097Z digest=sha256:421fe7cb177c1e490ef4ba2163eac00446d71bcacf9e00686e92eb7f2ef9b4af

Observation 11f65c12-4f3b-4bb2-b1e4-561effb46326 · outbound

This paper cites Algorithmic capabilities of random transformers.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Algorithmic capabilities of random transformers

Reference 53

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:15.057299Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:13.719543Z digest=sha256:925201cf1eb90315c8c9755f7c01177369571633e47de7828856d826cadb32d3

Observation b3db6963-7903-421f-8a58-a703d02dd134 · outbound

This paper cites Susskind, Samy Bengio, and Preetum Nakkiran.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Susskind, Samy Bengio, and Preetum Nakkiran

Reference 54

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:14.929332Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:13.771114Z digest=sha256:dcb0d9e06c79d1e2acd2d0af9e7709834425ce45f72dde4e4a2364821e2f2577

Observation 780b74b9-3aa4-4f75-b002-2baf6afa248f · outbound

This paper cites noun2 verb3 noun5.

TRACE for Tracking the Emergence of Semantic Representations in Transformers noun2 verb3 noun5

Reference 55

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:14.752021Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:13.959881Z digest=sha256:4c6025d14b0724b84c50a1a26461465a70aca8c64ff547c7f269ce222ea46645

Observation 6afe8182-68e1-4536-86f0-694a0d848d7e · outbound

This paper cites an unresolved cited work.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Unresolved cited work

Reference 57

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:42:14.834517Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:13.860852Z digest=sha256:b4b060a6c3cb49e7042b04be02b3cc1f174eaa3db2037054e600e0b0467f7e21

Observation c41654ee-fbc1-4c6a-8204-dbed1783a169 · outbound

This paper cites an unresolved cited work.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Unresolved cited work

Reference 2019

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:42:15.606068Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:13.031867Z digest=sha256:99aa0b0c8e397b8bac1c2bfe79bbacdfa7ba28b43e8c074c3c8238a8cd1325af

Observation bc771ef0-d21e-41dd-9554-6974d468451a · outbound

This paper cites an unresolved cited work.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Unresolved cited work

Reference 2024

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:42:16.973758Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-07T14:42:11.134431Z digest=sha256:de45d12474e1f6576b72782aea702d3444f34fcaa2f9219e4692dfeb84dfbea7

Pith citing papers

Observation cb30c5bf-1c43-4288-b1ad-d731ef66f01e · inbound

Rethinking Intrinsic Dimension Estimation in Neural Representations cites this paper.

Rethinking Intrinsic Dimension Estimation in Neural Representations TRACE for Tracking the Emergence of Semantic Representations in Transformers

Reference 27

Resolution
verified exact
arxiv_id, observed 2026-05-10T00:54:48.767180Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=arxiv_source observed=2026-05-10T00:50:49.134622Z digest=sha256:e937a84b33678ea69192113864f39eb4b7f3a67934eb25cd79f5f6c5f0a3a5a0