Pith. sign in

Paper Citation Record · LEDGER

Mechanistic Insights into Grokking from the Embedding Layer

As of 18 August 2026, this Paper Citation Record lists 29 of 29 outbound references and 3 inbound Pith citation observations for arXiv:2505.15624.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.15624 v1

Coverage vector

measured 29 of 29 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T15:20:33.600845Z

measured 32 of 32 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-18T06:34:40.430872+00:00

measured 3 of 3 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-07-11T00:46:52.525784Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-07-11T00:47:42.529781Z

Reference resolution

29 of 29 outbound references displayed

  • verified exact0
  • verified fuzzy7
  • unresolved22
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation a1567f65-7ae7-4bfb-9799-d8f790b73b5c · outbound

This paper cites Unifying Grokking and Double Descent.

Mechanistic Insights into Grokking from the Embedding Layer Unifying Grokking and Double Descent

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:31.311984Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:31.311984Z digest=sha256:b8824860e37985679d19137abc3aa49c9890f0a4fb7b78d06531a79e662dd869

Observation 6d143eb0-f0f2-4aec-a7f8-7cb0c7af2b31 · outbound

This paper cites Grokking Modular Polynomials.

Mechanistic Insights into Grokking from the Embedding Layer Grokking Modular Polynomials

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:31.413642Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:31.413642Z digest=sha256:b6b67ce84f3ef1e0c9bd0c33bf44397df4e68aefcba5ad6e4cae2020153d604d

Observation 9945eda6-9954-4e43-90e3-a9ff8dec296c · outbound

This paper cites Deep Grokking: Would Deep Neural Networks Generalize Better?.

Mechanistic Insights into Grokking from the Embedding Layer Deep Grokking: Would Deep Neural Networks Generalize Better?

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:31.512408Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:31.512408Z digest=sha256:c0e59c6d2a45d2e9b6653f9ab61f00612f5e96aff6ccff929784c77fcc54076c

Observation 5c346a6e-f423-4725-bf80-2df3f2041573 · outbound

This paper cites Grokking modular arithmetic.

Mechanistic Insights into Grokking from the Embedding Layer Grokking modular arithmetic

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:31.589869Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:31.589869Z digest=sha256:623d358294e2af212b83ed3dd8bf1d1caaca9d6717229831749aeff7cab13f48

Observation 03ef6097-b76f-4801-a308-79708ae23106 · outbound

This paper cites an unresolved cited work.

Mechanistic Insights into Grokking from the Embedding Layer Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:36.091392Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T15:20:31.674210Z digest=sha256:8f5bb6382deea2b896a5a42073f90b7a21ec7576215cac7677715918b348ad4e

Observation 516a2bc2-0ad6-4865-97d4-94074518c8a5 · outbound

This paper cites Deep Networks Always Grok and Here is Why.

Mechanistic Insights into Grokking from the Embedding Layer Deep Networks Always Grok and Here is Why

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:31.770732Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:31.770732Z digest=sha256:d732577ba08512583c8af0b833189b0411327ab25d33f6e5c1c050addc929257

Observation 8055ed54-856d-4d60-b4da-3bfb127837fd · outbound

This paper cites Jeffares, A.

Mechanistic Insights into Grokking from the Embedding Layer Jeffares, A

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:35.927084Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T15:20:31.871110Z digest=sha256:f217246641b3711be5da24e977299edb0d475fb8c1561ae0a67b9031c7d79584

Observation c2cb3d8b-281f-492e-9aac-cb0261ace342 · outbound

This paper cites Kobayashi, Y.

Mechanistic Insights into Grokking from the Embedding Layer Kobayashi, Y

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:35.782635Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T15:20:31.966594Z digest=sha256:782f118f192aacb6d102e3c7a761f4fd1974d81f4b149c9933c73442d03eaef3

Observation efec256d-0e15-427f-a806-b591c61bfe1b · outbound

This paper cites Kumar.Grokking as the transition from lazy to rich training dynamics.

Mechanistic Insights into Grokking from the Embedding Layer Kumar.Grokking as the transition from lazy to rich training dynamics

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:35.650629Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T15:20:32.104945Z digest=sha256:05ac612e4ff00312f8f0414b80d41fad006bbc627608f03ec406080979690f8a

Observation dd889ea2-f70c-49c0-805a-a2fce27314aa · outbound

This paper cites Noise Is Not the Main Factor Behind the Gap Between SGD and Adam on Transformers, but Sign Descent Might Be.

Mechanistic Insights into Grokking from the Embedding Layer Noise Is Not the Main Factor Behind the Gap Between SGD and Adam on Transformers, but Sign Descent Might Be

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:32.185977Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:32.185977Z digest=sha256:92becaa595ad01d53a1045db2be3a5430aacd3f3e538c52e6f9e1c3aabf5c090

Observation d6d12055-1c57-463e-97b5-fb5fb706bda7 · outbound

This paper cites Grokfast: Accelerated Grokking by Amplifying Slow Gradients.

Mechanistic Insights into Grokking from the Embedding Layer Grokfast: Accelerated Grokking by Amplifying Slow Gradients

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:32.279376Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:32.279376Z digest=sha256:ba89c08555c4833f119f4a14ace170a4e126c26672ca0a1e5cb078fa87a7d23b

Observation b8b276ee-db82-4c96-b527-582ea220c614 · outbound

This paper cites an unresolved cited work.

Mechanistic Insights into Grokking from the Embedding Layer Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:35.527786Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T15:20:32.374873Z digest=sha256:2ee4fe74a26c540a97ddb9ce497e1877e0e0dd6c28c28f383c88a9018cc52500

Observation 6f712040-a429-4652-8368-7fb819591959 · outbound

This paper cites an unresolved cited work.

Mechanistic Insights into Grokking from the Embedding Layer Unresolved cited work

Reference 13

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:35.411399Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T15:20:32.451877Z digest=sha256:1654039ce4e8f9d73797d89502e384a3d56f1353876b78a303d087966d1cc791

Observation 4edad32a-ca95-44e4-aa99-fd44fb87a4c7 · outbound

This paper cites Dichotomy of Early and Late Phase Implicit Biases Can Provably Induce Grokking.

Mechanistic Insights into Grokking from the Embedding Layer Dichotomy of Early and Late Phase Implicit Biases Can Provably Induce Grokking

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:32.525471Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:32.525471Z digest=sha256:4b4d896cb79d69d1087e0417832a56a66a5cd831985b14cc52f11a29a10ac7d3

Observation fe6b5f78-8ed3-44df-a795-4e4e76431139 · outbound

This paper cites Why Do You Grok? A Theoretical Analysis of Grokking Modular Addition.

Mechanistic Insights into Grokking from the Embedding Layer Why Do You Grok? A Theoretical Analysis of Grokking Modular Addition

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:32.612854Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:32.612854Z digest=sha256:06ffe54d91081d2f428e221217c6784e9c4b71a976ebc80ba4ecbb9ccd1bf1de

Observation fdd0ef98-8ed2-4d81-83c7-a3921b229c0f · outbound

This paper cites Nakkiran, G.

Mechanistic Insights into Grokking from the Embedding Layer Nakkiran, G

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:35.198115Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T15:20:32.726031Z digest=sha256:b3071bbc1b454f22ae1dcc4e81950cb8a18ee50e9a28827f6de176c9c9109dbe

Observation ef27649e-48a9-407b-ad40-f0bea8a86ee0 · outbound

This paper cites Progress measures for grokking via mechanistic interpretability.

Mechanistic Insights into Grokking from the Embedding Layer Progress measures for grokking via mechanistic interpretability

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:32.787652Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:32.787652Z digest=sha256:fcd1d3bb67b8393aa63b31ba8f6e25060385e3768a4e254701f62e93aff12b40

Observation 86065612-bebb-4c33-b7ee-6d21d2f4474e · outbound

This paper cites Toward Understanding Why Adam Converges Faster Than SGD for Transformers.

Mechanistic Insights into Grokking from the Embedding Layer Toward Understanding Why Adam Converges Faster Than SGD for Transformers

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:32.846977Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:32.846977Z digest=sha256:c2f7aeedfa79457762d2e9b4769858629cea872174b166527e62524991d3e027

Observation 7ff63fd5-d0ac-42d9-b025-6f6a941825fc · outbound

This paper cites Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets.

Mechanistic Insights into Grokking from the Embedding Layer Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:32.907248Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:32.907248Z digest=sha256:4d620b804105fa0c7e151d5b3f134be2cb9830e3d47aa0f1a955cb21aa323080

Observation 5a6f4584-9cee-4797-9c82-1e357fe54ed9 · outbound

This paper cites Grokking at the Edge of Numerical Stability.

Mechanistic Insights into Grokking from the Embedding Layer Grokking at the Edge of Numerical Stability

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:32.966025Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:32.966025Z digest=sha256:95c07e919b88203d921d53dc3a3d16f256749af214b44642384b0e18cfce2f3f

Observation 934c21f7-3b4a-432d-ae6c-16d98684e37a · outbound

This paper cites Explaining grokking through circuit efficiency.

Mechanistic Insights into Grokking from the Embedding Layer Explaining grokking through circuit efficiency

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:33.018742Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:33.018742Z digest=sha256:1b76a705fa8cbbcb34fe307e62f76108f4ff65cd54ce432682cea48ab4ab73b2

Observation 0f68dad0-555d-49be-a7f5-b6cf1d835efa · outbound

This paper cites an unresolved cited work.

Mechanistic Insights into Grokking from the Embedding Layer Unresolved cited work

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:33.088522Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:33.088522Z digest=sha256:bc162f070c9d1e30d275dbaa79d52d57d4af6f29b13ed5bb70ae2735dd170cd7

Observation befd7f07-cf2f-4dd4-837c-c158b116bf73 · outbound

This paper cites Let Me Grok for You: Accelerating Grokking via Embedding Transfer from a Weaker Model.

Mechanistic Insights into Grokking from the Embedding Layer Let Me Grok for You: Accelerating Grokking via Embedding Transfer from a Weaker Model

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:33.165073Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:33.165073Z digest=sha256:af107dfb1010c9cc71b51f8eb048649384c01f99bcd0eda162b5746c5959f597

Observation 64a87adb-cb78-467d-980d-9ca0ad804177 · outbound

This paper cites Yang and E.

Mechanistic Insights into Grokking from the Embedding Layer Yang and E

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:34.955379Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T15:20:33.244750Z digest=sha256:261cd2c49a67853ed3f60b4fedc6b6037e52a506181198834e0433f7c878e10f

Observation a46dae56-8ffe-4a9d-972c-b3508831d25c · outbound

This paper cites Zhang, S.

Mechanistic Insights into Grokking from the Embedding Layer Zhang, S

Reference 25

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:34.789016Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T15:20:33.329481Z digest=sha256:28c519c3c1ad232bc3589c3ff2b1e0fc2f9a5c5b8a73aa20e50bcb005502cf59

Observation 8db54ecc-4645-45b5-aa8f-62252775bc69 · outbound

This paper cites Why Transformers Need Adam: A Hessian Perspective.

Mechanistic Insights into Grokking from the Embedding Layer Why Transformers Need Adam: A Hessian Perspective

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:33.396451Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:33.396451Z digest=sha256:0e56565bc8133d008e566b75010574d19545de47d9a06e0a443637065e87cf7b

Observation 63cf471c-575a-4285-8928-cd5f11de9c27 · outbound

This paper cites an unresolved cited work.

Mechanistic Insights into Grokking from the Embedding Layer Unresolved cited work

Reference 27

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:34.646298Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T15:20:33.461927Z digest=sha256:08d1b043d61a4515399e9d192e03a41ec0eb66b11c5e9962199cf6c5d21efaa8

Observation 94d77c88-887a-4b30-a7c5-afbfd1704530 · outbound

This paper cites an unresolved cited work.

Mechanistic Insights into Grokking from the Embedding Layer Unresolved cited work

Reference 28

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:34.462892Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T15:20:33.515869Z digest=sha256:6a3b5f9a309fd7f5558c4616e7aa5677ce3833d280c81ac34378a097fb9247e7

Observation 0cb443d6-bec1-4308-ab18-747d43efe9dd · outbound

This paper cites Figure 9 shows the maximum eigenvalues of the Hessian with respect to E and W during training.

Mechanistic Insights into Grokking from the Embedding Layer Figure 9 shows the maximum eigenvalues of the Hessian with respect to E and W during training

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:34.254769Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T15:20:33.600845Z digest=sha256:3bd631b8bfd1c92a72e25838b1e5c1f1f5beb69779005d81d5a1a5ff9e02c7b6

Pith citing papers

Observation 62ecb233-e66f-4453-a930-9227882a6184 · inbound

Deciphering Two Training Clocks in Grokking via Deep Linear Network Theory with Conditional ReLU Reduction cites this paper.

Deciphering Two Training Clocks in Grokking via Deep Linear Network Theory with Conditional ReLU Reduction Mechanistic Insights into Grokking from the Embedding Layer

Reference 57

Resolution
verified exact
arxiv_id, observed 2026-07-02T12:06:56.081199Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-06-28T02:26:16.631418Z digest=sha256:7c4be61af3265cdd2455147137f369dfc5c91316fd69ac9a894362d27a9ddd04

Observation 1b04501c-70a7-4c5e-8e6e-8f0b3f04c833 · inbound

Beyond Neural Collapse: Task-Intrinsic Geometry Governs Neural Representations in Modular Arithmetic cites this paper.

Beyond Neural Collapse: Task-Intrinsic Geometry Governs Neural Representations in Modular Arithmetic Mechanistic Insights into Grokking from the Embedding Layer

Reference 20

Resolution
verified exact
arxiv_id, observed 2026-07-02T23:57:28.749482Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-06-27T17:39:14.658342Z digest=sha256:802cd5dd0da9dc5793eb4b565a4a310f8f7035e8bcdabfbb08698af91e2faec6

Observation 19c113ba-196b-4a86-8859-7cab247f68bd · inbound

At-Grok Is Not Converged:A Measurement-Validity Audit for Grokking Representation Metrics cites this paper.

At-Grok Is Not Converged:A Measurement-Validity Audit for Grokking Representation Metrics Mechanistic Insights into Grokking from the Embedding Layer

Reference 9

Resolution
verified exact
local_arxiv, observed 2026-07-11T00:47:42.552783Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-07-11T00:46:52.525784Z digest=sha256:459d5b55bd7c97f31dc3e0bdcabf91be37dd71f6f32897ba1f54a90cd32ec1b4