Pith. sign in

Paper Citation Record · LEDGER

Mechanistic Insights into Grokking from the Embedding Layer

As of 15 August 2026, this Paper Citation Record lists 29 of 29 outbound references and 3 inbound Pith citation observations for arXiv:2505.15624.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.15624 v1

Coverage vector

measured 29 of 29 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T15:20:33.600845Z

measured 32 of 32 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-15T06:32:42.880941+00:00

measured 3 of 3 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-07-11T00:46:52.525784Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-07-11T00:47:42.529781Z

Reference resolution

29 of 29 outbound references displayed

  • verified exact0
  • verified fuzzy7
  • unresolved22
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation a1567f65-7ae7-4bfb-9799-d8f790b73b5c · outbound

This paper cites Unifying Grokking and Double Descent.

Mechanistic Insights into Grokking from the Embedding Layer Unifying Grokking and Double Descent

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:31.311984Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:31.311984Z digest=sha256:16686f148ee096b30ff1e7a57378c420ebf0d2c57ffd623fa7543634a5bddc08

Observation 6d143eb0-f0f2-4aec-a7f8-7cb0c7af2b31 · outbound

This paper cites Grokking Modular Polynomials.

Mechanistic Insights into Grokking from the Embedding Layer Grokking Modular Polynomials

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:31.413642Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:31.413642Z digest=sha256:ab51ace753c6d9f0a48d921f8ed17a8068cdf879b35fedb09ef1648a12d324d0

Observation 9945eda6-9954-4e43-90e3-a9ff8dec296c · outbound

This paper cites Deep Grokking: Would Deep Neural Networks Generalize Better?.

Mechanistic Insights into Grokking from the Embedding Layer Deep Grokking: Would Deep Neural Networks Generalize Better?

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:31.512408Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:31.512408Z digest=sha256:b6719a591882fb2285ec661f1ee2d89ee1711b7af637f88a9c76dc3a2cf60447

Observation 5c346a6e-f423-4725-bf80-2df3f2041573 · outbound

This paper cites Grokking modular arithmetic.

Mechanistic Insights into Grokking from the Embedding Layer Grokking modular arithmetic

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:31.589869Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:31.589869Z digest=sha256:b679b95d2fc042828e5ec7c90733c33b84dbd038594a057c72515495ef718603

Observation 03ef6097-b76f-4801-a308-79708ae23106 · outbound

This paper cites an unresolved cited work.

Mechanistic Insights into Grokking from the Embedding Layer Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:36.091392Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-07T15:20:31.674210Z digest=sha256:506c910f03ecec74b2be39a69e9d1f6dd9514aa80927513dc69653130fe6e5cd

Observation 516a2bc2-0ad6-4865-97d4-94074518c8a5 · outbound

This paper cites Deep Networks Always Grok and Here is Why.

Mechanistic Insights into Grokking from the Embedding Layer Deep Networks Always Grok and Here is Why

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:31.770732Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:31.770732Z digest=sha256:581c8629610124ea7b4db91f9f2650773736d71ea39b3ac830fe858679eccb85

Observation 8055ed54-856d-4d60-b4da-3bfb127837fd · outbound

This paper cites Jeffares, A.

Mechanistic Insights into Grokking from the Embedding Layer Jeffares, A

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:35.927084Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-07T15:20:31.871110Z digest=sha256:a96e98575a09bea61c7a60ba81a6631c3f88ba0b83b4b4ae8a83a4745a9b01ea

Observation c2cb3d8b-281f-492e-9aac-cb0261ace342 · outbound

This paper cites Kobayashi, Y.

Mechanistic Insights into Grokking from the Embedding Layer Kobayashi, Y

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:35.782635Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-07T15:20:31.966594Z digest=sha256:74fac41705ce2c19b2d40117b8776f7c4a8966f935f6b79079119e249d00a9e0

Observation efec256d-0e15-427f-a806-b591c61bfe1b · outbound

This paper cites Kumar.Grokking as the transition from lazy to rich training dynamics.

Mechanistic Insights into Grokking from the Embedding Layer Kumar.Grokking as the transition from lazy to rich training dynamics

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:35.650629Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-07T15:20:32.104945Z digest=sha256:7776913da9d706dcf9335a4c4242529f0149d042af808709d0809d03c933994f

Observation dd889ea2-f70c-49c0-805a-a2fce27314aa · outbound

This paper cites Noise Is Not the Main Factor Behind the Gap Between SGD and Adam on Transformers, but Sign Descent Might Be.

Mechanistic Insights into Grokking from the Embedding Layer Noise Is Not the Main Factor Behind the Gap Between SGD and Adam on Transformers, but Sign Descent Might Be

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:32.185977Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:32.185977Z digest=sha256:d165584e2a111831b1c943b34f6a57e85c92f2e0810afbd92932b1088c4386c3

Observation d6d12055-1c57-463e-97b5-fb5fb706bda7 · outbound

This paper cites Grokfast: Accelerated Grokking by Amplifying Slow Gradients.

Mechanistic Insights into Grokking from the Embedding Layer Grokfast: Accelerated Grokking by Amplifying Slow Gradients

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:32.279376Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:32.279376Z digest=sha256:84038caed1ab4de2e881db42207e6da9d4dfc78ba3224881bbe5584fb6dc81b8

Observation b8b276ee-db82-4c96-b527-582ea220c614 · outbound

This paper cites an unresolved cited work.

Mechanistic Insights into Grokking from the Embedding Layer Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:35.527786Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-07T15:20:32.374873Z digest=sha256:ec4a3be380b92413b1101edc53d2a1759ab2e60741f6bbccc51c9722c35cc8a4

Observation 6f712040-a429-4652-8368-7fb819591959 · outbound

This paper cites an unresolved cited work.

Mechanistic Insights into Grokking from the Embedding Layer Unresolved cited work

Reference 13

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:35.411399Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-07T15:20:32.451877Z digest=sha256:15bed8dc5ec5893c59eab91c37c1f06038ba2effd6c6f8cc9e5b1867d38de822

Observation 4edad32a-ca95-44e4-aa99-fd44fb87a4c7 · outbound

This paper cites Dichotomy of Early and Late Phase Implicit Biases Can Provably Induce Grokking.

Mechanistic Insights into Grokking from the Embedding Layer Dichotomy of Early and Late Phase Implicit Biases Can Provably Induce Grokking

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:32.525471Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:32.525471Z digest=sha256:19704b128b158f30d0f36516b960a71c9e28df62798200a5109fcbb55eb10532

Observation fe6b5f78-8ed3-44df-a795-4e4e76431139 · outbound

This paper cites Why Do You Grok? A Theoretical Analysis of Grokking Modular Addition.

Mechanistic Insights into Grokking from the Embedding Layer Why Do You Grok? A Theoretical Analysis of Grokking Modular Addition

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:32.612854Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:32.612854Z digest=sha256:e9bbdda77746b446acad1d1bd8231802f552eacb448ecfd81ce0c843883d3f71

Observation fdd0ef98-8ed2-4d81-83c7-a3921b229c0f · outbound

This paper cites Nakkiran, G.

Mechanistic Insights into Grokking from the Embedding Layer Nakkiran, G

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:35.198115Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-07T15:20:32.726031Z digest=sha256:a0a9e61e205b734913430ed2eccf07fac75dc4feec3948151fc2c5bf06194191

Observation ef27649e-48a9-407b-ad40-f0bea8a86ee0 · outbound

This paper cites Progress measures for grokking via mechanistic interpretability.

Mechanistic Insights into Grokking from the Embedding Layer Progress measures for grokking via mechanistic interpretability

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:32.787652Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:32.787652Z digest=sha256:fcd1d3bb67b8393aa63b31ba8f6e25060385e3768a4e254701f62e93aff12b40

Observation 86065612-bebb-4c33-b7ee-6d21d2f4474e · outbound

This paper cites Toward Understanding Why Adam Converges Faster Than SGD for Transformers.

Mechanistic Insights into Grokking from the Embedding Layer Toward Understanding Why Adam Converges Faster Than SGD for Transformers

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:32.846977Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:32.846977Z digest=sha256:07d633e5540fdc877156660f8d73b1e0f9e760926b730dc4be41124c72cb046e

Observation 7ff63fd5-d0ac-42d9-b025-6f6a941825fc · outbound

This paper cites Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets.

Mechanistic Insights into Grokking from the Embedding Layer Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:32.907248Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:32.907248Z digest=sha256:3958054605c857a024d43d9bb9a78f69689b295f5fe940d67f82b6382d9daa0a

Observation 5a6f4584-9cee-4797-9c82-1e357fe54ed9 · outbound

This paper cites Grokking at the Edge of Numerical Stability.

Mechanistic Insights into Grokking from the Embedding Layer Grokking at the Edge of Numerical Stability

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:32.966025Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:32.966025Z digest=sha256:f7b6ec3001cbcefe5508f1f3e3fb8f5a3875b56eeec75b7ea8d7f85157beab43

Observation 934c21f7-3b4a-432d-ae6c-16d98684e37a · outbound

This paper cites Explaining grokking through circuit efficiency.

Mechanistic Insights into Grokking from the Embedding Layer Explaining grokking through circuit efficiency

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:33.018742Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:33.018742Z digest=sha256:5a5f47eb7d9560881bb6355854f601e4e3cdf282cac771231c07ef0da306ab66

Observation 0f68dad0-555d-49be-a7f5-b6cf1d835efa · outbound

This paper cites an unresolved cited work.

Mechanistic Insights into Grokking from the Embedding Layer Unresolved cited work

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:33.088522Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:33.088522Z digest=sha256:bc162f070c9d1e30d275dbaa79d52d57d4af6f29b13ed5bb70ae2735dd170cd7

Observation befd7f07-cf2f-4dd4-837c-c158b116bf73 · outbound

This paper cites Let Me Grok for You: Accelerating Grokking via Embedding Transfer from a Weaker Model.

Mechanistic Insights into Grokking from the Embedding Layer Let Me Grok for You: Accelerating Grokking via Embedding Transfer from a Weaker Model

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:33.165073Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:33.165073Z digest=sha256:8f6de4b744827f033d92a829ecbaed89b2ca75e3ada5907a8140ebcc18c2b516

Observation 64a87adb-cb78-467d-980d-9ca0ad804177 · outbound

This paper cites Yang and E.

Mechanistic Insights into Grokking from the Embedding Layer Yang and E

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:34.955379Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-07T15:20:33.244750Z digest=sha256:047e6c8b4c727697eba87a3f3c13cc729a431f8d33d85bfe4c9b73a29c932073

Observation a46dae56-8ffe-4a9d-972c-b3508831d25c · outbound

This paper cites Zhang, S.

Mechanistic Insights into Grokking from the Embedding Layer Zhang, S

Reference 25

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:34.789016Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-07T15:20:33.329481Z digest=sha256:4234a507cdc31964781e4de1092b49ebb67cc77a2113ae2691bbe7d5bd47066c

Observation 8db54ecc-4645-45b5-aa8f-62252775bc69 · outbound

This paper cites Why Transformers Need Adam: A Hessian Perspective.

Mechanistic Insights into Grokking from the Embedding Layer Why Transformers Need Adam: A Hessian Perspective

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:33.396451Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:33.396451Z digest=sha256:98c6fff471eec7dee97366d7a36aaed174f9a27f8de57476af9bb6fb38fc73ab

Observation 63cf471c-575a-4285-8928-cd5f11de9c27 · outbound

This paper cites an unresolved cited work.

Mechanistic Insights into Grokking from the Embedding Layer Unresolved cited work

Reference 27

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:34.646298Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-07T15:20:33.461927Z digest=sha256:088fa52124e74fe2ad6b98de3f468012c724b9bebbbf627ea2614aed35ba2f91

Observation 94d77c88-887a-4b30-a7c5-afbfd1704530 · outbound

This paper cites an unresolved cited work.

Mechanistic Insights into Grokking from the Embedding Layer Unresolved cited work

Reference 28

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:34.462892Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-07T15:20:33.515869Z digest=sha256:2dede598c777ae2b0d315ba05b4a554d2ce5950b51fd1faf3cc5f5adf540d788

Observation 0cb443d6-bec1-4308-ab18-747d43efe9dd · outbound

This paper cites Figure 9 shows the maximum eigenvalues of the Hessian with respect to E and W during training.

Mechanistic Insights into Grokking from the Embedding Layer Figure 9 shows the maximum eigenvalues of the Hessian with respect to E and W during training

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:34.254769Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-07T15:20:33.600845Z digest=sha256:447a8991c1cd060f8cfd4fb5d2b8c5442edf2473f58fc6bebc2dfe392c387923

Pith citing papers

Observation 62ecb233-e66f-4453-a930-9227882a6184 · inbound

Deciphering Two Training Clocks in Grokking via Deep Linear Network Theory with Conditional ReLU Reduction cites this paper.

Deciphering Two Training Clocks in Grokking via Deep Linear Network Theory with Conditional ReLU Reduction Mechanistic Insights into Grokking from the Embedding Layer

Reference 57

Resolution
verified exact
arxiv_id, observed 2026-07-02T12:06:56.081199Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-06-28T02:26:16.631418Z digest=sha256:697c2d48d8cab36dd5e6ae47b90a11975a21323db67d76ca7648f2505369b93b

Observation 1b04501c-70a7-4c5e-8e6e-8f0b3f04c833 · inbound

Beyond Neural Collapse: Task-Intrinsic Geometry Governs Neural Representations in Modular Arithmetic cites this paper.

Beyond Neural Collapse: Task-Intrinsic Geometry Governs Neural Representations in Modular Arithmetic Mechanistic Insights into Grokking from the Embedding Layer

Reference 20

Resolution
verified exact
arxiv_id, observed 2026-07-02T23:57:28.749482Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-06-27T17:39:14.658342Z digest=sha256:edcb0879b5a6b6d842d476135ac880d526817e5e4903975e8ee65b79dafc4c3f

Observation 19c113ba-196b-4a86-8859-7cab247f68bd · inbound

At-Grok Is Not Converged:A Measurement-Validity Audit for Grokking Representation Metrics cites this paper.

At-Grok Is Not Converged:A Measurement-Validity Audit for Grokking Representation Metrics Mechanistic Insights into Grokking from the Embedding Layer

Reference 9

Resolution
verified exact
local_arxiv, observed 2026-07-11T00:47:42.552783Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-07-11T00:46:52.525784Z digest=sha256:aa5e3e55c75dde173fd3c402a240121ee0015c4bb8baf4c32c49c51f61458649