Paper Citation Record · LEDGER

NormFormer: Improved Transformer Pretraining with Extra Normalization

As of 9 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 16 inbound Pith citation observations for arXiv:2110.09456.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2110.09456 v2

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 16 of 16 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 16 of 16 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T14:19:52.425001Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

0 of 0 outbound references displayed

verified exact0
verified fuzzy0
unresolved0
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

28
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation b1d251c3-42a8-4c44-990b-d098de0e89b2 · inbound

ST-MoE: Designing Stable and Transferable Sparse Expert Models cites this paper.

ST-MoE: Designing Stable and Transferable Sparse Expert Models NormFormer: Improved Transformer Pretraining with Extra Normalization

Reference 199

Resolution: verified exact; arxiv_id, observed 2026-05-12T23:14:25.853489Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 29ff6b07-a487-4db9-b543-7064dd252052 · inbound

Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality cites this paper.

Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality NormFormer: Improved Transformer Pretraining with Extra Normalization

Reference 91

Resolution: verified exact; arxiv_id, observed 2026-05-11T12:16:25.946940Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation b8b59346-a6ea-495f-bd66-e954ea21bd9e · inbound

Learning to (Learn at Test Time): RNNs with Expressive Hidden States cites this paper.

Learning to (Learn at Test Time): RNNs with Expressive Hidden States NormFormer: Improved Transformer Pretraining with Extra Normalization

Reference 67

Resolution: verified exact; arxiv_id, observed 2026-05-15T05:20:12.251119Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation dd02aa21-f87b-4963-999e-5fe241f90d42 · inbound

Spectral-Adaptive Modulation Networks for Visual Perception cites this paper.

Spectral-Adaptive Modulation Networks for Visual Perception NormFormer: Improved Transformer Pretraining with Extra Normalization

Reference 101

Resolution: verified exact; arxiv_id, observed 2026-05-22T22:35:11.646005Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation e6250802-0980-4c55-8a29-cf60446cfc06 · inbound

Understanding Transformer from the Perspective of Associative Memory cites this paper.

Understanding Transformer from the Perspective of Associative Memory NormFormer: Improved Transformer Pretraining with Extra Normalization

Reference 37

Resolution: unresolved; no resolver link, observed 2026-08-07T14:19:52.425001Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 95eb7219-1915-42ee-8692-65a282ad4ccc · inbound

Residual Matrix Transformers: Scaling the Size of the Residual Stream cites this paper.

Residual Matrix Transformers: Scaling the Size of the Residual Stream NormFormer: Improved Transformer Pretraining with Extra Normalization

Reference 43

Resolution: unresolved; no resolver link, observed 2026-08-06T22:10:41.617138Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0b32a93d-2461-43d1-be7d-49a75c0f1de0 · inbound

Enhancing next token prediction based pre-training for jet foundation models cites this paper.

Enhancing next token prediction based pre-training for jet foundation models NormFormer: Improved Transformer Pretraining with Extra Normalization

Reference 67

Resolution: unresolved; no resolver link, observed 2026-08-03T18:42:13.369717Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7b20b22d-d874-4795-bebe-a0d7a08359e0 · inbound

SpanNorm: Reconciling Training Stability and Performance in Deep Transformers cites this paper.

SpanNorm: Reconciling Training Stability and Performance in Deep Transformers NormFormer: Improved Transformer Pretraining with Extra Normalization

Reference 2021

Resolution: unresolved; no resolver link, observed 2026-08-03T06:37:53.244800Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 87d7a6bb-26a6-40c3-8f42-a733a5103058 · inbound

Masked-Token Prediction for Anomaly Detection at the Large Hadron Collider cites this paper.

Masked-Token Prediction for Anomaly Detection at the Large Hadron Collider NormFormer: Improved Transformer Pretraining with Extra Normalization

Reference 18

Resolution: verified exact; arxiv_id, observed 2026-05-11T14:11:04.347779Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 21ab91d6-1470-499f-ab84-275bc0b87d66 · inbound

Dissecting Jet-Tagger Through Mechanistic Interpretability cites this paper.

Dissecting Jet-Tagger Through Mechanistic Interpretability NormFormer: Improved Transformer Pretraining with Extra Normalization

Reference 44

Resolution: verified exact; arxiv_id, observed 2026-05-12T04:51:22.732285Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 269face2-5ba0-4007-9744-f9495e6b9bb8 · inbound

Learning Less Is More: Premature Upper-Layer Attention Specialization Hurts Language Model Pretraining cites this paper.

Learning Less Is More: Premature Upper-Layer Attention Specialization Hurts Language Model Pretraining NormFormer: Improved Transformer Pretraining with Extra Normalization

Reference 14

Resolution: verified exact; arxiv_id, observed 2026-05-12T06:31:27.895465Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 41a74ce0-72ff-4cdc-828b-babe7507c3cf · inbound

Dense Supervision Is Not Enough: The Readout Blind Spot in Looped Language Models cites this paper.

Dense Supervision Is Not Enough: The Readout Blind Spot in Looped Language Models NormFormer: Improved Transformer Pretraining with Extra Normalization

Reference 14

Resolution: verified exact; arxiv_id, observed 2026-07-03T17:08:44.043355Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation da89ef92-acd0-43fa-9443-93df1c86e530 · inbound

CascadeFormer: Depth-Tapered Transformers Motivated by Gradient Fan-in Asymmetry cites this paper.

CascadeFormer: Depth-Tapered Transformers Motivated by Gradient Fan-in Asymmetry NormFormer: Improved Transformer Pretraining with Extra Normalization

Reference 28

Resolution: verified exact; arxiv_id, observed 2026-06-26T05:29:00.032144Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 900e3749-5352-4242-bdec-812979d4370d · inbound

Transforming Rank: How Architecture Navigates the Spectral Pathologies of Depth cites this paper.

Transforming Rank: How Architecture Navigates the Spectral Pathologies of Depth NormFormer: Improved Transformer Pretraining with Extra Normalization

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-02T03:08:35.091316Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8af19852-f78d-43d3-a532-5a2890762fd4 · inbound

A Controlled Study of Attention-Only Transformers cites this paper.

A Controlled Study of Attention-Only Transformers NormFormer: Improved Transformer Pretraining with Extra Normalization

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-01T16:19:08.218424Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4ca5af7c-1300-4e6a-9731-a7264367390f · inbound

Dual Attention Residuals cites this paper.

Dual Attention Residuals NormFormer: Improved Transformer Pretraining with Extra Normalization

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-01T14:36:34.541050Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.