Paper Citation Record · LEDGER

Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

As of 7 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 37 inbound Pith citation observations for arXiv:2410.05192.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2410.05192 v3

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 37 of 37 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 37 of 37 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T12:12:47.569722Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

0 of 0 outbound references displayed

verified exact0
verified fuzzy0
unresolved0
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

1
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 22a06aaa-38ec-4f17-98a5-881b1a0aa397 · inbound

Training Dynamics Underlying Language Model Scaling Laws: Loss Deceleration and Zero-Sum Learning cites this paper.

Training Dynamics Underlying Language Model Scaling Laws: Loss Deceleration and Zero-Sum Learning Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 40

Resolution: unresolved; no resolver link, observed 2026-08-07T10:31:20.534009Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cefd3c8d-4ce7-45c9-99ff-acb5919ea260 · inbound

Recipes for Pre-training LLMs with MXFP8 cites this paper.

Recipes for Pre-training LLMs with MXFP8 Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-07T12:12:47.569722Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b5313255-eb34-44b3-a3b9-984f3cf42d19 · inbound

BioClinical ModernBERT: A State-of-the-Art Long-Context Encoder for Biomedical and Clinical NLP cites this paper.

BioClinical ModernBERT: A State-of-the-Art Long-Context Encoder for Biomedical and Clinical NLP Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 64

Resolution: unresolved; no resolver link, observed 2026-08-07T04:21:45.283461Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c175f1fc-bcb7-4348-ade2-8c41d48d21d6 · inbound

ByteSpan: Information-Driven Subword Tokenisation cites this paper.

ByteSpan: Information-Driven Subword Tokenisation Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 44

Resolution: unresolved; no resolver link, observed 2026-08-06T23:20:55.558998Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8e56a2c6-68f4-468a-b2d3-e557308434b4 · inbound

Scaling Collapse Reveals Universal Dynamics in Compute-Optimally Trained Neural Networks cites this paper.

Scaling Collapse Reveals Universal Dynamics in Compute-Optimally Trained Neural Networks Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 48

Resolution: unresolved; no resolver link, observed 2026-08-06T20:48:54.682273Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 46ec7f39-826e-43f3-ad28-e178f90c2d64 · inbound

Mpemba Effect in Large-Language Model Training Dynamics: A Minimal Analysis of the Valley-River model cites this paper.

Mpemba Effect in Large-Language Model Training Dynamics: A Minimal Analysis of the Valley-River model Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-06T19:59:05.216957Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 448880cd-8952-4b5d-af44-e21859de42a6 · inbound

WSM: Decay-Free Learning Rate Schedule via Checkpoint Merging for LLM Pre-training cites this paper.

WSM: Decay-Free Learning Rate Schedule via Checkpoint Merging for LLM Pre-training Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 64

Resolution: unresolved; no resolver link, observed 2026-08-06T14:49:40.357950Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3e405299-3eb1-4fca-9f5b-0bc3331cc7b8 · inbound

Theoretical Analysis on how Learning Rate Warmup Accelerates Convergence cites this paper.

Theoretical Analysis on how Learning Rate Warmup Accelerates Convergence Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-04T21:32:35.801321Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1c5a5312-e54b-4b57-8b03-ebbf370efd63 · inbound

World Modeling with Probabilistic Structure Integration cites this paper.

World Modeling with Probabilistic Structure Integration Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-04T20:07:03.143145Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bc431704-a053-41e8-993a-0db5dd316058 · inbound

Why Do We Need Warm-up? A Theoretical Perspective cites this paper.

Why Do We Need Warm-up? A Theoretical Perspective Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 66

Resolution: unresolved; no resolver link, observed 2026-08-04T12:39:01.733820Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation de12a0e5-f26d-4e6c-8048-8af409992ab6 · inbound

Scaling Latent Reasoning via Looped Language Models cites this paper.

Scaling Latent Reasoning via Looped Language Models Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 37

Resolution: verified exact; arxiv_id, observed 2026-05-15T07:43:11.863947Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 29b67147-6a72-4e4d-afba-15310c7b5757 · inbound

Scaling Latent Reasoning via Looped Language Models cites this paper.

Scaling Latent Reasoning via Looped Language Models Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 37

Resolution: unresolved; no resolver link, observed 2026-08-04T07:31:31.276350Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7041df66-e14d-48fa-9b66-5f6612aa5bd6 · inbound

Universal One-third Time Scaling in Learning Peaked Distributions cites this paper.

Universal One-third Time Scaling in Learning Peaked Distributions Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-03T05:01:13.163417Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2f493f42-1605-4fd8-9cc5-9a7417b627c6 · inbound

Theory of Optimal Learning Rate Schedules and Scaling Laws for a Random Feature Model cites this paper.

Theory of Optimal Learning Rate Schedules and Scaling Laws for a Random Feature Model Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 21

Resolution: verified exact; arxiv_id, observed 2026-05-16T07:00:43.295910Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 31e586fc-f1f2-4ca9-8473-b03c02c05ced · inbound

OmniMouse: Scaling properties of multi-modal, multi-task Brain Models on 150B Neural Tokens cites this paper.

OmniMouse: Scaling properties of multi-modal, multi-task Brain Models on 150B Neural Tokens Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 111

Resolution: verified exact; arxiv_id, observed 2026-05-11T12:51:04.770940Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 683f7852-1c1c-4119-a4ce-c4a97b12c1cb · inbound

Sharpness-Aware Pretraining Mitigates Catastrophic Forgetting cites this paper.

Sharpness-Aware Pretraining Mitigates Catastrophic Forgetting Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 77

Resolution: metadata mismatch; arxiv_id, observed 2026-05-09T06:20:42.358768Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation abfa34ad-b64a-409c-aa1e-1aba36e74d86 · inbound

Layer Collapse in Diffusion Language Models cites this paper.

Layer Collapse in Diffusion Language Models Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 19

Resolution: verified exact; arxiv_id, observed 2026-05-11T19:01:18.918915Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 19d357ff-dfd8-4c89-81f8-7d56fc61ec68 · inbound

Layer Collapse in Diffusion Language Models cites this paper.

Layer Collapse in Diffusion Language Models Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 19

Resolution: verified exact; arxiv_id, observed 2026-05-12T03:16:19.186092Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 71ed0272-3d9e-4ec9-b888-e7a36989a4ba · inbound

Efficient Pre-Training with Token Superposition cites this paper.

Efficient Pre-Training with Token Superposition Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 57

Resolution: verified exact; arxiv_id, observed 2026-05-11T20:11:09.614732Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 3ffed03c-4ffc-4387-a304-fb430ad2e4a6 · inbound

Efficient Pre-Training with Token Superposition cites this paper.

Efficient Pre-Training with Token Superposition Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 59

Resolution: verified exact; arxiv_id, observed 2026-05-20T22:59:11.971847Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation f7953c0e-5255-4547-aade-218bb215afe6 · inbound

Beyond Perplexity: A Geometric and Spectral Study of Low-Rank Pre-Training cites this paper.

Beyond Perplexity: A Geometric and Spectral Study of Low-Rank Pre-Training Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 25

Resolution: verified exact; arxiv_id, observed 2026-05-14T19:19:23.577938Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 25dcf6a0-b29f-4c60-a01b-df10affea01e · inbound

Beyond Perplexity: A Geometric and Spectral Study of Low-Rank Pre-Training cites this paper.

Beyond Perplexity: A Geometric and Spectral Study of Low-Rank Pre-Training Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 25

Resolution: verified exact; arxiv_id, observed 2026-05-20T20:28:59.913976Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation ce29ece4-1e27-467c-8ffe-d775327cc9b6 · inbound

NITP: Next Implicit Token Prediction for LLM Pre-training cites this paper.

NITP: Next Implicit Token Prediction for LLM Pre-training Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 53

Resolution: verified exact; arxiv_id, observed 2026-06-30T12:24:39.258946Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 4fb95c48-2318-4f41-8e05-e6852da4db63 · inbound

NITP: Next Implicit Token Prediction for LLM Pre-training cites this paper.

NITP: Next Implicit Token Prediction for LLM Pre-training Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 53

Resolution: verified exact; arxiv_id, observed 2026-07-04T00:39:16.247898Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation a1f1d358-8aa6-49fa-8bdb-b54f577e9629 · inbound

NITP: Next Implicit Token Prediction for LLM Pre-training cites this paper.

NITP: Next Implicit Token Prediction for LLM Pre-training Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 32

Resolution: unresolved; no resolver link, observed 2026-07-14T18:45:28.635910Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 38230947-1aa5-4bcb-a1c4-40a33a800e66 · inbound

Physical Object Understanding with a Physically Controllable World Model cites this paper.

Physical Object Understanding with a Physically Controllable World Model Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 43

Resolution: verified exact; arxiv_id, observed 2026-06-28T19:32:34.737365Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 9586509c-23fd-49fb-9486-ee5fb846db46 · inbound

A Geometric Characterization of the Stationary Plateau for Two-Layer Neural Networks cites this paper.

A Geometric Characterization of the Stationary Plateau for Two-Layer Neural Networks Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 33

Resolution: verified exact; arxiv_id, observed 2026-07-02T06:16:44.014554Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation df13f7f3-3663-48d7-86d1-232aeb0b4fae · inbound

Predictable Scaling Laws of Optimal Hyperparameters for LLM Continued Pre-training cites this paper.

Predictable Scaling Laws of Optimal Hyperparameters for LLM Continued Pre-training Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 21

Resolution: metadata mismatch; arxiv_id, observed 2026-07-02T12:46:56.662592Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation c22b9625-6e5c-4e86-a5a5-87199693c6e7 · inbound

On the Residual Scaling of Looped Transformers: Stability and Transferability cites this paper.

On the Residual Scaling of Looped Transformers: Stability and Transferability Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 28

Resolution: metadata mismatch; arxiv_id, observed 2026-07-03T21:08:58.376035Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation ff2bec40-5660-49f5-ad32-c9ab4dd77f72 · inbound

On the Residual Scaling of Looped Transformers: Stability and Transferability cites this paper.

On the Residual Scaling of Looped Transformers: Stability and Transferability Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 29

Resolution: metadata mismatch; arxiv_id, observed 2026-06-27T01:00:20.147453Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 1b7e697e-7f19-4b9d-a4ff-87dafb0c8516 · inbound

Towards Understanding the Power and Limits of the Muon Optimizer: A River-Valley Perspective cites this paper.

Towards Understanding the Power and Limits of the Muon Optimizer: A River-Valley Perspective Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 16

Resolution: verified exact; arxiv_id, observed 2026-07-04T06:29:38.143264Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation b4d9028b-c0ea-4c28-b0ce-6b4a96fa1e93 · inbound

Training for the Model You Return: Improving Optimization for Iterate-Averaged Language Models cites this paper.

Training for the Model You Return: Improving Optimization for Iterate-Averaged Language Models Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 37

Resolution: verified exact; arxiv_id, observed 2026-07-04T16:49:58.434221Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 0d99bf80-4423-4c4e-915d-bf09ba765d4f · inbound

Training for the Model You Return: Improving Optimization for Iterate-Averaged Language Models cites this paper.

Training for the Model You Return: Improving Optimization for Iterate-Averaged Language Models Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 37

Resolution: verified exact; arxiv_id, observed 2026-07-01T09:25:41.300839Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 17f0a578-cff1-475f-b1ad-cad8eb94c624 · inbound

WSqD: A Horizon-Free Learning Rate Schedule for Large Model Training cites this paper.

WSqD: A Horizon-Free Learning Rate Schedule for Large Model Training Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 18

Resolution: unresolved; no resolver link, observed 2026-07-14T08:04:06.432613Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f10ebdaa-b7d1-455d-80fb-0380eedbae66 · inbound

AGNFormer I: Reconstruction of AGN spectra using a probabilistic transformer model cites this paper.

AGNFormer I: Reconstruction of AGN spectra using a probabilistic transformer model Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 101

Resolution: unresolved; no resolver link, observed 2026-08-01T12:16:39.111653Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 651abc06-ade7-4366-9fc1-a69dde5ebb0e · inbound

AGNFormer I: Reconstruction of AGN spectra using a probabilistic transformer model cites this paper.

AGNFormer I: Reconstruction of AGN spectra using a probabilistic transformer model Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 153

Resolution: unresolved; no resolver link, observed 2026-08-01T12:16:45.544158Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6eb4aa11-6139-429c-b41c-b22a835280b6 · inbound

Weight-norm Criticality: A Mechanism for Loss Spikes Induced by the Normalization and Weight Decay cites this paper.

Weight-norm Criticality: A Mechanism for Loss Spikes Induced by the Normalization and Weight Decay Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 49

Resolution: unresolved; no resolver link, observed 2026-08-01T08:50:45.185948Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.