Pith. sign in

Paper Citation Record · LEDGER

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler

As of 9 August 2026, this Paper Citation Record lists 25 of 25 outbound references and 3 inbound Pith citation observations for arXiv:2508.01483.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2508.01483 v1

Coverage vector

measured 25 of 25 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T05:55:59.258807Z

measured 28 of 28 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 3 of 3 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-04T12:38:54.214964Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-01T07:35:29.145833Z

Reference resolution

25 of 25 outbound references displayed

  • verified exact1
  • verified fuzzy7
  • unresolved14
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch3

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation e64f15ae-2dd7-4dc1-b24f-663b9b1d1926 · outbound

This paper cites The 210M parameter model is used in the majority of the experiments.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler The 210M parameter model is used in the majority of the experiments

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T05:55:59.537123Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T05:55:59.236650Z digest=sha256:4530390b0aa22a55adc3d814b270e1d6051c56ee3c63d829eef2eff75c15b7aa

Observation ad4e3efd-a260-4745-9c5b-3f30696613ab · outbound

This paper cites All runs are trained with bfloat16 automatic mixed precision.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler All runs are trained with bfloat16 automatic mixed precision

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T05:55:59.547942Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T05:55:59.232940Z digest=sha256:68c963d1e7e2b97e0b3887ab1c9364535570d25d1001f125612f28b6c025e873

Observation 2115d95b-9171-448a-a406-aa00182860b1 · outbound

This paper cites An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.183667Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.183667Z digest=sha256:655a4f9eae86992db7564bf38263a914a63f1a2088ab90d5f3b3f123bc106df1

Observation d412c8ff-fcee-4fd4-822c-7e428aa65de8 · outbound

This paper cites Wide-minima Density Hypothesis and the Explore-Exploit Learning Rate Schedule.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Wide-minima Density Hypothesis and the Explore-Exploit Learning Rate Schedule

Reference 7

Resolution
metadata mismatch
local_arxiv, observed 2026-08-06T05:55:59.358651Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T05:55:59.191450Z digest=sha256:0d1614fcba6d6818b89335e68248c655f94a2ab8a3b3ded7e5838491374021f6

Observation 69dd7595-67b5-4912-b7db-73a62bd9bab1 · outbound

This paper cites Beyond Cosine Decay: On the effectiveness of Infinite Learning Rate Schedule for Continual Pre-training.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Beyond Cosine Decay: On the effectiveness of Infinite Learning Rate Schedule for Continual Pre-training

Reference 8

Resolution
metadata mismatch
local_arxiv, observed 2026-08-06T05:55:59.344185Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T05:55:59.195570Z digest=sha256:abb057c66d5e513395e97e3ee56ffc8f80523fcf79a7296e73a813debebed255

Observation 4353f7bc-a0b3-4d53-84e0-45d0af8c4c6c · outbound

This paper cites an unresolved cited work.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-08-06T05:55:59.591293Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T05:55:59.203520Z digest=sha256:3dfaad6b3f5d0e4028b429e4765208e844b8690b8ec1a7eca6e5c90e96ee2626

Observation b9426328-c111-4b69-b3a0-8f8b51c52533 · outbound

This paper cites doi: 10.18653/v1/2024.acl-long.293.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler doi: 10.18653/v1/2024.acl-long.293

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.207072Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.207072Z digest=sha256:7abf9f9abca0e75471d9e015f90454deee9c52aa7d7a30d1728e641c3e4e83ab

Observation ef360291-23dc-49cf-b3a7-df6e3df566fc · outbound

This paper cites Don't Decay the Learning Rate, Increase the Batch Size.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Don't Decay the Learning Rate, Increase the Batch Size

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.210656Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.210656Z digest=sha256:683d452a519bcd775fa7b61467669fbdb4c2448d7b15fd46481ce54c80c0dbe0

Observation bf2116aa-d4ff-40e6-863b-a992720fe400 · outbound

This paper cites Shreyas Subramanian, Vignesh Ganapathiraman, and Corey D Barrett.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Shreyas Subramanian, Vignesh Ganapathiraman, and Corey D Barrett

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T05:55:59.580840Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T05:55:59.214720Z digest=sha256:9783de7ea1db68be7c965b2deaf09d4f8506f8771a8599f23347c97d33b97396

Observation f580f63f-e4c4-4652-8135-ac6ad900a171 · outbound

This paper cites doi: 10.18653/v1/2024.findings-emnlp.954.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler doi: 10.18653/v1/2024.findings-emnlp.954

Reference 14

Resolution
verified exact
doi, observed 2026-08-06T05:55:59.290875Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T05:55:59.218248Z digest=sha256:0776a5815b58e4a1e54f5e2ef45878675298c0ce8135fd1a985bfaad3dc6b5e5

Observation 5f0e8e74-056e-4c73-a84c-aa0ac1620d68 · outbound

This paper cites LLaMA: Open and Efficient Foundation Language Models.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler LLaMA: Open and Efficient Foundation Language Models

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.221774Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.221774Z digest=sha256:e5662a60e6aa01f7496803b81e167c84efc5a7a40f387c3b4b08d9017a8d9bb6

Observation 9a27deff-1654-4ae9-bb7c-f62815412d85 · outbound

This paper cites 16 Published in Transactions on Machine Learning Research (08/2025) Mitchell Wortsman, Gabriel Ilharco, Samir Yitzhak Gadre, Rebecca Roelofs, Raphael Gontijo-Lopes, Ari S.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler 16 Published in Transactions on Machine Learning Research (08/2025) Mitchell Wortsman, Gabriel Ilharco, Samir Yitzhak Gadre, Rebecca Roelofs, Raphael Gontijo-Lopes, Ari S

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T05:55:59.569801Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T05:55:59.225701Z digest=sha256:5458a5539c955374466cfffbce7e5c73c43e1656728213271e0753ca493bd6bb

Observation a80fc90e-720b-48d2-aac3-1bb7e1a9176a · outbound

This paper cites 17 Published in Transactions on Machine Learning Research (08/2025) A Experiments Context The experimental setup mirrors that of Hägele et al.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler 17 Published in Transactions on Machine Learning Research (08/2025) A Experiments Context The experimental setup mirrors that of Hägele et al

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T05:55:59.558978Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T05:55:59.229131Z digest=sha256:2de5d32a38fff2cb7fa0f322fcd66279e42cfe589ee0f9aa47bd94a4720e1da1

Observation 02a056cd-9cb2-4ee4-b63b-3d86532566e0 · outbound

This paper cites an unresolved cited work.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-06T05:55:59.504163Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T05:55:59.247298Z digest=sha256:52ec06069017ddf7309b342e817f1c4d5ac8147f5a14146d36efede3b8180ba2

Observation a970ca86-da9b-4405-a693-f1ebf87989f5 · outbound

This paper cites Presumably, variations between plots should become less noticeable with an increase in the number of experiments with different data permutations.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Presumably, variations between plots should become less noticeable with an increase in the number of experiments with different data permutations

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T05:55:59.525954Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T05:55:59.240218Z digest=sha256:912b7f2d913568492d4906a4f5ebe19998d2a776d93ff4eeb9de3c5748b12c8c

Observation c25cd938-6e2b-45ef-ad7b-7af13e4b9ebd · outbound

This paper cites an unresolved cited work.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Unresolved cited work

Reference 21

Resolution
unresolved
raw_fallback, observed 2026-08-06T05:55:59.514509Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T05:55:59.243991Z digest=sha256:cd2e69e4d4a70658b6acca51e1862dd4abfe3c4cbb77528d7e685c90a66b0a05

Observation a0b0458f-e33c-4606-a9ec-b0316251651e · outbound

This paper cites an unresolved cited work.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Unresolved cited work

Reference 24

Resolution
unresolved
raw_fallback, observed 2026-08-06T05:55:59.492461Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T05:55:59.251270Z digest=sha256:f0a469569d4009d5acbc03928cf429d3e91057addd702e40fc0761891f5a0cdf

Observation 4a2350c0-b7da-4a76-8039-e8a11de5be3f · outbound

This paper cites effective learning rate.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler effective learning rate

Reference 25

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T05:55:59.481617Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T05:55:59.254943Z digest=sha256:505097a06e2f8df305632565c5da5fabf17adea040dfa516c02682ad08c22b8f

Observation c67ab800-5a04-4d09-90ed-1fafb9fda031 · outbound

This paper cites an unresolved cited work.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-08-06T05:55:59.470768Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T05:55:59.258807Z digest=sha256:23fe26b9d16dcd46cdc51d598944e5cb5d8299599ad2969a20ca7eb131d663a2

Observation b51ce19c-d957-49fd-ba5d-2ceab981533c · outbound

This paper cites Rotational Equilibrium: How Weight Decay Balances Learning Across Neural Networks.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Rotational Equilibrium: How Weight Decay Balances Learning Across Neural Networks

Reference 2017

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.199656Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.199656Z digest=sha256:aa3fc69fc2bf718816da3d84d0130cd01a1b2b5e77c462cbe5eca09df819a731

Observation 3860b738-1439-4bf8-9137-5dd28d9283b6 · outbound

This paper cites Online Normalization for Training Neural Networks.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Online Normalization for Training Neural Networks

Reference 2019

Resolution
metadata mismatch
local_arxiv, observed 2026-08-06T05:55:59.392100Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T05:55:59.175107Z digest=sha256:3f502198b1f533c87a09c7addaf8327bbb2293275b2962ba6bf518d2ecaed840

Observation 79e55738-1928-4437-b9db-ff79d9374f41 · outbound

This paper cites The Step Decay Schedule: A Near Optimal, Geometrically Decaying Learning Rate Procedure For Least Squares.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler The Step Decay Schedule: A Near Optimal, Geometrically Decaying Learning Rate Procedure For Least Squares

Reference 2020

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.187523Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.187523Z digest=sha256:1532ffa54382cedcd017cec58f60f202549c13aa771e7de25d820fe855489593

Observation 9f4e2581-7596-42f5-ae26-ee771dafc909 · outbound

This paper cites an unresolved cited work.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Unresolved cited work

Reference 2023

Resolution
unresolved
raw_fallback, observed 2026-08-06T05:55:59.601287Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T05:55:59.179408Z digest=sha256:ea665ef348d24b83dc5907853f8173e1d17851f009f60931e6274fc24f7d2bd6

Observation e5e79c72-541b-441f-8e96-9ab167de6dba · outbound

This paper cites Shane Bergsma, Nolan Dey, Gurpreet Gosal, Gavia Gray, Daria Soboleva, and Joel Hestness.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Shane Bergsma, Nolan Dey, Gurpreet Gosal, Gavia Gray, Daria Soboleva, and Joel Hestness

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.166459Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.166459Z digest=sha256:2ea0fef5aa6e923723ed21a2339f31d3beadff17deff333256d6cf473c26db7e

Observation 1b48094d-8215-4781-b2fe-76fcf80fa2e7 · outbound

This paper cites DeepSeek LLM: Scaling Open-Source Language Models with Longtermism.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler DeepSeek LLM: Scaling Open-Source Language Models with Longtermism

Reference 2025

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.170814Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.170814Z digest=sha256:1a28b55a62ea2375770d5d354ad8ac93a9ba7a56215c9d332e32ef84e519e74b

Pith citing papers

Observation a5ed8a55-fe3a-47d2-8dbc-4f922557ea2f · inbound

Why Do We Need Warm-up? A Theoretical Perspective cites this paper.

Why Do We Need Warm-up? A Theoretical Perspective Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-04T12:38:54.214964Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T12:38:54.214964Z digest=sha256:8f8b983edf17835c6790e625939cc0aaf401829084e3ff4842dee56e249c80d3

Observation ef85312c-51f3-4c57-95ef-b567d5823845 · inbound

Sparse Layers are Critical to Scaling Looped Language Models cites this paper.

Sparse Layers are Critical to Scaling Looped Language Models Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler

Reference 23

Resolution
verified exact
arxiv_id, observed 2026-05-12T06:21:28.309833Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-12T04:19:12.696712Z digest=sha256:9d9fe9ce1934591bad997116353a0c714e7f0e4d322911275ce7188bd1cb814b

Observation 912ed991-2177-4a6b-84d1-51791829ffd9 · inbound

Sparse Layers are Critical to Scaling Looped Language Models cites this paper.

Sparse Layers are Critical to Scaling Looped Language Models Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler

Reference 23

Resolution
verified exact
arxiv_id, observed 2026-07-01T07:35:29.147307Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-07-01T07:26:37.559459Z digest=sha256:b4ba6240ceb91c34ceb0fdba061f045f1690872865d83d4bb9ab9cafc03d44f9