Pith. sign in

Paper Citation Record · LEDGER

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler

As of 20 August 2026, this Paper Citation Record lists 25 of 25 outbound references and 3 inbound Pith citation observations for arXiv:2508.01483.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2508.01483 v1

Coverage vector

measured 25 of 25 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T05:55:59.258807Z

measured 28 of 28 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-19T06:32:44.657259+00:00

measured 3 of 3 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-04T12:38:54.214964Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-01T07:35:29.145833Z

Reference resolution

25 of 25 outbound references displayed

  • verified exact1
  • verified fuzzy7
  • unresolved14
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch3

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation e64f15ae-2dd7-4dc1-b24f-663b9b1d1926 · outbound

This paper cites The 210M parameter model is used in the majority of the experiments.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler The 210M parameter model is used in the majority of the experiments

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T05:55:59.537123Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T05:55:59.236650Z digest=sha256:e2b570f757734c63db6febb2ff93f54a6070ddc04cce680fa5a5c9b7a553b288

Observation ad4e3efd-a260-4745-9c5b-3f30696613ab · outbound

This paper cites All runs are trained with bfloat16 automatic mixed precision.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler All runs are trained with bfloat16 automatic mixed precision

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T05:55:59.547942Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T05:55:59.232940Z digest=sha256:c76c118f922c7192f2f43133e471989381c0ae3fefa7a7d046ec4185c6b069d7

Observation 2115d95b-9171-448a-a406-aa00182860b1 · outbound

This paper cites An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.183667Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.183667Z digest=sha256:c8e3948d6a19d4813258326ac044f8cdb3de2729934e0cc22268f5dbdc2ccf20

Observation d412c8ff-fcee-4fd4-822c-7e428aa65de8 · outbound

This paper cites Wide-minima Density Hypothesis and the Explore-Exploit Learning Rate Schedule.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Wide-minima Density Hypothesis and the Explore-Exploit Learning Rate Schedule

Reference 7

Resolution
metadata mismatch
local_arxiv, observed 2026-08-06T05:55:59.358651Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T05:55:59.191450Z digest=sha256:8ec42227204a69f22720e0ce089f248f7fb2de8e5c6eaf68383c9a6614ae53d0

Observation 69dd7595-67b5-4912-b7db-73a62bd9bab1 · outbound

This paper cites Beyond Cosine Decay: On the effectiveness of Infinite Learning Rate Schedule for Continual Pre-training.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Beyond Cosine Decay: On the effectiveness of Infinite Learning Rate Schedule for Continual Pre-training

Reference 8

Resolution
metadata mismatch
local_arxiv, observed 2026-08-06T05:55:59.344185Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T05:55:59.195570Z digest=sha256:1396a8f8f7b8daa5ec0053619654cceb7d2f555b0212044715f08ec6fc100ba8

Observation 4353f7bc-a0b3-4d53-84e0-45d0af8c4c6c · outbound

This paper cites an unresolved cited work.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-08-06T05:55:59.591293Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T05:55:59.203520Z digest=sha256:85e706ac16cf08003d94ebbe24ccd5296ca150c8ffb82033d62b5be9aad0ee12

Observation b9426328-c111-4b69-b3a0-8f8b51c52533 · outbound

This paper cites doi: 10.18653/v1/2024.acl-long.293.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler doi: 10.18653/v1/2024.acl-long.293

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.207072Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.207072Z digest=sha256:d212728ed4b577bb4cbe62d9dcb2be8daecbfb9b1268d7fe41c8c7c19806d43c

Observation ef360291-23dc-49cf-b3a7-df6e3df566fc · outbound

This paper cites Don't Decay the Learning Rate, Increase the Batch Size.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Don't Decay the Learning Rate, Increase the Batch Size

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.210656Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.210656Z digest=sha256:d635d979bafa12c3cd6f213e88a391f3a7dfa62a3f7203095c83f2eef3e4d97b

Observation bf2116aa-d4ff-40e6-863b-a992720fe400 · outbound

This paper cites Shreyas Subramanian, Vignesh Ganapathiraman, and Corey D Barrett.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Shreyas Subramanian, Vignesh Ganapathiraman, and Corey D Barrett

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T05:55:59.580840Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T05:55:59.214720Z digest=sha256:08360146979808e7905acd11c89600790977f577943cd8195ef0063f55ddf44c

Observation f580f63f-e4c4-4652-8135-ac6ad900a171 · outbound

This paper cites doi: 10.18653/v1/2024.findings-emnlp.954.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler doi: 10.18653/v1/2024.findings-emnlp.954

Reference 14

Resolution
verified exact
doi, observed 2026-08-06T05:55:59.290875Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T05:55:59.218248Z digest=sha256:1af2587baa6f4e9377fa5ed9fe16910ba7a81e1f7e8dedfd12c37db23d2674b5

Observation 5f0e8e74-056e-4c73-a84c-aa0ac1620d68 · outbound

This paper cites LLaMA: Open and Efficient Foundation Language Models.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler LLaMA: Open and Efficient Foundation Language Models

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.221774Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.221774Z digest=sha256:5bcef9fa72dcc3490cd572c8c09a8bab4a2e8e02b04d12dd08e84421d063d4ec

Observation 9a27deff-1654-4ae9-bb7c-f62815412d85 · outbound

This paper cites 16 Published in Transactions on Machine Learning Research (08/2025) Mitchell Wortsman, Gabriel Ilharco, Samir Yitzhak Gadre, Rebecca Roelofs, Raphael Gontijo-Lopes, Ari S.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler 16 Published in Transactions on Machine Learning Research (08/2025) Mitchell Wortsman, Gabriel Ilharco, Samir Yitzhak Gadre, Rebecca Roelofs, Raphael Gontijo-Lopes, Ari S

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T05:55:59.569801Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T05:55:59.225701Z digest=sha256:e03846b1533f91d96a1f244ee91eea27f2a848a05a5b6a984ebb368be4413913

Observation a80fc90e-720b-48d2-aac3-1bb7e1a9176a · outbound

This paper cites 17 Published in Transactions on Machine Learning Research (08/2025) A Experiments Context The experimental setup mirrors that of Hägele et al.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler 17 Published in Transactions on Machine Learning Research (08/2025) A Experiments Context The experimental setup mirrors that of Hägele et al

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T05:55:59.558978Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T05:55:59.229131Z digest=sha256:513ae9ca33ef2cb3d7339f6686e3c9fe31216ec188e8fbef0990a3492f071554

Observation 02a056cd-9cb2-4ee4-b63b-3d86532566e0 · outbound

This paper cites an unresolved cited work.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-06T05:55:59.504163Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T05:55:59.247298Z digest=sha256:e1f7997a4aed92b32a6044fa3d22bcb939d745c618aa45b7104be573b6e28ae8

Observation a970ca86-da9b-4405-a693-f1ebf87989f5 · outbound

This paper cites Presumably, variations between plots should become less noticeable with an increase in the number of experiments with different data permutations.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Presumably, variations between plots should become less noticeable with an increase in the number of experiments with different data permutations

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T05:55:59.525954Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T05:55:59.240218Z digest=sha256:be46df39c96d4cc5605df5e91bae1387456bce4bbd964a60e8246e7b8023a2c7

Observation c25cd938-6e2b-45ef-ad7b-7af13e4b9ebd · outbound

This paper cites an unresolved cited work.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Unresolved cited work

Reference 21

Resolution
unresolved
raw_fallback, observed 2026-08-06T05:55:59.514509Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T05:55:59.243991Z digest=sha256:7a0722afdbf836b2211768ee0e415a970b089e43c044def3e96b954b4152c1de

Observation a0b0458f-e33c-4606-a9ec-b0316251651e · outbound

This paper cites an unresolved cited work.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Unresolved cited work

Reference 24

Resolution
unresolved
raw_fallback, observed 2026-08-06T05:55:59.492461Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T05:55:59.251270Z digest=sha256:19e7f57ed571e77aaa661ddc0f346e8c7a9b3ab1444cd587a2c8fd41a548413a

Observation 4a2350c0-b7da-4a76-8039-e8a11de5be3f · outbound

This paper cites effective learning rate.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler effective learning rate

Reference 25

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T05:55:59.481617Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T05:55:59.254943Z digest=sha256:a246014d150ff8550e8ebf6cf9436b93506ff959f7d393519fcbdb59497eea5f

Observation c67ab800-5a04-4d09-90ed-1fafb9fda031 · outbound

This paper cites an unresolved cited work.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-08-06T05:55:59.470768Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T05:55:59.258807Z digest=sha256:9f216739fe892aa811c23b0ebca446a3ccf60ba4f08e03b50a27bd5ad489c08d

Observation b51ce19c-d957-49fd-ba5d-2ceab981533c · outbound

This paper cites Rotational Equilibrium: How Weight Decay Balances Learning Across Neural Networks.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Rotational Equilibrium: How Weight Decay Balances Learning Across Neural Networks

Reference 2017

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.199656Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.199656Z digest=sha256:2f6eb793600a4b14696274331af962cfb3217f9566956d52b1d0d51efe4c57f9

Observation 3860b738-1439-4bf8-9137-5dd28d9283b6 · outbound

This paper cites Online Normalization for Training Neural Networks.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Online Normalization for Training Neural Networks

Reference 2019

Resolution
metadata mismatch
local_arxiv, observed 2026-08-06T05:55:59.392100Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T05:55:59.175107Z digest=sha256:161eb9c186b777ffaff5bbb587bbe5b68639b3dd96e39c25dbad526fb68782dc

Observation 79e55738-1928-4437-b9db-ff79d9374f41 · outbound

This paper cites The Step Decay Schedule: A Near Optimal, Geometrically Decaying Learning Rate Procedure For Least Squares.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler The Step Decay Schedule: A Near Optimal, Geometrically Decaying Learning Rate Procedure For Least Squares

Reference 2020

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.187523Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.187523Z digest=sha256:7da519878c69c8215f25f0718ab70646277c5667f0483e3f1f0a0949772b37e9

Observation 9f4e2581-7596-42f5-ae26-ee771dafc909 · outbound

This paper cites an unresolved cited work.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Unresolved cited work

Reference 2023

Resolution
unresolved
raw_fallback, observed 2026-08-06T05:55:59.601287Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-06T05:55:59.179408Z digest=sha256:7253d1ebae0d8b2624f1207483520cb91eb915df456801e6e3f3af1014d30d0a

Observation e5e79c72-541b-441f-8e96-9ab167de6dba · outbound

This paper cites Shane Bergsma, Nolan Dey, Gurpreet Gosal, Gavia Gray, Daria Soboleva, and Joel Hestness.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Shane Bergsma, Nolan Dey, Gurpreet Gosal, Gavia Gray, Daria Soboleva, and Joel Hestness

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.166459Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.166459Z digest=sha256:1090fa2cacbe5951f908470e1e084edbd9c14f64d90c0a3c31a575dc3a93a9cc

Observation 1b48094d-8215-4781-b2fe-76fcf80fa2e7 · outbound

This paper cites DeepSeek LLM: Scaling Open-Source Language Models with Longtermism.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler DeepSeek LLM: Scaling Open-Source Language Models with Longtermism

Reference 2025

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.170814Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.170814Z digest=sha256:015bf39408f96bd27aba405fe5f7c0612d5bf79470cec7a5b76c297ebfcf2724

Pith citing papers

Observation a5ed8a55-fe3a-47d2-8dbc-4f922557ea2f · inbound

Why Do We Need Warm-up? A Theoretical Perspective cites this paper.

Why Do We Need Warm-up? A Theoretical Perspective Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-04T12:38:54.214964Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T12:38:54.214964Z digest=sha256:f078aa18a29fc260f0268900b736027b9afaaa35c787e5abfc167c0533d85c88

Observation ef85312c-51f3-4c57-95ef-b567d5823845 · inbound

Sparse Layers are Critical to Scaling Looped Language Models cites this paper.

Sparse Layers are Critical to Scaling Looped Language Models Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler

Reference 23

Resolution
verified exact
arxiv_id, observed 2026-05-12T06:21:28.309833Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-05-12T04:19:12.696712Z digest=sha256:eaa583be24416a86558c562c162161b7b221a213595cec251bffb3ba6e637d11

Observation 912ed991-2177-4a6b-84d1-51791829ffd9 · inbound

Sparse Layers are Critical to Scaling Looped Language Models cites this paper.

Sparse Layers are Critical to Scaling Looped Language Models Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler

Reference 23

Resolution
verified exact
arxiv_id, observed 2026-07-01T07:35:29.147307Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-07-01T07:26:37.559459Z digest=sha256:55b36bc77b124e0e941c564ec0fceff210f5ef34184060ec171c9173effab430