Pith. sign in

Paper Citation Record · LEDGER

Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models

As of 19 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 16 inbound Pith citation observations for arXiv:2402.19449.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2402.19449 v2

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 16 of 16 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-19T06:32:44.657259+00:00

measured 16 of 16 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-16T04:02:00.026561Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-02T23:37:27.035864Z

Reference resolution

0 of 0 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved0
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation e44d38be-0401-4187-ad20-26de2a8c7329 · inbound

Adaptive Methods through the Lens of SDEs: Theoretical Insights on the Role of Noise cites this paper.

Adaptive Methods through the Lens of SDEs: Theoretical Insights on the Role of Noise Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models

Reference 2014

Resolution
unresolved
no resolver link, observed 2026-08-12T13:54:28.824588Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T13:54:28.824588Z digest=sha256:0cf0517dfb5adbf2130f4fabe84a68ef443611c1438223318ca08cb1a5fd22f9

Observation 483bd74d-39e7-4e6f-ab3b-bc86c1cfd077 · inbound

Revisiting the Initial Steps in Adaptive Gradient Descent Optimization cites this paper.

Revisiting the Initial Steps in Adaptive Gradient Descent Optimization Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-11T23:55:18.171126Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:55:18.171126Z digest=sha256:e5b8ba427a8f0d12d23f30e9cef2f966a51bf8488e57768e960316fa20fabcf9

Observation 27594f91-5cf2-4a8b-b430-4fbd50d73a4e · inbound

SWAN: SGD with Normalization and Whitening Enables Stateless LLM Training cites this paper.

SWAN: SGD with Normalization and Whitening Enables Stateless LLM Training Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-11T13:28:28.941168Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T13:28:28.941168Z digest=sha256:d00333470c85b153505090fbbde092072f3f1a965572628c6ae197aec285ef75

Observation 2f3cd7b1-45a6-4f41-be3f-4401f52edc0a · inbound

Adaptive Batch Size Schedules for Distributed Training of Language Models with Data and Model Parallelism cites this paper.

Adaptive Batch Size Schedules for Distributed Training of Language Models with Data and Model Parallelism Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-10T23:08:28.116499Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T23:08:28.116499Z digest=sha256:bdd7669f2cd6e5f8b31839e6a04a2f38f20912ecffb427a88189911585ea27ab

Observation a77130f8-5e40-43e1-9d2b-4127d2037e90 · inbound

Class Imbalance in Anomaly Detection: Learning from an Exactly Solvable Model cites this paper.

Class Imbalance in Anomaly Detection: Learning from an Exactly Solvable Model Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-10T18:07:32.921473Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-10T18:07:32.921473Z digest=sha256:198e895a42b22e7631f5b53bff4141faff4b0472c379226142f7f33c8f0f9a68

Observation 34a40cd0-c212-4fd7-ab57-f29d81426256 · inbound

Gradient Multi-Normalization for Stateless and Scalable LLM Training cites this paper.

Gradient Multi-Normalization for Stateless and Scalable LLM Training Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-08T14:37:23.544235Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-08T14:37:23.544235Z digest=sha256:31fb243bc586d4d2c6796ea83acb583e7059cb01cf098b314a7adfe7047a6a68

Observation 4ee2ef16-3de8-498f-9667-616dc150ad73 · inbound

Improving Adaptive Moment Optimization via Preconditioner Diagonalization cites this paper.

Improving Adaptive Moment Optimization via Preconditioner Diagonalization Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-08T12:40:42.267822Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-08T12:40:42.267822Z digest=sha256:3cde360e7af33071379b8c57739a321c9e93b98d6448f8f4547182e975a81bd0

Observation b0d0ba62-37af-4f0e-bcbd-11c0dd21b4e3 · inbound

Nonlinearly Preconditioned Gradient Methods under Generalized Smoothness cites this paper.

Nonlinearly Preconditioned Gradient Methods under Generalized Smoothness Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-08T04:56:54.561543Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:56:54.561543Z digest=sha256:21f27d0aa9f437aa9d85156456c839af636e517eca2c22e2af75b0bc6db56e8b

Observation 93b8ace5-b1e8-41e7-976f-b4ee1f3a29da · inbound

Is your batch size the problem? Revisiting the Adam-SGD gap in language modeling cites this paper.

Is your batch size the problem? Revisiting the Adam-SGD gap in language modeling Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-07T00:50:30.584903Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T00:50:30.584903Z digest=sha256:ccd7557cc2e9e7be0aaf2e7e335ddead3cd294a8c0e00502189b2161939839ff

Observation 695b4b05-6208-440c-9b30-0ffb1201aa38 · inbound

Simple Convergence Proof of Adam From a Sign-like Descent Perspective cites this paper.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-06T19:25:24.881398Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:25:24.881398Z digest=sha256:6b065b3bcf51b8cf3b44190db196976a5fa69d8f093bb28ec943001226fcdd70

Observation 03e8a653-b280-4c7a-9d79-158e223e8596 · inbound

SoftSignSGD(S3): An Enhanced Optimizer for Practical DNN Training and Loss Spikes Minimization Beyond Adam cites this paper.

SoftSignSGD(S3): An Enhanced Optimizer for Practical DNN Training and Loss Spikes Minimization Beyond Adam Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-06T19:10:16.543726Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:10:16.543726Z digest=sha256:120daaedc969498c3a3719b362b51f59d5397c080360999b5b1439e57264188a

Observation 804db7b2-bcdb-4899-85ca-a5638c30b740 · inbound

On the Performance of Differentially Private Optimization with Heavy-Tail Class Imbalance cites this paper.

On the Performance of Differentially Private Optimization with Heavy-Tail Class Imbalance Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-06T17:35:00.523005Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T17:35:00.523005Z digest=sha256:ef384d8b468ac339c98936846411e87c43eec89c2feb02b1e7692a171d34eec7

Observation 9c2a846a-b032-4017-be1b-a5bf448f13cf · inbound

Enhancing Optimizer Stability: Momentum Adaptation of The NGN Step-size cites this paper.

Enhancing Optimizer Stability: Momentum Adaptation of The NGN Step-size Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models

Reference 43

Resolution
unresolved
no resolver link, observed 2026-08-16T04:02:00.026561Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-16T04:02:00.026561Z digest=sha256:f859e90810d0edf7d42a948ae62a1dedcabdbf8e9132f152725ebf5f60a50082

Observation 220bfc87-8221-47cc-b5a2-1361fcbafb40 · inbound

Cornerstones or Stumbling Blocks? Deciphering the Rock Tokens in On-Policy Distillation cites this paper.

Cornerstones or Stumbling Blocks? Deciphering the Rock Tokens in On-Policy Distillation Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models

Reference 16

Resolution
verified exact
arxiv_id, observed 2026-05-12T07:31:35.949353Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-05-12T02:32:09.080336Z digest=sha256:0d4fa57e10701dfb39a99bf7517c3b4f5021a73abca1ff8e16933040b1be0438

Observation 9660cd88-0dd3-4a6a-b3ac-3a2905a11290 · inbound

Cornerstones or Stumbling Blocks? Deciphering the Rock Tokens in On-Policy Distillation cites this paper.

Cornerstones or Stumbling Blocks? Deciphering the Rock Tokens in On-Policy Distillation Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models

Reference 31

Resolution
verified exact
arxiv_id, observed 2026-07-01T13:45:45.699212Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-06-30T22:52:01.824412Z digest=sha256:f1ccb2c10d26ba05c3ae025aa275c501e684da7b9a599b8062e6995f32c478ee

Observation a90c3278-5f69-4580-a59f-b32941ed8761 · inbound

Cornerstones or Stumbling Blocks? Deciphering the Rock Tokens in On-Policy Distillation cites this paper.

Cornerstones or Stumbling Blocks? Deciphering the Rock Tokens in On-Policy Distillation Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models

Reference 31

Resolution
verified exact
arxiv_id, observed 2026-07-02T23:37:27.037144Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-07-02T23:34:26.508233Z digest=sha256:e4a5c28a36f73c87d5408e16b000d32d3de3a97b0deaa56926b4cf200608cc8f