Pith. sign in

Paper Citation Record · LEDGER

The Effect of Mini-Batch Noise on the Implicit Bias of Adam

As of 5 August 2026, this Paper Citation Record lists 83 of 83 outbound references and 2 inbound Pith citation observations for arXiv:2602.01642.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2602.01642 v2

Coverage vector

measured 83 of 83 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-05-16T08:03:15.785558Z

measured 85 of 85 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-05T06:32:48.257954+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-07-31T02:16:07.806062Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-06-29T13:23:28.008798Z

Reference resolution

83 of 83 outbound references displayed

  • verified exact11
  • verified fuzzy69
  • unresolved1
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 259a5dbe-1e12-4cb3-985c-6e31e3399b34 · outbound

This paper cites A Modern Look at the Relationship between Sharpness and Generalization.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam A Modern Look at the Relationship between Sharpness and Generalization

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.246637Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:581dcfc630d1a51a6a77138a5bb65fd67bc9d7790c74609655196fd705591ab5

Observation a533e2f3-9ffa-4cab-b4f4-049b60b6fd57 · outbound

This paper cites an unresolved cited work.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Unresolved cited work

Reference 2

Resolution
unresolved
raw_fallback, observed 2026-05-16T08:07:35.238921Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:faf20a513423e24f6d19a9a870e7ddbdca78530007348b2fc4c5ff5ffea602e2

Observation 832dfbf4-560c-4635-bfac-10550e5fb72f · outbound

This paper cites PaLM 2 Technical Report.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam PaLM 2 Technical Report

Reference 3

Resolution
verified exact
local_arxiv, observed 2026-05-16T08:07:34.265810Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:ebdc57953aaa49f424be84b162bbb5494e16e80226137b2656d313226dd47037

Observation fcc4ad15-7c84-43dd-8711-7f9c86f30fae · outbound

This paper cites Understanding Gradient Descent on the Edge of Stability in Deep Learning.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Understanding Gradient Descent on the Edge of Stability in Deep Learning

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.236583Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:1eda2b91f245171eee5f7bf54591c63d660cc9d2543a28646909b280a8d4a608

Observation 3c4586db-93d4-4e53-8b83-8117d975a3b4 · outbound

This paper cites Implicit Gradient Regularization.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Implicit Gradient Regularization

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.223668Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:1dc432a38d32f2a98b6ab280daa546b80393cfff95a5a999cab2442cfbfc06a1

Observation 95bf7d69-9f6e-4e84-8459-38618df4df00 · outbound

This paper cites On the Trajectories of SGD Without Replacement.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam On the Trajectories of SGD Without Replacement

Reference 6

Resolution
verified exact
arxiv_id, observed 2026-05-16T08:07:34.276285Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:511c1539052371e7acbe4ffbb4a95ab17e304c40591b21def297d43847acce94

Observation f31f9aa9-6dfd-4b89-a186-fece1de3b5d5 · outbound

This paper cites Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.211674Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:1a3e60f9f8be7c3aa93f508a058a660ff09c5cf4612d212ac50d6980e786bdf7

Observation 69b6e555-57d5-46c8-a352-496faf4932bd · outbound

This paper cites Language Models are Few-Shot Learners.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Language Models are Few-Shot Learners

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.195085Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:da9f6b912fb7403800f8635b43d70f61499cebf329f24967b0b78f915d0b3206

Observation 4ca4f547-2f58-42fb-a328-998492640079 · outbound

This paper cites Modified Loss of Momentum Gradient Descent: Fine-Grained Analysis.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Modified Loss of Momentum Gradient Descent: Fine-Grained Analysis

Reference 10

Resolution
verified exact
arxiv_id, observed 2026-05-16T08:07:34.259449Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:90510c09c2b2f4b2a8aec0ee3fc8032fafbe3d2507b6bd9ef9e3cf8a431fbd73

Observation bf2f534f-af61-444e-8a55-98e4085e8553 · outbound

This paper cites On the Implicit Bias of Adam.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam On the Implicit Bias of Adam

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.372671Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:571e47e1ca9f62af950a72e7a2fe89992f57ddd3d5d3169794d5257dea8d895e

Observation de1913af-4a88-4af9-9387-2cece511f947 · outbound

This paper cites How Memory in Optimization Algorithms Implicitly Modifies the Loss.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam How Memory in Optimization Algorithms Implicitly Modifies the Loss

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.370174Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:696995eb6f78a066e01da0961360374fa0b10c78e9cbdee1c695a80e184169f5

Observation 288e2e44-c8f7-4195-a98d-49667f2f01fe · outbound

This paper cites Adaptive Methods through the Lens of SDEs: Theoretical Insights on the Role of Noise.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Adaptive Methods through the Lens of SDEs: Theoretical Insights on the Role of Noise

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.360484Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:9406b76f148deaa342b9851d080dfb514f723bb03770010f38decd090559ff05

Observation 39d63884-eab0-4a5c-a984-123f67e4453a · outbound

This paper cites Transformer-XL: Attentive Language Models beyond a Fixed-Length Context.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Transformer-XL: Attentive Language Models beyond a Fixed-Length Context

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.357917Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:b4f5f433b29fde07f36b864154039b5f317a3adc8ce69fcda30af3f9e7166ca6

Observation a27417ed-ba7b-4007-b894-955050653dc5 · outbound

This paper cites Label Noise SGD Provably Prefers Flat Global Minimizers.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Label Noise SGD Provably Prefers Flat Global Minimizers

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.350708Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:6eb918e9973ca9fa3465f45eb07537d4449bb6b3f36d4469185e1984cc094214

Observation 19ef7a89-f00f-4b49-867c-c89b776e2aca · outbound

This paper cites Sharp Minima Can Generalize For Deep Nets.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Sharp Minima Can Generalize For Deep Nets

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.343325Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:772f5360b1deb7942cb52796e2dc65d576463b24fa5f63e1fa3772f4abb5c2c6

Observation ec112a9b-32ee-4cd2-998e-05a859f10aef · outbound

This paper cites Sharpness-Aware Training for Free.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Sharpness-Aware Training for Free

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.337836Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:c0c22aba1781bb5e80e81a5a93363477200b08e3c998c9ae3a182653365f6cc4

Observation bd88e28f-76a8-4314-b1b3-6176656ec2e8 · outbound

This paper cites The Llama 3 Herd of Models.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam The Llama 3 Herd of Models

Reference 18

Resolution
verified exact
local_arxiv, observed 2026-05-16T08:07:34.286211Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:1bce53beaab9968afb219e10d3ea2c326b8f555e579424004998a67936c492ff

Observation d34315e8-9353-4a4c-a54c-67bf0db3f645 · outbound

This paper cites Multiscale analysis of accelerated gradient methods.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Multiscale analysis of accelerated gradient methods

Reference 19

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.334871Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:f18fc95fcb14c6d9a54f3967bcf8613ae0ff095ac54eed02cf8557cbf68cfa3e

Observation 087abeef-3820-45d6-bc1a-9c840dbca434 · outbound

This paper cites Sharpness-aware Minimization for Efficiently Improving Generalization.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Sharpness-aware Minimization for Efficiently Improving Generalization

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.331872Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:03b714646248af70c158a9a5f254bf3d2a828c49a8184e450cd73659e8f96400

Observation c085a2bc-86d8-4286-b237-a8ac2d64dc72 · outbound

This paper cites Implicit regularization in Heavy-ball momentum accelerated stochastic gradient descent.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Implicit regularization in Heavy-ball momentum accelerated stochastic gradient descent

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.329287Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:93fb7db6114a4b14f4b3b664ad8f8e3d84a32380b0a4f5b8efa231fdee3f2bda

Observation f9c1d5f4-1f30-4b02-948e-7f0625c3448a · outbound

This paper cites Characterizing implicit bias in terms of optimization geometry.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Characterizing implicit bias in terms of optimization geometry

Reference 22

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.326617Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:8420586d7f79033a9a64ed054ddc416f3d1ae2570bba84f2b42558a364ee4ecc

Observation 1c031d9d-7154-464f-af34-4fe6b2e02efd · outbound

This paper cites Implicit bias of gradient descent on linear convolutional networks.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Implicit bias of gradient descent on linear convolutional networks

Reference 23

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.323986Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:d7195d549a044010a343548e2268600da7849e34ec0378140d3d22b8404468b0

Observation 110bb86e-2414-4948-926a-0b868e5a835d · outbound

This paper cites SIMPLIFYING NEURAL NETS BY DISCOVERING FLAT MINIMA.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam SIMPLIFYING NEURAL NETS BY DISCOVERING FLAT MINIMA

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.321510Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:850a2b401eb94a9ac5259af48d5aa2cd54929315bb1958bf2e8f3b7b43525cdd

Observation aa510e92-fd0c-48ed-864f-a93649d437f8 · outbound

This paper cites Directional convergence and alignment in deep learning.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Directional convergence and alignment in deep learning

Reference 25

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.319080Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:923c63e74940854eb7783cbf90736ff097d3c2c40245b264c6d7f466c372fd63

Observation 64d2a43b-906c-4817-870c-e6afb88a40a6 · outbound

This paper cites Gradient descent aligns the layers of deep linear networks.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Gradient descent aligns the layers of deep linear networks

Reference 26

Resolution
verified exact
local_arxiv, observed 2026-05-16T08:07:34.293910Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:704908b28433c33673c08167ac7ca50273d9c4add2f281de1054374621437857

Observation 3cb1b50a-8ac2-4b01-85db-9d4476b1c361 · outbound

This paper cites Risk and parameter convergence of logistic regression.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Risk and parameter convergence of logistic regression

Reference 27

Resolution
verified exact
local_arxiv, observed 2026-05-16T08:07:34.282618Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:ac08dc66f387721fb605e03156cccd456fcb0f9a5b14fd874761892bec0ae7ac

Observation bd2f80f0-418c-4f84-aebb-2f8e44bb7aff · outbound

This paper cites The implicit bias of gradient descent on nonseparable data.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam The implicit bias of gradient descent on nonseparable data

Reference 28

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.316364Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:1fb83afdb847590df82601c595beb5e3e84564e10b15403f6fd687ad11405ce9

Observation 00c36c5e-6ba2-42ad-9c45-9061e75029c0 · outbound

This paper cites Fantastic Generalization Measures and Where to Find Them.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Fantastic Generalization Measures and Where to Find Them

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.313439Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:446bdb19d529d65e976c932a59f2b15ff02e2f26cde1194aa80b0d5797c78fd7

Observation 2eb6fef4-4445-43b1-8062-b4b18cd287a7 · outbound

This paper cites On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima

Reference 30

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.310675Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:0211bbdc172d1d9186ef339a95222ab90e953d1a53e9d5406017e368269eb578

Observation a28c1a92-965a-4bce-bfc5-dedd730955e5 · outbound

This paper cites 2025 (cit.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam 2025 (cit

Reference 31

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.308224Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:a1d9090ae713215d2550779c0e36a1344f01941471ded9a609788205fb5539c6

Observation a42f1662-81d6-45b4-b176-8bdf817b45b1 · outbound

This paper cites Fisher SAM: Information Geometry and Sharpness Aware Minimisation.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Fisher SAM: Information Geometry and Sharpness Aware Minimisation

Reference 32

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.305756Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:5716c622d10d11465a985d54bfed78a80e24c6c62258d91bb95a65a82df3ccb7

Observation 1b43ae9a-abae-484a-88b8-cf3ead11ee8b · outbound

This paper cites Adam: A Method for Stochastic Optimization.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Adam: A Method for Stochastic Optimization

Reference 33

Resolution
verified exact
local_arxiv, observed 2026-05-16T08:07:34.279231Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:599d6fdee2de1ee7294c5b9f6eb336aca9da82d4a3cc9d8787a5f66bd7af6b9a

Observation 715b89a2-cfc2-47d9-bd59-bafa2c18017f · outbound

This paper cites Weight decay induces low-rank attention layers.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Weight decay induces low-rank attention layers

Reference 34

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.303297Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:c944299ab581011c19610bc725fe635d3766dfa3c83c0c98e58e3eb1b0c313cf

Observation db789b33-006f-4bad-8421-6c6a9c66e5f5 · outbound

This paper cites Continuous time analysis of momentum methods.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Continuous time analysis of momentum methods

Reference 35

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.300614Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:0e8e5b4ce7fc1b15675c027b9aba84f086fcb22c24e79444b4f9459de8921235

Observation a3ada450-cb68-4cb3-bece-a6118061d85c · outbound

This paper cites Noise Is Not the Main Factor Behind the Gap Between Sgd and Adam on Transformers, But Sign Descent Might Be.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Noise Is Not the Main Factor Behind the Gap Between Sgd and Adam on Transformers, But Sign Descent Might Be

Reference 36

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.298083Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:d08bdc819e437069b28b22c084131be8f7ff1e5b9473bbe89ff96a3a6833f27c

Observation ea22ca68-e6b1-4053-8d05-5eea4d9d923e · outbound

This paper cites ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks

Reference 37

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.295370Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:e85fa8da2368ce2c7472372c4ef35221ef8f09825f263227c722201d352d257a

Observation 6c1ff5ba-136e-4b29-b2c8-f7cc7fe528f9 · outbound

This paper cites Enhancing Sharpness-Aware Optimization Through Variance Suppression.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Enhancing Sharpness-Aware Optimization Through Variance Suppression

Reference 38

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.292943Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:70bbccce07f2941277790ccea986b1d2c3882f0a58cec6bfc3a6064578c54352

Observation d0daa434-08cd-4b2a-ad5d-0ee45d7ef51e · outbound

This paper cites Friendly Sharpness-Aware Minimization.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Friendly Sharpness-Aware Minimization

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.290406Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:069e4f83939a716da3831f573fdf73f4aee576256f30457f32e45300a2bdfce0

Observation 59454159-8529-46cb-8817-77d8b02386d5 · outbound

This paper cites Towards Efficient and Scalable Sharpness-Aware Minimization.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Towards Efficient and Scalable Sharpness-Aware Minimization

Reference 40

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.287829Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:8995e65b90578f35d8ade7f702e088590f0f1f94973cbe3f5d82951dedb5b96c

Observation 00ab6625-81c2-4505-9f08-0d67b92687b0 · outbound

This paper cites 2019 (cit.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam 2019 (cit

Reference 41

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.285414Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:abe5ce1f41ed4f79b499ef5ab0e52501ed2ba5ffc8f2b7af2da89fca89f076cf

Observation 30f640a0-f9c6-4080-a86b-63a2450af2e9 · outbound

This paper cites Gradient Descent Maximizes the Margin of Homogeneous Neural Networks.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Gradient Descent Maximizes the Margin of Homogeneous Neural Networks

Reference 42

Resolution
metadata mismatch
arxiv_id, observed 2026-05-16T08:07:34.269457Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:767fa14f384838c1b6cd8b6a53eae5a0cc46208cc9a4578866f5f46a1f388123

Observation 7fcf2416-1207-4707-b696-328b9d7fd62f · outbound

This paper cites A Qualitative Study of the Dynamic Behavior for Adaptive Gradient Algorithms.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam A Qualitative Study of the Dynamic Behavior for Adaptive Gradient Algorithms

Reference 43

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.282595Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:f9664c19a51345c04fa8f1c081f245a4022059e5991298805a954d657d32cd99

Observation 1d6211d6-3d05-4cbf-854a-65262e4f1ae0 · outbound

This paper cites On the SDEs and Scaling Rules for Adaptive Gradient Algorithms.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam On the SDEs and Scaling Rules for Adaptive Gradient Algorithms

Reference 44

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.280027Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:276ca08b96d146cf0d99197ed2a0c9648ea0596f6e118b8a557d126fb12d1ff5

Observation 16181f8a-d0b3-40fd-a89b-2b2e1658e3f2 · outbound

This paper cites Small Batch Size Training for Language Models: When Vanilla SGD Works, and Why Gradient Accumulation is Wasteful.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Small Batch Size Training for Language Models: When Vanilla SGD Works, and Why Gradient Accumulation is Wasteful

Reference 45

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.277495Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:9468bd68f2f5a2cfe6df986fa7cb832b69af48e57c7d552ac146f742ed4418ff

Observation 4c15face-ecea-433f-92c8-ed331fc393eb · outbound

This paper cites 2018 (cit.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam 2018 (cit

Reference 46

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.275114Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:7935e7ac3e1b3fb71a235be80f14d2c9711af3cb9e093174960fc6bbfcfafcc7

Observation b6538872-dfe5-455a-a3f1-b838d7ceb38e · outbound

This paper cites Pointer Sentinel Mixture Models.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Pointer Sentinel Mixture Models

Reference 47

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.272662Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:11884e1a743bf8432642345adb3bf437e6fd717f95e8a53c250ced142e02d8c7

Observation 3344bb9c-119b-4a88-ab21-d25ceda4bede · outbound

This paper cites Toward Equation of Motion for Deep Neural Networks: Continuous-time Gradient Descent and Discretization Error Analysis.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Toward Equation of Motion for Deep Neural Networks: Continuous-time Gradient Descent and Discretization Error Analysis

Reference 48

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.269969Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:8fcb6d63abc0dc85f58cebf5a959f13b1e8467015f04813c7e1d284717604dfa

Observation ff12b064-a3fd-4e14-8a2e-3c291ebc7791 · outbound

This paper cites Stochastic gradient descent on separable data: Exact convergence with a fixed learning rate.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Stochastic gradient descent on separable data: Exact convergence with a fixed learning rate

Reference 49

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.267229Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:9557da0ccb9d02c7c4aa02447916fadc5714e8faa61bb3a639ef5597632b13e3

Observation 08daf478-d343-4b1e-963b-c4846e5f10c4 · outbound

This paper cites Convergence of gradient descent on separable data.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Convergence of gradient descent on separable data

Reference 50

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.264615Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:f6e21a6ebb661ef3da5a32390855c99d5562dc265f8a2ed840f7ab3ee0677537

Observation 31e4c776-914b-43ea-92ba-de5ef52fe999 · outbound

This paper cites Lexicographic and depth-sensitive margins in homogeneous and non- homogeneous deep models.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Lexicographic and depth-sensitive margins in homogeneous and non- homogeneous deep models

Reference 51

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.262083Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:9e41f9fe889f75066ba41a5b9f19462c7b6f6a423acd856eb97a84cc3a731181

Observation 1265a202-8da1-4b5a-b3d1-d617d7563e28 · outbound

This paper cites In Search of Adam’s Secret Sauce.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam In Search of Adam’s Secret Sauce

Reference 52

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.259557Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:57f78d07eb5ccec435881f138e9cfeba8ff392e7b184bb17335734eedf08de3b

Observation dc2f707d-decd-4e56-b804-40ad7df12a50 · outbound

This paper cites The AdEMAMix Optimizer: Better, Faster, Older.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam The AdEMAMix Optimizer: Better, Faster, Older

Reference 53

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.257116Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:ca1f4480710c561f196a6e9eb990c52f9f43f3544adfa6cc2150bd61a2fb46dc

Observation 95d83c9e-79c5-4eb4-a17f-051e62e10bc5 · outbound

This paper cites Resolving Discrepancies in Compute-Optimal Scaling of Language Models.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Resolving Discrepancies in Compute-Optimal Scaling of Language Models

Reference 54

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.254473Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:2652cbfcf9ad56aa5042d0c2914026345a452ccb8be49d8d2f1005229d18b22f

Observation d23a6e93-12ce-4db5-9835-606e5c8c98a6 · outbound

This paper cites The implicit bias of adagrad on separable data.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam The implicit bias of adagrad on separable data

Reference 55

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.251686Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:7f4fac7c78e11ef268dd758de9d9f37b7505022cd8e4b67b92fc796efb6b85cb

Observation d6866641-1196-4d4c-b211-007ffd229156 · outbound

This paper cites A Scale Invariant Measure of Flatness for Deep Network Minima.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam A Scale Invariant Measure of Flatness for Deep Network Minima

Reference 56

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.249163Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:165c5e62a793e39ba106b2d62c789deedae5affe35c969440fce66b577ce643b

Observation 370762c3-036e-422d-88a2-e2d6b9713482 · outbound

This paper cites On a continuous time model of gradient descent dynamics and instability in deep learning.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam On a continuous time model of gradient descent dynamics and instability in deep learning

Reference 57

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.243902Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:df8aeda24c614d5b5c54d882ffa19a25559b86a0b0518fc76d5b20bac432a60a

Observation 2283e755-d5c8-4a02-afb9-0f45653a8253 · outbound

This paper cites Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers

Reference 58

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.241409Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:e2395eb30a65cbaa2a22ceab71636c69065346fd4e32212a0cfdc98ffd0cbcb7

Observation 866a2720-3a32-4793-8622-43f1f6cabe4e · outbound

This paper cites Adafactor: Adaptive learning rates with sublinear memory cost.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Adafactor: Adaptive learning rates with sublinear memory cost

Reference 59

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.233969Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:f3f2c8341caf5a87b456bdd8e2c34f99b5f911bac7753ce9bf532ea9ad4d3978

Observation 28cc48b0-ced5-4761-826e-93bb6deadebe · outbound

This paper cites Optimizer benchmarking needs to account for hyperparameter tuning.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Optimizer benchmarking needs to account for hyperparameter tuning

Reference 60

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.231583Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:4c49c8d54786011971d9f6a1cdfa2a3d13bedc6f09944f2e0c2b500e6b210d89

Observation 4323f4e0-8d94-4844-b184-6c64986940e6 · outbound

This paper cites On the Origin of Implicit Regularization in Stochastic Gradient Descent.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam On the Origin of Implicit Regularization in Stochastic Gradient Descent

Reference 61

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.229043Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:670f1e50c0bbd3faa32572a09791bd8e33107caf0eda993e4b150a55c3cb392c

Observation 0d32c139-575e-4ece-aa04-f899352a79aa · outbound

This paper cites The implicit bias of gradient descent on separable data.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam The implicit bias of gradient descent on separable data

Reference 62

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.226510Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:6269fefa8e8fa827e6b975b554e88b11efb8d0a272fc882a4aafba861fcf7909

Observation f41618bd-64db-4be9-bd58-4943ba72f790 · outbound

This paper cites A Universal Class of Sharpness-Aware Minimization Algorithms.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam A Universal Class of Sharpness-Aware Minimization Algorithms

Reference 63

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.221042Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:2b3a4f7644e468a34a2085eeceb9361d1ded94ece98785183ce0db9cd29b3a3b

Observation 1c8a7ef0-52e5-4acb-b28d-2902b7d5324e · outbound

This paper cites Llama 2: Open Foundation and Fine-Tuned Chat Models.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Llama 2: Open Foundation and Fine-Tuned Chat Models

Reference 64

Resolution
verified exact
local_arxiv, observed 2026-05-16T08:07:34.290223Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:869f7c802c76f4cfd4c7b4314f94a55734edcac6f24f3c54f44d55ac002a41e1

Observation c627a75c-f7ed-4660-ad95-7b45dfabd633 · outbound

This paper cites Normalized Flat Minima: Exploring Scale Invariant Definition of Flat Minima for Neural Networks Using PAC-Bayesian Analysis.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Normalized Flat Minima: Exploring Scale Invariant Definition of Flat Minima for Neural Networks Using PAC-Bayesian Analysis

Reference 65

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.217754Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:a816e0896d9a20c11bcd6b4c556ce0437b08adc81259c3f0630f71e134e41656

Observation 9cd1ed24-92b3-4f1c-ad61-aa4b26c55916 · outbound

This paper cites Position: Will we run out of data? Limits of LLM scaling based on human- generated data.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Position: Will we run out of data? Limits of LLM scaling based on human- generated data

Reference 66

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.214783Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:db5feacc8d8ea8b902d73465a726ba848b001b81be8e78b83edc861ea292dc59

Observation 2a8c0539-9519-40f1-a2ac-6fc754652b3b · outbound

This paper cites Does Momentum Change the Implicit Regularization on Separable Data?.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Does Momentum Change the Implicit Regularization on Separable Data?

Reference 67

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.207880Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:93f10604218b62139400cf2b033bd450f67bcab563a0d9786d98b9d0b954517a

Observation b383f808-8fbb-44e3-9b5e-86223d8dbec8 · outbound

This paper cites The Implicit Bias for Adaptive Optimization Algorithms on Homogeneous Neural Networks.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam The Implicit Bias for Adaptive Optimization Algorithms on Homogeneous Neural Networks

Reference 68

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.204493Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:6ac0f8b2dbf47eee6d488731ebf985d23554654997bc3a802f1f994a9a2bc816

Observation f55999e9-c070-4c34-8f2e-32f7bf92e848 · outbound

This paper cites 2025 (cit.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam 2025 (cit

Reference 69

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.201311Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:0238ff268ec35c3ff97d35a735c865815b174b2d8ccba71f39e52ee9bbf74542

Observation d7a884fd-e6d6-4848-b02f-5d4a1f88db54 · outbound

This paper cites 2025 (cit.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam 2025 (cit

Reference 70

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.198347Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:e74feffd9ddff502a971c6214059afcf97fae601fafe7bf67640c04614da1183

Observation 486f2236-7a9c-42a3-93f3-9cc9313cce3e · outbound

This paper cites Implicit Bias of AdamW: ℓ∞-Norm Constrained Optimization.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Implicit Bias of AdamW: ℓ∞-Norm Constrained Optimization

Reference 71

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.191922Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:c66a4eba06140d64a1760624d0f21cf7dbe78ae589ed05970280c22a44c2af74

Observation 5370cd6f-6449-4d01-9cf8-0c99195ba459 · outbound

This paper cites SAMPa: Sharpness-aware Minimization Par- allelized.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam SAMPa: Sharpness-aware Minimization Par- allelized

Reference 72

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.186538Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:7d90a01fae5858017516f700a727c8479fdd897658fadf86b6b6e177fabc1e22

Observation 7c12507c-d82f-43c5-b542-f53187a90551 · outbound

This paper cites Adaptive Inertia: Disentangling the Effects of Adaptive Learning Rate and Momen- tum.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Adaptive Inertia: Disentangling the Effects of Adaptive Learning Rate and Momen- tum

Reference 73

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.183436Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:2fba7b58d533448634439a7c6c4e57d45252f66740d7274c6fffcdfa10493744

Observation 53d57a2b-9fb2-41fb-a9f2-ef7688952b8a · outbound

This paper cites Positively Scale-Invariant Flatness of ReLU Neural Networks.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Positively Scale-Invariant Flatness of ReLU Neural Networks

Reference 74

Resolution
verified exact
local_arxiv, observed 2026-05-16T08:07:34.262668Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:13702899c5119821ad7d5cd9c7da0996caf0bcae61ecc27c703d69a7595e5466

Observation 13fd7bd0-489e-42f6-bf18-0a0a0f143239 · outbound

This paper cites GLM-130B: An Open Bilingual Pre-trained Model.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam GLM-130B: An Open Bilingual Pre-trained Model

Reference 75

Resolution
verified exact
local_arxiv, observed 2026-05-16T08:07:34.272853Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:b49a52ece979ba7578951eec765e1cf65f6ab1b62736073c5870e124d3050462

Observation 835943a9-8a66-423e-8a9c-e5a55b18f916 · outbound

This paper cites Three Mechanisms of Weight Decay Regularization.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Three Mechanisms of Weight Decay Regularization

Reference 76

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.367450Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:0c858dcc6b18fa39492c67f4b4e015ddc69dca554f3f97124674c5fce7e1b7cd

Observation 1d703a4d-aeee-4919-ad8a-1a9a2335f775 · outbound

This paper cites How Does Critical Batch Size Scale in Pre-training?.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam How Does Critical Batch Size Scale in Pre-training?

Reference 77

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.365192Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:de62f71f30052527d7e55f337bca3833a8d9c66869e396c30b148c4173fc9f42

Observation 374e3019-0360-4aec-b731-eb62cdc928fb · outbound

This paper cites Why are adaptive methods good for attention models?.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Why are adaptive methods good for attention models?

Reference 78

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.362818Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:6a69d838ba2e29e5e79d5cfe0488b42ac1cb2031e481ed3e314477715791478e

Observation 92cacf5d-5fa7-4c0b-bcbb-eb44854641df · outbound

This paper cites OPT: Open Pre-trained Transformer Language Models.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam OPT: Open Pre-trained Transformer Language Models

Reference 79

Resolution
verified exact
local_arxiv, observed 2026-05-16T08:07:34.297829Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:7d729e254f9301a58d4640583895773174f2baaf7b499feed58b60c31fe7e253

Observation 02cdc0a7-8700-4eba-874c-b44e850afa6e · outbound

This paper cites Deconstructing What Makes a Good Optimizer for Autoregressive Language Models.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Deconstructing What Makes a Good Optimizer for Autoregressive Language Models

Reference 80

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.355502Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:323ca3fb430e13dc97945034f58b2d008301c8745ac6b44deb3a8e075fe08503

Observation dca82baa-9aa5-46e5-a26d-3b9122a34c47 · outbound

This paper cites Regularizing Neural Networks via Adversarial Model Perturbation.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Regularizing Neural Networks via Adversarial Model Perturbation

Reference 81

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.352864Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:43a2babe73f5d5b178957480bbf26f21749fc1df8d5db4e5222b64e0da231650

Observation f832ec5b-055c-4287-9e70-71d7f26a5238 · outbound

This paper cites Towards Theoretically Understanding Why Sgd Generalizes Better Than Adam in Deep Learning.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Towards Theoretically Understanding Why Sgd Generalizes Better Than Adam in Deep Learning

Reference 82

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.348475Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:a82e382dd92d469809092c5b13b78de1f1dc2613f1a63184c46a63ccc5dd4b09

Observation 79d711d9-4c6d-43da-a334-9b4f314fe7c6 · outbound

This paper cites Towards Understanding Convergence and Generalization of AdamW.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Towards Understanding Convergence and Generalization of AdamW

Reference 83

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.345758Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:f69eae931ee72e509d28a1230186b07ec506f7be5bbb47b051a3d16e08aaf0be

Observation f78646ce-893c-4d09-b6ab-bc1624672ba8 · outbound

This paper cites 2022 (cit.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam 2022 (cit

Reference 84

Resolution
malformed identifier
raw_fallback, observed 2026-05-16T08:07:35.340303Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:9a768df1939fe5c4dd1c4605a29a1023fec608451523819916440f79e716f0b3

Pith citing papers

Observation bf67973f-8e78-4004-a4de-ec8ec8bd0a2c · inbound

Do Deep Networks Forget Initialization? A Forgetting-Time View of Practical Inductive Bias cites this paper.

Do Deep Networks Forget Initialization? A Forgetting-Time View of Practical Inductive Bias The Effect of Mini-Batch Noise on the Implicit Bias of Adam

Reference 110

Resolution
verified exact
local_arxiv, observed 2026-06-29T13:23:28.010453Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-06-29T13:20:54.303605Z digest=sha256:01e313bb67bb15e59001ca0a7f59d0c6f17d25532096734c0fc82bbe75565380

Observation ef575262-d288-4069-b27f-0b5ed773a300 · inbound

Chimera: Designing and Chinchilla-Scaling Hybrid Visual Diffusion Transformers cites this paper.

Chimera: Designing and Chinchilla-Scaling Hybrid Visual Diffusion Transformers The Effect of Mini-Batch Noise on the Implicit Bias of Adam

Reference 9

Resolution
unresolved
no resolver link, observed 2026-07-31T02:16:07.806062Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-31T02:16:07.806062Z digest=sha256:5d193125e21fc8aeb8863fd4bd7b33726a2cb62da2fe6d338f0fdb757b74de84