Pith. sign in

Paper Citation Record · LEDGER

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models

As of 10 August 2026, this Paper Citation Record lists 62 of 62 outbound references and 1 inbound Pith citation observation for arXiv:2505.22549.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.22549 v1

Coverage vector

measured 62 of 62 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T13:13:25.493384Z

measured 63 of 63 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-10T06:31:04.303077+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-06-26T21:25:15.709652Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-04T00:09:15.167070Z

Reference resolution

62 of 62 outbound references displayed

  • verified exact3
  • verified fuzzy30
  • unresolved28
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation d2172a97-5db9-44bd-940e-f6e3a406a789 · outbound

This paper cites SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:20.016971Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:20.016971Z digest=sha256:e301c174150ab1749bf9622ec2025e2960de55cc7c689252493f5e8259d75ed8

Observation 1182027c-1689-4156-9684-b6ec03755afb · outbound

This paper cites Arjevani, Y.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Arjevani, Y

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:37.319228Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:20.076371Z digest=sha256:e4883015c4599f4a4258678341606351d59f350a554a1206620b99d90c7c3d84

Observation 06d66d0d-b985-48ff-b2f1-9020cf6ff699 · outbound

This paper cites Balles and P.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Balles and P

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:37.141686Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:20.189804Z digest=sha256:18433f45e296a519810fa481b7b99d5efef3a43589e15bcb56c6e996a3009e53

Observation c2fceca2-3682-44d7-ac14-742348bfe704 · outbound

This paper cites Ben Allal, A.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Ben Allal, A

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:37.023451Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:20.345120Z digest=sha256:96759903e8eb078a83dee4d9fe76b0bbb72ac94245707538ca6315111cb8ed31

Observation 1eeb5636-1ece-4a77-b008-610f822a643c · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:36.818454Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:20.505095Z digest=sha256:482a91970640920291a81b9439c071f8844caade38da20a3d5f27a217bb52917

Observation f4aabb6e-e55f-47e6-80f0-2ee6a4b6b9ed · outbound

This paper cites Brown, B.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Brown, B

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:36.553211Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:20.584311Z digest=sha256:8c7119c8b7fdb369fc1e8e7ec803c2dd02890a19a75d8095ecc2350f8da62345

Observation 85f54d5b-9c0d-4c0a-915c-3e936ec6cb40 · outbound

This paper cites Communication-Efficient Language Model Training Scales Reliably and Robustly: Scaling Laws for DiLoCo.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Communication-Efficient Language Model Training Scales Reliably and Robustly: Scaling Laws for DiLoCo

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:20.674049Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:20.674049Z digest=sha256:3f70378e71113c2f90a5791379e9f10748819522be3a71c791990c38d9c9b5d1

Observation 7dcaaa74-a7ad-4b7e-8a40-33a8c294e375 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:36.299354Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:20.819250Z digest=sha256:17932be4c35d15be68aaa19de3e192931af165cc7a354205c128c3021a837b30

Observation e397315e-a9c3-4ad6-b551-2f29fe8c7e29 · outbound

This paper cites Cheng and M.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Cheng and M

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:35.995718Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:20.901750Z digest=sha256:0b9cb7d5848c8413aacba9c72df465e2df556dcec0f02bc979fa481901628f63

Observation e3cbe639-80a1-4d91-9dfd-0cc96524c175 · outbound

This paper cites Chowdhery, S.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Chowdhery, S

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:35.728657Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:21.001201Z digest=sha256:2beca7cce7dbec95b76fee6a4d8dc5b678737a624691e7fc9b04bdbf637ba88d

Observation 56c4c9b9-d72e-4cab-95bf-0ca6cfe59eab · outbound

This paper cites Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:21.076522Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:21.076522Z digest=sha256:427fff6226293514b772e81bc7fdbf95bb2379a92e2515e6f448132b663deac1

Observation ec5ff9dd-d323-429c-b9ae-5d73bd6acdd0 · outbound

This paper cites DiLoCo: Distributed Low-Communication Training of Language Models.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models DiLoCo: Distributed Low-Communication Training of Language Models

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:21.194758Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:21.194758Z digest=sha256:d20d7655577452db1dce53b92edd9023a01a5c63dec96319058d196ec39268c2

Observation dc2aca47-b452-4bb7-9d1f-c8ec3322efaa · outbound

This paper cites The Llama 3 Herd of Models.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models The Llama 3 Herd of Models

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:21.241231Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:21.241231Z digest=sha256:91be9ef22838ba18aa38d1e099051b871270d3c88e78f36d7bbdb6a71895f3da

Observation fa042afe-7b73-4a30-ba41-43604c9a1a77 · outbound

This paper cites Hägele, E.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Hägele, E

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:35.471669Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:21.347722Z digest=sha256:9b5e9912c8a59147143291b35b8916de6012b8b802e2b52622f0a623b20c72cf

Observation d3ec821f-913d-4e5c-8e05-df2105ea2c9f · outbound

This paper cites Training Compute-Optimal Large Language Models.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Training Compute-Optimal Large Language Models

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:21.432532Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:21.432532Z digest=sha256:4e2b677a528ec77a1b8db4fb6e13c3e173ef3308cb3f15c4dec1284f467aac04

Observation 02244ee3-5359-4aac-a49f-4620c7a164eb · outbound

This paper cites Iacob, L.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Iacob, L

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:35.289962Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:21.502087Z digest=sha256:b8887a78db12c90a397ee7eaed28f785202f2b2a42ef966582999223f3540279

Observation b70640e3-b4a8-44a8-bcc5-5658b1bedac2 · outbound

This paper cites Kairouz, H.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Kairouz, H

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:35.138200Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:21.584559Z digest=sha256:4aa768d84b7f8ad98b1e709a3ba225a9c1359ae4863b545a61e8a8a6aca851da

Observation acbbcfa6-4117-4adf-9623-1b9f978c102d · outbound

This paper cites Scaling Laws for Neural Language Models.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Scaling Laws for Neural Language Models

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:21.616016Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:21.616016Z digest=sha256:7b57b4070cc21a63727012d4adb4e4e400e1be751466823e7bdaeec4ac5dcd36

Observation 376832bb-4af6-4c5e-8318-9b5c83f6dc18 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:34.958988Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:21.719820Z digest=sha256:43d4c09c1f13ca1eef13cd1163c3594a04381302e7299008970ed493bd422b5c

Observation e6b5315a-c6d4-4ce1-a797-9a502e0854e0 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 20

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:34.694578Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:21.798715Z digest=sha256:8cbadbab83cbb5cfb99eb4c2c98ebba742f66dc18a1c997b1be599f6f6a6a2c9

Observation 02b638ad-33a7-4afb-9204-5936a9e00396 · outbound

This paper cites Kunstner, J.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Kunstner, J

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:34.397500Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:21.885888Z digest=sha256:7fb82f24bf2ddac69de53223c5819b03d1e93dcbd410f65d4147b4275c794508

Observation 9ac251c1-d723-4cb9-8bbe-b6c7b1434dd3 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 22

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:34.195239Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:21.972625Z digest=sha256:2a0938040310c622b065c21cdb24536b60758e3096aae5d1553a37f22d9185f8

Observation 553ec41f-12ed-4230-8365-2b04178fd61e · outbound

This paper cites On Distributed Adaptive Optimization with Gradient Compression.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models On Distributed Adaptive Optimization with Gradient Compression

Reference 23

Resolution
verified exact
local_arxiv, observed 2026-08-07T13:13:26.318258Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:22.047003Z digest=sha256:015162d5ff3d7f4e01891fd8815628e4a752c9a33644ddf904724d53ade41f2e

Observation 9070db0e-b562-4e6e-95cd-a603cefe4134 · outbound

This paper cites Asynchronous Local-SGD Training for Language Modeling.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Asynchronous Local-SGD Training for Language Modeling

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:22.137707Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:22.137707Z digest=sha256:1fbf235797462bb6b6ca45c76b92e60ff8b742ebec17a7b892aae2be549947a6

Observation 5b730c6a-0274-4a67-89cc-ec0346934cfd · outbound

This paper cites An Improved Analysis of Stochastic Gradient Descent with Momentum.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models An Improved Analysis of Stochastic Gradient Descent with Momentum

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:22.271416Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:22.271416Z digest=sha256:392397239738e46c3fd26d46e79f29d25b75ad1a54000990e8e497090bb0f125

Observation 1ba3bc43-cbaf-4110-8490-f59d8522d991 · outbound

This paper cites McMahan, E.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models McMahan, E

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:33.934171Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:22.356385Z digest=sha256:1296db2b2d2b4d2e44f3ca8f46082c0436f9a9112333cc1524788c80c847f9c9

Observation 0fdc09ab-3052-41d3-b99f-ce62e1a5d987 · outbound

This paper cites Pagliardini, P.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Pagliardini, P

Reference 27

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:33.696273Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:22.421704Z digest=sha256:d60719fdb1b1ea8277c2d6e6d144344fce82a547968d0a8fa9cca1c4b5ec3c2b

Observation 56b6d560-0ace-49c7-a97d-8e2ebdf0eb02 · outbound

This paper cites Pascanu, T.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Pascanu, T

Reference 28

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:33.513449Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:22.510089Z digest=sha256:632ba94560c4ca5c3bafe442aad4753431f666e21588ca1ee1b8787ae1776b0d

Observation c38cac2e-3901-4c06-9d7c-510c33131ad8 · outbound

This paper cites Penedo, H.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Penedo, H

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:33.317576Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:22.599548Z digest=sha256:6dcb8e99f996b5946fb37d214aa98e7801a5e7ca5a00387feb372bf7d494f238

Observation 31724ded-a253-4b0a-82e1-f6fc126e04cd · outbound

This paper cites Rajbhandari, J.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Rajbhandari, J

Reference 30

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:33.137571Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:22.735762Z digest=sha256:38ca67ca4bb1203f51caca9c3c9c53aa94f86206bdc0fe2420f58ea149404532

Observation de86753f-45cd-41d4-a142-a31a4eb5fa0f · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 31

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:31.849223Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:22.838407Z digest=sha256:4740fde69dbd53ab752d969fff7163a5f6d2f7898a2a6bf6f31e6fa4493a95c2

Observation dd1bc151-ab41-426d-81d6-81c6d1a113fa · outbound

This paper cites Romero, J.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Romero, J

Reference 32

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:31.172018Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:22.915688Z digest=sha256:6d7125e1cbe9627f0496f177db1f040131713af25367efaa6a0c7ee0860d034d

Observation 9670be89-79d8-4266-9918-a33f2a890c84 · outbound

This paper cites The Future of Large Language Model Pre-training is Federated.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models The Future of Large Language Model Pre-training is Federated

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:23.000067Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:23.000067Z digest=sha256:00e4a54d12a9fc68dc9da5d9f793df32c15b567449a2d85401e30e92587a17c0

Observation f35efcc2-b8a9-4ef4-9009-2212069bb9b6 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 34

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:30.926712Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:23.091906Z digest=sha256:dad3cc69fb3b82cedab67a29a21241107a6aa4d348cfe9e23391e23b60118cc4

Observation 7dc45ccc-7726-4c18-be64-1d6f46d010bd · outbound

This paper cites Sardana, J.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Sardana, J

Reference 35

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:30.730065Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:23.138477Z digest=sha256:01ebb870d5c480b87913080c061b0e20d0d1b16698d333a26772b6a61eb5879c

Observation 1633bc0d-b3c6-455e-9726-e95d9252e04f · outbound

This paper cites BLOOM: A 176B-Parameter Open-Access Multilingual Language Model.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:23.210344Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:23.210344Z digest=sha256:3021342dedbe8d28ef81625b1ae9b2354137031994f57b15750a5b14e5a53cfb

Observation 0edd5e36-f54c-4ea8-9d15-ad58925c83a3 · outbound

This paper cites Horovod: fast and easy distributed deep learning in TensorFlow.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Horovod: fast and easy distributed deep learning in TensorFlow

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:23.272737Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:23.272737Z digest=sha256:6ed144a4a3aa52c7a2eea9b60424559483b174b4e9829888d7869c21a6e4adc4

Observation dcc13d16-0859-42b1-878a-2b6d86398f7b · outbound

This paper cites Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:23.388282Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:23.388282Z digest=sha256:c1f7b35badb0b815c95682a7fc8fe354622a6a058c42760e12884f1a0e317938

Observation fc3c1ede-4716-4da3-a7af-1cd3deb103ae · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 39

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:30.297874Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:23.472300Z digest=sha256:6675c46c66bf9b82e2a383db4353e43e1a875c0c002fb6e3c20ebfc37a5d29b3

Observation 1c8d626d-472d-4307-b3eb-49323cc5fe02 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 40

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:30.060945Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:23.544757Z digest=sha256:96fce5fc13651e4a805eaba7b73a1d50eed3a6a4aeb82beb9d93613523f728e4

Observation fae14c7f-d9e3-4107-9ccf-58096e679471 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 41

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:29.939892Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:23.591593Z digest=sha256:2548f9931c84bb3a3c108e7d289926d145c8b43e19efa43829a73c325e4f6739

Observation 3e0828f0-b59b-4972-9592-a2c521a7d14a · outbound

This paper cites Sutskever, J.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Sutskever, J

Reference 42

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:29.727166Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:23.721571Z digest=sha256:60b569ae2ba0b297d14965015c573d31a2caa3db025a3676a12236be5faef7b4

Observation 284a3f56-ed13-49ee-b690-91e29127956b · outbound

This paper cites Taniguchi, K.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Taniguchi, K

Reference 43

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:29.456801Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:23.778017Z digest=sha256:1dba419a25c856273811ebf8b815f66b1b14dffcf46b1e68c2533a6193425672

Observation 1e361132-4e09-46ec-b25e-2197c8203fa1 · outbound

This paper cites Touvron, L.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Touvron, L

Reference 44

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:23.868628Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:23.868628Z digest=sha256:2d8ea8135450b63193cf01fd38c64b3c0139c4f6bccb75e7ede2b32de0e26cf6

Observation 11adccbd-73df-459a-b8f8-7ffb50aaaf5d · outbound

This paper cites A Field Guide to Federated Optimization.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models A Field Guide to Federated Optimization

Reference 45

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:23.936074Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:23.936074Z digest=sha256:bb85119b1fdd3005ae47acee25fee240e1cf418cf071138f9bc97e7316d3ee04

Observation 4b52a0a3-13e7-4cda-8ad3-3c5fbfa43fb7 · outbound

This paper cites Wortsman, T.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Wortsman, T

Reference 46

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:29.272497Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:24.003640Z digest=sha256:e0f12aff5501cedcfcba6fd835d50b0d2ccd540c525fa9a1fcb293b235d73303

Observation 9b8a6365-cff8-4b6e-94ef-da7de7d9d3d3 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 47

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:29.040628Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:24.104412Z digest=sha256:1721a91526182d0d6e6086bb5c0c2bb518179b9a9faa756be0e5b0412ef0d992

Observation cd03e95e-8439-4bc0-a05e-d05eed787a6f · outbound

This paper cites On the Linear Speedup Analysis of Communication Efficient Momentum SGD for Distributed Non-Convex Optimization.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models On the Linear Speedup Analysis of Communication Efficient Momentum SGD for Distributed Non-Convex Optimization

Reference 48

Resolution
verified exact
local_arxiv, observed 2026-08-07T13:13:26.051565Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:24.215335Z digest=sha256:77a8f87fa3c9ef825e68bcc83ca1572e9e40467c4e278080f2b840f5a957ea11

Observation 5b0172b0-644d-41ee-a673-1a941bf38ccd · outbound

This paper cites Revisiting Optimal Convergence Rate for Smooth and Non-convex Stochastic Decentralized Optimization.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Revisiting Optimal Convergence Rate for Smooth and Non-convex Stochastic Decentralized Optimization

Reference 49

Resolution
verified exact
local_arxiv, observed 2026-08-07T13:13:25.744102Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:24.274554Z digest=sha256:1ce01a5b9bebc0b76aaceb18b41d4c2c96ecbb485be90dfd9f44ab1daef56545

Observation 6eef702e-2002-468c-8be1-d59019a01988 · outbound

This paper cites Zellers, A.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Zellers, A

Reference 50

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:28.884976Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:24.383352Z digest=sha256:071a52a320f5be25766b2c098b23019984fb8d33eb01e4c38153c5dd11c84c9c

Observation 9baf1577-4e6d-4ae4-ae60-cbfa1c113c7b · outbound

This paper cites Zhang, D.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Zhang, D

Reference 51

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:28.718210Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:24.463744Z digest=sha256:746b4d6d9c1df2224a0634086f78712107828e0d00e74d705084389cc08457a0

Observation d1fc6803-060c-4bd3-b437-6bf27ee7b888 · outbound

This paper cites Zhang, C.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Zhang, C

Reference 52

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:28.462537Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:24.547386Z digest=sha256:1960a3e3d74905e594fa64acf24eda1fe478d6034c9fd9415047aaf12b844d4d

Observation 3cfae97b-22f2-47a0-887e-05acd4d4b233 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 53

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:28.241838Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:24.644047Z digest=sha256:08b3b993bd3c9d58b3a2594f87024bdbd7bb1fc6a2e93400b5fe0bede90e1d4b

Observation 4130c04a-182c-4b4f-9db3-1f4c5cded0bb · outbound

This paper cites Starting from the recommended baseline learning rate (η0) from Allal et al.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Starting from the recommended baseline learning rate (η0) from Allal et al

Reference 54

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:28.064042Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:24.769520Z digest=sha256:37a1ee71af15abe26da7a1279e9e756a18e216cf5a694d0200f17f5c2c54a0ce

Observation 2f86a6c2-fac7-40d6-8d20-bcb3e60a948c · outbound

This paper cites We then repeat this procedure for Local Adam , using η∗ DDP as the new baseline.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models We then repeat this procedure for Local Adam , using η∗ DDP as the new baseline

Reference 55

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:27.910261Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:24.889199Z digest=sha256:dcc91160f04baaffbfaf4afd4c22f50bc23d6edd96992cfdd5f68ccefcfac15e

Observation a47370d2-6703-46b3-a6ba-9cb97ecfc5dd · outbound

This paper cites 2a by including results on the heterogeneous data dis- tribution described in Section 4.1.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models 2a by including results on the heterogeneous data dis- tribution described in Section 4.1

Reference 56

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:27.665023Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:24.969874Z digest=sha256:123f1937ac810b63a6c9c4815037a09fc75caa9495103342649bb1527c46334f

Observation 84a2cd1c-e0d3-4019-bc13-1279e37a1492 · outbound

This paper cites 4 by showing the separate impact of varying synchro- nization frequencies for parameters and the second momentum when the base frequency is Kb = 16.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models 4 by showing the separate impact of varying synchro- nization frequencies for parameters and the second momentum when the base frequency is Kb = 16

Reference 57

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:27.393938Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:25.034417Z digest=sha256:502c9c63b58e30ba190245f91bbdb8501e1128c9ee2eebccf92f6cb02e40076f

Observation 072682f0-0c24-4435-8b21-291f702ca700 · outbound

This paper cites 4 by evaluatingDES-LOC-Adam.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models 4 by evaluatingDES-LOC-Adam

Reference 58

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:27.177192Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:25.108096Z digest=sha256:708f31ee755d32197c276f30a7118c0c2058b8e66e367480cd08a46dbb0ac1d2

Observation adafeeb5-6161-44ab-9cd6-4ed87e2d9bed · outbound

This paper cites 5 by showing DES-LOC-ADOPT’s perplexity against baseline methods on heterogeneous data (as defined in Section 4.1).

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models 5 by showing DES-LOC-ADOPT’s perplexity against baseline methods on heterogeneous data (as defined in Section 4.1)

Reference 59

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:26.988547Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:25.240333Z digest=sha256:2115d9f364cf11950bfd49dd9e044ab12871c507e8ca7dc6822e61b85c634a90

Observation fdb9cb9d-a4d9-4009-bb60-b631ec4d23a1 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 60

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:26.837297Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:25.314478Z digest=sha256:1ed00e80246e69b57ba789d3367c1d91501a296bfa2b56956f7dc130f68b3296

Observation c596c3a4-92a7-41c7-ab4b-b3e0fe3fafd1 · outbound

This paper cites 5 for DES-LOC-Adam, demon- strating that DES-LOC achieves similar communication reductions and performance when using Adam instead of ADOPT.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models 5 for DES-LOC-Adam, demon- strating that DES-LOC achieves similar communication reductions and performance when using Adam instead of ADOPT

Reference 61

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:26.688336Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:25.393918Z digest=sha256:ddce8c335ad7e753f03f43c1f6bba73944d7bbd8ba050947c827279568ed8543

Observation 60c5d486-d6dd-416d-9b5e-8ebfe01f3065 · outbound

This paper cites standard.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models standard

Reference 62

Resolution
malformed identifier
raw_fallback, observed 2026-08-07T13:13:26.537852Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T13:13:25.493384Z digest=sha256:b4cef5b12430efedd44de6371db6f0e5c098c0f57591db72c6a070c850fe50da

Pith citing papers

Observation 4e410f05-9633-4292-9045-ef6ea71e3455 · inbound

FoMoE: Breaking the Full-Replica Barrier with a Federation of MoEs cites this paper.

FoMoE: Breaking the Full-Replica Barrier with a Federation of MoEs DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models

Reference 110

Resolution
verified exact
arxiv_id, observed 2026-07-04T00:09:15.169175Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=arxiv_source observed=2026-06-26T21:25:15.709652Z digest=sha256:43d79547cede6cfad2b9c391750d211a2f94f1220a0f6a8d838bb0ba6e2980b3