Paper Citation Record · LEDGER

Overcoming the Communication-Performance Tradeoff in LLM Pretraining

As of 20 August 2026, this Paper Citation Record lists 32 of 32 outbound references and 9 inbound Pith citation observations for arXiv:2508.15706.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2508.15706 v3

Coverage vector

measured 32 of 32 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-05T17:50:42.853083Z

measured 41 of 41 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-20T06:33:59.587034+00:00

measured 9 of 9 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T12:45:28.702340Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

32 of 32 outbound references displayed

verified exact2
verified fuzzy7
unresolved20
parse uncertain0
malformed identifier2
metadata mismatch1

External citation measurements

0
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

Observation 6221515e-e182-4be1-823f-8309dee29e8b · outbound

This paper cites 16 Preprint Table 12: Final validation loss for the 178M model while varying the number of workers (R∈ {8,16,32}) and the communication interval (H∈ {15,50,100}).Bestis bold.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining 16 Preprint Table 12: Final validation loss for the 178M model while varying the number of workers (R∈ {8,16,32}) and the communication interval (H∈ {15,50,100}).Bestis bold

Reference 4

Resolution: malformed identifier; raw_fallback, observed 2026-08-05T17:50:43.317668Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 02098e63-497e-48e5-b296-5fcc499f8ff9 · outbound

This paper cites Training Compute-Optimal Large Language Models.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining Training Compute-Optimal Large Language Models

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-05T17:50:42.630685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 63df926d-8e53-4189-88e7-22d9e4ffa8e5 · outbound

This paper cites INTELLECT-1 Technical Report.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining INTELLECT-1 Technical Report

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-05T17:50:42.768010Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bf1d3653-3e5a-48ba-a4f7-dd2cbb1f5aa0 · outbound

This paper cites Noise Is Not the Main Factor Behind the Gap Between SGD and Adam on Transformers, but Sign Descent Might Be.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining Noise Is Not the Main Factor Behind the Gap Between SGD and Adam on Transformers, but Sign Descent Might Be

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-05T17:50:42.783058Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a45babaf-8826-4cf5-87ea-5c08e4a1d170 · outbound

This paper cites an unresolved cited work.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining Unresolved cited work

Reference 12

Resolution: unresolved; raw_fallback, observed 2026-08-05T17:50:43.397038Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 77bef573-8aeb-4a55-b5b4-a2b3846e9218 · outbound

This paper cites Shigang Li and Torsten Hoefler.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining Shigang Li and Torsten Hoefler

Reference 13

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T17:50:43.387707Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 1e9f20c1-531a-4430-ae6f-0a1001da84c6 · outbound

This paper cites Federated optimization in heterogeneous networks.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining Federated optimization in heterogeneous networks

Reference 14

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T17:50:43.378489Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 0c0f2604-2fcd-4c56-98ed-9444dc80d49b · outbound

This paper cites Incentivizing Permissionless Distributed Learning of LLMs.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining Incentivizing Permissionless Distributed Learning of LLMs

Reference 15

Resolution: metadata mismatch; local_arxiv, observed 2026-08-05T17:50:43.162053Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation b85900f8-f8d3-49e3-8353-904a2293331a · outbound

This paper cites Don't Use Large Mini-Batches, Use Local SGD.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining Don't Use Large Mini-Batches, Use Local SGD

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-05T17:50:42.798739Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fd604448-d23b-4e34-a966-a2ad89c2f040 · outbound

This paper cites Trade-offs of Local SGD at Scale: An Empirical Study.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining Trade-offs of Local SGD at Scale: An Empirical Study

Reference 18

Resolution: verified exact; local_arxiv, observed 2026-08-05T17:50:43.123584Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 76434ade-3f92-47d1-995a-cf1f69e543e0 · outbound

This paper cites Adaptive Federated Optimization.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining Adaptive Federated Optimization

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-05T17:50:42.811192Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4a93db86-469d-456f-8eb1-fbe2d0c37ee1 · outbound

This paper cites Fedpaq: A communication-efficient federated learning method with periodic averaging and quan- tization.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining Fedpaq: A communication-efficient federated learning method with periodic averaging and quan- tization

Reference 21

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T17:50:43.369319Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation f54a0ab4-e55b-46fc-a858-74364dacdff9 · outbound

This paper cites Daniel Rothchild, Ashwinee Panda, Enayat Ullah, Nikita Ivkin, Ion Stoica, Vladimir Braverman, Joseph Gonzalez, and Raman Arora.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining Daniel Rothchild, Ashwinee Panda, Enayat Ullah, Nikita Ivkin, Ion Stoica, Vladimir Braverman, Joseph Gonzalez, and Raman Arora

Reference 22

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T17:50:43.358390Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation e9ceadcd-49c7-4772-b107-db8fe1eada13 · outbound

This paper cites Frank Seide, Hao Fu, Jasha Droppo, Gang Li, and Dong Yu.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining Frank Seide, Hao Fu, Jasha Droppo, Gang Li, and Dong Yu

Reference 23

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T17:50:43.348698Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation cfda8956-9216-4fbf-abad-c3a3e96ce514 · outbound

This paper cites Local SGD Converges Fast and Communicates Little.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining Local SGD Converges Fast and Communicates Little

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-05T17:50:42.825545Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c7b2f858-94bd-43c9-aaa2-4f663a26e2d7 · outbound

This paper cites The Error-Feedback Framework: Better Rates for SGD with Delayed Gradients and Compressed Communication.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining The Error-Feedback Framework: Better Rates for SGD with Delayed Gradients and Compressed Communication

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-05T17:50:42.832022Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cfa86fd4-b77c-4429-a9d6-4c88b674ac0b · outbound

This paper cites MuLoCo: Muon is a practical inner optimizer for DiLoCo.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining MuLoCo: Muon is a practical inner optimizer for DiLoCo

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-05T17:50:42.834629Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bc7ce4e6-e092-4508-84f9-ee6e9fb245d7 · outbound

This paper cites Powersgd: Practical low-rank gra- dient compression for distributed optimization.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining Powersgd: Practical low-rank gra- dient compression for distributed optimization

Reference 29

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T17:50:43.338673Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 319545ff-8ff6-45a6-bd7d-c89389b22308 · outbound

This paper cites SlowMo: Improving Communication-Efficient Distributed SGD with Slow Momentum.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining SlowMo: Improving Communication-Efficient Distributed SGD with Slow Momentum

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-05T17:50:42.840735Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cb840401-95b0-47c9-8ce9-921e70a0c235 · outbound

This paper cites 12 Preprint Prateek Yadav, Derek Tam, Leshem Choshen, Colin Raffel, and Mohit Bansal.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining 12 Preprint Prateek Yadav, Derek Tam, Leshem Choshen, Colin Raffel, and Mohit Bansal

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-05T17:50:42.843800Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0b5e8ceb-46a3-4688-9858-41b8c4b4d0c1 · outbound

This paper cites TIES-Merging: Resolving Interference When Merging Models.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining TIES-Merging: Resolving Interference When Merging Models

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-05T17:50:42.846515Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 22f7550f-3658-46d9-98b9-5618ee0a8859 · outbound

This paper cites an unresolved cited work.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining Unresolved cited work

Reference 33

Resolution: unresolved; raw_fallback, observed 2026-08-05T17:50:43.327078Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation b4982b35-9e66-4f74-905e-e11c073a41fe · outbound

This paper cites Understanding Top-k Sparsification in Distributed Deep Learning.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining Understanding Top-k Sparsification in Distributed Deep Learning

Reference 2014

Resolution: malformed identifier; no resolver link, observed 2026-08-05T17:50:42.822540Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9882bc39-c807-4627-80db-8146ef538214 · outbound

This paper cites Ilyas Fatkhullin, Alexander Tyurin, and Peter Richt´arik.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining Ilyas Fatkhullin, Alexander Tyurin, and Peter Richt´arik

Reference 2016

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T17:50:43.405846Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 705b1671-64c1-4608-8a81-a1538f6a8306 · outbound

This paper cites Optimizing the Communication-Accuracy Trade-off in Federated Learning with Rate-Distortion Theory.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining Optimizing the Communication-Accuracy Trade-off in Federated Learning with Rate-Distortion Theory

Reference 2017

Resolution: verified exact; local_arxiv, observed 2026-08-05T17:50:43.138006Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 86d2e3ab-221c-43e8-9605-21c57eb89b87 · outbound

This paper cites Error Feedback Fixes SignSGD and other Gradient Compression Schemes.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining Error Feedback Fixes SignSGD and other Gradient Compression Schemes

Reference 2019

Resolution: unresolved; no resolver link, observed 2026-08-05T17:50:42.775569Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ee5d3247-a933-498e-a5b7-1107f4133822 · outbound

This paper cites Federated Optimization: Distributed Machine Learning for On-Device Intelligence.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining Federated Optimization: Distributed Machine Learning for On-Device Intelligence

Reference 2020

Resolution: unresolved; no resolver link, observed 2026-08-05T17:50:42.779456Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a3705fd5-2814-4ef8-82cf-5495a7ca8831 · outbound

This paper cites Decoupled momentum optimization.arXiv preprint arXiv:2411.19870,.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining Decoupled momentum optimization.arXiv preprint arXiv:2411.19870,

Reference 2021

Resolution: unresolved; no resolver link, observed 2026-08-05T17:50:42.808173Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e163af05-5ad3-4b11-9034-c2322da03950 · outbound

This paper cites INTELLECT-1 Technical Report.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining INTELLECT-1 Technical Report

Reference 2022

Resolution: unresolved; no resolver link, observed 2026-08-05T17:50:42.668228Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2f595d93-b45a-42a4-8cd5-f81b06ca3339 · outbound

This paper cites WASH: Train your Ensemble with Communication-Efficient Weight Shuffling, then Average.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining WASH: Train your Ensemble with Communication-Efficient Weight Shuffling, then Average

Reference 2023

Resolution: unresolved; no resolver link, observed 2026-08-05T17:50:42.528727Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 56cd2afe-9f0a-41fd-a231-e5696fb4f400 · outbound

This paper cites DiLoCo: Distributed Low-Communication Training of Language Models.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining DiLoCo: Distributed Low-Communication Training of Language Models

Reference 2024

Resolution: unresolved; no resolver link, observed 2026-08-05T17:50:42.327928Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 89ce55a4-0b28-47c8-a9b6-6077f25d8c10 · outbound

This paper cites Debraj Basu, Deepesh Data, Can Karakus, and Suhas Diggavi.

Overcoming the Communication-Performance Tradeoff in LLM Pretraining Debraj Basu, Deepesh Data, Can Karakus, and Suhas Diggavi

Reference 2025

Resolution: unresolved; no resolver link, observed 2026-08-05T17:50:42.224878Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation c154d6ed-ccdb-41eb-b8d5-14eba14dc59e · inbound

MuLoCo: Muon is a practical inner optimizer for DiLoCo cites this paper.

MuLoCo: Muon is a practical inner optimizer for DiLoCo Overcoming the Communication-Performance Tradeoff in LLM Pretraining

Reference 43

Resolution: unresolved; no resolver link, observed 2026-08-07T12:45:28.702340Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 126fe051-41cf-4dbe-ad5b-43d896bd82b0 · inbound

Understanding and Exploiting Weight Update Sparsity for Communication-Efficient Distributed RL cites this paper.

Understanding and Exploiting Weight Update Sparsity for Communication-Efficient Distributed RL Overcoming the Communication-Performance Tradeoff in LLM Pretraining

Reference 19

Resolution: verified exact; arxiv_id, observed 2026-07-24T02:22:54.639277Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation a68ffe5a-ef00-452d-a16c-cbcc61f46106 · inbound

LoRDO: Distributed Low-Rank Optimization with Infrequent Communication cites this paper.

LoRDO: Distributed Low-Rank Optimization with Infrequent Communication Overcoming the Communication-Performance Tradeoff in LLM Pretraining

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-03T04:44:55.982385Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c0dcd1dc-464b-4c46-84c0-ed2d084ad204 · inbound

ResBM: Residual Bottleneck Models for Low-Bandwidth Pipeline Parallelism cites this paper.

ResBM: Residual Bottleneck Models for Low-Bandwidth Pipeline Parallelism Overcoming the Communication-Performance Tradeoff in LLM Pretraining

Reference 8

Resolution: verified exact; arxiv_id, observed 2026-07-24T02:22:54.639277Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 3646a5f2-e9f7-45ea-9aa6-f819aa2acaf6 · inbound

ROSE: Rollout On Serving GPUs via Cooperative Elasticity for Agentic RL cites this paper.

ROSE: Rollout On Serving GPUs via Cooperative Elasticity for Agentic RL Overcoming the Communication-Performance Tradeoff in LLM Pretraining

Reference 55

Resolution: verified exact; arxiv_id, observed 2026-07-24T02:22:54.639277Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 9fb95a3d-52ce-4a82-ad20-b73f8a39e7da · inbound

ROSE: Rollout On Serving GPUs via Cooperative Elasticity for Agentic RL cites this paper.

ROSE: Rollout On Serving GPUs via Cooperative Elasticity for Agentic RL Overcoming the Communication-Performance Tradeoff in LLM Pretraining

Reference 54

Resolution: verified exact; arxiv_id, observed 2026-07-24T02:22:54.639277Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 6cc8a123-c7b5-4134-83e1-63c5c4fb1c83 · inbound

Learned Subspace Compression for Communication-Efficient Pipeline Parallelism cites this paper.

Learned Subspace Compression for Communication-Efficient Pipeline Parallelism Overcoming the Communication-Performance Tradeoff in LLM Pretraining

Reference 46

Resolution: verified exact; arxiv_id, observed 2026-07-24T02:22:54.639277Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation bc42eb0a-9ce7-46ac-9282-99f3de76e69b · inbound

Unifying Local Communications and Local Updates for LLM Pretraining cites this paper.

Unifying Local Communications and Local Updates for LLM Pretraining Overcoming the Communication-Performance Tradeoff in LLM Pretraining

Reference 29

Resolution: verified exact; arxiv_id, observed 2026-07-24T02:22:54.639277Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation abe9d0ca-ee98-467a-870c-9ed1dcc00a57 · inbound

FoMoE: Breaking the Full-Replica Barrier with a Federation of MoEs cites this paper.

FoMoE: Breaking the Full-Replica Barrier with a Federation of MoEs Overcoming the Communication-Performance Tradeoff in LLM Pretraining

Reference 143

Resolution: verified exact; arxiv_id, observed 2026-07-24T02:22:54.639277Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.